Fractal knowledge display method and system driven by somatosensory interaction technology

Abstract

The present invention provides a fractal knowledge display method and system driven by somatosensory interaction technology, which relates to the technical field of fractal knowledge display, including: when a first user interacts through a touch screen, obtaining a first season selection result and a first mode selection result; controlling a projector to present a first season scene, determining whether it is a two-person mode, and if so, generating a two-person mode interaction instruction; performing a user scan, obtaining a first real-time body image and a second real-time body image; performing posture synthesis according to the two-person mode fractal rules, generating a first dynamic human tree pattern; projecting to a preset projection area through a projector, and performing interactive display in combination with the first season scene. The present invention solves the technical problem that the popularization methods of fractal knowledge in the prior art are mostly simple image changes or text overlay displays, lacking intuitive and vivid display methods for complex structures, resulting in poor understanding and memory of fractal knowledge by users.

Description

Technical Field

[0001] The present invention relates to the field of somatosensory interaction technology, and in particular to a fractal knowledge display method and system driven by somatosensory interaction technology. Background Art

[0002] The application of somatosensory interactive technology in the fields of education and exhibition has made some progress. At present, somatosensory interactive technology is mostly used in entertainment, education, exhibition and other scenes, especially in museums and exhibition halls, which allow users to interact without contact through somatosensory devices, adding experience and fun. Such systems usually include somatosensory devices, displays or projection devices, which can capture the user's movements and postures to achieve interactive effects.

[0003] In terms of knowledge display, especially complex knowledge structures (such as fractal knowledge), the existing somatosensory interactive display methods are mostly simple image changes or text superposition displays, lacking intuitive and vivid display methods for complex structures. Therefore, the existing technology still faces the problems of limited user interaction and immersion in the knowledge display system, lack of dynamic display and real-time feedback of knowledge points, and insufficient personalized interactive experience. Summary of the invention

[0004] The present application provides a fractal knowledge display method and system driven by somatosensory interaction technology, aiming to solve the problems that the somatosensory interaction display methods in the prior art are mostly simple image changes or text overlay displays, lacking intuitive and vivid display methods for complex structures, and the current somatosensory interaction system has relatively fixed dynamic changes in knowledge display, and is unable to dynamically generate knowledge structure patterns according to the user's real-time posture changes and effectively display the generation process or structural hierarchy of abstract knowledge structures (such as fractal structures), resulting in limited user interaction and immersion, lack of dynamic display and real-time feedback of knowledge points, and insufficient personalized interactive experience.

[0005] The first aspect disclosed in the present application provides a fractal knowledge display method driven by somatosensory interaction technology, the method is applied to a fractal knowledge display system driven by somatosensory interaction technology, the system is connected to a projector, a somatosensory camera, a touch screen and an audio communication, the method includes: initializing the projector and the touch screen, and when a first user interacts through the touch screen, obtaining a first season selection result and a first mode selection result; controlling the projector to present the first season scene according to the first season selection result, judging whether the first mode selection result is a two-person mode, and if so, generating a two-person mode interaction instruction; according to the two-person mode interaction instruction, controlling the somatosensory camera to perform user scanning on a preset interaction area, obtaining a first real-time body image of the first user and a second real-time body image of the second user; performing posture synthesis according to the first real-time body image and the second real-time body image according to the two-person mode fractal rule to generate a first dynamic human tree pattern; projecting the first dynamic human tree pattern to a preset projection area through the projector, and performing interactive display in combination with the first season scene.

[0006] The second aspect disclosed in the present application provides a fractal knowledge display system driven by somatosensory interaction technology, the system is connected to a projector, a somatosensory camera, a touch screen and an audio system, the system is used for the fractal knowledge display method driven by the somatosensory interaction technology, the system comprises: a selection result acquisition module, the selection result acquisition module is used to initialize the projector and the touch screen, when the first user interacts through the touch screen, the first season selection result and the first mode selection result are obtained; a season scene presentation module, the season scene presentation module is used to control the projector to present the first season scene according to the first season selection result, and judge whether the first mode selection result is a two-person selection result. mode, if so, generating a two-person mode interaction instruction; a user scanning module, the user scanning module is used to control the somatosensory camera to perform user scanning on the preset interaction area according to the two-person mode interaction instruction, and obtain the first real-time body image of the first user and the second real-time body image of the second user; a posture synthesis module, the posture synthesis module is used to perform posture synthesis according to the first real-time body image and the second real-time body image according to the two-person mode fractal rule, and generate a first dynamic human tree pattern; an interactive display module, the interactive display module is used to project the first dynamic human tree pattern to the preset projection area through the projector, and perform interactive display in combination with the first season scene.

[0007] One or more technical solutions provided in this application have at least the following technical effects or advantages: This method aims to combine the user's real-time body posture with the fractal knowledge display through an improved somatosensory interactive display method to generate dynamic fractal structure patterns, and generate different levels of bifurcations and patterns according to the user's position and posture to enhance interactivity and immersion. This method can achieve the following technical effects: 1. This method presents scenes according to the season selected by the user, so that the user's posture changes are reflected in real time on the projected pattern, which increases the realism of the interaction and allows the user to directly participate in the generation process of the fractal pattern through body movements. This immersive experience enhances the visual appeal and interactivity of the display; 2. This method selects a suitable single-player mode or double-player mode according to the number of users. In the double-player mode, the image data of the two users are used to generate the trunk and bifurcation of the fractal pattern respectively. The complex fractal pattern is formed by combining the postures of the two users. Through the double-player interactive mode, the posture data of the users is obtained in real time and displayed in a fractal structure, so that the users can personally participate in the dynamic generation process of knowledge during the interactive process, which increases the fun of the interaction and the depth of knowledge display. 3. This method uses a somatosensory camera to capture the user's posture in real time and converts it into the components of a fractal pattern. Whether in single-player or double-player mode, the user's posture will be processed into the trunk and bifurcation of a tree structure. The application of fractal rules makes the pattern present a visual effect with hierarchy and symmetry, which increases the artistry of the fractal pattern. In double-player mode, this method can generate different fractal structures according to the posture information of the user in the main area and the user in the secondary area, and set the trunk and bifurcation positions through double-player interaction, and generate multi-level dynamic human tree patterns layer by layer, so as to achieve a personalized interactive display effect and make the user's image naturally integrated into the display content; 4. The dynamic generation of fractal structure in this method reflects the recursive and self-similar characteristics of fractal knowledge. The system dynamically updates the fractal pattern according to the real-time posture changes of the user, so that the display content can respond to the user's body changes in real time. This dynamic effect not only enhances the attractiveness of the display, but also allows users to intuitively feel the hierarchy and recursion of fractal knowledge.

[0008] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 A schematic flow chart of a fractal knowledge display method driven by somatosensory interaction technology provided in an embodiment of the present application.

[0010] Figure 2A schematic diagram of the structure of a fractal knowledge display system driven by somatosensory interaction technology provided in an embodiment of the present application.

[0011] Explanation of the accompanying drawings: selection result acquisition module 10, season scene presentation module 20, user scanning module 30, posture synthesis module 40, interactive display module 50. DETAILED DESCRIPTION

[0012] The embodiments of the present application provide a fractal knowledge display method driven by somatosensory interaction technology, which solves the technical problem that the existing technology popularizes fractal knowledge in the form of multimedia videos or graphic introductions, and the display method is rigid and outdated, lacks interactive experience, and leads to poor understanding and memory of fractal knowledge by users.

[0013] After introducing the basic principles of the present application, various non-limiting implementation methods of the present application will be specifically introduced below in conjunction with the accompanying drawings of the specification. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0014] like Figure 1 As shown, the embodiment of the present application provides a fractal knowledge display method driven by somatosensory interaction technology, the method is applied to a fractal knowledge display system driven by somatosensory interaction technology, the system is connected to a projector, a somatosensory camera, a touch screen and an audio system, and the method includes: The projector and the touch screen are initialized, and when a first user interacts through the touch screen, a first season selection result and a first mode selection result are obtained.

[0015] First, initialize the touch screen to ensure that its power is on, touch sensitivity adjustment is completed, and the screen display is normal, and prompt the user to make a selection. At the same time, the projector starts, and the projection image is clearly visible by checking parameters such as projection light source, focus, and projection area. After initialization is completed, the projector enters standby mode and waits for further instructions from the user.

[0016] After the user interacts, a selection interface is displayed on the touch screen, including season and mode options, wherein the season options include spring, summer, autumn, and winter; the mode options include single-player mode and double-player mode. After the first user clicks the corresponding season and mode options on the touch screen, the system obtains the first user's season selection and mode selection, and stores them as the first season selection result and the first mode selection result.

[0017] The projector is controlled to present the first season scene according to the first season selection result, and it is determined whether the first mode selection result is a two-player mode. If so, a two-player mode interaction instruction is generated.

[0018] According to the season selected by the first user, such as spring, summer, autumn or winter, the corresponding visual content is loaded from the preset scene library. The scene images of different seasons have specific tones and elements (such as flowers, snow scenes, leaves, etc.) to enhance the sense of season. The projector adaptively adjusts parameters such as brightness and contrast according to the content of the scene to ensure that the projection effect matches the expected scene, and accurately projects the scene image to the interactive area, allowing users to have an immersive seasonal experience.

[0019] Check the first mode selection result of the first user. If the two-person mode is selected, generate the corresponding two-person mode interaction instruction and enter the two-person mode interaction. The two-person mode interaction instruction instructs the somatosensory camera to prepare to enter the user scanning state of the two-person mode. The interaction instruction is used to control the camera to perform the scanning operation of the two-person interaction. If the single-person mode is selected, directly enter the operation process of the single-person mode, which will be described in detail in subsequent steps.

[0020] According to the two-person mode interaction instruction, the body sensing camera is controlled to perform user scanning on a preset interaction area to obtain a first real-time body image of the first user and a second real-time body image of the second user.

[0021] According to the two-person mode interaction instruction, the body sensing camera is started to monitor the preset interaction area. The preset interaction area will be marked by ground signs or projection area boundaries, prompting the user to stand in the interaction area so that the camera can successfully capture the user's image. The body sensing camera starts to scan the interaction area and captures the image of the user standing in the area in real time. When the camera detects that there are two users in the interaction area, it identifies and records the real-time body images of the first user and the second user respectively, and obtains the first real-time body image and the second real-time body image.

[0022] The first real-time body image and the second real-time body image are subjected to posture synthesis according to a two-person mode fractal rule to generate a first dynamic human tree pattern.

[0023] Based on the first real-time body image and the second real-time body image, the body contour and posture of each user, such as the angles and positions of the head, arms, and legs, are identified respectively, and key posture information, including the user's body proportions, arm and leg angles, etc., is extracted from the real-time images. This information is used to generate a pattern with fractal characteristics.

[0024] According to the user's position in the interactive area, through interaction with the user, one user is designated as the main area user and the other user as the secondary area user. This setting determines which user's image constitutes the trunk and which user constitutes the first-level fork when generating the fractal pattern.

[0025] Perform posture synthesis. Specifically, the image of the user in the main area is used as the trunk of the human tree. The user's posture is extracted for preliminary fractal. The image of the user in the secondary area is used to generate the first-level bifurcation of the human tree. The first-level bifurcation is connected to the shoulder of the trunk, showing the effect of branch extension. According to the fractal rule, the posture data is extracted from the images of the main and secondary users in an alternating manner, and the second-level and third-level bifurcations are generated layer by layer. These bifurcations are connected at fractal angles, and the generated pattern is expanded layer by layer to form a fractal structure that is visually similar to the human tree. In order to achieve a dynamic effect, the system continuously collects the user's real-time posture and updates the fractal pattern so that the trunk and bifurcations of the pattern change dynamically with the user's posture, generating a first dynamic human tree pattern.

[0026] The first dynamic human tree pattern is projected onto a preset projection area through the projector and interactively displayed in combination with the first season scene.

[0027] The generated dynamic human tree pattern is transmitted to a projector and projected onto a preset projection area by the projector. The projected dynamic human tree pattern is merged with the previously presented seasonal scene, and the color and transparency of the pattern are coordinated with the background scene so that the human tree pattern appears to be naturally integrated with the seasonal scene. In addition, the positions where the images are connected are connected using patterns that match the season.

[0028] In this way, during the interactive process, users can see a human tree pattern composed of their own images in the projection. At the same time, the human tree will change in real time according to the changes in the audience's movements, which can effectively mobilize the user's enthusiasm for learning fractal knowledge.

[0029] Furthermore, according to the two-person mode interaction instruction, the somatosensory camera is controlled to perform user scanning in a preset interaction area to obtain a first real-time body image of the first user and a second real-time body image of the second user, the method includes: Generate interactive prompt information according to the two-person mode interactive instruction, wherein the interactive prompt information includes main area prompt information and sub-area prompt information of the preset interactive area; after the first user and the second user select the interactive area according to the interactive prompt information, perform user scanning of the main area and the sub-area through the somatosensory camera to obtain the first real-time body image and the second real-time body image, wherein the first real-time body image and the second real-time body image have a main area identifier / sub-area identifier.

[0030] According to the two-person mode interaction instructions, the system generates interaction prompt information to guide the first user and the second user to enter the preset interaction area, so that the user positions in the main and sub-areas can be distinguished in subsequent gesture recognition. The preset interaction area includes the main area and the sub-area. Therefore, the main area prompt information is used to guide the user to enter the main area in the interaction area, and the sub-area prompt information is used to guide the user to enter the sub-area in the interaction area. This prompt may include ground markings, such as the main area words or color markings for prompts.

[0031] According to the prompt information, the first user and the second user independently choose to enter their respective main area or sub-area. The position of the user in the interactive area determines the main area or sub-area identification of the subsequent image, ensuring that the system can identify and distinguish the image source of each user. When the user is in place, the body sensing camera scans the user in the main area and the sub-area respectively, and obtains the first real-time body image of the first user and the second real-time body image of the second user respectively.

[0032] After capturing the real-time body image of the main area, the system automatically adds a main area identifier to the image. The identifier is used in subsequent posture synthesis to ensure that the trunk and main branches of the fractal tree come from the user in the main area. Similarly, after capturing the real-time body image of the secondary area, the system automatically adds a secondary area identifier to the image. The identifier is used for the secondary branches of the fractal tree to form a complete tree structure.

[0033] Furthermore, the user scanning further includes: When the user scan is started, the duration of the scan and the number of scanned persons are recorded; the duration of the scan is verified according to the first verification duration, and a duration verification result is obtained; when the duration verification result is passed, the first real-time body image and the second real-time body image are obtained, wherein, before the duration of the scan reaches the first verification duration, the number of scanned persons obtained is 2, and the duration verification result is passed.

[0034] When scanning starts, the timing starts, and the cumulative time from the start of scanning to the current moment is recorded to obtain the duration of the scan. This timing is used to determine whether the user has completed the position within the specified time, which is convenient for subsequent duration verification. At the same time, the number of users detected in the scanning area is recorded. When the body sensing camera detects the user's image, the current number of scanned people is updated to ensure that the number of people meets the requirements of the two-person mode, that is, two people are present at the same time. If the number of people changes during the scanning process, such as a user temporarily leaving or entering, the system will update the number of people data in real time.

[0035] The first verification duration is a preset time threshold, such as 20 seconds, which is used to determine whether the user is in place within a reasonable time. The scanning duration is compared with the first verification duration. If the number of scanned people meets the two-person mode requirement before the scanning duration reaches the first verification duration, that is, the number of people is 2, then the duration verification result is verification passed, indicating that the user has entered the interactive area within the specified time and is ready to interact.

[0036] After the verification is passed, the first real-time body image and the second real-time body image are obtained, and the two image data are respectively assigned a main area identifier and a secondary area identifier to ensure that when a fractal pattern is generated, the pattern structure complies with the design rules of the two-person mode.

[0037] Furthermore, the user scanning further includes: When the result of the duration verification is verification failure, an analysis of the number of scans is performed, wherein when the scanning duration reaches the first verification duration, and the number of scans obtained is not 2, the duration verification result is verification failure; when the number of scans is 1, the two-person mode is switched to single-person mode; when the number of scans is 0, a scan failure reminder is given through sound, and the second verification duration is obtained at the same time; when the scanning duration reaches the second verification duration and the number of scans is still 0, the interactive process is ended and the system returns to the standby state.

[0038] When the scanning duration reaches the preset first verification duration, if the number of users scanned is not 2, the duration verification result is judged as verification failure, which means that the system failed to detect the conditions for two-person interaction within the predetermined time, so further analysis of the actual number of detected people is required to determine the next step.

[0039] If it is detected that the number of people currently scanned is 1, that is, there is only one user in the interactive area, the two-person mode will be automatically switched to the single-person mode, and the interactive content will be adjusted according to the rules of the single-person mode to adapt to the single-person interactive situation. In this single-person mode, the body sensing camera only needs to capture the image of a single user, and the subsequent posture synthesis and fractal pattern generation will be based on the single-person mode rules, thereby avoiding the interaction delay caused by waiting for another user.

[0040] If it is detected that the current number of scanned persons is 0, it is determined that there is no user in the interactive area, resulting in the inability to continue in both the two-player mode and the single-player mode. A prompt sound or voice reminder is played through the audio equipment to prompt that there is no one in the current scanning area, and the user is asked to re-enter the interactive area. After the reminder is issued, the second verification time is set, for example, waiting for another 5 seconds to check again whether anyone has entered the scanning area. If no one enters within the second verification time, the execution process ends.

[0041] In this case, the system ends the current interactive process, resets all timers and scanning operations, and returns to standby mode, waiting for a new user to enter the interactive area and make an initial selection.

[0042] Furthermore, the step of performing posture synthesis according to the first real-time body image and the second real-time body image in accordance with the two-person mode fractal rule to generate a first dynamic human tree pattern includes: According to the main area identifier / sub-area identifier, a main body image and a sub-body image are determined; a trunk of a human tree is constructed with the main body image, and a first-level bifurcation of the human tree is constructed with the sub-body image, and the trunk of the human tree and the first-level bifurcation of the human tree are connected according to the two-person mode fractal rule; a second-level bifurcation of the human tree is constructed again with the main body image, and so on, the bifurcation continues in an alternating manner and is connected layer by layer to form the first dynamic human tree pattern.

[0043] According to the main area identification, the image of the user in the main area is marked as the main body image, which is used to construct the trunk of the human tree in the future; according to the secondary area identification, the image of the user in the secondary area is marked as the secondary body image, which is used as the first-level branch part of the human tree in the future. After determining the main and secondary images, the different position and posture data of the two images can be applied to different parts of the fractal pattern respectively.

[0044] The data of the main body image is used to construct the trunk of the human tree. The trunk is the basis of the fractal tree and represents the main structure of the fractal pattern. The construction of the trunk usually depends on the overall posture of the main user, such as the overall outline from the head to the torso. After the trunk is generated, the data of the secondary body image is used to generate a first-level bifurcation according to the fractal rules of the two-person mode. The first-level bifurcation is connected to the trunk and represents the first layer of branches of the fractal tree. The fractal angle rules are applied to determine the direction and angle of the first-level bifurcation. For example, the first-level bifurcation can start from the top or shoulder position of the trunk and be adjusted according to the arm and leg angles of the main and secondary users to make the fractal structure natural and symmetrical. Finally, the image data of the trunk and the first-level bifurcation are synthesized, and the secondary body image is connected to the trunk as a first-level bifurcation, so that the overall pattern presents a tree structure with branches.

[0045] After the first-level bifurcation is generated, the construction of multiple layers of bifurcations continues in an alternating manner. Specifically, the primary body image is used again to construct the secondary bifurcation, and the secondary body image is used to construct the tertiary bifurcation, alternating layer by layer. This alternating method ensures the hierarchy of the fractal structure, so that each layer of bifurcations has a different source image, and the direction of the bifurcation is adjusted according to the bifurcation angle of the previous layer to maintain the symmetry and continuity of the fractal tree.

[0046] In the process of generating bifurcations, the posture changes of the main and secondary users are obtained in real time, and the shapes and angles of the trunk and bifurcations are dynamically adjusted, so that the human tree pattern can change continuously with the user's movements, and the bifurcations are connected layer by layer, so that each layer of bifurcations is closely connected to the end of the upper layer of bifurcations, and finally a complete first dynamic human tree pattern is formed. This pattern has a rich sense of layering, which not only shows the user's posture, but also conforms to the recursive structure of the fractal.

[0047] Furthermore, the two-player mode fractal rules include: The legs of the secondary fork of the human tree are connected to the shoulders of the trunk of the human tree to replace the arms of the trunk of the human tree, and the fractal angle is determined according to the arm angle of the trunk of the human tree.

[0048] In two-player mode, following the two-player mode fractal rules, the trunk is generated through the image of the user in the main area, and the forks are gradually added through the images of the users in the secondary area. At this time, when the secondary fork of the human tree is generated, the traditional branch form is no longer used, but the connection form of the user's legs and shoulders is applied to increase the uniqueness of the pattern. When constructing the secondary fork, the image of the secondary user's leg is connected to the shoulder position of the main user. This design breaks the traditional connection mode of the human tree pattern and makes the secondary fork form an effect of legs replacing arms. Through this special connection, the legs of the secondary fork are set as substitutes for the trunk arms, giving the human tree pattern a more dynamic and abstract appearance.

[0049] The connection angle of the secondary bifurcation legs is determined according to the angle of the main trunk arm, which means that the arm posture of the user in the main area directly affects the direction and fractal angle of the secondary bifurcation. The fractal angle will be dynamically updated during the pattern generation process. If the arm angle of the user in the main area changes, the connection angle will be recalculated to adjust the bifurcation structure in real time to maintain the continuity and symmetry of the pattern. This design makes the human tree pattern have a unique visual effect in two-person interaction, giving the tree structure a stronger sense of dynamics and abstraction, and increasing the artistry and appreciation.

[0050] Furthermore, the method for determining whether the first mode selection result is a two-player mode further includes: If not, generate a single-player mode interaction instruction; according to the single-player mode interaction instruction, control the somatosensory camera to perform user scanning on the preset interaction area to obtain the single-player mode real-time body image of the first user; according to the single-player mode real-time body image, perform posture synthesis according to the single-player mode fractal rule to generate a second dynamic human tree pattern, wherein in the single-player mode fractal rule, the fractal angle is determined according to the arm angle of the first user.

[0051] If the first mode selection result is not a two-player mode, that is, a single-player mode, a single-player mode interaction instruction is generated. This instruction instructs the system to operate the somatosensory camera and the fractal pattern generation process according to the specific rules of the single-player mode, including that the somatosensory camera only monitors one user in the interactive area, and the projection content and fractal pattern are also generated according to the single-player rules.

[0052] According to the single-player mode interaction instructions, the somatosensory camera is controlled to scan the preset interaction area. The camera focuses on detecting and capturing the real-time body image of the first user, and no longer searches for or detects the second user. The single-player mode real-time body image of the first user is obtained by scanning, with special attention paid to his body posture and movements. The image data includes the angles and positions of the head, arms, and legs, which facilitates the subsequent generation of fractal patterns.

[0053] In single-player mode, the second dynamic human tree pattern is generated according to the single-player mode fractal rules. Compared with the two-player mode, the fractal structure of the single-player mode is simpler and is mainly based on the posture changes of a single user. In the fractal rules of the single-player mode, the fractal angle is determined by the arm angle of the first user, which means that the user's arm angle will directly affect the bifurcation angle and direction of the tree pattern. During the interaction process, the arm angle changes of the first user are obtained in real time, and the fractal angle is adjusted accordingly, so that the pattern changes dynamically with the user's actions. For example, when the user raises his arm, the bifurcation angle of the tree will increase, showing an extension effect; when the user puts down his arm, the bifurcation angle will shrink. The second dynamic human tree pattern in single-player mode is generated using the image of the first user. This pattern has a simple structure, but it will change with the user's posture, maintaining a real-time interactive effect.

[0054] In summary, the fractal knowledge display method driven by the somatosensory interaction technology provided in the embodiment of the present application has the following technical effects: The scene is presented according to the season selected by the user, so that the user's posture changes are reflected in the projected pattern in real time, which increases the realism of the interaction and allows users to directly participate in the generation process of the fractal pattern through body movements. This immersive experience enhances the visual appeal and interactivity of the display; the appropriate single-player mode or double-player mode is selected according to the number of users. In the double-player mode, the image data of the two users are used to generate the trunk and bifurcation of the fractal pattern respectively, and a complex fractal pattern is formed by combining the postures of the two users. This design not only increases the diversity of interaction, but also increases the fun of multi-person participation, encouraging cooperative interaction; the user's posture is captured in real time by the somatosensory camera and converted into the components of the fractal pattern. Whether in single-player or double-player mode, the user's posture will be processed into the trunk and bifurcation of the tree structure. The application of fractal rules makes the pattern present a visual effect with hierarchy and symmetry, which increases the artistry of the fractal pattern; the dynamic generation of fractal structure reflects the recursive and self-similar characteristics of fractal knowledge. Users can intuitively understand the basic concepts of fractals by forming fractal patterns through their own postures. This experiential learning method is more vivid than static display and helps to enhance users' understanding and memory of fractal knowledge.

[0055] Based on the same inventive concept as the fractal knowledge display method driven by the somatosensory interaction technology in the aforementioned embodiment, Figure 2 As shown, the embodiment of the present application provides a fractal knowledge display system driven by somatosensory interaction technology, the system is connected to a projector, a somatosensory camera, a touch screen and a speaker, and the system includes: A selection result acquisition module 10, the selection result acquisition module 10 is used to initialize the projector and the touch screen, and when the first user interacts through the touch screen, the first season selection result and the first mode selection result are obtained; a season scene presentation module 20, the season scene presentation module 20 is used to control the projector to present the first season scene according to the first season selection result, and determine whether the first mode selection result is a two-person mode, and if so, generate a two-person mode interaction instruction; a user scanning module 30, the user scanning module 30 is used to control the somatosensory camera to perform user scanning on a preset interaction area according to the two-person mode interaction instruction, and obtain a first real-time body image of the first user and a second real-time body image of the second user; a posture synthesis module 40, the posture synthesis module 40 is used to perform posture synthesis according to the first real-time body image and the second real-time body image according to the two-person mode fractal rule to generate a first dynamic human tree pattern; an interactive display module 50, the interactive display module 50 is used to project the first dynamic human tree pattern to a preset projection area through the projector, and perform interactive display in combination with the first season scene.

[0056] Furthermore, the system further comprises a real-time body image acquisition module to perform the following operation steps: Generate interactive prompt information according to the two-person mode interactive instruction, wherein the interactive prompt information includes main area prompt information and sub-area prompt information of the preset interactive area; after the first user and the second user select the interactive area according to the interactive prompt information, perform user scanning of the main area and the sub-area through the somatosensory camera to obtain the first real-time body image and the second real-time body image, wherein the first real-time body image and the second real-time body image have a main area identifier / sub-area identifier.

[0057] Furthermore, the system further includes a body image acquisition module to perform the following operation steps: When the user scan is started, the duration of the scan and the number of scanned persons are recorded; the duration of the scan is verified according to the first verification duration, and a duration verification result is obtained; when the duration verification result is passed, the first real-time body image and the second real-time body image are obtained, wherein, before the duration of the scan reaches the first verification duration, the number of scanned persons obtained is 2, and the duration verification result is passed.

[0058] Furthermore, the system also includes a scanning number analysis module to perform the following operation steps: When the result of the duration verification is verification failure, an analysis of the number of scans is performed, wherein when the scanning duration reaches the first verification duration, and the number of scans obtained is not 2, the duration verification result is verification failure; when the number of scans is 1, the two-person mode is switched to single-person mode; when the number of scans is 0, a scan failure reminder is given through sound, and the second verification duration is obtained at the same time; when the scanning duration reaches the second verification duration and the number of scans is still 0, the interactive process is ended and the system returns to the standby state.

[0059] Furthermore, the system further comprises a human tree pattern generation module to perform the following operation steps: According to the main area identifier / sub-area identifier, a main body image and a sub-body image are determined; a trunk of a human tree is constructed with the main body image, and a first-level bifurcation of the human tree is constructed with the sub-body image, and the trunk of the human tree and the first-level bifurcation of the human tree are connected according to the two-person mode fractal rule; a second-level bifurcation of the human tree is constructed again with the main body image, and so on, the bifurcation continues in an alternating manner and is connected layer by layer to form the first dynamic human tree pattern.

[0060] Furthermore, the two-player mode fractal rules include: The legs of the secondary fork of the human tree are connected to the shoulders of the trunk of the human tree to replace the arms of the trunk of the human tree, and the fractal angle is determined according to the arm angle of the trunk of the human tree.

[0061] Furthermore, the determining whether the first mode selection result is a two-player mode further includes: If not, generate a single-player mode interaction instruction; according to the single-player mode interaction instruction, control the somatosensory camera to perform user scanning on the preset interaction area to obtain the single-player mode real-time body image of the first user; according to the single-player mode real-time body image, perform posture synthesis according to the single-player mode fractal rule to generate a second dynamic human tree pattern, wherein in the single-player mode fractal rule, the fractal angle is determined according to the arm angle of the first user.

[0062] Through the above-mentioned detailed description of the fractal knowledge display method driven by the somatosensory interaction technology, those skilled in the art can clearly understand the fractal knowledge display system driven by the somatosensory interaction technology in this embodiment. Since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description.

[0063] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A fractal knowledge display method driven by somatosensory interaction technology, characterized in that: The method is applied to a fractal knowledge display system driven by somatosensory interaction technology, wherein the system is connected to a projector, a somatosensory camera, a touch screen and an audio system, and the method comprises: Initializing the projector and the touch screen, and when a first user interacts through the touch screen, obtaining a first season selection result and a first mode selection result; controlling the projector to present the first season scene according to the first season selection result, determining whether the first mode selection result is a two-player mode, and if so, generating a two-player mode interaction instruction; According to the two-person mode interaction instruction, the body sensing camera is controlled to perform user scanning on a preset interaction area to obtain a first real-time body image of the first user and a second real-time body image of the second user; Performing posture synthesis according to the first real-time body image and the second real-time body image in accordance with the fractal rule of the two-person mode to generate a first dynamic human tree pattern; The first dynamic human tree pattern is projected onto a preset projection area through the projector and interactively displayed in combination with the first season scene.

2. The fractal knowledge display method driven by somatosensory interaction technology as claimed in claim 1, characterized in that: According to the two-person mode interaction instruction, controlling the body sensing camera to perform user scanning on a preset interaction area to obtain a first real-time body image of a first user and a second real-time body image of a second user, the method comprising: Generate interactive prompt information according to the two-player mode interactive instruction, wherein the interactive prompt information includes main area prompt information and sub-area prompt information of the preset interactive area; After the first user and the second user select an interactive area according to the interactive prompt information, the somatosensory camera performs a user scan on the main area and the sub-area to obtain the first real-time body image and the second real-time body image, wherein the first real-time body image and the second real-time body image have a main area identifier / sub-area identifier.

3. The fractal knowledge display method driven by somatosensory interaction technology as claimed in claim 2, characterized in that: The user scanning further includes: When a user scan is initiated, the duration of the scan and the number of scanned people are recorded; Performing duration verification on the scanning duration according to the first verification duration, and obtaining a duration verification result; When the duration verification result is passed, the first real-time body image and the second real-time body image are obtained, wherein before the scanning duration reaches the first verification duration, the number of scanned persons obtained is 2, and the duration verification result is passed.

4. The fractal knowledge display method driven by somatosensory interaction technology as claimed in claim 3, characterized in that: The user scanning further includes: When the duration verification result is verification failure, a number of scans analysis is performed, wherein when the duration of the scan reaches the first verification duration, and the number of scans obtained is not 2, the duration verification result is verification failure; When the number of scanned persons is 1, the two-person mode is switched to the single-person mode; When the number of scanned persons is 0, a scanning failure reminder is given through the sound, and the second verification time is obtained at the same time; When the scanning duration reaches the second verification duration and the number of scanned persons is still 0, the interactive process ends and returns to the standby state.

5. The fractal knowledge display method driven by somatosensory interaction technology as claimed in claim 2, characterized in that: The step of performing posture synthesis according to the first real-time body image and the second real-time body image in accordance with a two-person mode fractal rule to generate a first dynamic human tree pattern includes: Determining a primary body image and a secondary body image according to the primary region identifier / secondary region identifier; The main body image is used to construct a human tree trunk, the secondary body image is used to construct a first-level bifurcation of the human tree, and the main body of the human tree and the first-level bifurcation of the human tree are connected according to the two-person mode fractal rule; The secondary branch of the human tree is constructed again with the main body image, and so on, the branches continue to be alternately connected layer by layer to form the first dynamic human tree pattern.

6. The fractal knowledge display method driven by somatosensory interaction technology as claimed in claim 5, characterized in that: The two-player mode fractal rules include: The legs of the secondary fork of the human tree are connected to the shoulders of the trunk of the human tree to replace the arms of the trunk of the human tree, and the fractal angle is determined according to the arm angle of the trunk of the human tree.

7. The fractal knowledge display method driven by somatosensory interaction technology as claimed in claim 1, characterized in that: The method for determining whether the first mode selection result is a two-player mode further includes: If not, generate single-player mode interaction instructions; According to the single-player mode interaction instruction, control the body sensing camera to perform user scanning on a preset interaction area to obtain a single-player mode real-time body image of the first user; According to the single-player mode real-time body image, posture synthesis is performed according to the single-player mode fractal rule to generate a second dynamic human tree pattern, wherein in the single-player mode fractal rule, a fractal angle is determined according to the arm angle of the first user.

8. The fractal knowledge display system driven by somatosensory interaction technology is characterized by: The system is connected to a projector, a somatosensory camera, a touch screen and an audio system for implementing the somatosensory interactive technology-driven fractal knowledge display method according to any one of claims 1 to 7, and the system comprises: A selection result acquisition module, the selection result acquisition module is used to initialize the projector and the touch screen, and when the first user interacts through the touch screen, obtain the first season selection result and the first mode selection result; a season scene presentation module, the season scene presentation module being used to control the projector to present the first season scene according to the first season selection result, and to determine whether the first mode selection result is a two-player mode, and if so, to generate a two-player mode interaction instruction; A user scanning module, the user scanning module is used to control the body sensing camera to perform user scanning on a preset interactive area according to the two-person mode interaction instruction, and obtain a first real-time body image of the first user and a second real-time body image of the second user; a posture synthesis module, the posture synthesis module being used to perform posture synthesis according to the first real-time body image and the second real-time body image in accordance with a two-person mode fractal rule to generate a first dynamic human tree pattern; An interactive display module is used to project the first dynamic human tree pattern to a preset projection area through the projector, and perform interactive display in combination with the first season scene.

Images