Fractal display method and system based on user behavior analysis

Abstract

The invention belongs to the technical field of fractal knowledge display, and relates to a fractal display method and system based on user behavior analysis, and the method comprises the steps: obtaining the initial distance information of a user relative to a display region, the initial reflection signal frequency of a radar induction device, and the frequency of a transmitter through the radar induction device; the somatosensory camera obtains initial action posture information of the user; constructing a user action and track database; obtaining initial user action and trajectory parameters; initial user action and track parameters are taken as reference, subsequent distance information of the user, reflected signal frequency of the radar sensing device and transmitter frequency are acquired based on a timestamp, initial action posture information of the user is acquired by the somatosensory camera, and a data set is formed; the method has the advantages that the action and track parameters and the action posture information of the user are automatically obtained, and corresponding music and explanation are played for the user to attract the user to watch parting display.

Description

Technical Field

[0001] The present invention belongs to the technical field of fractal knowledge display, and in particular relates to a fractal display method and system based on user behavior analysis. Background Art

[0002] In the field of mathematics, fractal refers to "a geometric shape that can be divided into several parts, and each part is (at least approximately) a smaller version of the whole shape", that is, a pattern with self-similar properties. The mathematical concept of fractal is highly relevant to daily life and is a mathematical field knowledge suitable for popular science education to the public.

[0003] The existing ways of presenting fractal knowledge for popular science mainly take the form of graphic introductions and simple small-screen multimedia interactions, including introductions to different mathematical fractal forms and displays of exquisite fractal patterns.

[0004] On the one hand, this display method is rigid and outdated. On the other hand, since the concept of fractals is difficult to understand, different entry points need to be adopted for different groups of people, and users also need to be attracted to watch. Therefore, how to adopt corresponding measures and display methods for different groups of people has become the situation faced by the display of fractal knowledge. Summary of the invention

[0005] The goal to be achieved by the present invention is: how to solve the problem that the fractal knowledge display method in the existing technology is rigid and outdated; on the other hand, since the fractal concept is difficult to understand, different entry points need to be adopted for different groups of people, and it is also necessary to attract users to watch. Therefore, how to adopt corresponding measures and display methods for different groups of people is a technical problem.

[0006] In order to achieve the above objectives, the present invention provides a fractal display method and system based on user behavior analysis.

[0007] The specific technical solution adopted by the present invention is: On the one hand, the present invention provides a fractal display method based on user behavior analysis, the method is applied to a system for displaying fractal information to a user when the user has a behavior, the system is connected to a radar sensing device, a projector, a body sensing camera and an audio communication device, and the method includes: Initialize the radar sensing device, projector, body sensing camera and audio, and display the initialization status of the system in the projection area; When a user approaches the display area, the radar sensor device obtains the user's initial distance information relative to the display area, the initial reflection signal frequency and transmitter frequency of the radar sensor device, and the body sensing camera obtains the user's initial motion posture information; Build a user action and trajectory database; The initial distance information, the initial reflection signal frequency and transmitter frequency of the radar sensing device, and the initial motion posture information of the user obtained by the body sensing camera are input into the user motion and trajectory database to obtain initial user motion and trajectory parameters; Based on the initial user action and trajectory parameters, the user's subsequent distance information, the reflected signal frequency and transmitter frequency of the radar sensing device are obtained based on the timestamp, and the body sensing camera obtains the user's initial action posture information to form a data set; Based on BP neural network, build a user attraction analysis model; Inputting the data set into a user attraction analysis model, and outputting the user's movement trend and personality determination results based on the constructed user attraction analysis model; Based on the movement tendency and personality determination result of the user, the speakers are controlled to play corresponding types of music to attract the user to watch the images and graphic materials displayed in the fractal form.

[0008] Furthermore, the user action and trajectory database is constructed: Calculate the user's initial azimuth information and initial angle information based on the initial distance information, the initial reflection signal frequency of the radar sensing device and the transmitter frequency to form a user initial position data set; Based on the timestamp, the user's subsequent distance information, the reflected signal frequency and the transmitter frequency of the radar sensing device are obtained, and the user's subsequent azimuth information and angle information are calculated to form a subsequent location data set of the user; Based on the timestamp, the body sensing camera obtains the user's initial motion posture information to form a data set of user motion posture changes; Based on the timestamp, obtain the user's historical actions and trajectory analysis records recorded by the system to form a historical reference data set; The user action and trajectory database is constructed using a user initial position data set, a user subsequent position data set, a user action posture change data set and a historical reference data set.

[0009] Furthermore, the construction of the user attraction analysis model includes: Based on the timestamp, obtaining the user's historical actions and trajectory analysis records recorded by the system to form a historical reference data set; The user attraction analysis model is supervisedly trained, verified and tested using the data set and the historical reference data set until the accuracy of the user attraction analysis model meets the preset requirements, thereby obtaining the constructed user attraction analysis model.

[0010] Furthermore, the output of the user's movement trend and personality determination result based on the constructed user attraction analysis model includes: Obtaining a user motion trajectory curve through a user initial position data set and a user subsequent position data set to determine the user's motion trend; The user's activity level is determined by the user's movement and posture change data set, so that the system can choose cheerful or soothing music and commentary methods.

[0011] Furthermore, based on the user attraction analysis model outputting the user's movement trend and personality determination results, the system recombines the fractal image clips and graphic materials to form a new playback order to suit the corresponding user.

[0012] Furthermore, when the video ends, if the radar sensing device and the body sensing camera still detect the presence of a user in the playback area, the system will replay the image.

[0013] On the other hand, the present invention provides a fractal display system based on user behavior analysis based on the fractal display method based on user behavior analysis according to claim 1, comprising: The audio module includes at least a first audio system for playing attractive music to approaching users and a second audio system for cooperating with the projector to play music; A projector module is used to display images and graphic materials of fractal display to users; A radar sensor device for detecting the distance information of the user; A body sensing camera, used to detect the user's motion posture; Constructing a user action and trajectory database module, using a user initial position data set, a user subsequent position data set, a user action posture change data set and a historical reference data set to construct the user action and trajectory database; Constructing a user attraction analysis model module, using the data set and the historical reference data set to supervise training, verify and test the user attraction analysis model until the accuracy of the user attraction analysis model meets the preset requirements, obtaining the constructed user attraction analysis model, and controlling the audio system to play the corresponding type of music based on the user's movement trend and personality determination results to attract the user to watch the images and graphic materials displayed by the fractal display; The image and audio processing module recombines the fractal image clips and graphic materials based on the user's movement trend and personality judgment results to form a new playback order to suit the corresponding user.

[0014] The positive effect of the present invention is: by automatically acquiring user action and trajectory parameters and motion posture information, the user attraction analysis model is supervised trained, verified and tested using the data set and the historical reference data set until the accuracy of the user attraction analysis model meets the preset requirements, and the constructed user attraction analysis model is obtained. Based on the user's movement trend and personality judgment results, the audio is controlled to play the corresponding type of music to attract the user to watch the fractal display images and graphic materials. At the same time, based on the user's movement trend and personality judgment results, the fractal image clips and graphic materials are recombined to form a new playback order to adapt to the corresponding users for better fractal knowledge display and dissemination. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 It is a flow chart of the method and system for fractal display based on user behavior analysis in the present invention; Figure 2 It is a flowchart of constructing a user action and trajectory database in the method of fractal display method and system based on user behavior analysis in the present invention; Figure 3 It is a structural diagram of the system in the fractal display method and system based on user behavior analysis in the present invention. DETAILED DESCRIPTION

[0016] In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined purpose of the invention, the fractal display method and system based on user behavior analysis proposed by the present invention, its specific implementation method, structure, characteristics and effects are described in detail below in combination with the accompanying drawings and embodiments.

[0017] In the following description, different “one embodiment” or “another embodiment” do not necessarily refer to the same embodiment. Furthermore, the particular features, structures or characteristics of one or more embodiments may be combined in any suitable form.

[0018] Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

[0019] The acquisition, storage, use, and processing of data in the technical solution of the present invention are in compliance with the relevant provisions of national laws and regulations.

[0020] The present application is applicable to the prior art where the fractal knowledge display method is rigid and outdated. On the other hand, since the fractal concept is difficult to understand, different entry points need to be adopted for different groups of people, and users also need to be attracted to watch. Therefore, the technical problem of how to adopt corresponding measures and display methods for different groups of people can be solved by the technical solution provided by the present invention. The fractal display method and system based on user behavior analysis provided by the present invention are specifically explained below in conjunction with the accompanying drawings.

[0021] The present invention is described in detail below with reference to the accompanying drawings and specific embodiments:

[0022] Embodiment 1: The present invention provides a fractal display method based on user behavior analysis, the method is applied to a system for displaying fractal information to a user when the user has a behavior, the system is connected to a radar sensing device, a projector, a body sensing camera and an audio communication device, and the method includes: S100: Initialize the radar sensing device, projector, body sensing camera and audio, and display the initialization status of the system in the projection area; S200: When a user approaches the display area, the radar sensing device obtains the initial distance information of the user relative to the display area, the initial reflection signal frequency and the transmitter frequency of the radar sensing device, and the body sensing camera obtains the initial motion posture information of the user; S300: Build a user action and trajectory database; S400: inputting the initial distance information, the initial reflection signal frequency and transmitter frequency of the radar sensing device, and the initial motion posture information of the user obtained by the body sensing camera into the user motion and trajectory database to obtain initial user motion and trajectory parameters; S500: Based on the initial user action and trajectory parameters, the user's subsequent distance information, the reflection signal frequency and transmitter frequency of the radar sensing device are obtained based on the timestamp, and the body sensing camera obtains the user's initial action posture information to form a data set; S600: Building a user attraction analysis model based on BP neural network; S700: inputting the data set into a user attraction analysis model, and outputting the user's movement trend and personality determination results based on the constructed user attraction analysis model; S800: Based on the movement tendency and personality determination result of the user, the audio system is controlled to play the corresponding type of music to attract the user to watch the images and graphic materials displayed in the fractal form.

[0023] Preferably, the construction of the user action and trajectory database: S310: Calculate the user's initial orientation information and initial angle information based on the initial distance information, the initial reflection signal frequency of the radar sensing device and the transmitter frequency, and form a user initial position data set; S320: Based on the timestamp, obtain the user's subsequent distance information, the reflected signal frequency and the transmitter frequency of the radar sensing device, calculate the user's subsequent azimuth information and angle information, and form a subsequent location data set of the user; S330: Based on the timestamp, the body sensing camera obtains the user's initial motion posture information to form a user motion posture change data set; S340: Based on the timestamp, obtain the user's historical actions and trajectory analysis records recorded by the system to form a historical reference data set; S350: constructing the user action and trajectory database using the user initial position data set, the user subsequent position data set, the user action posture change data set and the historical reference data set.

[0024] Preferably, the constructing of the user attraction analysis model includes: S610: Based on the timestamp, obtain the user's historical actions and trajectory analysis records recorded by the system to form a historical reference data set; S620: Use the data set and the historical reference data set to perform supervised training, verification and testing on the user attraction analysis model until the accuracy of the user attraction analysis model meets the preset requirements, thereby obtaining the constructed user attraction analysis model.

[0025] Preferably, the outputting of the user's movement trend and personality determination result based on the constructed user attraction analysis model includes: S710: Obtaining a user motion trajectory curve through the user initial position data set and the user subsequent position data set to determine the user's motion trend; Specifically, the user's motion trajectory curve can be used to determine whether the user's distance from the fractal exhibition area is increasing or decreasing, thereby determining whether the user is approaching or moving away from the fractal exhibition area; when the user is approaching the fractal exhibition area, the system can activate corresponding attraction measures to attract the user to watch by playing music or explaining.

[0026] S720: Determine the user's activity level through a set of user movement and posture change data, so that the system can select cheerful or soothing music and narration methods.

[0027] Specifically, the user's activity level is determined to determine whether the user is a lively or quiet person, and then based on this result, cheerful or soothing music and commentary are used to attract the user's attention and achieve the purpose of the user coming to watch.

[0028] Preferably, based on the user attraction analysis model outputting the user's movement trend and personality determination results, the system recombines the fractal image clips and graphic materials to form a new playback order to suit the corresponding user.

[0029] Preferably, when the video presentation ends, if the radar sensing device and the body sensing camera still detect the presence of a user in the playback area, the system replays the image.

[0030] Embodiment 2: The present invention provides a fractal display system based on user behavior analysis based on the fractal display method based on user behavior analysis described in claim 1, comprising: The audio module at least includes a first audio for playing attractive music to approaching users and a second audio for cooperating with the projector to play music; the audio module is connected to the user attraction analysis model building module and the projector module respectively; The projector module is used to display the fractal images and graphic materials to the user; the projector module is connected to the audio module and the user attraction analysis model building module respectively; A radar sensing device is used to detect the distance information of the user; the radar sensing device is connected to a module for building a user action and trajectory database; A body sensing camera is used to detect the user's motion posture; the body sensing camera is connected to a module for building a user action and trajectory database; Constructing a user action and trajectory database module, using a user initial position data set, a user subsequent position data set, a user action posture change data set and a historical reference data set to construct the user action and trajectory database; the user action and trajectory database module is respectively connected with a radar sensing device, a body sensing camera, a user historical action and trajectory analysis database module and a user attraction analysis model construction module; Constructing a user attraction analysis model module, using the data set and the historical reference data set to supervise training, verify and test the user attraction analysis model until the accuracy of the user attraction analysis model meets the preset requirements, obtaining the constructed user attraction analysis model, and controlling the audio to play the corresponding type of music based on the user's movement trend and personality judgment result to attract the user to watch the images and graphic materials displayed by the fractal display; constructing the user attraction analysis model module is respectively connected with the user action and trajectory database construction module, the user historical action and trajectory analysis database module, the audio module and the projector module; The image and audio processing module recombines the fractal image clips and graphic materials based on the user's movement trend and personality judgment results to form a new playback order to suit the corresponding user.

[0031] A user history action and trajectory analysis database module is used to store and record the system's analysis results of user history actions and trajectories; When in use, when a user moves near the fractal display area, the radar sensing device detects the user's initial distance information relative to the display area, and sends the radar sensing device's initial reflection signal frequency and transmitter frequency of the user to the user action and trajectory database construction module at the same time; at the same time, the body sensing camera obtains the user's initial action posture information and sends it to the user action and trajectory database construction module; the radar sensing device's initial reflection signal frequency and transmitter frequency, calculate the user's initial orientation information and initial angle information, and form a user initial position data set; Based on the timestamp, the user's subsequent distance information, the reflected signal frequency and the transmitter frequency of the radar sensing device are obtained, and the user's subsequent azimuth information and angle information are calculated to form a subsequent location data set of the user; Based on the timestamp, the body sensing camera obtains the user's initial motion posture information to form a data set of user motion posture changes; Based on the timestamp, obtain the user's historical actions and trajectory analysis records recorded by the system to form a historical reference data set; The user action and trajectory database construction module uses the user initial position data set, the user subsequent position data set, the user action posture change data set and the historical reference data set to construct the user action and trajectory database; The module for constructing a user attraction analysis model obtains the data set and the historical reference data set from the module for constructing a user action and trajectory database, and uses the data set and the historical reference data set to perform supervised training, verification and testing on the user attraction analysis model until the accuracy of the user attraction analysis model meets the preset requirements, thereby obtaining the constructed user attraction analysis model, and using the user's initial position data set, the user's subsequent position data set, the user's action posture change data set and the historical reference data set to analyze and determine the user's activity level and movement trajectory, and outputs the user's movement trend and personality determination results based on the user attraction analysis model. The system recombines the fractal image clips and graphic materials to form a new playback order to adapt to the corresponding users.

[0032] This embodiment automatically obtains user action and trajectory parameters and motion posture information, and uses the data set and the historical reference data set to supervise the training, verification and testing of the user attraction analysis model until the accuracy of the user attraction analysis model meets the preset requirements, thereby obtaining the constructed user attraction analysis model, and based on the user's movement trend and personality judgment results, controlling the audio system to play the corresponding type of music to attract the user to watch the fractal display images and graphic materials. At the same time, based on the user's movement trend and personality judgment results, the fractal image clips and graphic materials are recombined to form a new playback order to adapt to the corresponding users for better fractal knowledge display and dissemination.

[0033] The foregoing has broadly outlined some aspects and features of various embodiments, which should be construed as merely illustrative of various potential applications. Other beneficial results may be obtained by applying the disclosed information in different ways or by combining various aspects of the disclosed embodiments. Other aspects and a more comprehensive understanding may be obtained by reference to the detailed description of the exemplary embodiments in conjunction with the accompanying drawings, within the scope defined by the claims.

[0034] The above embodiments have been described in detail. Of course, the above description is not intended to limit the present invention, and the present invention is not limited to the above examples. Changes, modifications, additions, reductions, and substitutions made by relevant technicians within the essential scope of the present invention also fall within the protection scope of the present invention.

Claims

1. A fractal display method based on user behavior analysis, characterized in that: The method is applied to a system for displaying classification to a user when the user performs an action, the system is connected to a radar sensing device, a projector, a body sensing camera and an audio communication device, and the method includes: Initialize the radar sensing device, projector, body sensing camera and audio, and display the initialization status of the system in the projection area; When a user approaches the display area, the radar sensor device obtains the user's initial distance information relative to the display area, the initial reflection signal frequency and transmitter frequency of the radar sensor device, and the body sensing camera obtains the user's initial motion posture information; Build a user action and trajectory database; The initial distance information, the initial reflection signal frequency and transmitter frequency of the radar sensing device, and the initial motion posture information of the user obtained by the body sensing camera are input into the user motion and trajectory database to obtain initial user motion and trajectory parameters; Based on the initial user action and trajectory parameters, the user's subsequent distance information, the reflected signal frequency and transmitter frequency of the radar sensing device are obtained based on the timestamp, and the body sensing camera obtains the user's initial action posture information to form a data set; Based on BP neural network, build a user attraction analysis model; Inputting the data set into a user attraction analysis model, and outputting the user's movement trend and personality determination results based on the constructed user attraction analysis model; Based on the user's movement tendency and personality determination result, the speakers are controlled to play corresponding types of music to attract the user to watch the images and graphic materials displayed in the fractal form.

2. The fractal display method based on user behavior analysis according to claim 1 is characterized in that: Constructing the user action and trajectory database: Calculate the user's initial azimuth information and initial angle information based on the initial distance information, the initial reflection signal frequency of the radar sensing device and the transmitter frequency to form a user initial position data set; Based on the timestamp, the user's subsequent distance information, the reflected signal frequency and the transmitter frequency of the radar sensing device are obtained, and the user's subsequent azimuth information and angle information are calculated to form a subsequent location data set of the user; Based on the timestamp, the body sensing camera obtains the user's initial motion posture information to form a data set of user motion posture changes; Based on the timestamp, obtaining the user's historical actions and trajectory analysis records recorded by the system to form a historical reference data set; The user action and trajectory database is constructed using a user initial position data set, a user subsequent position data set, a user action posture change data set and a historical reference data set.

3. The fractal display method based on user behavior analysis according to claim 2 is characterized in that: The constructing of the user attraction analysis model comprises: Based on the timestamp, obtaining the user's historical actions and trajectory analysis records recorded by the system to form a historical reference data set; The user attraction analysis model is supervisedly trained, verified and tested using the data set and the historical reference data set until the accuracy of the user attraction analysis model meets the preset requirements, thereby obtaining the constructed user attraction analysis model.

4. The fractal display method based on user behavior analysis according to claim 3 is characterized in that: The output of the user's movement trend and personality determination result based on the constructed user attraction analysis model includes: Obtaining a user motion trajectory curve through a user initial position data set and a user subsequent position data set to determine the user's motion trend; The user's activity level is determined by the user's movement and posture change data set, so that the system can choose cheerful or soothing music and commentary methods.

5. The fractal display method based on user behavior analysis according to claim 4 is characterized in that: According to the user attraction analysis model outputting the user's movement trend and personality determination results, the system recombines the fractal image clips and graphic materials to form a new playback order to suit the corresponding user.

6. The fractal display method based on user behavior analysis according to claim 5 is characterized in that: When the video ends, if the radar sensor and the body sensing camera still detect the presence of a user in the playback area, the system will replay the image.

7. A fractal display system based on user behavior analysis based on the fractal display method based on user behavior analysis according to any one of claims 1 to 5, characterized in that: include: The audio module includes at least a first audio system for playing attractive music to approaching users and a second audio system for cooperating with the projector to play music; A projector module is used to display images and graphic materials of fractal display to users; A radar sensor device for detecting the distance information of the user; A body sensing camera, used to detect the user's motion posture; Constructing a user action and trajectory database module, using a user initial position data set, a user subsequent position data set, a user action posture change data set and a historical reference data set to construct the user action and trajectory database; Constructing a user attraction analysis model module, using the data set and the historical reference data set to supervise training, verify and test the user attraction analysis model until the accuracy of the user attraction analysis model meets the preset requirements, obtaining the constructed user attraction analysis model, and controlling the audio system to play the corresponding type of music based on the user's movement trend and personality determination results to attract the user to watch the images and graphic materials displayed by the fractal display; The image and audio processing module recombines the fractal image clips and graphic materials based on the user's movement trend and personality judgment results to form a new playback order to suit the corresponding user.

Images