Interaction method and system of digital multimedia culture wall
By calculating the regional and individual behavior interest values, the digital multimedia cultural wall realizes multi-person collaborative interaction, solves the problem of insufficient interaction in the existing technology under the scenario of multiple people interacting simultaneously, and improves the overall interactive experience quality of the multimedia cultural wall.
Patent Information
- Application Number
- CN202510800369.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-16
- Publication Date
- 2025-09-12
AI Technical Summary
The existing multimedia cultural wall cannot take into account the needs of multi-person collaboration and interaction in scenarios where multiple people are interacting simultaneously, resulting in a lack of globality and overall experience depth in the interactive content, affecting the immersive experience of other tourists.
Real-time video data is obtained through the camera module, and the target detection and tracking model is used to obtain the coordinates and unique ID of tourists. The regional behavior interest value and personal behavior interest value are calculated. Based on these interest values, different levels of display are performed, including the baseline layer, hotspot layer, click layer and interactive layer, to achieve a balance between individual and multi-person interaction.
It achieves the simultaneous consideration of individual and multi-person interactions on the multimedia cultural wall, improves the interactive experience of multi-person collaboration, and enhances the coherence and sense of participation of the overall immersive experience.
Smart Images
Figure CN120631294A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of digital multimedia cultural walls, and in particular to an interactive method and system for digital multimedia cultural walls. Background Art
[0002] In today's digital age, cultural displays are constantly evolving. Digital multimedia cultural walls, as an innovative display format, are increasingly being used in museums, exhibition halls, science and technology museums, and various public cultural spaces. Leveraging modern multimedia technologies such as projection, touch screens, and sensors, they present cultural information to audiences in a more vivid, intuitive, and interactive manner, significantly enhancing audience engagement and experience.
[0003] Currently, most multimedia cultural wall interactive designs on the market focus on individual visitor behavior. This design model allows the wall to respond to individual visitors' movements, gestures, and voice, creating a one-on-one interactive experience. For example, when a visitor approaches a specific display area, the multimedia cultural wall will automatically play an introductory video; or visitors can browse different cultural content by touching the screen.
[0004] However, with the increasing diversification of cultural exhibitions and the increasing demand for interactive experiences from audiences, this interactive model, based solely on individual behavior, has gradually exposed its limitations. In real-world scenarios, multiple visitors often gather in front of a cultural wall, hoping to participate in the interaction and share their experiences. However, existing multimedia cultural walls cannot effectively accommodate scenarios where multiple people interact simultaneously. This results in a lack of holistic interaction content and fails to fully consider the collaborative and interactive needs of multiple visitors.
[0005] Furthermore, when individual interactions such as tapping the screen occur, the interaction experience for others is negatively impacted. Other visitors are often forced to passively watch and are unable to participate in the interaction, which undermines the depth and coherence of the entire immersive experience.
[0006] In summary, the existing multimedia cultural wall interactive technology has shortcomings in dealing with scenarios where multiple people interact simultaneously, and it is in urgent need of innovation and improvement to meet the higher requirements of modern cultural exhibition activities for interactive experience and improve the overall experience quality of the audience. Summary of the Invention
[0007] In order to better balance personal interaction and multi-person interaction, the present application provides an interactive method and system for a digital multimedia cultural wall.
[0008] In the first aspect, the present application provides an interactive method and system for a digital multimedia cultural wall, which adopts the following technical solutions:
[0009] An interactive method for a digital multimedia cultural wall comprises the following steps:
[0010] Acquire real-time video data and convert it into frame images;
[0011] Based on the target detection and tracking model, the frame image is detected to obtain the visitor's coordinates and unique ID;
[0012] Based on the preset interest area, the number of tourists in the interest area, as well as the average stay time and gaze time of tourists are obtained, and the regional behavioral interest value is obtained through weighted calculation;
[0013] Obtain the stay time, gaze time and click times of each tourist in the area of interest, and obtain the individual behavior interest value through weighted calculation;
[0014] Based on regional behavioral interest values and personal behavioral interest values, different levels of display are performed;
[0015] The levels of content displayed on the cultural wall are the baseline level, the hotspot level, and the click level. The specific steps of displaying different levels based on the regional behavior interest value and the individual behavior interest value include:
[0016] When the regional behavioral interest value is greater than the first threshold, the cultural wall corresponding to the interest area superimposes the hotspot layer on the basis of the display baseline layer;
[0017] When the individual behavior interest value is greater than the second threshold and the regional behavior interest value is less than the third threshold, based on the click situation, the cultural wall corresponding to the interest area superimposes the click layer on the basis of the display baseline layer; wherein, the third threshold is less than the first threshold.
[0018] With this setup, the cultural wall displays the base layer by default. The base layer consists of a basic background display, such as text, images, and icons. The area in front of the cultural wall is then monitored by a camera. Based on real-time video, regional and individual behavioral interest values are generated. The regional behavioral interest value reflects the interest of all visitors in the cultural wall content in that area, while the individual behavioral interest value reflects the interest of individual visitors in that area. Finally, based on the regional and individual behavioral interest values, a hotspot layer or a click layer is selected over the base layer, achieving a balance between individual and multi-user interaction. The click layer is a layer that displays text, images, and icons on the base layer, providing further information upon click, such as character introductions, video animations, and dynamic details. The hotspot layer primarily features dynamic special effects, such as preset cultural relic details, story clips, and videos related to historical events. The content of the click and hotspot layers can overlap.
[0019] In one embodiment, the cultural wall display content also includes an interactive layer. The specific steps of displaying different levels based on the regional behavior interest value and the individual behavior interest value also include:
[0020] When there are multiple interest areas superimposed with hotspot layers or click layers, it is determined whether the displays corresponding to the multiple interest areas are related. If so, the cultural wall corresponding to the interest area is superimposed with an interactive layer on the basis of the display base layer.
[0021] In one embodiment, the unique ID is bound with information of the area of interest and the dwelling time and gaze time corresponding to the information of the area of interest, and the step of obtaining the number of tourists located in the area of interest specifically includes:
[0022] The stay time of tourists in the interest area corresponding to the interest area information plus a;
[0023] Based on the head posture analysis of tourists who spend more time in the same area of interest, the gaze of the tourists is judged. If it is judged that they are looking at the cultural wall corresponding to the area of interest, the gaze time under the same area of interest information is increased by c;
[0024] The number of unique IDs located in the area of interest and with non-zero gaze time is taken as the number of tourists in the corresponding area of interest.
[0025] In one embodiment: if the stay time is less than the first time threshold, the tourist leaves the interest area, and the stay time in the corresponding interest area information is reset to zero;
[0026] If the stay time is greater than the first time threshold, the tourist leaves the area of interest, and the stay time in the corresponding area of interest information is reduced by b per frame, and the gaze time is reduced by d per frame. When either the gaze time or the stay time is cleared, the gaze time and the stay time are cleared synchronously; where a<b, c<d.
[0027] In one embodiment, the regional behavior interest value is obtained by weighted calculation, and the specific formula is:
[0028]
[0029] Where R1 is the regional behavioral interest value, S is the stay time, G is the gaze time, N is the number of tourists, i is the unique ID of the tourist, and j is the interest area information, where w1≤W2<w3.
[0030] In one embodiment, the unique ID is also bound to the number of clicks on the corresponding area of interest information, and the method for obtaining the number of clicks includes the following steps:
[0031] Get the click coordinates and click time of the click position on the cultural wall corresponding to the area of interest;
[0032] Based on the tourist coordinates, the tourists whose distance from the clicked coordinates is less than the preset distance are obtained as target tourists;
[0033] Based on the click time, a frame image of the corresponding time is obtained, and the number of clicks corresponding to the tourists whose gaze time increases among all target tourists in the frame image is increased by 1.
[0034] In one embodiment, when a visitor leaves the corresponding interest area for more than a preset time, the number of clicks is reset to zero.
[0035] In one embodiment, the personal behavior interest value is obtained by weighted calculation, and the specific formula is:
[0036]
[0037] Where R2 is the personal behavior interest value, where w4≤W5<w6.
[0038] In one embodiment, the specific step of displaying different levels based on the regional behavioral interest value and the individual behavioral interest value further includes: when the individual behavioral interest value is greater than a second threshold, the regional behavioral interest value is less than a third threshold, and the number of clicks is zero, the cultural wall corresponding to the interest area is superimposed with a hotspot layer on the basis of the display base layer;
[0039] The personal behavior interest value is obtained through weighted calculation, and the specific formula is:
[0040]
[0041] Where R2 is the personal behavior interest value, where w4≤W5<w6.
[0042] In a second aspect, the present application provides an interactive method and system for a digital multimedia cultural wall, which adopts the following technical solutions:
[0043] An interactive system for a digital multimedia cultural wall, comprising:
[0044] Camera module, used to collect on-site video data;
[0045] The target detection module acquires real-time video data and converts it into frame images. Based on the target detection and tracking model, the frame images are detected to obtain the visitor's coordinates and unique ID.
[0046] The data processing module obtains the number of tourists located in the preset interest area, as well as the average stay time and gaze time of tourists, and calculates the regional behavioral interest value; and obtains the individual behavioral interest value through weighted calculation based on the stay time, gaze time, and number of clicks of each tourist in the interest area; and sends a display signal based on the analysis results of the regional behavioral interest value and the individual behavioral interest value;
[0047] The interactive display module performs different levels of display based on the received display signals.
[0048] In summary, this application has the following beneficial effects:
[0049] Two interest values, personal and regional, are introduced. Based on the analysis of the two interest values, different levels of display are carried out on the cultural wall to achieve interaction. BRIEF DESCRIPTION OF THE DRAWINGS
[0050] Figure 1 Schematic diagram of the interactive method of the digital multimedia cultural wall in this embodiment;
[0051] Figure 2 Schematic diagram of the structure of the interactive system of the digital multimedia cultural wall in this embodiment;
[0052] Figure 3 This is a schematic diagram of one of the methods for judging a visitor's gaze in this embodiment.
[0053] In the figure, 10 is a camera module; 20 is a target detection module; 30 is a data processing module; and 40 is an interactive display module. DETAILED DESCRIPTION
[0054] The present application is further described in detail below with reference to the accompanying drawings.
[0055] In order to more clearly understand the purpose, technical solutions and advantages of the present application, the present application is described and illustrated below in conjunction with the accompanying drawings and embodiments. However, it should be understood by those skilled in the art that the present application can be implemented without these details. In some cases, in order to avoid unnecessary descriptions that make various aspects of the present application obscure, the well-known methods, processes, systems, components and / or circuits that have been described at a higher level will not be described in detail. It is obvious to those skilled in the art that various changes can be made to the embodiments disclosed in the present application, and the general principles defined in the present application can be applied to other embodiments and application scenarios without departing from the principles and scope of the present application. Therefore, the present application is not limited to the embodiments shown, but conforms to the broadest scope consistent with the scope claimed for protection in the present application.
[0056] It should be noted that the description of these embodiments is used to help understand the present invention, but does not constitute a limitation of the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not conflict with each other.
[0057] In the description of this application, "several" means one or more, "many" means more than two, "greater than," "less than," and "exceed" are understood to exclude the number itself, while "above," "below," and "within" are understood to include the number itself. The use of "first" and "second" in the description is solely for the purpose of distinguishing technical features and should not be construed as indicating or implying relative importance, implicitly specifying the number of the indicated technical features, or implicitly specifying the order of the indicated technical features.
[0058] In the description of this application, reference to the terms "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples" means that the specific features, structures, materials, or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of this application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any combination in one or more embodiments or examples.
[0059] Refer to the attached Figure 1 , the present invention shows an interactive method of a digital multimedia cultural wall, which is applied to an interactive system, such as Figure 2 As shown, the system includes a camera module 10 , a target detection module 20 , a data processing module 30 and an interactive display module 40 .
[0060] Among them, the camera module 10 is preferably a high-definition monocular camera, multi-camera camera or depth camera, which is used to collect video data of the cultural wall in real time. At the same time, if the ambient light is insufficient, it can be equipped with an infrared fill light or an ambient light sensor to ensure the clarity of video capture.
[0061] The target detection module 20 and the data processing module 30 may be integrated into a separate processor or integrated into the interactive display module 40 .
[0062] The target detection module 20 has data transmission and reception capabilities. The camera module 10 transmits data via wired or wireless transmission, enabling the target detection module 20 to acquire real-time video data. After decoding and noise reduction, the video data is converted into frame images. Furthermore, based on a target detection and tracking model, the target detection module 20 can detect the frame images and obtain the visitor's coordinates and unique ID.
[0063] The data processing module 30 is used to calculate regional and individual behavioral interest values and, based on the analysis results, sends a display signal to the interactive display module 40. Specifically, based on a preset area of interest, the number of visitors within the area of interest, as well as their average dwell time and gaze time, are obtained, and the regional behavioral interest value is calculated through weighted calculation. The dwell time, gaze time, and number of clicks of each visitor in the area of interest are calculated and then the individual behavioral interest value is calculated.
[0064] The interactive display module 40 is preferably a display screen with a touch function, which performs different levels of display based on the received display signal.
[0065] The display screens can be arranged in multiple sections on the cultural wall, with a single display screen or a combination of multiple displays used to divide the regions of interest. Alternatively, a single display screen can be installed on the cultural wall, and regions of interest can be divided by displaying different content at different horizontal locations. After the division is achieved in this manner, the entire space within a preset range in front of the interactive display module 40 is designated as the region of interest. The region of interest is displayed as a bounding box in the frame image.
[0066] In addition, the number of ROI bounding boxes in a single frame image may vary depending on the number of cameras in the camera module 10. For example, if a separate camera is used for each ROI, only one bounding box will be present in each frame image. If a single camera is used to capture the entire cultural wall, the number of ROI bounding boxes in the frame image will be the same as the number of ROIs. Alternatively, a single camera may be used to capture multiple ROIs. If multiple ROI bounding boxes exist in a single frame image, adjacent bounding boxes must not overlap to facilitate differentiation.
[0067] like Figure 1 The interactive method of the digital multimedia cultural wall specifically includes the following steps:
[0068] S100: Acquire real-time video data and convert the video data into frame images.
[0069] S200: Based on the target detection and tracking model, the frame image is detected to obtain the visitor's coordinates and unique ID.
[0070] This step is specifically implemented by combining the target detection algorithm YOLO with the target visual tracking algorithm DeepSORT. That is, based on the target detection algorithm, the coordinates of tourists in the frame image are detected, and based on the target visual tracking algorithm, a corresponding unique ID is assigned to each tourist for distinction.
[0071] In addition, to meet the needs of subsequent data processing, this step requires converting the two-dimensional coordinates detected by the target detection algorithm into three-dimensional spatial coordinates. The specific conversion method varies depending on the camera used. Among them, a depth camera can directly obtain a depth map. That is, the depth value of the two-dimensional coordinate point directly obtained from the depth map can be converted into three-dimensional coordinates. Therefore, its implementation is relatively simple and it is used as the preferred camera module 10.
[0072] In this step, the unique ID is represented by a numerical value. Each visitor's unique ID is also unique across different AOIs. The unique ID is associated with the corresponding AOI information, along with the dwell time, gaze time, and click count. The AOI information is represented by a number, which is used to associate and distinguish the dwell time, gaze time, and click count with the corresponding AOI in subsequent calculations.
[0073] For example, an interest area numbered 1 is associated with the visitor's dwell time, gaze time, and click count when in interest area 1; an interest area numbered 2 is associated with the visitor's dwell time, gaze time, and click count when in interest area 2. Therefore, each visitor's unique ID is associated with multiple datasets consisting of interest area information, dwell time, gaze time, and click count. All dwell time, gaze time, and click count values are initially zero.
[0074] S300: Based on a preset interest area, the number of tourists located in the interest area, as well as the average stay time and gaze time of the tourists are obtained, and a regional behavior interest value is obtained through weighted calculation.
[0075] In one embodiment, the step of obtaining the number of tourists located in the area of interest specifically includes:
[0076] Step 1: The dwell time of the tourist in the AOI is incremented by a. Specifically, when the two-dimensional coordinates of a tourist are within the bounding box of the AOI, the dwell time of the AOI in the unique ID of the tourist is incremented by a. For example, if tourist A is detected in AOI numbered 1, the dwell time of AOI numbered 1 is incremented by a, while the dwell times of other AOI numbers remain unchanged.
[0077] Step 2: Based on the increase in the length of stay in the same area of interest, head posture analysis is performed to determine the gaze of the tourists. If the tourists are judged to be gazing at the cultural wall corresponding to the area of interest, the gaze time under the same area of interest information is increased by c.
[0078] In this step, algorithms such as MTCNN and YOLO are used to detect key points of the face, such as the eyes, nose tip, and mouth corners. Based on these key points, the head posture is estimated to obtain the orientation of the face, and then the angle between the face orientation and the cultural wall is calculated.
[0079] When making gaze judgments, different judgment methods can be used based on different accuracy. For example, when the accuracy requirements are relatively low, a preset angle can be set directly. When the calculated angle between the face direction and the cultural wall is less than or equal to the preset angle, it can be judged as looking at the cultural wall.
[0080] If the accuracy requirement is relatively high, refer to the attached Figure 3 As shown, the solid-line box represents the cultural wall, and the dashed-line 3D area represents the corresponding area of interest. When determining whether to gaze at the cultural wall, the 2D coordinates of the visitor's face can be used as the corresponding 2D coordinates on the cultural wall. The 2D coordinates of the visitor's face can be directly obtained from key points on the face, such as using the coordinates of the tip of the nose as the 2D coordinates of the face. In this example, point B is the 2D coordinate of the visitor's face, and point A is the corresponding 2D coordinate on the cultural wall.
[0081] The distance between the visitor and the cultural wall is then calculated based on their 3D coordinates, that is, the distance between points A and B. The location of the gaze point C on the wall is then calculated based on the angle between the visitor's face and the wall. If the gaze point is within the wall corresponding to the area of interest, the visitor is considered to be gazing at the wall.
[0082] The angle between the face and the cultural wall is divided into yaw and pitch. The yaw angle represents the angle at which the face turns left or right, while the pitch angle represents the angle at which the face is raised or lowered. To calculate the coordinates of gaze point C, the pitch distance AD and the yaw distance AE are calculated using the distance between point A and B, the yaw angle, and the pitch angle. Finally, the distances AD and AE are added to the horizontal and vertical coordinates of point A, respectively, to obtain the coordinates of gaze point C.
[0083] Step 3: The number of unique IDs located in the area of interest and with non-zero gaze time is taken as the number of tourists in the corresponding area of interest.
[0084] By using the above-mentioned method of obtaining the number of tourists, the number of tourists passing by can be effectively excluded.
[0085] Correspondingly, the specific formula for obtaining the regional behavior interest value through weighted calculation in this step is:
[0086]
[0087] Where R1 is the regional behavioral interest value, S is the stay time, G is the gaze time, N is the number of tourists, i is the unique ID of the tourist, and j is the interest area information, where w1≤W2<w3.
[0088] It should be noted that when calculating the regional behavioral interest value, only the number of tourists in the current frame image and the corresponding tourists' stay time and gaze time are calculated. That is to say, in this frame image, there are tourists who enter the interest area and gaze at the cultural wall in this frame, there are tourists who have entered the interest area before and gaze at the cultural wall in this frame image, and there are tourists who have entered the interest area before but did not gaze at the cultural wall in this frame image.
[0089] When calculating the stay time and gaze time, the stay time is subtracted by a and the gaze time is subtracted by c in order to reduce the interference of repeated counting. Because one gaze has been considered when calculating the number of tourists, the first gaze and stay increase are removed in the calculation.
[0090] In another embodiment, in view of the fact that tourists may leave the area of interest at random and go to other areas of interest, some of these tourists may still be interested in the area of interest. Therefore, in this embodiment, the stay time and gaze time after leaving are adjusted according to a time-series decay method. When such tourists return to the area after a certain period of time after leaving, the stay time and gaze time can be retained to a certain extent. The specific adjustment method is as follows:
[0091] If the stay time is less than the first time threshold, the tourist leaves the area of interest, and the stay time in the corresponding area of interest information is cleared.
[0092] If the stay time is greater than the first time threshold, the tourist leaves the area of interest, and the stay time in the corresponding area of interest information is reduced by b per frame, and the gaze time is reduced by d per frame. When either the gaze time or the stay time is cleared, the gaze time and the stay time are cleared synchronously; where a<b, c<d.
[0093] S400: Obtain the stay time, gaze time and click times of each tourist in the area of interest, and obtain the personal behavior interest value through weighted calculation.
[0094] In this step, the method for obtaining the number of clicks includes the following steps:
[0095] Step 1: Obtain the click coordinates and click time of the click position on the cultural wall corresponding to the area of interest.
[0096] In this step, the sliding behavior on the touch screen is recorded as only one click, and the click coordinates and click time are the coordinates and time when the cultural wall is first touched.
[0097] Step 2: Based on the visitor coordinates, obtain the visitors whose distance from the click coordinates is less than a preset distance as target visitors.
[0098] In this step, the preset distance is the distance that a visitor can normally click to reach the point. The visitor coordinates here refer to three-dimensional coordinates. Using the plane coordinate point (x, y) in the visitor's three-dimensional coordinates, the distance between the plane coordinate point (x, y) and the click coordinate can be calculated. This distance and the Z coordinate in the three-dimensional coordinates are then used as the side length of a right triangle. The calculated hypotenuse is the distance between the visitor coordinates and the click coordinates.
[0099] Step 3: Based on the click time, a frame image of the corresponding time is obtained, and the number of clicks corresponding to the tourists whose gaze time increases among all target tourists in the frame image is increased by 1.
[0100] Most tourists can be excluded by the distance between the tourist coordinates and the click coordinates. After further screening based on whether there is a gaze at the cultural wall in the frame image, most interference factors can be eliminated. In addition, weighted calculation is required based on the residence time and gaze time. Therefore, it is basically possible to identify tourists who are truly interested in the area of interest without the need for more refined determination methods such as arm posture evaluation. While ensuring accuracy, the computational load is effectively reduced.
[0101] Step 4: When a visitor leaves the corresponding area of interest for more than a preset time, the number of clicks is reset to zero.
[0102] The number of clicks is an indicator of high interest value in the evaluation of personal behavior interest value. In order to avoid the number of clicks being reset to zero after leaving the interest area, this embodiment retains the number of clicks for a certain period of time by means of a preset time, so that tourists with click records can more easily form a deep interaction with the cultural wall when they leave and return.
[0103] In one embodiment, the specific formula for obtaining the personal behavior interest value through weighted calculation is:
[0104]
[0105] Where R2 is the personal behavior interest value, where w4≤W5<w6.
[0106] In this formula, when the number of clicks is zero, the individual behavioral interest value is zero, which means that the prerequisite for an individual to form a deep interaction with the cultural wall is to click on the cultural wall.
[0107] S500: Display at different levels based on the regional behavior interest value and the individual behavior interest value.
[0108] Among them, the levels of content displayed on the cultural wall are the base layer, hotspot layer, click layer and interactive layer. The cultural wall displays the information of the base layer by default, where the base layer is a basic background screen display, such as text, patterns, icons, etc. The click layer is a further in-depth display after clicking the corresponding text, pattern, icon, etc. on the base layer, such as character information introduction, video dynamic introduction, detail dynamic display, etc. The hotspot layer is mainly dynamic special effects with a high overall correlation with the area of interest, such as preset cultural relics details, story clips, related historical event videos, etc., among which the content in the click layer and the hotspot layer may partially overlap, and the content in the hotspot layer is preferably pre-designed for playback order based on the correlation with the area of interest. The interactive layer is the related content between multiple areas of interest, including dynamic interactive videos such as historical dialogues and fights.
[0109] In this step, the specific steps for displaying different levels based on the regional behavior interest value and the individual behavior interest value include:
[0110] When the regional behavioral interest value is greater than the first threshold, the cultural wall corresponding to the interest area superimposes a hotspot layer on the basis of displaying the baseline layer.
[0111] When the individual behavior interest value is greater than the second threshold and the regional behavior interest value is less than the third threshold, based on the click situation, the cultural wall corresponding to the interest area superimposes the click layer on the basis of the display baseline layer; wherein the third threshold is less than the first threshold.
[0112] When there are multiple interest areas superimposed with hotspot layers or click layers, it is determined whether the displays corresponding to the multiple interest areas are related. If so, the cultural wall corresponding to the interest area is superimposed with an interactive layer on the basis of the display base layer.
[0113] Through the above steps, the regional behavioral interest value is used to reflect the interest of all visitors in the area of interest in the cultural wall content displayed in that area, while the individual behavioral interest value is used to reflect the interest of a single visitor in the area of interest in the cultural wall content displayed in that area. Finally, based on the regional and individual behavioral interest values, the user can choose whether to overlay the hotspot layer or the click layer on the base layer, thus achieving a balance between individual and multi-person interaction. Furthermore, when initiating deep interactions based on multiple interest areas, if there are connections between the interest areas, the interactive layer is prioritized to achieve interaction between multiple interest areas and enhance visitor engagement.
[0114] In another embodiment, when there are no clicks, the personal behavior interest value may also be greater than the second threshold. Specifically, the specific steps of displaying different levels based on the regional behavior interest value and the personal behavior interest value also include: when the personal behavior interest value is greater than the second threshold, the regional behavior interest value is less than the third threshold, and the number of clicks is zero, the cultural wall corresponding to the interest area is superimposed with a hotspot layer on top of the display base layer.
[0115] The personal behavior interest value is obtained through weighted calculation. The specific formula is:
[0116]
[0117] Where R2 is the personal behavior interest value, where w4≤W5<w6.
[0118] The embodiments of this specific implementation method are all preferred embodiments of the present application and are not intended to limit the scope of protection of the present application. Therefore, any equivalent changes made based on the structure, shape, and principle of the present application should be included in the scope of protection of the present application.
Claims
1. An interactive method for a digital multimedia cultural wall, characterized by The following steps are involved: Acquire real-time video data and convert it into frame images; Based on the target detection and tracking model, the frame image is detected to obtain the visitor's coordinates and unique ID; Based on the preset interest area, the number of tourists in the interest area, as well as the average stay time and gaze time of tourists are obtained, and the regional behavioral interest value is obtained through weighted calculation; Obtain the stay time, gaze time and click times of each tourist in the area of interest, and obtain the individual behavior interest value through weighted calculation; Based on regional behavioral interest values and personal behavioral interest values, different levels of display are performed; The levels of content displayed on the cultural wall are the baseline level, the hotspot level, and the click level. The specific steps for displaying different levels based on the regional behavior interest value and the individual behavior interest value include: When the regional behavioral interest value is greater than the first threshold, the cultural wall corresponding to the interest area superimposes the hotspot layer on the basis of the display baseline layer; When the individual behavior interest value is greater than the second threshold and the regional behavior interest value is less than the third threshold, based on the click situation, the cultural wall corresponding to the interest area superimposes the click layer on the basis of the display baseline layer; wherein, the third threshold is less than the first threshold.
2. The interactive method of digital multimedia cultural wall according to claim 1, characterized in that: The cultural wall display content also includes an interactive layer. The specific steps of displaying different levels based on the regional behavior interest value and the individual behavior interest value also include: When there are multiple interest areas superimposed with hotspot layers or click layers, it is determined whether the displays corresponding to the multiple interest areas are related. If so, the cultural wall corresponding to the interest area is superimposed with an interactive layer on the basis of the display base layer.
3. The interactive method of digital multimedia cultural wall according to claim 1, characterized in that: The unique ID is bound with the area of interest information and the stay time and gaze time corresponding to the area of interest information. The step of obtaining the number of tourists located in the area of interest specifically includes: The stay time of tourists in the interest area corresponding to the interest area information plus a; Based on the head posture analysis of tourists who spend more time in the same area of interest, the gaze of the tourists is judged. If it is judged that they are looking at the cultural wall corresponding to the area of interest, the gaze time under the same area of interest information is increased by c; The number of unique IDs located in the area of interest and with non-zero gaze time is taken as the number of tourists in the corresponding area of interest.
4. The interactive method of digital multimedia cultural wall according to claim 3 is characterized by: If the stay time is less than the first time threshold, the tourist leaves the area of interest, and the stay time in the corresponding area of interest information is reset; If the stay time is greater than the first time threshold, the tourist leaves the area of interest, and the stay time in the corresponding area of interest information is reduced by b per frame, and the gaze time is reduced by d per frame. When either the gaze time or the stay time is cleared, the gaze time and the stay time are cleared synchronously; where a<b, c<d.
5. The interactive method of digital multimedia cultural wall according to claim 1, characterized in that: The specific formula for obtaining the regional behavior interest value through weighted calculation is: Where R1 is the regional behavioral interest value, S is the stay time, G is the gaze time, N is the number of tourists, i is the unique ID of the tourist, and j is the interest area information, where w1≤W2<w3.
6. The interactive method of digital multimedia cultural wall according to claim 1, characterized in that: The unique ID is also bound to the number of clicks on the corresponding area of interest information. The method for obtaining the number of clicks includes the following steps: Get the click coordinates and click time of the click position on the cultural wall corresponding to the area of interest; Based on the tourist coordinates, the tourists whose distance from the clicked coordinates is less than the preset distance are obtained as target tourists; Based on the click time, a frame image of the corresponding time is obtained, and the number of clicks corresponding to the tourists whose gaze time increases among all target tourists in the frame image is increased by 1.
7. The interactive method of digital multimedia cultural wall according to claim 6 is characterized by: When a visitor leaves the corresponding area of interest for more than the preset time, the number of clicks is reset to zero.
8. The interactive method of digital multimedia cultural wall according to claim 1, 6 or 7, characterized in that: The specific formula for obtaining the personal behavior interest value through weighted calculation is: Where R2 is the personal behavior interest value, where w4≤W5<w6.
9. The interactive method of digital multimedia cultural wall according to claim 1, 6 or 7, characterized in that: The specific steps of displaying different levels based on the regional behavioral interest value and the individual behavioral interest value further include: when the individual behavioral interest value is greater than a second threshold, the regional behavioral interest value is less than a third threshold, and the number of clicks is zero, the cultural wall corresponding to the interest area is superimposed with a hotspot layer on the basis of the display base layer; The personal behavior interest value is obtained through weighted calculation, and the specific formula is: Where R2 is the personal behavior interest value, where w4≤W5<w6.
10. An interactive system for a digital multimedia cultural wall, characterized in that: include: A camera module (10) is used to collect on-site video data; The target detection module (20) acquires real-time video data and converts the video data into frame images; and based on the target detection and tracking model, detects the frame images to obtain the coordinates and unique ID of the visitor; The data processing module (30) obtains the number of tourists located in the interest area, as well as the average stay time and gaze time of tourists based on the preset interest area, and calculates the regional behavior interest value; and obtains the individual behavior interest value through weighted calculation based on the stay time, gaze time, and number of clicks of each tourist in the interest area; and sends a display signal based on the analysis results of the regional behavior interest value and the individual behavior interest value; The interactive display module (40) performs different levels of display based on the received display signal.