Intelligent control method and device for multifunctional projection equipment

Abstract

This application provides an intelligent control method and device for a multi-functional projection device, belonging to the field of projection control. The method includes: acquiring personnel flow information, personnel distribution information, and personnel trajectory information of a target area; dividing the personnel flow information into multiple target personnel flow information based on the personnel flow information; each target personnel flow information corresponds one-to-one with a target sub-area; each target sub-area is an area within the target area that is at a different distance from the target multi-functional projection device; dividing the personnel trajectory information into multiple target personnel trajectory information based on the personnel flow information; each target personnel trajectory information corresponds one-to-one with a target sub-area; determining a target projection control strategy based on the multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information; and controlling the target multi-functional projection device to perform projection display based on the target projection control strategy. This application can improve the adaptability of information projection by the projection device.

Description

Technical Field

[0001] This application belongs to the field of screen projection control technology, and more specifically, relates to an intelligent control method and device for a multifunctional screen projection device. Background Technology

[0002] With the rapid development of intelligent display technology, projection devices have been widely used in scenarios requiring precise information delivery, such as shopping malls, conference rooms, and exhibition halls. Currently, the control methods for projection devices mainly rely on preset time strategies, fixed content polling, or trigger-based control based on simple sensors. These methods are gradually showing limitations in complex and dynamic scenarios with varying levels of human activity, resulting in low adaptability of the projected information to the people in the projection area and poor information delivery effectiveness.

[0003] Therefore, a smart control method for multifunctional projection devices is needed. Summary of the Invention

[0004] The purpose of this application is to provide an intelligent control method and device for a multi-functional projection device, so as to determine the intelligent control strategy of the multi-functional projection device by analyzing personnel information.

[0005] A first aspect of this application provides an intelligent control method for a multifunctional screen projection device, comprising:

[0006] Acquire information on pedestrian traffic, pedestrian distribution, and pedestrian trajectory in the target area; the target area is the information projection area corresponding to the target multi-functional projection device.

[0007] Based on the personnel flow information, the personnel flow information is divided into multiple target personnel flow information; each target personnel flow information corresponds one-to-one with a target sub-region; each target sub-region is a region within the target area that is at a different distance from the target multi-functional projection device; based on the personnel flow information, the personnel trajectory information is divided into multiple target personnel trajectory information; each target personnel trajectory information corresponds one-to-one with a target sub-region.

[0008] The target projection control strategy is determined based on multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information; the target multi-functional projection device is controlled to perform projection display based on the target projection control strategy.

[0009] A second aspect of this application provides an intelligent control device for a multi-functional projection device, comprising: an information acquisition module for acquiring personnel flow information, personnel distribution information, and personnel trajectory information of a target area; the target area is the information projection area corresponding to the target multi-functional projection device.

[0010] The information segmentation module is used to divide the personnel flow information into multiple target personnel flow information based on the personnel flow information; each target personnel flow information corresponds one-to-one with a target sub-region; each target sub-region is a region within the target area that is at a different distance from the target multi-functional projection device; the module also divides the personnel trajectory information into multiple target personnel trajectory information based on the personnel flow information; each target personnel trajectory information corresponds one-to-one with a target sub-region.

[0011] The projection control module is used to determine the target projection control strategy based on multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information; and to control the target multi-functional projection device to perform projection display based on the target projection control strategy.

[0012] A third aspect of this application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes the computer program to implement the steps of the intelligent control method for the multifunctional projection device described above.

[0013] In a fourth aspect of this application, a computer-readable storage medium is provided, which stores a computer program that, when executed by a processor, implements the steps of the intelligent control method for the multifunctional projection device described above.

[0014] A fifth aspect of this application provides a computer program product, including a computer program or computer-executable instructions, wherein when the computer program or computer-executable instructions are executed by a processor, the steps of the intelligent control method for the above-described multifunctional projection device are implemented.

[0015] The beneficial effects of the intelligent control method and device for the multifunctional screen projection device provided in this application are as follows:

[0016] This application embodiment divides the personnel flow information into multiple target personnel flow information according to the target sub-regions (areas in the target region that are at different distances from the target multi-functional projection device). At the same time, the personnel trajectory information is also divided into multiple target personnel trajectory information according to the target sub-regions. Combined with the personnel distribution information, the projection control strategy is determined. This can comprehensively consider the personnel situation in different sub-regions, formulate more targeted projection strategies, make the projection content more in line with the personnel information characteristics of the projection area, and thus enhance the information projection effect. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 A flowchart illustrating the intelligent control method for a multifunctional projection device provided in an embodiment of this application;

[0019] Figure 2 A structural block diagram of the intelligent control device for a multifunctional projection device provided in an embodiment of this application;

[0020] Figure 3 This is a schematic block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0021] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0022] To make the objectives, technical solutions, and advantages of this application clearer, the following description will be provided in conjunction with the accompanying drawings and specific embodiments.

[0023] Please refer to Figure 1 , Figure 1 This is a flowchart illustrating an intelligent control method for a multifunctional projection device provided in an embodiment of this application. The method can be executed by an electronic device and may include steps S101-S103.

[0024] S101: Obtain information on pedestrian traffic, pedestrian distribution, and pedestrian trajectory in the target area; the target area is the information projection area corresponding to the target multi-functional projection device.

[0025] In this embodiment, the target area can be the effective viewing space physically covered by multiple projection devices, and its boundaries can be determined by the device's display viewing angle and distance threshold. The method for acquiring personnel information in the target area can be camera-based visual acquisition, specifically by deploying high-definition cameras and processing the video stream using computer vision algorithms.

[0026] For example, when acquiring traffic flow information, object detection algorithms are used to identify human body contours in the image to count the number of people in real time, and then combined with time-series analysis such as sliding windows to calculate the difference between inflow and outflow. When acquiring distribution information, the image is divided into grids of equal size, and the proportion of people in each grid is counted to generate a heat map. At the same time, perspective transformation is used to correct distortion in the image processing to achieve matching with physical space coordinates. When acquiring trajectory information, multi-object tracking algorithms are used to associate the positions of the same human body in different frames to generate a motion path, and parameters such as trajectory start / end point and dwell time are calculated.

[0027] In this embodiment, obtaining personnel information in the target area can also be achieved using an infrared array sensor as an auxiliary means. The infrared array sensor detects the infrared radiation emitted by the human body, identifies whether there are personnel in the area, and outputs the approximate distribution density of personnel based on the differences in infrared signal intensity of each point array of the sensor.

[0028] S102: Based on the personnel flow information, divide the personnel flow information into multiple target personnel flow information; each target personnel flow information corresponds one-to-one with a target sub-region; each target sub-region is a region in the target area that is at a different distance from the target multi-functional projection device; based on the personnel flow information, divide the personnel trajectory information into multiple target personnel trajectory information; each target personnel trajectory information corresponds one-to-one with a target sub-region.

[0029] In this embodiment, the target personnel flow information can be independent personnel flow data for each sub-area, which may include: real-time number of people in the sub-area, i.e., the total number of people in the area at the current moment; number of people entering and leaving the area per unit time, i.e. the number of people entering and leaving the area within a set period; peak flow, i.e. the maximum number of people appearing in the area within a certain period of time; and peak flow duration, i.e. the length of time the peak state is maintained.

[0030] In this embodiment, the target personnel trajectory information can be detailed data on the movement status of personnel in each sub-region, which may include: the number of trajectories in the sub-region, i.e., the total number of independent movement paths of all personnel in the region; trajectory start / end attribute, which clarifies whether the start and end positions of each trajectory are in the current sub-region; average movement speed, which is calculated from the movement distance and time of all trajectories in the region; and the proportion of trajectories pointing to the projection device, i.e., the percentage of trajectories whose endpoints face the projection device out of the total number of trajectories in the region.

[0031] In this embodiment, the trajectory information of the target person can be predicted by capturing the short-term time dependence of the trajectory based on a convolutional neural network. A lightweight model can be trained using the most recent real-time trajectory fragments to output the trajectory coordinates for the next 1-2 minutes in real time.

[0032] In this embodiment, the target sub-region can be divided into three annular regions—near, middle, and far—centered on the physical installation location of the projection device and according to a preset distance gradient. The boundaries of each region are clearly defined by a distance threshold, and the annular boundaries need to be adapted and corrected by taking into account the coordinates of obstacles (such as walls and pillars) in the physical space during the division, to ensure that each sub-region is a valid space that can actually be viewed.

[0033] In this embodiment, the target personnel flow information can be divided by first collecting real-time coordinate data of personnel in the target area using a camera, calculating the straight-line distance between the coordinates of each person and the center coordinates of the projection device, and matching the personnel to the corresponding sub-area; then counting the real-time number of personnel in each sub-area, and introducing a sliding window algorithm to continuously calculate the difference between the number of people entering and leaving each sub-area within the window period, and finally obtaining independent and dynamically updated flow data for each sub-area.

[0034] In this embodiment, the target personnel trajectory information can be divided as follows: First, based on the previous multi-target tracking algorithm, the camera video stream is processed to generate a complete motion trajectory of each person from entering to leaving the target area. This trajectory includes continuous timestamps and corresponding spatial coordinate data. Next, each complete trajectory is segmented according to the coordinate boundaries of each sub-region. Finally, for the sub-trajectories in each sub-region after splitting, the trajectory parameters specific to that region are counted one by one.

[0035] S103: Determine the target projection control strategy based on multiple target personnel flow information, multiple target personnel trajectory information and personnel distribution information; control the target multi-functional projection device to perform projection display based on the target projection control strategy.

[0036] In this embodiment, the personnel distribution information may include the personnel density of each sub-region, which is calculated by dividing the total number of people in the region by the area, thus determining the number of people per square meter and visually reflecting the degree of congestion. The personnel distribution information may also include the coordinates of the distribution heat map center, which uses clustering algorithms to locate the spatial coordinates of the most densely populated area, clearly identifying the core location of congestion.

[0037] In this embodiment, the target projection control strategy can be a projection scheme adapted to each sub-region, and the parameters can include content selection or playback mode.

[0038] For example, people in the nearby area are close to the screen and can clearly capture details, so videos with close-ups of products and multiple frames are prioritized; people in the distant area have limited visual clarity, so concise text and images with strong color contrast are displayed. The playback mode is combined with traffic characteristics: people in the nearby area have fast turnover and short stays, so 15-30 second loop playback is used; people in the middle area have stable traffic and longer stays, so complete content can be played in one go.

[0039] In this embodiment, controlling the multi-functional screen projection device to perform screen projection display can be achieved through the following process: First, the screen projection control strategy is converted into standardized instructions that the device can recognize; then, the instructions are sent to the control motherboard of the screen projection device through a local area network protocol or a device-specific interface; next, the device control module receives the instructions, parses them, drives the hardware to execute them, and calls the storage module to load the target content; finally, the device sends back the execution status in real time, and if an abnormality is detected, a retry mechanism is triggered.

[0040] As can be seen from the above, the embodiments of this application divide the personnel flow information into multiple target personnel flow information according to the target sub-regions (areas in the target region that are at different distances from the target multi-functional projection device), and also divide the personnel trajectory information into multiple target personnel trajectory information according to the target sub-regions. Combined with the personnel distribution information, the projection control strategy is determined. This can comprehensively consider the personnel situation in different sub-regions, formulate more targeted projection strategies, make the projection content more in line with the personnel information characteristics of the projection area, and thus enhance the information projection effect.

[0041] In one embodiment of this application, a target projection control strategy is determined based on multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information, including:

[0042] The first screen projection control strategy is determined based on multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information.

[0043] The target projection control strategy is determined based on multiple target personnel flow information, multiple target personnel trajectory information, personnel distribution information, and the first projection control strategy.

[0044] In this embodiment, determining the first projection control strategy based on multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information may include:

[0045] For each target personnel flow information, determine the relative flow density of the target sub-region corresponding to that target personnel flow information; the relative flow density is the ratio of the number of people in the target sub-region to the maximum personnel capacity of the target sub-region.

[0046] For each target person's trajectory information, determine the trajectory endpoint pointing rate of the target sub-region corresponding to that target person's trajectory information; the trajectory endpoint pointing rate is the ratio of the number of trajectories in the target sub-region whose trajectory endpoint is the target multi-functional projection device to the total number of trajectories in the target sub-region;

[0047] The personnel distribution center is determined based on the personnel distribution information, and the target distance is determined based on the personnel distribution center; the target distance is the distance between the personnel distribution center and the target multi-functional projection device.

[0048] The first projection control strategy is determined based on the relative traffic density of each target sub-region, the trajectory endpoint pointing rate of each target sub-region, and the target distance.

[0049] In this embodiment, the first projection control strategy can obtain a video library containing different versions of the same type of video through personnel density information. The target projection control strategy can establish the correspondence between the analysis results of multiple target personnel information and different versions of video through a data matching algorithm based on multiple target personnel information and the first projection control strategy.

[0050] In this embodiment, the maximum personnel capacity can be the maximum reasonable number of people that can be accommodated within a specific space, calculated based on preset standards (such as comfortable activity space per person, safety evacuation requirements, etc.). Relative flow density can be used to reflect the congestion level of a sub-area. Relative flow density can be calculated by dividing the real-time number of people in the current sub-area by the maximum personnel capacity of the current sub-area. The trajectory endpoint pointing rate can be used to reflect the attention tendency of people in the sub-area towards the projection device. The trajectory endpoint pointing rate can be calculated by first counting the number of trajectories whose endpoints directly point to the target multi-functional projection device from the target personnel trajectory information in the area; then counting the total number of all personnel movement trajectories in the area; finally, dividing the number of trajectories whose endpoints point to the projection device by the total number of trajectories in the sub-area yields the trajectory endpoint pointing rate for that area.

[0051] In this embodiment, the personnel distribution center can be determined using a spatial clustering algorithm. First, real-time coordinate data of all personnel within the target sub-region is extracted. A spatial clustering algorithm is then used to aggregate and analyze these coordinate points, identifying the core area with the highest personnel density. Then, the geometric center point of all personnel coordinates within this core area is determined by calculating the average coordinates, thus identifying the personnel distribution center. The target distance can be determined as the straight-line distance between the personnel distribution center and the center coordinates of the circle where the target multi-functional projection device is installed.

[0052] In one embodiment of this application, a first projection control strategy is determined based on the relative traffic density of each target sub-region, the trajectory endpoint pointing rate of each target sub-region, and the target distance, including:

[0053] The first projection control strategy is determined based on the relative traffic density of each target sub-region, the trajectory endpoint pointing rate of each target sub-region, and the target distance; the average dwell time is the ratio of the dwell time of a person in the target sub-region to the total number of people in the target sub-region.

[0054] In this embodiment, the average dwell time can be used as an indicator to quantify the viewing time window of people in a sub-area. The average dwell time can be calculated by dividing the total dwell time of each trajectory in the sub-area by the total number of people.

[0055] In this embodiment, parameters of different dimensions can be uniformly quantized to the [0,1] interval to eliminate differences in magnitude. The specific normalization process will not be described in detail in this embodiment. In this embodiment, it is also considered that the distance between different target sub-regions and the target multi-functional projection device is different. Therefore, the influence weights on the first projection control strategy should be different. Thus, each target sub-region can be assigned a weight according to its distance. The closer the distance, the greater the weight in the weighted calculation.

[0056] In this embodiment, the personnel density score can be calculated by combining the normalized parameters. The higher the personnel density score, the shorter the length and playback duration of the videos in the target video library determined by the first projection control strategy. This involves weighting the relative traffic density of each target sub-region, the trajectory endpoint pointing rate of each target sub-region, the average dwell time of each target sub-region, and the target distance. In the weighted calculation, the weight corresponding to the relative traffic density of each target sub-region can be set to a relatively large value, such as 50%. The weights corresponding to the trajectory endpoint pointing rate, the average dwell time, and the target distance of each target sub-region can be evenly distributed. The finally calculated personnel density score can be used to select a target video library from multiple stored standard video libraries using a preset mapping table. Each standard video library contains different versions of videos, but all have the same duration. The purpose of the first projection control strategy is to select a target video library from multiple standard video libraries. When there are many people in the area, and the density is high, short videos with high information density can be played. If long videos are played, users will leave before they see the core information, resulting in information transmission failure. Short, fast-paced videos can condense core content (such as product selling points and event information) in a short time, making them easier to capture quickly. This makes the screen projection content more compatible with the real-time characteristics of the crowd, maximizing information transmission efficiency and user acceptance.

[0057] It should be noted that during the weighted calculation process, both the average stay duration and the target distance are negatively correlated with the final personnel density score. Therefore, they can be standardized into positively correlated parameters. In this embodiment, the standardization of the average stay duration is taken as an example, and Tnorm is defined as 1 - (average stay duration / Tmax), where Tmax is the preset maximum effective stay duration, such as 10 minutes.

[0058] As can be seen from the above, this application's embodiment first normalizes relative traffic density, trajectory endpoint pointing rate, average dwell time, and target distance; simultaneously, it assigns weights based on distance, allowing closer sub-regions with better viewing conditions to have a greater impact on the strategy, aligning with the needs of actual viewing scenarios. Secondly, the weighted calculation emphasizes relative traffic density while reasonably allocating weights to other parameters, and standardizes the two negatively correlated parameters, average dwell time and target distance, into positively correlated parameters to ensure accurate calculation logic. The resulting personnel density score comprehensively reflects the personnel gathering degree, attention tendency, and dwell characteristics of the sub-region. Finally, the target video library is selected by combining the score with a preset mapping table. When personnel density is high, short-duration, high-information-density video libraries are prioritized to avoid information transmission failure due to rapid personnel departure in long videos, while short videos can quickly condense core content and accurately match personnel flow and dwell status.

[0059] In one embodiment of this application, the first screen casting control strategy includes: a target video library; the target video library contains different versions of the same type of video; the selling points of different versions of the video are different; the selling point is a certain moment in the total playback time of the video; the target screen casting control strategy includes: a target version of the video;

[0060] Based on multiple target personnel flow information, multiple target personnel trajectory information, personnel distribution information, and the first projection control strategy, the target projection control strategy is determined, including:

[0061] The target time is determined based on multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information; the target time is the moment when the personnel flow in the first target sub-region reaches its maximum; the first target sub-region is the area in each target sub-region that is closest to the target multi-functional projection device.

[0062] The target version of the video is determined from the target video library based on the target time. The target version of the video is the version whose selling point time deviates the least from the target time among the different versions of the video.

[0063] In this embodiment, the target video library may include at least one of the following: a uniquely identified video version ID, the total playback duration of each video version, or the key selling points of each video version. Key selling points may include crucial moments in the video that convey core information (such as product discounts or feature highlights). These key selling points are preset by relevant personnel based on experience; in this embodiment, only the specific moment corresponding to the key selling point of each video within its playback duration is stored.

[0064] In this embodiment, the first target sub-region can be the closest region selected from all target sub-regions based on the target distance between the sub-region and the target multi-functional projection device. The target time can be the time when the flow of people in the first target sub-region reaches its peak, and can include a specific timestamp. The target time can be obtained by reasoning and prediction based on multiple target flow of people information, multiple target trajectory information, and people distribution information.

[0065] In this embodiment, the target version video can be obtained by: firstly extracting the selling point moments corresponding to each video version from the target video library, then calculating the absolute deviation between the selling point moment of each version and the target moment, and finally selecting the version with the smallest deviation as the target version video.

[0066] As can be seen from the above, the embodiments of this application improve the accuracy of screen projection content delivery by setting the determination logic of the first screen projection control strategy and the target screen projection control strategy. A target video library containing different selling point versions of the same type of video is constructed to provide a resource foundation for differentiated delivery. Then, focusing on the first target sub-area closest to the screen projection device and with the best viewing conditions, and combining the personnel flow, trajectory, and distribution information of this area and other sub-areas, the target time with the largest personnel flow is accurately located. Subsequently, by calculating the deviation between the selling point time and the target time of each video version, the target version video with the smallest deviation is selected, ensuring that the core information of the video is accurately presented at the time when the personnel are most concentrated. This avoids information waste caused by the mismatch between the selling point time and the peak personnel flow, ensuring the efficiency of core information delivery and the audience reception effect.

[0067] In one embodiment of this application, determining the target time based on multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information includes:

[0068] Based on multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information, determine the flow time series of personnel flow in the first target sub-area within a preset time range.

[0069] Multiple candidate peak traffic times are determined based on traffic time series. The candidate peak traffic times are the times when the population flow value in the traffic time series is greater than the preset traffic threshold.

[0070] For each candidate peak traffic moment, based on the target personnel trajectory information corresponding to the first target sub-region, determine the average dwell time change rate of personnel in the first target sub-region at that moment; the average dwell time change rate is the ratio of the change in average dwell time within a preset time before and after that moment to the preset time.

[0071] Based on personnel distribution information, the personnel distribution concentration of the first target sub-region at each candidate traffic peak time is determined; the personnel distribution concentration is a quantitative value of the density of personnel distribution in the first target sub-region at that time.

[0072] The target time is determined based on the population flow values ​​at multiple candidate peak times, the corresponding average dwell time change rate, and the population distribution concentration.

[0073] In this embodiment, the traffic flow time series can be a dynamic data curve showing the continuous change of personnel flow in the first target sub-area over a preset time range. The dynamic curve can be obtained by setting a specific preset time range, and then using devices such as cameras or sensors to collect the number of people in the first target sub-area in real time at a sampling frequency of once per second; finally, the processed data is mapped to a continuous time axis (x-axis) and the corresponding traffic flow value (y-axis).

[0074] In this embodiment, the preset traffic threshold can be determined to have different values ​​depending on whether it is during a peak period. For example, during the preset weekday morning peak period (7:00-9:00), when there is frequent pedestrian flow in the first target sub-area, the preset traffic threshold can be increased by a first step, which can be determined based on experience; during the preset off-peak period, when the overall pedestrian flow is lower, the preset traffic threshold can be decreased by a second step, which can also be determined based on experience.

[0075] In this embodiment, the rate of change of average dwell time can be calculated by dividing the average dwell time of the first target sub-region obtained from the predicted trajectory information within a preset time before and after the traffic peak by the preset total time.

[0076] In this embodiment, the concentration of personnel distribution can be obtained by using a clustering algorithm to obtain the cluster center of the personnel location information of the first target sub-region, and then by calculating the straight-line distance from the cluster center to the projection device.

[0077] In this embodiment, the target time can be calculated by weighting the personnel flow values, corresponding average dwell time change rate, and personnel distribution concentration of multiple candidate peak traffic times. For example, multiple candidate peak traffic times are first selected from the personnel flow information of the first target sub-region. Then, three core indicators are matched for each candidate time and assigned different weights. Among them, the personnel flow value has a higher weight, the average dwell time change rate has a lower weight, and the personnel distribution concentration weight is adapted to the scenario requirements. At the same time, these three indicators are normalized to eliminate the difference in units. Then, the comprehensive score of each candidate time is calculated through a preset weighting formula, and finally the candidate time with the highest score is selected as the target time.

[0078] As can be seen from the above, this application first generates a traffic time series based on the personnel flow, trajectory, and distribution information of the first target sub-region, intuitively presenting the dynamic changes of personnel flow over time; then, it flexibly adjusts the preset traffic threshold to filter candidate peak times based on time period characteristics; simultaneously, for each candidate time, it quantifies the stability of personnel stay by the rate of change of average stay duration, and calculates the concentration of personnel distribution using clustering algorithms and distance calculations; finally, it integrates the three indicators through weighted calculation, and after normalization to eliminate differences in dimensions, it allocates weights according to the needs of the scenario, ultimately selecting the time with the highest score as the target time. This method of weight allocation and strengthening core needs ensures that the target time has a high degree of personnel concentration, while also taking into account the stability of personnel stay and the concentration of distribution.

[0079] In one embodiment of this application, in response to the fact that no people have appeared within a preset standby time period as indicated by the personnel flow information, the target multi-functional projection device is controlled to enter standby mode.

[0080] In this embodiment, the preset standby time can be the threshold time for triggering device standby. The parameter is the specific duration, which can be configured according to the scenario (e.g., 5 minutes during peak hours in shopping malls, and 15 minutes at night).

[0081] In this embodiment, the process of controlling the multi-functional projection device to go into standby mode can be as follows: First, configure a preset standby time and traffic detection cycle. Then, start the device's camera or sensor to detect and collect personnel traffic information in the information projection area according to the set cycle. Each time, count the real-time number of people and the number of people entering and leaving and determine whether both are 0. If the number of people and the number of people entering and leaving are both 0 for the first time, start the timer. It is necessary to ensure that all detection cycles during the timer meet the state of no people. After the cumulative time reaches the preset standby time, generate a standby control command and send it to the projection device. The command includes turning off the screen backlight to the lowest brightness, cutting off the audio output, and pausing the content playback. At the same time, only the traffic detection module is kept running to monitor the return of people in real time. Once personnel traffic information is detected indicating the presence of people, the standby is immediately lifted and the device is restored to normal projection mode.

[0082] As can be seen from the above, the preset standby time of this application can be dynamically configured according to the scenario to adapt to the personnel flow characteristics at different times; and the standby control process first collects traffic information according to the set period and determines whether there are no people. Only after the continuous detection period meets the requirement of no people and the cumulative time reaches the standard will standby be triggered, reducing frequent start and stop caused by short periods of no people. At the same time, only the traffic detection module is kept running during standby, which reduces energy consumption by turning off the screen backlight and cutting off the audio, and can immediately resume screen projection when people return, improving the economy and practicality of the device operation.

[0083] In this embodiment, the multi-functional projection device can not only project images according to the target control strategy, but also be applied to various scenarios such as advertising display, cafeteria menu display, meeting guidance, and visitor guidance at the gate. For example, when applied to a cafeteria scenario, the multi-functional projection device can automatically switch to menu display mode according to the time period, supporting carousel display and linkage with the ordering system.

[0084] In this embodiment, the multi-functional projection device can have a unified management platform, enabling remote adjustment of projection parameters and synchronous content updates without on-site operation by staff. The multi-functional projection device can also have built-in network outage protection and local caching to ensure normal content display even in the event of network failure.

[0085] Corresponding to the intelligent control method of the multi-functional projection device in the above embodiment, Figure 2 This is a structural block diagram of the intelligent control device for a multifunctional projection device provided in one embodiment of this application. For ease of explanation, only the parts relevant to the embodiment of this application are shown. (Reference) Figure 2 The intelligent control device 20 of the multi-functional projection device includes: an information acquisition module 21, an information division module 22, and a projection control module 23.

[0086] Among them, the information collection module 21 is used to acquire personnel flow information, personnel distribution information and personnel trajectory information in the target area; the target area is the information projection area corresponding to the target multi-functional projection device;

[0087] Information segmentation module 22 is used to divide the personnel flow information into multiple target personnel flow information based on the personnel flow information; the target personnel flow information corresponds one-to-one with the target sub-region; the target sub-region is the area in the target region that is at a different distance from the target multi-functional projection device; personnel trajectory information is divided into multiple target personnel trajectory information based on the personnel flow information; the target personnel trajectory information corresponds one-to-one with the target sub-region.

[0088] The projection control module 23 is used to determine the target projection control strategy based on multiple target personnel flow information, multiple target personnel trajectory information and personnel distribution information; and to control the target multi-functional projection device to perform projection display based on the target projection control strategy.

[0089] In one embodiment of this application, the projection control module 23 is specifically used to determine a first projection control strategy based on multiple target personnel flow information, multiple target personnel trajectory information and personnel distribution information;

[0090] The target projection control strategy is determined based on multiple target personnel flow information, multiple target personnel trajectory information, personnel distribution information, and the first projection control strategy.

[0091] In one embodiment of this application, the projection control module 23 is further configured to determine the relative flow density of the target sub-area corresponding to each target personnel flow information; the relative flow density is the ratio of the number of people in the target sub-area to the maximum personnel capacity of the target sub-area;

[0092] For each target person's trajectory information, determine the trajectory endpoint pointing rate of the target sub-region corresponding to that target person's trajectory information; the trajectory endpoint pointing rate is the ratio of the number of trajectories in the target sub-region whose trajectory endpoint is the target multi-functional projection device to the total number of trajectories in the target sub-region;

[0093] The personnel distribution center is determined based on the personnel distribution information, and the target distance is determined based on the personnel distribution center; the target distance is the distance between the personnel distribution center and the target multi-functional projection device.

[0094] The first projection control strategy is determined based on the relative traffic density of each target sub-region, the trajectory endpoint pointing rate of each target sub-region, and the target distance.

[0095] In one embodiment of this application, the projection control module 23 is further configured to determine a first projection control strategy based on the relative traffic density of each target sub-region, the trajectory endpoint pointing rate of each target sub-region, the average dwell time of each target sub-region, and the target distance; the average dwell time is the ratio of the dwell time of a person in the target sub-region to the total number of people in the target sub-region.

[0096] In one embodiment of this application, the first screen casting control strategy includes: a target video library; the target video library contains different versions of the same type of video; the different versions of the video correspond to different purchase points; the purchase point is a certain moment in the total playback time of the video; the target screen casting control strategy includes: a target version of the video;

[0097] The projection control module 23 is further used to determine the target time based on multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information; the target time is the time when the personnel flow in the first target sub-region reaches its maximum; the first target sub-region is the area in each target sub-region that is closest to the target multi-functional projection device;

[0098] The target version of the video is determined from the target video library based on the target time. The target version of the video is the version whose buying point time deviates the least from the target time among all different versions of the video.

[0099] In one embodiment of this application, the projection control module 23 is further configured to determine the flow time series of the first target sub-area within a preset time range based on multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information;

[0100] Multiple candidate peak traffic times are determined based on traffic time series. The candidate peak traffic times are the times when the population flow value in the traffic time series is greater than the preset traffic threshold.

[0101] For each candidate peak traffic moment, based on the target personnel trajectory information corresponding to the first target sub-region, determine the average dwell time change rate of personnel in the first target sub-region at that moment; the average dwell time change rate is the ratio of the change in average dwell time within a preset time before and after that moment to the preset time.

[0102] Based on personnel distribution information, the personnel distribution concentration of the first target sub-region at each candidate traffic peak time is determined; the personnel distribution concentration is a quantitative value of the density of personnel distribution in the first target sub-region at that time.

[0103] The target time is determined based on the population flow values ​​at multiple candidate peak times, the corresponding average dwell time change rate, and the population distribution concentration.

[0104] In one embodiment of this application, the intelligent control device 20 of the multi-functional projection device further includes: a standby control module, used to control the target multi-functional projection device to enter standby mode in response to the absence of personnel in the personnel flow information within a preset standby time.

[0105] See Figure 3 , Figure 3 This is a schematic block diagram of an electronic device provided according to an embodiment of this application. Figure 3 The electronic device 300 in this embodiment may include one or more processors 301, one or more input devices 302, one or more output devices 303, and one or more memories 304. The processors 301, input devices 302, output devices 303, and memories 304 communicate with each other via a communication bus 305. The memories 304 store computer programs, including program instructions. The processors 301 execute the program instructions stored in the memories 304. Specifically, the processors 301 are configured to invoke the program instructions to perform the functions of the modules in the aforementioned device embodiments, for example... Figure 2 The functions of the information acquisition module 21, information division module 22, and screen projection control module 23 are shown.

[0106] It should be understood that, in the embodiments of this application, the processor 301 may be a central processing unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0107] Input device 302 may include a touchpad, a fingerprint sensor (for collecting the user's fingerprint information and fingerprint orientation information), a microphone, etc., and output device 303 may include a display (LCD, etc.), a speaker, etc.

[0108] The memory 304 may include read-only memory and random access memory, and provides instructions and data to the processor 301. A portion of the memory 304 may also include non-volatile random access memory. For example, the memory 304 may also store device type information.

[0109] In specific implementations, the processor 301, input device 302, and output device 303 described in the embodiments of this application can execute the implementation method described in the intelligent control method of the multifunctional projection device provided in the embodiments of this application, or they can execute the implementation method of the electronic device described in the embodiments of this application, which will not be repeated here.

[0110] In another embodiment of this application, a computer-readable storage medium is provided. This computer-readable storage medium stores a computer program, which includes program instructions. When executed by a processor, the program instructions implement all or part of the processes in the methods described above. Alternatively, the computer program can instruct related hardware to complete the process. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include any entity or device capable of carrying computer program code, a recording medium, a USB flash drive, a portable hard drive, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium, etc.

[0111] The computer-readable storage medium can be an internal storage unit of the electronic device in any of the foregoing embodiments, such as a hard disk or memory of the electronic device. The computer-readable storage medium can also be an external storage device of the electronic device, such as a plug-in hard disk, smart media card (SMC), secure digital card (SD), flash card, etc., provided on the electronic device. Furthermore, the computer-readable storage medium can include both internal and external storage units of the electronic device. The computer-readable storage medium is used to store computer programs and other programs and data required by the electronic device. The computer-readable storage medium can also be used to temporarily store data that has been output or will be output.

[0112] This application provides a computer program product, which includes computer-executable instructions or a computer program. The computer-executable instructions or the computer program are stored in a computer-readable storage medium. The processor of the electronic device reads the computer-executable instructions from the computer-readable storage medium and executes the computer-executable instructions, causing the electronic device to perform the intelligent control method of the multi-functional projection device described in this application embodiment.

[0113] Those skilled in the art will recognize that the modules and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0114] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the electronic devices and units described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0115] In the several embodiments provided in this application, it should be understood that the disclosed electronic devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules, units, or components may be combined or integrated into another system, or some features may be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces or modules, or it may be an electrical, mechanical, or other form of connection.

[0116] The modules described as separate components may or may not be physically separate. Similarly, the components shown as modules may or may not be physical modules; they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of the embodiments of this application, depending on actual needs.

[0117] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0118] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A smart control method for a multi-functional projection device, characterized in that, include: Obtain information on pedestrian traffic, pedestrian distribution, and pedestrian trajectory in the target area; The target area is the information projection area corresponding to the target multi-functional projection device; The personnel flow information is divided into multiple target personnel flow information; The target personnel flow information corresponds one-to-one with the target sub-regions; the target sub-regions are areas within the target region that are at different distances from the target multi-functional projection device; the personnel trajectory information is divided into multiple target personnel trajectory information; the target personnel trajectory information corresponds one-to-one with the target sub-regions; For each target personnel flow information, the relative flow density of the target sub-region corresponding to that target personnel flow information is determined; the relative flow density is the ratio of the number of people in the target sub-region to the maximum personnel capacity of the target sub-region. For each target personnel trajectory information, the trajectory endpoint pointing rate of the target sub-region corresponding to that target personnel trajectory information is determined; the trajectory endpoint pointing rate is the ratio of the number of trajectories in the target sub-region whose trajectory endpoint is the target multi-functional projection device to the total number of trajectories in the target sub-region. Based on the personnel distribution information, the personnel distribution center is determined, and based on the personnel distribution center, the target distance is determined; the target distance is the distance between the personnel distribution center and the target multi-functional projection device. Based on the relative flow density of each target sub-region, the trajectory endpoint pointing rate of each target sub-region, the average dwell time of each target sub-region, and the target distance, a first projection control strategy is determined; the average dwell time is the ratio of the total dwell time of personnel in the target sub-region to the total number of personnel in the target sub-region. Based on the multiple target personnel flow information, the multiple target personnel trajectory information, the personnel distribution information, and the first projection control strategy, a target projection control strategy is determined. Based on the target projection control strategy, the target multi-functional projection device is controlled to perform projection display; The first screen casting control strategy includes: a target video library; the target video library contains different versions of the same type of video; different versions of the video correspond to different selling points; the selling point is a certain moment in the total playback time of the video; the target screen casting control strategy includes: a target version of the video; The determination of the first screen projection control strategy is specifically as follows: The relative traffic density of each target sub-region, the trajectory endpoint pointing rate of each target sub-region, the average dwell time of each target sub-region, and the target distance are normalized and then weighted to obtain a personnel density score. Based on the personnel density score, a target video library is selected from multiple standard video libraries. The higher the personnel density score, the shorter the video length in the selected target video library. In the weighted calculation process, the average dwell time and the target distance are negatively correlated with the personnel density score. The step of determining the target projection control strategy based on the multiple target personnel flow information, the multiple target personnel trajectory information, the personnel distribution information, and the first projection control strategy includes: Based on the multiple target personnel flow information, the multiple target personnel trajectory information, and the personnel distribution information, a target time is predicted; the target time is the moment when the personnel flow in the first target sub-region reaches its maximum; the first target sub-region is the region in each target sub-region that is closest to the target multi-functional projection device. Based on the target time, a target version of the video is determined from the target video library; the target version of the video is the version whose selling point time deviates the least from the target time, so that the video content corresponding to the selling point time is presented at the target time.

2. The intelligent control method for the multifunctional projection device as described in claim 1, characterized in that, The prediction of the target time based on the multiple target personnel flow information, the multiple target personnel trajectory information, and the personnel distribution information includes: Based on the multiple target personnel flow information, the multiple target personnel trajectory information, and the personnel distribution information, a flow time series of personnel flow in the first target sub-region over a preset time range is determined; wherein, the target personnel trajectory information is predicted. Based on the traffic time series, multiple candidate traffic peak times are determined, and the candidate traffic peak times are the times when the population flow value in the traffic time series is greater than a preset traffic threshold. For each candidate peak traffic moment, based on the target personnel trajectory information corresponding to the first target sub-region, the average dwell time change rate of personnel in the first target sub-region at that moment is determined; the average dwell time change rate is the ratio of the change in average dwell time within a preset time before and after that moment to the preset time. Based on the personnel distribution information, the personnel distribution concentration of the first target sub-region at each candidate traffic peak time is determined; the personnel distribution concentration is a quantified value of the density of personnel distribution in the first target sub-region at that time. The target time is determined based on the population flow values ​​at multiple candidate peak times, the corresponding average dwell time change rate, and the population distribution concentration.

3. The intelligent control method for the multifunctional projection device as described in claim 1, characterized in that, Also includes: If no people are present as indicated by the personnel flow information within a preset standby time, the target multi-functional projection device is controlled to enter standby mode.

4. An intelligent control device for a multi-functional projection device, used to implement the intelligent control method as described in any one of claims 1-3, characterized in that, include: The information collection module is used to acquire information on pedestrian flow, pedestrian distribution, and pedestrian trajectory in the target area. The target area is the information projection area corresponding to the target multi-functional projection device; The information segmentation module is used to segment the personnel flow information into multiple target personnel flow information; The target personnel flow information corresponds one-to-one with the target sub-regions; the target sub-regions are areas within the target region that are at different distances from the target multi-functional projection device. The personnel trajectory information is divided into multiple target personnel trajectory information; each target personnel trajectory information corresponds one-to-one with a target sub-region. The screen projection control module is used to determine the target screen projection control strategy based on the multiple target personnel flow information, the multiple target personnel trajectory information and the personnel distribution information; The target multi-functional projection device is controlled to perform projection display based on the target projection control strategy.

5. An electronic device comprising a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the method as described in any one of claims 1 to 3.

6. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method as described in any one of claims 1 to 3.

Images