A multi-screen sorting system for LCD display screens
Through the LCD display multi-screen sorting system, the target object information is analyzed, the tracking mode is determined, and the tracking monitoring data is generated and displayed. This solves the time-consuming and labor-intensive problem of multiple people staring at the screen to find the target object, and improves tracking efficiency.
Patent Information
- Application Number
- CN202510221496.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-27
- Publication Date
- 2025-09-12
- Estimated Expiration
- 2045-02-27
AI Technical Summary
In places such as large supermarkets or shopping malls, it takes a lot of manpower and time to find and track a target object by having multiple people closely watching multiple monitoring images on each LCD screen, and the tracking efficiency is low.
An LCD display multi-screen sorting system is used, including a target object acquisition module, a pattern determination module, an object tracking module, a screen display module and an evaluation and optimization module. By analyzing the target object information, the tracking mode is determined, and tracking monitoring data marked with the target object is generated. The data is then displayed in multiple screens on the LCD display to optimize the monitoring process.
It improves the efficiency of target object tracking and reduces the consumption of human resources. Users can clearly see the movement of the target object, quickly determine its location, and save search time.
Smart Images

Figure CN120179197B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of video surveillance, and in particular to a multi-image sorting system for an LCD display screen. Background Art
[0002] In the prior art, for places such as large supermarkets or shopping malls, although an LCD display screen in the monitoring center can obtain the monitoring images corresponding to each surveillance camera in the place, when it is necessary to view the monitoring images to track the movement trajectory of a target object, multiple people are usually required to gather at the monitoring center at the same time. Each person must stare at multiple LCD monitoring images at the same time to find the specific location of the target object and which monitoring image the target object will move to next. Therefore, the entire tracking process requires a lot of manpower and time, and the tracking efficiency is low.
[0003] Therefore, the present invention provides an LCD display screen multi-image sorting system to solve the above problems. Summary of the Invention
[0004] In view of the above situation, in order to overcome the defects of the prior art, the present invention provides an LCD display screen multi-screen sorting system to solve the above-mentioned problem that in a set place, multiple people have to stare at multiple monitoring screens on each LCD display screen to find and track the target object. The entire tracking process requires a lot of manpower and time, and the tracking efficiency is low.
[0005] In order to achieve the above object, the technical solution adopted by the present invention is:
[0006] An LCD display screen multi-image sorting system, comprising:
[0007] A target object acquisition module is used to acquire target object information uploaded by a user, wherein the target object information includes one or more of image information, text description information, and template information selected from preset target object templates;
[0008] a mode determination module, which analyzes the target object information to determine the fuzziness level and target feature information of the target object information, and determines a tracking mode of the target object according to the fuzziness level, wherein the tracking mode includes a coarse tracking mode and a precise tracking mode;
[0009] An object tracking module selects a corresponding sub-tracking model from the object tracking model according to the tracking mode, uses the sub-tracking model to perform image analysis on target feature information and monitoring data to generate tracking monitoring data marked with the target object; and predicts the movement trajectory of the target object based on the tracking monitoring data to generate a predicted route;
[0010] The screen display module displays the tracking monitoring data and the monitoring images of each monitoring location in the predicted route on multiple screens of the LCD screen according to the preset display mode;
[0011] The evaluation and optimization module obtains feedback data and performs analysis and evaluation based on the feedback data, tracking and monitoring data, and predicted routes to obtain evaluation results. Based on the problem characteristics and optimization characteristics in the evaluation results, an adjustment strategy is generated, and the object tracking module and screen display module are adjusted according to the adjustment strategy.
[0012] Preferably, the analysis of the target object information to determine the fuzzy level and target feature information of the target object information includes: performing image feature extraction and text feature extraction on the target object information to obtain extracted feature information; querying and analyzing the extracted feature information based on a key requirement feature information library to determine the target feature information in the extracted feature information; and calculating the fuzzy level of the target object feature information according to the preset score corresponding to each target feature information in the key requirement feature information library.
[0013] Preferably, the method of using the sub-tracking model to perform image analysis on the target feature information and the monitoring data to generate tracking monitoring data marked with the target object includes: when the sub-tracking model is a coarse tracking model, screening and analyzing the monitoring data according to the target feature information to determine initial target monitoring data; using an image recognition model to identify and analyze the video frame corresponding to the initial target monitoring data to determine a suspected target object; and taking a screenshot of the video frame image containing the suspected target object and displaying it in a split screen; after obtaining the video frame image selected by the user, determining the suspected target object in the video frame image as the target object; and screening the target monitoring data containing the target object from the initial target monitoring data according to the feature information corresponding to the target object;
[0014] When the sub-tracking model is a precise tracking model, the monitoring data is screened and analyzed according to the target feature information to determine the target monitoring data containing the target object;
[0015] After acquiring the target monitoring data of the target object, the target object in the target monitoring data is marked to obtain tracking monitoring data marked with the target object.
[0016] Preferably, the target object in the target monitoring data is marked to obtain tracking monitoring data marked with the target object, including: obtaining video frame image data containing the target object, target pixel data and marked pixel data of the target object in the target monitoring data; converting the video frame image data into video frame pixel data; adjusting the video frame pixel data according to the target pixel data and the marked pixel data to obtain marked video frame data; and converting the marked video frame data into tracking monitoring data in chronological order.
[0017] Preferably, the method of predicting the movement trajectory of the target object based on the tracking and monitoring data to generate a predicted route includes: obtaining the movement data and / or associated personnel data of the target object and obtaining the channel data of the preset place based on the tracking and monitoring data; when the associated personnel data exists, using the movement trajectory of the associated personnel as the predicted route of the target object; when the associated personnel data does not exist, analyzing the movement data, associated personnel and channel data to predict the terminal position of the target object; and generating a predicted route based on the current position and terminal position of the target object.
[0018] Preferably, before displaying the tracking monitoring data and the monitoring images of each monitoring location in the predicted route in multiple screens of the LCD display screen according to a preset display mode, an LCD display screen multi-screen sorting system also includes: obtaining the number and specifications of the LCD display screens and the number of monitoring devices in the set location; analyzing the specifications and quantities to determine the interval of the number of split screens; optimizing the interval of the number of split screens and the number of monitoring devices to determine the initial display mode; obtaining the display data after the monitoring personnel adjusts the initial display mode to obtain the preset display mode; or obtaining the monitoring personnel's customized display mode, and using the customized display mode as the preset display mode.
[0019] Preferably, a multi-screen sorting system for an LCD display screen also includes: obtaining voice instructions from a monitoring person; identifying the voice instructions based on a preset instruction recognition library to determine the preset instruction with the highest matching degree as a control instruction; and adjusting the split screen of the LCD display screen according to the control instruction.
[0020] Preferably, the adjustment strategy is generated based on the problem characteristics and optimization characteristics in the evaluation results, including: determining the steps to be optimized of the object tracking module and / or the screen display module based on the problem characteristics; determining the strategy to be optimized based on the steps to be optimized and the corresponding optimization characteristics; and integrating the strategies to be optimized to obtain the adjustment strategy.
[0021] Preferably, an LCD display screen multi-screen sorting system further includes: when the target object loses its trace, performing personnel behavior recognition analysis on the monitoring data when the target object loses its trace to determine the secondary target object carrying the target object; and using the secondary target object as the new target object.
[0022] Preferably, an LCD display screen multi-screen sorting system further includes: a lost item query module for acquiring submitted lost items; calling an object tracking module to analyze the lost items to determine the owner and associated owners of the lost items; establishing a lost item association library of the owner, associated owners, and lost items, and partially displaying the lost item association library in a split screen of the LCD display screen.
[0023] The beneficial effects of the present invention are:
[0024] 1. The present invention analyzes the target object information uploaded by the user to obtain target feature information and determine the completeness of the target object information; then determines the fuzziness level according to the completeness of the target object information, and determines the tracking mode for analyzing the target feature information according to the fuzziness level; then uses the corresponding sub-tracking model in the object tracking module to analyze and process the target feature information to generate tracking monitoring data marked with the target object; at the same time, the predicted route of the target object is analyzed according to the tracking monitoring data, and the tracking monitoring data and the monitoring images of each monitoring position in the predicted route are displayed in multiple split screens of the LCD display screen, so that the user can clearly see the movement of the target object through the multiple screens of the LCD display screen, and determine the current position and predicted position of the target object, which helps to quickly obtain the target object. In this way, the present invention can solve the problem that in a set place, multiple people stare at the multiple monitoring screens in each LCD display screen to find and track the target object, and the entire tracking process requires a lot of manpower and time, and the tracking efficiency is low.
[0025] 2. In the object tracking module, the present invention determines whether to adopt a coarse tracking model or a precise tracking model based on the completeness of the target object information uploaded by the user; when the fuzzy tracking model is adopted, the monitoring data is first preliminarily screened according to the acquired target feature information to obtain initial target monitoring data; then the image recognition model is used to identify and analyze the video frames corresponding to the initial target monitoring data to determine the suspected target object; and the video frame images containing the suspected target object are captured and displayed on the split screen of the LCD display screen so that the user and the monitoring personnel can intuitively see multiple suspected target objects; after the user determines the target object from multiple suspected target objects, the initial target monitoring data is processed and analyzed according to the feature information corresponding to the target object to determine the target monitoring data containing the target object; when the sub-tracking model is a precise tracking model, the monitoring data is directly screened and analyzed according to the target feature information to determine the target monitoring data containing the target object; after the target monitoring data is obtained, the target object in the target monitoring data is marked to obtain tracking monitoring data marked with the target object. Through the above method, the present invention can determine whether to adopt a coarse tracking model or a precise tracking model according to the completeness of the target object information uploaded by the user, and then process and analyze the monitoring data, and finally obtain tracking monitoring data marked with the target object. It can solve the problem that multiple people stare at multiple monitoring screens on each LCD display screen to find and track the target object, and the entire tracking process requires a lot of manpower and time, thereby improving the tracking efficiency.
[0026] 3. When generating a predicted route, if the target object is a child or a pet, the target object's movement data and associated personnel data are obtained based on the tracking monitoring data, as well as the channel data of the preset place. The movement trajectory of the associated personnel is used as the predicted route of the target object, so that customers can quickly meet the target object according to the predicted route, thereby saving the travel time caused by multiple searches. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] Figure 1 The present invention is a schematic module diagram of an LCD display screen multi-image sorting system. DETAILED DESCRIPTION
[0028] The following will refer to the attached Figure 1 The embodiments of the present invention are described in detail. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the scope of protection of the present invention.
[0029] An LCD display screen multi-screen sorting system, as shown in the attached Figure 1 Shown, including:
[0030] The target object acquisition module is used to acquire target object information uploaded by the user. The target object information can be picture information, text description information, or template information selected from preset target object templates.
[0031] Target objects include keys, handbags, children, adults, mobile phones, watches, etc. When the target object information is text description information, the user's voice information can be converted into text information through the speech recognition model, saving the user's time in entering text.
[0032] The mode determination module analyzes the target object information to determine the fuzziness level and target feature information of the target object information, and determines the tracking mode of the target object according to the fuzziness level; the tracking mode includes a coarse tracking mode and a precise tracking mode.
[0033] The object tracking module selects a corresponding sub-tracking model from the object tracking model according to the tracking mode, uses the sub-tracking model to perform image analysis on the target feature information and monitoring data to generate tracking monitoring data marked with the target object; and predicts the movement trajectory of the target object based on the tracking monitoring data to generate a predicted route.
[0034] The screen display module displays the tracking monitoring data and the monitoring images of each monitoring location in the predicted route on multiple screens of the LCD display according to the preset display mode.
[0035] The evaluation and optimization module obtains tracking feedback data and performs analysis and evaluation based on the feedback data, tracking monitoring data, and predicted routes to obtain evaluation results. Based on the problem characteristics and optimization characteristics in the evaluation results, an adjustment strategy is generated, and the object tracking module and screen display module are adjusted according to the adjustment strategy.
[0036] In this embodiment, after the target object is marked in one frame, the movement of the target object is automatically tracked in each frame, and the current position of the target object is displayed in the center of the LCD display screen.
[0037] Specifically, the present invention analyzes the target object information uploaded by the user to obtain target feature information and determine the completeness of the target object information; then determines the fuzziness level according to the completeness of the target object information, and determines the tracking mode for analyzing the target feature information according to the fuzziness level; then uses the corresponding sub-tracking model in the object tracking module to analyze and process the target feature information to generate tracking monitoring data marked with the target object; at the same time, the predicted route of the target object is analyzed according to the tracking monitoring data, and the tracking monitoring data and the monitoring images of each monitoring position in the predicted route are displayed in multiple split screens of the LCD display screen, so that the user can clearly see the movement of the target object through the multiple screens of the LCD display screen, and determine the current position and predicted position of the target object, which helps to quickly obtain the target object. In the above manner, the present invention can solve the problem that in a set place, multiple people stare at the multiple monitoring screens in each LCD display screen to find and track the target object, and the entire tracking process requires a lot of manpower and time, and the tracking efficiency is low.
[0038] In one embodiment of the present invention, the target object information is analyzed to determine the fuzziness level and target feature information of the target object information, including: performing image feature extraction and text feature extraction on the target object information to obtain extracted feature information; querying and analyzing the extracted feature information based on a key requirement feature information library to determine the target feature information in the extracted feature information; and calculating the fuzziness level of the target object feature information according to the preset score corresponding to each target feature information in the key requirement feature information library.
[0039] Preferably, the sum of the preset scores corresponding to each key demand feature information is 100 points.
[0040] First, the key requirement feature information of the target object information is determined to form a key requirement feature information database. During continuous use, key requirement features are added, replaced, or deleted from the key requirement feature information database to meet the actual needs of the application site. When processing the target object feature information, evaluating the fuzziness level of the target object information, and obtaining the target feature information, the key requirement feature information contained in the target object information uploaded by the user is searched and the retrieved key requirement feature information is used as the target feature information. The fuzziness level of the target object feature information is calculated based on the preset score corresponding to each key requirement feature information in the key requirement feature information database.
[0041] Furthermore, an alternative embodiment is: using an image analysis model to evaluate the occlusion degree and noise level of image information to determine the completeness score of the image and obtain image feature information; using a text analysis model to evaluate the text description information to determine the text score and text feature information of the text description information; determining the weights of the image information and text description information according to the target object type, performing a weighted calculation on the text score, completeness score and their respective corresponding weights to determine the comprehensive score of the target object information, and determining the blur level based on the comprehensive score; and integrating the image feature information and text feature information to obtain target feature information.
[0042] Specifically, first, when determining the fuzziness level of the target object information, the fuzziness level of the target object information is divided into the following three levels: The target object information status corresponding to the first level is: serious information missing, a large amount of key information is missing in the image, description or time and place information, and it is impossible to effectively understand or use this information to grasp the core content. The target object information status corresponding to the second level is: there is some incomplete or vague information, but it can still be analyzed or speculated to a certain extent through the existing partial information, and has a certain degree of usability. The target object information status corresponding to the third level is: the image, description and time and place information are relatively detailed and accurate, and each part of the information complements each other, which can fully present the overall picture and relevant situation of the target object. Among them, the target object information corresponding to the first and second levels is tracked in coarse tracking mode, and the target object information corresponding to the third level is tracked in precise tracking mode.
[0043] Uploaded photos are checked for occlusion and noise levels. The occlusion check examines whether the target object is obscured by other objects, as well as the extent and significance of the obstruction. Extensive obstruction may result in the loss of critical information, reducing the completeness assessment. The noise level assessment checks for noise, as excessive noise can affect image quality. The amount of noise and its impact on the clarity of the target object are considered in the completeness assessment. Time and location information assessment includes time accuracy and location detail assessment. Time accuracy assessment determines whether the time information is a specific date and time or a vague time range. Specific time points provide greater time accuracy, helping to improve information completeness; broad time descriptions reduce completeness. Location detail assessment assesses the level of detail in location information, including specific street names, building names, longitude and latitude. Detailed location information can more accurately pinpoint the location of an event, increasing information completeness; general location descriptions reduce completeness.
[0044] Calculating the fuzzy level of the comprehensive assessment involves assigning information weights, calculating the comprehensive assessment score, and determining the fuzzy level. Information weight assignment is used to assign different weights to image information, text description information, and time and location information based on their importance in a specific context. For example, in some cases, image information may be more important and have a higher weight; while in other cases, text descriptions or time and location information may be more critical. Calculating the comprehensive assessment score: The assessment results of image information, text description information, and time and location information are weighted and summed according to the assigned weights to obtain a comprehensive assessment score. Determining the fuzzy level: The level of information completeness is determined based on the range of the comprehensive assessment score. Different score thresholds can be set to correspond to the three levels of low completeness, medium completeness, and high completeness. For example, a score below 30 points corresponds to the first level, a score between 30 and 70 points corresponds to the second level, and a score above 70 points corresponds to the third level.
[0045] Through the above-mentioned implementation method, the present invention can process the target object information uploaded by the user, determine the fuzzy level and target feature information of the target object information, so as to determine which tracking mode to adopt, and then determine the corresponding sub-tracking model from the object tracking model to analyze and process the target feature information, quickly find the target object from the monitoring data, and execute subsequent steps.
[0046] In one embodiment of the present invention, the step of performing image analysis on target feature information and monitoring data using the sub-tracking model to generate tracking monitoring data marked with the target object includes:
[0047] When the sub-tracking model is a coarse tracking model, the monitoring data is screened and analyzed according to the target feature information to determine the initial target monitoring data; the image recognition model is used to identify and analyze the video frame corresponding to the initial target monitoring data to determine the suspected target object; and the video frame image containing the suspected target object is screenshotted and displayed in the split screen; after obtaining the video frame image selected by the user, the suspected target object in the video frame image is determined as the target object; and the target monitoring data containing the target object is screened from the initial target monitoring data according to the feature information corresponding to the target object.
[0048] When the sub-tracking model is a precise tracking model, the monitoring data is screened and analyzed according to the target feature information to determine the target monitoring data containing the target object.
[0049] After acquiring the target monitoring data of the target object, the target object in the target monitoring data is marked to obtain tracking monitoring data marked with the target object.
[0050] Specifically, in the object tracking module, the present invention determines whether to adopt a coarse tracking model or a precise tracking model based on the completeness of the target object information uploaded by the user; when the fuzzy tracking model is adopted, the monitoring data is first preliminarily screened according to the acquired target feature information to obtain initial target monitoring data; then the image recognition model is used to identify and analyze the video frames corresponding to the initial target monitoring data to determine the suspected target object; and the video frame images containing the suspected target object are captured and displayed on the split screen of the LCD display screen so that the user and the monitoring personnel can intuitively see multiple suspected target objects; after the user determines the target object from multiple suspected target objects, the initial target monitoring data is processed and analyzed according to the feature information corresponding to the target object to determine the target monitoring data containing the target object; when the sub-tracking model is a precise tracking model, the monitoring data is directly screened and analyzed according to the target feature information to determine the target monitoring data containing the target object; after the target monitoring data is obtained, the target object in the target monitoring data is marked to obtain tracking monitoring data marked with the target object. Through the above method, the present invention can determine whether to use a rough tracking model or a precise tracking model according to the completeness of the target object information uploaded by the user, and then process and analyze the monitoring data to finally obtain tracking monitoring data marked with the target object.
[0051] Through the above-mentioned implementation, the present invention can solve the problem that multiple people stare at multiple monitoring screens on each LCD display screen to search and track the target object, and the entire tracking process requires a lot of manpower and time, thereby improving tracking efficiency.
[0052] Furthermore, the LCD display screen multi-screen sorting system of the present invention is provided with a target object switching mode. When the target object loses its trace, the monitoring data at the time when the target object loses its trace is analyzed to determine the secondary target object; or the secondary target object is manually circled and the secondary target object is used as the new target object for trajectory tracking, which facilitates the search for the movement trajectory of the original target object, and thus the original target object can be quickly found.
[0053] In one embodiment of the present invention, the target object in the target monitoring data is marked to obtain tracking monitoring data marked with the target object, including: obtaining video frame image data containing the target object, target pixel data and marked pixel data of the target object in the target monitoring data; converting the video frame image data into video frame pixel data; adjusting the video frame pixel data according to the target pixel data and the marked pixel data to obtain marked video frame data; and converting the marked video frame data into tracking monitoring data in chronological order.
[0054] In this embodiment, the present invention adjusts the original pixels around or within the target pixel data in the video frame pixel data to the target pixel data based on the target pixel data and the marked pixel data, and then integrates the original pixels in the video frame data according to the order of the data to obtain tracking monitoring data. Through the configuration of this embodiment, the present invention enables monitoring personnel and customers to identify the target object from the tracking monitoring data, quickly determine the target object's movement trajectory, current location, etc., saving monitoring personnel and customers' search time and improving customers' trust.
[0055] In one embodiment of the present invention, the method of predicting the movement trajectory of a target object based on tracking and monitoring data to generate a predicted route includes: obtaining the movement data and / or associated personnel data of the target object and obtaining channel data of a preset place based on the tracking and monitoring data; when associated personnel data exists, using the movement trajectory of the associated personnel as the predicted route of the target object; when associated personnel data does not exist, analyzing the movement data, associated personnel and channel data to predict the terminal position of the target object; and generating a predicted route based on the current position and terminal position of the target object.
[0056] In this embodiment, when generating a predicted route, when the target object is a child or a pet, the movement data and associated personnel data of the target object and the channel data of the preset place are obtained based on the tracking monitoring data, and the movement trajectory of the associated personnel is used as the predicted route of the target object, so that the customer can quickly meet the target object according to the predicted route, thereby saving the travel time caused by multiple searches.
[0057] In one embodiment of the present invention, before the tracking monitoring data and the monitoring images of each monitoring location in the predicted route are displayed in multiple screens of the LCD display screen according to a preset display mode, an LCD display screen multi-screen sorting system also includes: obtaining the number and specifications of the LCD display screens and the number of monitoring devices in the set location; analyzing the specifications and number of the LCD display screens to determine the number interval of the split screens; optimizing the number interval of the split screens and the number of monitoring devices to determine the initial display mode; obtaining the display data after the monitoring personnel adjusts the initial display mode to obtain the preset display mode; or obtaining the monitoring personnel's customized display mode, and using the customized display mode as the preset display mode.
[0058] Through the setting method of this embodiment, the present invention can plan appropriate monitoring pages for monitoring personnel according to the number and specifications of LCD display screens and the number of monitoring equipment in the set location, so that the split screen planning in the LCD display screen is reasonable and fits the monitoring habits of the monitoring personnel.
[0059] In one embodiment of the present invention, a multi-screen sorting system for an LCD display screen further includes: obtaining voice instructions from a monitoring personnel; identifying the voice instructions based on a preset instruction recognition library to determine the preset instruction with the highest matching degree as a control instruction; and adjusting the split screen of the LCD display screen according to the control instruction.
[0060] In this embodiment, the voice commands include zooming in, zooming out, and displaying a split screen of a certain tag, so as to reduce the time consumed by manual search and quickly find the corresponding content.
[0061] In one embodiment of the present invention, the generation of an adjustment strategy based on the problem characteristics and optimization characteristics in the evaluation results includes: determining the steps to be optimized of the object tracking module and / or the screen display module based on the problem characteristics; determining the strategy to be optimized based on the steps to be optimized and the corresponding optimization characteristics; and integrating the strategies to be optimized to obtain the adjustment strategy.
[0062] In the evaluation and optimization module, feedback data is obtained, and analysis and evaluation are performed based on the feedback data, tracking monitoring data, and predicted routes to obtain evaluation results. The feedback data mainly comes from the opinion data provided by monitoring personnel based on specific usage conditions after using the LCD display multi-screen sorting system of the present invention, as well as the system defect data discovered by R&D personnel themselves.
[0063] Through the setting method of this embodiment, the present invention can optimize the object tracking module and the picture display module according to the feedback data, so that the object tracking module and the picture display module are more in line with the actual needs of the monitoring personnel, saving the monitoring personnel time consumed in the search process.
[0064] In one embodiment of the present invention, a multi-screen sorting system for an LCD display screen further includes: when a target object loses its trace, performing human behavior recognition analysis on the monitoring data at the time when the target object loses its trace to determine a secondary target object carrying the target object; and using the secondary target object as a new target object.
[0065] In this embodiment, small items, such as keys and cell phones, are easily put into pockets or backpacks. When such a target object disappears, the surveillance video footage of the time of disappearance is analyzed for human behavior recognition to identify the secondary target object that put the target object into the pocket or backpack. The secondary target object is then used as the new target object for subsequent tracking to determine the original target object's location. This converts the monitoring personnel's manual recognition behavior into intelligent automatic recognition, freeing up the monitoring personnel's energy and saving a lot of query time.
[0066] In one embodiment of the present invention, a multi-screen sorting system for an LCD display further includes a lost item query module for acquiring submitted lost items; invoking an object tracking module to analyze the lost items to determine the owner and associated owners of the lost items; establishing a lost item association library of lost owners, associated owners, and lost items, and partially displaying the lost item association library in a split screen of the LCD display.
[0067] Preferably, when the lost property association database is displayed, the information of the owner and associated owners is hidden to avoid direct viewing by customers, so as to prevent customers from picking up the wrong lost items.
[0068] Specifically, lost items handed in by cleaning staff or customers are collected and stored in a unified manner. The target object tracking module is used to identify the owners of these lost items. A correspondence between the owner and the item is then established. Furthermore, a correspondence between the item and multiple associated owners is established. This allows for owners with inconvenient schedules to have someone else pick up the item on their behalf, i.e., an associated owner can pick it up on their behalf, or a stranger can pick it up with the owner's photo or other identification information.
[0069] Through the setting method of this embodiment, the present invention can quickly determine from the lost item query module whether the customer's lost item is stored when a customer asks whether his or her lost item is stored and after the customer provides proof information of the lost item. When the item is among the stored lost items, the customer can take it away quickly, saving the monitoring personnel's query time.
[0070] In one embodiment of the present invention, when laying out each monitoring screen on an LCD display screen, it mainly includes image segmentation and layout, image processing and optimization, display control and management, and hardware architecture and support. Among them, image segmentation and layout include: ① Window division: According to the display mode and screen layout requirements set by the user, the system divides the LCD display screen into multiple independent display areas or windows. These windows can have different sizes, shapes and positions to meet the needs of multi-screen display. For example, the screen can be evenly divided into multiple rectangular areas, or customized divisions can be made according to specific proportions and positions. ② Image mapping: During normal monitoring, the collected image signals are mapped to corresponding display windows respectively. The system will crop, scale, and other processes the input image according to the position and size of each window so that it can be accurately displayed in the corresponding area and maintain the original proportion and clarity of the image.
[0071] Image processing and optimization include: ① Color correction and adjustment: Because different image sources may have different color spaces and display characteristics, the system performs color correction and adjustment on the image in each display window. By adjusting parameters such as color temperature, saturation, and hue, the images in different windows achieve more consistent and harmonious color representation, avoiding noticeable color differences. ② Image enhancement and clarity: To improve the visual quality of the image, the system can also perform image enhancement processing such as sharpening, noise reduction, and edge enhancement. These processing operations can make image details clearer and edges sharper, improving overall image quality.
[0072] Display control and management include: ① Window switching and scheduling: The system provides flexible window switching and scheduling capabilities, allowing users to adjust the layout and content of display windows at any time according to their needs. For example, users can quickly switch the display position of different windows, adjust the window size, or select different image sources for display through the remote control, keyboard shortcuts, or the software interface. ② Display mode settings: In addition to basic multi-screen display, the system also supports a variety of display mode settings, such as full-screen display, single-window magnification display, and picture-in-picture display. Users can select the appropriate display mode to meet their viewing needs.
[0073] Hardware architecture and support include: ① Processor and chipset: LCD multi-screen sorting systems typically utilize high-performance processors and specialized image processing chipsets to implement image acquisition, processing, and display control. These hardware devices possess powerful computing and image processing capabilities, capable of processing multiple HD image signals in real time and ensuring stable system operation. ② Storage and Cache: To ensure rapid transmission and processing of image data, the system is equipped with storage and cache devices of sufficient capacity. These devices provide temporary storage of image data, alleviating data transmission pressure and improving system response speed and image display smoothness.
[0074] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system comprising at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0075] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.
[0076] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0077] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0078] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.
[0079] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact through a communication network. The client-server relationship arises through computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, a server in a distributed system, or a server integrated with a blockchain.
[0080] Thus far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principles of the present invention, those skilled in the art may make equivalent changes or substitutions to the relevant technical features, and the technical solutions after such changes or substitutions will fall within the scope of protection of the present invention.
Claims
1. An LCD display screen multi-image sorting system, characterized in that: include: A target object acquisition module is used to acquire target object information uploaded by a user, wherein the target object information includes one or more of image information, text description information, and template information selected from preset target object templates; a mode determination module, which analyzes the target object information to determine the fuzziness level and target feature information of the target object information, and determines a tracking mode of the target object according to the fuzziness level, wherein the tracking mode includes a coarse tracking mode and a precise tracking mode; An object tracking module selects a corresponding sub-tracking model from the object tracking model according to the tracking mode, uses the sub-tracking model to perform image analysis on target feature information and monitoring data to generate tracking monitoring data marked with the target object; and predicts the movement trajectory of the target object based on the tracking monitoring data to generate a predicted route; The screen display module displays the tracking monitoring data and the monitoring images of each monitoring location in the predicted route on multiple screens of the LCD screen according to the preset display mode; The evaluation and optimization module obtains feedback data and performs analysis and evaluation based on the feedback data, tracking and monitoring data, and predicted routes to obtain evaluation results. Based on the problem characteristics and optimization characteristics in the evaluation results, an adjustment strategy is generated, and the object tracking module and screen display module are adjusted according to the adjustment strategy.
2. The LCD display screen multi-image sorting system according to claim 1, characterized in that: The analysis of the target object information to determine the fuzzy level and target feature information of the target object information includes: performing image feature extraction and text feature extraction on the target object information to obtain extracted feature information; querying and analyzing the extracted feature information based on a key requirement feature information library to determine the target feature information in the extracted feature information; and calculating the fuzzy level of the target object feature information according to the preset score corresponding to each target feature information in the key requirement feature information library.
3. The LCD display screen multi-image sorting system according to claim 1, characterized in that: The use of the sub-tracking model to perform image analysis on target feature information and monitoring data to generate tracking monitoring data marked with the target object includes: When the sub-tracking model is a coarse tracking model, the monitoring data is screened and analyzed based on the target feature information to determine initial target monitoring data; the video frame corresponding to the initial target monitoring data is identified and analyzed using an image recognition model to determine a suspected target object; and a video frame image containing the suspected target object is captured and displayed in a split screen; after obtaining a video frame image selected by the user, the suspected target object in the video frame image is determined as the target object; and target monitoring data containing the target object is screened from the initial target monitoring data based on the feature information corresponding to the target object; When the sub-tracking model is a precise tracking model, the monitoring data is screened and analyzed according to the target feature information to determine the target monitoring data containing the target object; After acquiring the target monitoring data of the target object, the target object in the target monitoring data is marked to obtain tracking monitoring data marked with the target object.
4. The LCD display screen multi-image sorting system according to claim 3, characterized in that: The target object in the target monitoring data is marked to obtain tracking monitoring data marked with the target object, including: obtaining video frame image data containing the target object, target pixel data of the target object and marked pixel data in the target monitoring data; converting the video frame image data into video frame pixel data; adjusting the video frame pixel data according to the target pixel data and the marked pixel data to obtain marked video frame data; and converting the marked video frame data into tracking monitoring data in chronological order.
5. The LCD display screen multi-image sorting system according to claim 1, characterized in that: The method of predicting the target object's movement trajectory based on the tracking monitoring data to generate a predicted route includes: The target object's movement data and / or associated personnel data and the channel data of the preset place are obtained based on the tracking monitoring data; when the associated personnel data exists, the movement trajectory of the associated personnel is used as the predicted route of the target object; when the associated personnel data does not exist, the movement data, associated personnel and channel data are analyzed to predict the target object's terminal location; and a predicted route is generated based on the target object's current location and terminal location.
6. The LCD display screen multi-image sorting system according to claim 1, characterized in that: Before displaying the tracking monitoring data and the monitoring images of each monitoring location in the predicted route in multiple screens of the LCD display screen according to the preset display mode, it also includes: obtaining the number and specifications of the LCD display screens and the number of monitoring devices in the set location; analyzing the specifications and number of the LCD display screens to determine the number intervals of the split screens; optimizing the number intervals of the split screens and the number of monitoring devices to determine the initial display mode; obtaining the display data after the monitoring personnel adjusts the initial display mode to obtain the preset display mode; or obtaining the monitoring personnel's customized display mode, and using the customized display mode as the preset display mode.
7. The LCD display screen multi-image sorting system according to claim 6, characterized in that: Also includes: Acquire the voice command of the monitoring personnel; recognize the voice command based on the preset command recognition library to determine the preset command with the highest matching degree as the control command; Adjust the split screen of the LCD display screen according to the control instruction.
8. The LCD display screen multi-image sorting system according to claim 1, characterized in that: The generation of adjustment strategies based on the problem characteristics and optimization characteristics in the evaluation results includes: Determine the steps to be optimized of the object tracking module and / or the screen display module according to the problem characteristics; determine the strategies to be optimized according to the steps to be optimized and the corresponding optimization characteristics; and integrate the strategies to be optimized to obtain an adjustment strategy.
9. The LCD display screen multi-image sorting system according to claim 3, characterized in that: Also includes: When the target object loses its trace, the monitoring data at the time of the target object losing its trace is subjected to human behavior recognition analysis to determine the secondary target object carrying the target object; The secondary target object is used as the new target object.
10. The LCD display screen multi-image sorting system according to claim 1, characterized in that: Also includes: The lost item query module obtains the submitted lost items; calls the object tracking module to analyze the lost items to determine the owner and related owners of the lost items; A lost property association database of lost property owners, associated lost property owners, and lost property is established, and the lost property association database is partially displayed in a split screen of the LCD display.
Citation Information
Patent Citations
Tracking system based on pedestrian re-identification and hierarchical search strategy
CN117037057A
Moving object monitoring apparatus using a plurality of cameras
JP2007267294A