Multi-picture sorting system for LCD (Liquid Crystal Display) screen
By designing a multi-screen sorting system for LCD display screen, analyzing the target object information uploaded by users, using corresponding sub-tracking models for image analysis, generating tracking and monitoring data marked with target objects, and predicting the moving trajectory of the target object, solving the problem of low efficiency of multiple people staring at multiple monitoring images in the LCD display screen, and achieving fast and efficient target object tracking.
Patent Information
- Application Number
- CN202510221496.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-27
- Publication Date
- 2025-06-20
- Estimated Expiration
- 2045-02-27
AI Technical Summary
In large supermarkets or shopping malls, multiple people are staring at multiple monitoring images in the LCD display to find and track target objects, which consumes a lot of manpower and time and is inefficient in tracking.
Design a multi-screen sorting system for LCD display screen, including target object acquisition module, pattern determination module, object tracking module, picture display module and evaluation optimization module. The system analyzes the target object information uploaded by the user, determines the blur level and tracking mode, uses the corresponding sub-tracking model for image analysis, generates tracking and monitoring data marked with the target object, and predicts the moving trajectory of the target object, and finally displays the monitoring image in multiple screens of the LCD display screen.
Through this system, users can quickly see the movement of the target object in multiple screens of the LCD display screen clearly, determine its current and predicted location, improve tracking efficiency, and save manpower and time.
Smart Images

Figure CN120179197A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of video surveillance, and particularly relates to an LCD display multi-screen sorting system. Background Art
[0002] In the prior art, for a place such as a large supermarket or a large shopping mall, although a monitoring center's LCD display can obtain the monitoring images corresponding to each monitoring camera in the place, when it is necessary to view the monitoring images to track the movement trajectory of a certain target object, usually multiple people need to gather at the monitoring center simultaneously, and each person stares at multiple monitoring images on the LCD simultaneously, so as to find the specific location of the target object and which monitoring image the target object will move to next. Therefore, the entire tracking process requires a large amount of manpower and time, and the tracking efficiency is low.
[0003] Therefore, the present invention provides an LCD display multi-screen sorting system to solve the above problems. Summary of the Invention
[0004] In view of the above situation, in order to overcome the deficiencies of the prior art, the present invention provides an LCD display multi-screen sorting system to solve the problem that in a set place, multiple people stare at multiple monitoring images on each LCD display to search for and track a target object, and the entire tracking process requires a large amount of manpower and time, and the tracking efficiency is low.
[0005] In order to achieve the above object, the technical solution adopted by the present invention is as follows:
[0006] An LCD display multi-screen sorting system, comprising:
[0007] A target object acquisition module, configured to acquire target object information uploaded by a user, where the target object information includes one or more of picture information, text description information, and template information selected from a preset target object template;
[0008] A mode determination module, which analyzes the target object information to determine the fuzzy level and target feature information of the target object information, and determines the tracking mode of the target object according to the fuzzy level, where the tracking mode includes a rough tracking mode and a precise tracking mode;
[0009] An object tracking module, which selects a corresponding sub-tracking model from the object tracking model according to the tracking mode, and performs image analysis on the target feature information and monitoring data by using the sub-tracking model to generate tracking monitoring data marked with the target object; predicts the movement trajectory of the target object according to the tracking monitoring data to generate a predicted route;
[0010] The screen display module displays the tracking and monitoring data and the monitoring images of each monitoring position in the predicted route on multiple screens of the LCD display according to a preset display mode;
[0011] The evaluation and optimization module obtains feedback data, and performs analysis and evaluation based on the feedback data, tracking and monitoring data, and predicted route to obtain an evaluation result; according to the problem characteristics and optimization characteristics in the evaluation result, a adjustment strategy is generated, and the object tracking module and the screen display module are adjusted according to the adjustment strategy.
[0012] Preferably, analyzing the target object information to determine the fuzzy level and target feature information of the target object information includes: extracting picture features and text features from the target object information to obtain extracted feature information; querying and analyzing the extracted feature information based on the key requirement feature information library to determine the target feature information in the extracted feature information; and calculating the fuzzy level of the target object feature information according to the preset scores corresponding to each target feature information in the key requirement feature information library.
[0013] Preferably, using the sub-tracking model to perform image analysis on the target feature information and monitoring data to generate tracking and monitoring data marked with the target object includes: when the sub-tracking model is a rough tracking model, screening and analyzing the monitoring data according to the target feature information to determine the initial target monitoring data; using an image recognition model to perform recognition and analysis on the video frames corresponding to the initial target monitoring data to determine the suspected target object; and taking screenshots of the video frame images containing the suspected target object and displaying them in the sub-screen; after obtaining the video frame image selected by the user, determining the suspected target object in the video frame image as the target object; screening the target monitoring data containing the target object from the initial target monitoring data according to the feature information corresponding to the target object;
[0014] When the sub-tracking model is a precise tracking model, screening and analyzing the monitoring data according to the target feature information to determine the target monitoring data containing the target object;
[0015] After obtaining the target monitoring data of the target object, performing marking processing on the target object in the target monitoring data to obtain the tracking and monitoring data marked with the target object.
[0016] Preferably, marking the target object in the target monitoring data to obtain the tracking and monitoring data marked with the target object includes: obtaining the video frame image data containing the target object, the target pixel data of the target object, and the marking pixel data in the target monitoring data; converting the video frame image data into video frame pixel data; adjusting the video frame pixel data according to the target pixel data and the marking pixel data to obtain the marked video frame data; and converting the marked video frame data into the tracking and monitoring data in chronological order.
[0017] Preferably, predicting the moving trajectory of the target object based on the tracking and monitoring data to generate a predicted route includes: obtaining the moving data of the target object and / or the associated personnel data from the tracking and monitoring data and obtaining the channel data of the preset venue; when there is associated personnel data, using the moving trajectory of the associated personnel as the predicted route of the target object; when there is no associated personnel data, analyzing the moving data, the associated personnel, and the channel data to predict the end position of the target object; and generating a predicted route based on the current position and the end position of the target object.
[0018] Preferably, before displaying the monitoring images at each monitoring position in the tracking and monitoring data and the predicted route in multiple screens of the LCD display according to the preset display mode, an LCD display multi-screen sorting system further includes: obtaining the quantity and specifications of the LCD displays and the quantity of the monitoring devices in the set venue; analyzing the specifications and the quantity to determine the sub-screen quantity range; optimizing and analyzing the sub-screen quantity range and the quantity of the monitoring devices to determine the initial display mode; obtaining the display data after the monitoring personnel adjust the initial display mode to obtain the preset display mode; or obtaining the custom display mode of the monitoring personnel and using the custom display mode as the preset display mode.
[0019] Preferably, an LCD display multi-screen sorting system further includes: obtaining the voice command of the monitoring personnel; recognizing the voice command based on the preset command recognition library to determine the preset command with the highest matching degree as the control command; and adjusting the sub-screen of the LCD display according to the control command.
[0020] Preferably, generating an adjustment strategy according to the problem characteristics and the optimization characteristics in the evaluation result includes: determining the steps to be optimized for the object tracking module and / or the screen display module according to the problem characteristics; determining the optimization strategies to be optimized according to the steps to be optimized and the corresponding optimization characteristics; and integrating each optimization strategy to obtain the adjustment strategy.
[0021] Preferably, an LCD display multi-screen sorting system further includes: when the target object loses track, performing personnel behavior recognition and analysis on the monitoring data when the target object loses track to determine a secondary target object carrying the target object; and using the secondary target object as a new target object.
[0022] Preferably, an LCD display multi-screen sorting system further includes: a lost item query module that obtains the submitted lost item; calls the object tracking module to analyze the lost item to determine the owner and associated owners of the lost item; establishes a lost item association library for the owner, associated owners, and the lost item, and partially displays the lost item association library in the split screens of the LCD display.
[0023] The beneficial effects of the present invention are as follows:
[0024] 1. The present invention analyzes the target object information uploaded by the user to obtain target feature information and determines the completeness of the target object information; then determines the fuzzy level according to the completeness of the target object information, and determines the tracking mode for analyzing the target feature information according to the fuzzy level; then uses the corresponding sub-tracking model in the object tracking module to analyze and process the target feature information to generate tracking and monitoring data marked with the target object; at the same time, analyzes the predicted route of the target object according to the tracking and monitoring data, and displays the monitoring images at each monitoring position in the tracking and monitoring data and the predicted route in multiple split screens of the LCD display, so that the user can clearly see the movement of the target object through multiple screens of the LCD display, and determine the current position and predicted position of the target object, thereby helping to quickly obtain the target object. Through the above method, the present invention can solve the problem that in a set place, multiple people need to closely monitor multiple monitoring screens in the LCD display to search for and track the target object, and the entire tracking process requires a large amount of manpower and time, and the tracking efficiency is low.
[0025] 2. In the object tracking module, the present invention determines whether to adopt a rough tracking model or a precise tracking model according to the completeness of the target object information uploaded by the user. When adopting the fuzzy tracking model, first, the monitoring data is preliminarily screened according to the obtained target feature information to obtain the initial target monitoring data. Then, an image recognition model is used to identify and analyze the video frames corresponding to the initial target monitoring data to determine the suspected target objects. And the video frame images containing the suspected target objects are captured and displayed in the sub - screens of the LCD display, so that users and monitoring personnel can intuitively see multiple suspected target objects. After the user determines the target object from multiple suspected target objects, the initial target monitoring data is processed and analyzed according to the feature information corresponding to the target object to determine the target monitoring data containing the target object. When the sub - tracking model is a precise tracking model, the monitoring data is directly screened and analyzed according to the target feature information to determine the target monitoring data containing the target object. After obtaining the target monitoring data, the target objects in the target monitoring data are marked to obtain the tracking monitoring data marked with the target objects. By the above method, the present invention can determine whether to adopt a rough tracking model or a precise tracking model according to the completeness of the target object information uploaded by the user, and then process and analyze the monitoring data, and finally can obtain the tracking monitoring data marked with the target objects, which can solve the problem that multiple people stare at multiple monitoring screens in each LCD display to search for and track the target object, and the whole tracking process requires a large amount of manpower and time, thus improving the tracking efficiency.
[0026] 3. When generating the predicted route, when the target object is a child or a pet, the movement data of the target object, the associated personnel data and the passage data of the preset venue are obtained according to the tracking monitoring data, and the movement trajectory of the associated personnel is used as the predicted route of the target object, so that customers can quickly converge with the target object according to the predicted route, thereby saving the travel time during multiple searches. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] Figure 1 It is a schematic module diagram of a multi - screen sorting system for an LCD display according to the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0028] The following will refer to the reference appendix Figure 1 to describe the embodiments of the present invention in detail. Those skilled in the art should understand that these embodiments are only used to explain the technical principle of the present invention and are not intended to limit the protection scope of the present invention.
[0029] A multi - screen sorting system for an LCD display, as shown in the appendix Figure 1 shown, includes:
[0030] A target object acquisition module, configured to acquire target object information uploaded by a user, where the target object information may be picture information, text description information, or template information selected from a preset target object template.
[0031] Among them, the target objects include keys, handbags, children, adults, mobile phones, watches, etc. When the target object information is text description information, the voice recognition model can be used to convert the user's voice information into text information, saving the time for the user to enter text.
[0032] A mode determination module, which analyzes the target object information to determine the fuzzy level and target feature information of the target object information, and determines the tracking mode of the target object according to the fuzzy level; the tracking mode includes a rough tracking mode and a precise tracking mode.
[0033] An object tracking module, which selects a corresponding sub-tracking model from the object tracking model according to the tracking mode, and performs image analysis on the target feature information and monitoring data by using the sub-tracking model to generate tracking and monitoring data marked with the target object; predicts the moving trajectory of the target object according to the tracking and monitoring data to generate a predicted route.
[0034] A screen display module, which displays the monitoring images at each monitoring position in the tracking and monitoring data and the predicted route in multiple screens of the LCD display according to a preset display mode.
[0035] An evaluation and optimization module, which acquires the feedback data of the tracking, and performs analysis and evaluation according to the feedback data, the tracking and monitoring data, and the predicted route to obtain an evaluation result; generates an adjustment strategy according to the problem features and optimization features in the evaluation result, and adjusts the object tracking module and the screen display module according to the adjustment strategy.
[0036] In this embodiment, after marking the target object in one screen, the movement trend of the target object is automatically tracked in each screen, and the current position of the target object is displayed at the central position of the LCD display.
[0037] Specifically, the present invention analyzes the target object information uploaded by the user to obtain target feature information and determines the completeness of the target object information; then determines the fuzzy level according to the completeness of the target object information, and determines the tracking mode for analyzing the target feature information according to the fuzzy level; then uses the corresponding sub-tracking model in the object tracking module to analyze and process the target feature information to generate tracking and monitoring data marked with the target object; at the same time, analyzes the predicted route of the target object according to the tracking and monitoring data, and displays the monitoring images of each monitoring position in the tracking and monitoring data and the predicted route in multiple sub-windows of the LCD display screen, so that the user can clearly see the movement of the target object through multiple screens of the LCD display screen, and determine the current position and predicted position of the target object, thereby helping to quickly obtain the target object. Through the above method, the present invention can solve the problem that in a set place, multiple people stare at multiple monitoring screens in each LCD display screen to search for and track the target object, and the entire tracking process requires a large amount of manpower and time, and the tracking efficiency is low.
[0038] In an embodiment of the present invention, the analysis of the target object information to determine the fuzzy level and target feature information of the target object information includes: extracting picture features and text features from the target object information to obtain the extracted feature information; querying and analyzing the extracted feature information based on the key requirement feature information library to determine the target feature information in the extracted feature information; and calculating the fuzzy level of the target object feature information according to the preset scores corresponding to each target feature information in the key requirement feature information library.
[0039] Preferably, the sum of the preset scores corresponding to each key requirement feature information is 100 points.
[0040] First, determine the key requirement feature information of the target object information to form a key requirement feature information library, and during continuous use, add, replace or delete key requirements in the key requirement feature information library to meet the actual needs of the application site. When processing the target object feature information, evaluating the fuzzy level of the target object information and obtaining the target feature information, query the key requirement feature information contained in the target object information uploaded by the user, and use the queried key requirement feature information as the target feature information; and calculate the fuzzy level of the target object feature information according to the preset scores corresponding to each key requirement feature information in the key requirement feature information library.
[0041] Furthermore, an alternative embodiment is: using an image analysis model to evaluate the degree of occlusion and the noise level of the image information to determine the completeness score of the image and obtain image feature information; using a text analysis model to evaluate the text description information to determine the text score and text feature information of the text description information; determining the weights of the image information and the text description information according to the target object type, performing weighted calculations on the text score, the completeness score and their respective corresponding weights to determine a comprehensive score for the target object information, and determining the blur level based on the comprehensive score; and integrating the image feature information and the text feature information to obtain the target feature information.
[0042] Specifically, first, when determining the fuzziness level of the target object information, the fuzziness level of the target object information is divided into the following three levels: The target object information status corresponding to the first level is: serious information missing, a large amount of key information is missing in the image, description or time and place information, and it is impossible to effectively understand or use this information to grasp the core content. The target object information status corresponding to the second level is: there are some incomplete or vague information, but it can still be analyzed or speculated to a certain extent through the existing partial information, and it has a certain degree of usability. The target object information status corresponding to the third level is: the image, description and time and place information are relatively detailed and accurate, and each part of the information complements each other, which can fully present the overall picture and related situation of the target object. Among them, the target object information corresponding to the first and second levels is tracked in rough tracking mode, and the target object information corresponding to the third level is tracked in precise tracking mode.
[0043] The uploaded photos are checked for occlusion and evaluated for noise level. The occlusion check is used to observe whether the target object is blocked by other objects, as well as the area and importance of the occlusion. Large-area occlusion may lead to the loss of key information and reduce the level of completeness assessment. The noise level assessment is used to check whether there are noise points in the image. Too much noise will affect the image quality. According to the amount of noise and the degree of impact on the clarity of the target object, corresponding considerations are given in the completeness assessment. The time and location information assessment includes time accuracy assessment and location detail assessment. Among them, time accuracy assessment: determine whether the time information is a specific date and time, or a vague time range. Specific time points can provide higher time accuracy and help improve information completeness; while broad time descriptions will reduce completeness. Location detail assessment: evaluate the level of detail of location information, including specific street names, building names, longitude and latitude, etc. Detailed location information can more accurately locate the location of the event and increase the completeness of the information; only general location descriptions will reduce completeness.
[0044] When calculating the fuzzy level of the comprehensive evaluation, it includes information weight assignment, calculating the comprehensive evaluation score, and determining the fuzzy level. Among them, information weight assignment is used to assign different weights to image information, text description information, and time and location information according to their importance in a specific context. For example, in some cases, image information may be more important and have a higher weight; while in other cases, text description or time and location information may be more critical. Calculate the comprehensive evaluation score: According to the assigned weights, perform weighted summation on the evaluation results of image information, text description information, and time and location information to obtain a comprehensive evaluation score. Determine the fuzzy level: According to the range of the comprehensive evaluation score, determine the integrity level of the information. Different score thresholds can be set to correspond to the three levels of low integrity, medium integrity, and high integrity. For example, a score below 30 points corresponds to the first level, a score in the range of 30-70 points corresponds to the second level, and a score above 70 points corresponds to the third level.
[0045] Through the above implementation method, the present invention can process the target object information uploaded by the user, determine the fuzzy level of the target object information and the target feature information, so as to determine which tracking mode to adopt, and then determine the corresponding sub-tracking model from the object tracking model to analyze and process the target feature information, quickly find the target object from the monitoring data, and perform subsequent steps.
[0046] In an embodiment of the present invention, the use of the sub-tracking model to perform image analysis on the target feature information and the monitoring data to generate tracking and monitoring data marked with the target object includes:
[0047] When the sub-tracking model is a rough tracking model, screen and analyze the monitoring data according to the target feature information to determine the initial target monitoring data; use an image recognition model to perform recognition analysis on the video frames corresponding to the initial target monitoring data to determine the suspected target object; and take screenshots of the video frame images containing the suspected target object and display them in the split screen; after obtaining the video frame image selected by the user, determine the suspected target object in the video frame image as the target object; screen the target monitoring data containing the target object from the initial target monitoring data according to the feature information corresponding to the target object.
[0048] When the sub-tracking model is a precise tracking model, screen and analyze the monitoring data according to the target feature information to determine the target monitoring data containing the target object.
[0049] After obtaining the target monitoring data of the target object, perform marking processing on the target object in the target monitoring data to obtain the tracking and monitoring data marked with the target object.
[0050] Specifically, in the object tracking module, the present invention determines whether to adopt a rough tracking model or a precise tracking model according to the completeness of the target object information uploaded by the user. When the fuzzy tracking model is adopted, first, the monitoring data is preliminarily screened according to the obtained target feature information to obtain the initial target monitoring data. Then, an image recognition model is used to identify and analyze the video frames corresponding to the initial target monitoring data to determine the suspected target objects. And the video frame images containing the suspected target objects are captured and displayed in the sub-pictures of the LCD display screen, so that the user and the monitoring personnel can intuitively see multiple suspected target objects. After the user determines the target object from multiple suspected target objects, the initial target monitoring data is processed and analyzed according to the feature information corresponding to the target object to determine the target monitoring data containing the target object. When the sub-tracking model is a precise tracking model, the monitoring data is directly screened and analyzed according to the target feature information to determine the target monitoring data containing the target object. After obtaining the target monitoring data, the target objects in the target monitoring data are marked to obtain the tracking monitoring data marked with the target objects. Through the above method, the present invention can determine whether to adopt a rough tracking model or a precise tracking model according to the completeness of the target object information uploaded by the user, and then process and analyze the monitoring data, and finally can obtain the tracking monitoring data marked with the target objects.
[0051] Through the above implementation manner, the present invention can solve the problem that multiple people stare at multiple monitoring screens in each LCD display screen to search for and track the target object, and the whole tracking process requires a large amount of manpower and time, thereby improving the tracking efficiency.
[0052] Furthermore, a target object switching mode is set in the multi-screen sorting system of the LCD display screen of the present invention. When the target object loses its trace, the monitoring data when the target object loses its trace is analyzed to determine the secondary target object; or the secondary target object is manually circled, and the secondary target object is used as a new target object for trajectory tracking, which provides convenience for searching for the movement trajectory of the original target object, and then the original target object can be quickly found.
[0053] In an embodiment of the present invention, the marking process of the target object in the target monitoring data to obtain the tracking monitoring data marked with the target object includes: obtaining the video frame image data containing the target object, the target pixel data and the marking pixel data of the target object in the target monitoring data; converting the video frame image data into video frame pixel data; adjusting the video frame pixel data according to the target pixel data and the marking pixel data to obtain the marked video frame data; and converting the marked video frame data into the tracking monitoring data in chronological order.
[0054] In this embodiment, the present invention adjusts the original pixels to the target pixel data around or inside the target pixel data in the video frame pixel data according to the target pixel data and the marked pixel data, and then integrates them according to the sequence of the video frame data to obtain the tracking and monitoring data. Through the setting method of this embodiment, the present invention enables the monitoring personnel and customers to determine the target object from the tracking and monitoring data, quickly determine the moving trajectory, current position, etc. of the target object, saves the search time of the monitoring personnel and customers, and improves the trust of the customers.
[0055] In one embodiment of the present invention, predicting the moving trajectory of the target object based on the tracking and monitoring data to generate a predicted route includes: obtaining the moving data and / or associated personnel data of the target object according to the tracking and monitoring data and obtaining the passage data of the preset venue; when there is associated personnel data, using the moving trajectory of the associated personnel as the predicted route of the target object; when there is no associated personnel data, analyzing the moving data, associated personnel and passage data to predict the end position of the target object; generating a predicted route according to the current position and the end position of the target object.
[0056] In this embodiment, when generating the predicted route, when the target object is a child or a pet, obtain the moving data and associated personnel data of the target object according to the tracking and monitoring data and obtain the passage data of the preset venue, and use the moving trajectory of the associated personnel as the predicted route of the target object, so that the customer can quickly converge with the target object according to the predicted route, thereby saving the travel time during multiple searches.
[0057] In one embodiment of the present invention, before displaying the monitoring images of each monitoring position in the tracking and monitoring data and the predicted route in multiple screens of the LCD display according to a preset display mode, an LCD display multi-screen sorting system further includes: obtaining the number and specifications of the LCD displays and the number of monitoring devices in the set venue; analyzing the specifications and number of the LCD displays to determine the range of the number of sub-screens; optimizing and analyzing the range of the number of sub-screens and the number of monitoring devices to determine the initial display mode; obtaining the display data after the monitoring personnel adjust the initial display mode to obtain the preset display mode; or obtaining the custom display mode of the monitoring personnel and using the custom display mode as the preset display mode.
[0058] Through the setting method of this embodiment, the present invention can plan a suitable monitoring page for the monitoring personnel according to the number and specifications of the LCD displays and the number of monitoring devices in the set venue, so that the sub-screen planning in the LCD display is reasonable and conforms to the monitoring habits of the monitoring personnel.
[0059] In an embodiment of the present invention, an LCD display multi-screen sorting system further includes: obtaining a voice command of a monitoring personnel; identifying the voice command based on a preset command recognition library to determine the preset command with the highest matching degree as a control command; and adjusting the split screen of the LCD display according to the control command.
[0060] In this embodiment, the voice commands include zooming in, zooming out, displaying the split screen of a certain label, etc., so as to reduce the time consumed by manual search and quickly query the corresponding content.
[0061] In an embodiment of the present invention, generating an adjustment strategy according to the problem features and optimization features in the evaluation result includes: determining the steps to be optimized for the object tracking module and / or the screen display module according to the problem features; determining the optimization strategies to be optimized according to the steps to be optimized and the corresponding optimization features; and integrating each optimization strategy to obtain an adjustment strategy.
[0062] In the evaluation and optimization module, feedback data is obtained, and analysis and evaluation are performed according to the feedback data, tracking monitoring data, and predicted route to obtain an evaluation result; wherein, the feedback data mainly comes from the opinion data provided by the monitoring personnel according to the specific usage situation after using an LCD display multi-screen sorting system of the present invention, and the system defect data discovered by the R & D personnel themselves.
[0063] Through the setting method of this embodiment, the present invention can optimize the object tracking module and the screen display module according to the feedback data, so that the object tracking module and the screen display module better meet the actual needs of the monitoring personnel, and save the time consumed by the monitoring personnel during the search process.
[0064] In an embodiment of the present invention, an LCD display multi-screen sorting system further includes: when the target object loses its trace, performing personnel behavior recognition analysis on the monitoring data when the target object loses its trace to determine a secondary target object carrying the target object; and using the secondary target object as a new target object.
[0065] In this embodiment, for small items such as keys and mobile phones, it is easy for people to put them in their pockets or backpacks. When such a target object loses its trace, perform personnel behavior recognition analysis on the monitoring video when the target object loses its trace to determine the secondary target object that puts the target object in its pocket or backpack, and then use the secondary target object as a new target object for subsequent trace tracking, so as to determine the position of the original target object, convert the manual recognition behavior of the monitoring personnel into intelligent automatic recognition, and can release more energy of the monitoring personnel and save a large amount of query time for the monitoring personnel.
[0066] In an embodiment of the present invention, an LCD display multi-screen sorting system further includes a lost item query module, which acquires the submitted lost items; calls the object tracking module to analyze the lost items to determine the owners and associated owners of the lost items; establishes a lost item association library for the owners, associated owners, and lost items, and partially displays the lost item association library in the sub-screens of the LCD display.
[0067] Preferably, when displaying the lost item association library, the information of the owners and associated owners is hidden to prevent customers from directly seeing it, so as to prevent customers from taking the wrong lost items.
[0068] Specifically, the lost items of other customers submitted by cleaning staff or customers are uniformly collected and stored, and the owners of these lost items are determined through the target object tracking module. Then, the corresponding relationship between the owners and the items is established, and further the corresponding relationship between the items and multiple associated owners is established, so that for owners who are inconvenient in daily life, others can pick up on their behalf, that is, the associated owners pick up on their behalf, or strangers carry proof information such as photos of the owners to pick up on their behalf.
[0069] Through the setting method of this embodiment, the present invention can quickly determine whether there is a lost item of a customer in the lost item query module when a customer asks whether there is a lost item stored and after the customer provides proof information of the lost item. When there is such an item among the stored lost items, the customer can quickly pick it up, saving the query time of the monitoring personnel.
[0070] In an embodiment of the present invention, when laying out each monitoring screen in the LCD display, it mainly includes image segmentation and layout, image processing and optimization, display control and management, and hardware architecture and support. Among them, image segmentation and layout includes: ① Window division: According to the display mode set by the user and the screen layout requirements, the system divides the LCD display into multiple independent display areas or windows. These windows can have different sizes, shapes, and positions to meet the requirements of multi-screen display. For example, the screen can be evenly divided into multiple rectangular areas, or custom divided according to specific ratios and positions. ② Image mapping: During normal monitoring, the collected image signals of each channel are respectively mapped to the corresponding display windows. The system will perform operations such as cropping and scaling on the input images according to the position and size of each window, so that they can be accurately displayed in the corresponding areas while maintaining the original ratio and clarity of the images.
[0071] Image processing and optimization include: ① Color correction and adjustment: Since there may be differences in the color spaces and display characteristics of different image sources, the system will perform color correction and adjustment on the images in each display window. By adjusting parameters such as the color temperature, saturation, and hue of the image, the images in different windows will be more consistent and coordinated in color performance, avoiding obvious color differences. ② Image enhancement and sharpening: To improve the visual effect of the image, the system can also perform enhancement processing on the image, such as sharpening, noise reduction, and edge enhancement. These processing operations can make the details of the image clearer, the edges sharper, and enhance the overall image quality.
[0072] Display control and management include: ① Window switching and scheduling: The system provides flexible window switching and scheduling functions, and users can change the layout and content of the display window according to their needs at any time. For example, through the remote control, keyboard shortcuts, or software interface, etc., the display position of different windows can be quickly switched, the window size can be adjusted, or different image sources can be selected for display. ② Display mode setting: In addition to the basic multi-screen split display, the system also supports the setting of multiple display modes, such as full-screen display, single-window magnification display, picture-in-picture display, etc. Users can select the appropriate display mode according to the actual situation to meet different viewing needs.
[0073] Hardware architecture and support include: ① Processor and chipset: The LCD multi-screen sorting system usually uses high-performance processors and professional image processing chipsets to achieve image acquisition, processing, and display control. These hardware devices have powerful computing capabilities and image processing capabilities, can process multiple high-definition image signals in real time, and ensure the stable operation of the system. ② Storage and cache: To ensure the fast transmission and processing of image data, the system is also equipped with a certain amount of storage and cache devices. These devices can temporarily store image data, relieve the pressure of data transmission, and improve the response speed of the system and the smoothness of image display.
[0074] The various embodiments of the systems and techniques described above in this article can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGA), application specific integrated circuits (ASIC), application specific standard products (ASSP), systems on a chip (SOC), complex programmable logic devices (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: implemented in one or more computer programs, the one or more computer programs can be executed and / or interpreted on a programmable system including at least one programmable processor, the programmable processor can be a dedicated or general-purpose programmable processor, can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device.
[0075] The program code for implementing the methods of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the program codes are executed by the processor or controller, the functions / operations specified in the flowchart and / or block diagram are implemented. The program codes can be executed entirely on the machine, partially on the machine, executed partially on the machine as an independent software package and partially on a remote machine, or executed entirely on a remote machine or server.
[0076] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0077] In order to provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and a pointing device (e.g., a mouse or a trackball), by which the user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and the input received from the user can be in any form (including acoustic input, voice input, or tactile input).
[0078] The systems and techniques described herein can be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected to each other by digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include: local area network (LAN), wide area network (WAN), and the Internet.
[0079] A computer system can include clients and servers. The clients and servers are generally far from each other and typically interact through a communication network. The client-server relationship is created by computer programs that run on the respective computers and have a client-server relationship with each other. The server can be a cloud server, a server of a distributed system, or a server integrated with a blockchain.
[0080] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.
Claims
1. An LCD display screen multi-image sorting system, characterized in that: include: A target object acquisition module, used to acquire target object information uploaded by a user, wherein the target object information includes one or more of picture information, text description information, and template information selected from preset target object templates; A mode determination module analyzes the target object information to determine the fuzziness level of the target object information and target feature information, and determines a tracking mode of the target object according to the fuzziness level, wherein the tracking mode includes a rough tracking mode and a precise tracking mode; The object tracking module selects a corresponding sub-tracking model from the object tracking model according to the tracking mode, uses the sub-tracking model to perform image analysis on the target feature information and the monitoring data to generate tracking monitoring data marked with the target object; predicts the movement trajectory of the target object according to the tracking monitoring data to generate a predicted route; The screen display module displays the tracking monitoring data and the monitoring images of each monitoring location in the predicted route in multiple screens of the LCD display according to the preset display mode; The evaluation and optimization module obtains feedback data, and performs analysis and evaluation based on the feedback data, tracking monitoring data and predicted routes to obtain evaluation results; generates adjustment strategies based on the problem characteristics and optimization characteristics in the evaluation results, and adjusts the object tracking module and the screen display module based on the adjustment strategies.
2. The LCD display screen multi-image sorting system according to claim 1, characterized in that: The analysis of the target object information to determine the fuzzy level and target feature information of the target object information includes: performing image feature extraction and text feature extraction on the target object information to obtain extracted feature information; querying and analyzing the extracted feature information based on a key requirement feature information library to determine the target feature information in the extracted feature information; and calculating the fuzzy level of the target object feature information according to the preset score corresponding to each target feature information in the key requirement feature information library.
3. The LCD display screen multi-image sorting system according to claim 1, characterized in that: The adopting of the sub-tracking model to perform image analysis on target feature information and monitoring data to generate tracking monitoring data marked with the target object includes: When the sub-tracking model is a rough tracking model, the monitoring data is screened and analyzed according to the target feature information to determine the initial target monitoring data; the video frame corresponding to the initial target monitoring data is identified and analyzed using an image recognition model to determine the suspected target object; and the video frame image containing the suspected target object is captured and displayed in the split screen; after obtaining the video frame image selected by the user, the suspected target object in the video frame image is determined as the target object; the target monitoring data containing the target object is screened from the initial target monitoring data according to the feature information corresponding to the target object; When the sub-tracking model is a precise tracking model, the monitoring data is screened and analyzed according to the target feature information to determine the target monitoring data containing the target object; After the target monitoring data of the target object is acquired, the target object in the target monitoring data is marked to obtain tracking monitoring data marked with the target object.
4. The LCD display screen multi-image sorting system according to claim 3, characterized in that: The target object in the target monitoring data is marked to obtain tracking monitoring data marked with the target object, including: obtaining video frame image data containing the target object, target pixel data and marked pixel data of the target object in the target monitoring data; converting the video frame image data into video frame pixel data; adjusting the video frame pixel data according to the target pixel data and the marked pixel data to obtain marked video frame data; converting the marked video frame data into tracking monitoring data in chronological order.
5. The LCD display screen multi-image sorting system according to claim 1, characterized in that: The method of predicting the movement trajectory of the target object according to the tracking monitoring data to generate a predicted route includes: The mobile data and / or associated personnel data of the target object and the channel data of the preset place are obtained according to the tracking monitoring data; when the associated personnel data exist, the movement trajectory of the associated personnel is used as the predicted route of the target object; when the associated personnel data do not exist, the mobile data, associated personnel and channel data are analyzed to predict the terminal position of the target object; the predicted route is generated according to the current position and the terminal position of the target object.
6. The LCD display screen multi-image sorting system according to claim 1, characterized in that: Before displaying the tracking monitoring data and the monitoring images of each monitoring position in the predicted route in multiple screens of the LCD display screen according to the preset display mode, it also includes: obtaining the number and specifications of the LCD display screens and the number of monitoring devices in the set location; analyzing the specifications and number of the LCD display screens to determine the number interval of the split screens; optimizing the number interval of the split screens and the number of monitoring devices to determine the initial display mode; obtaining the display data after the monitoring personnel adjusts the initial display mode to obtain the preset display mode; or obtaining the customized display mode of the monitoring personnel, and using the customized display mode as the preset display mode.
7. The LCD display screen multi-image sorting system according to claim 6, characterized in that: Also includes: Acquire the voice command of the monitoring personnel; recognize the voice command based on the preset command recognition library to determine the preset command with the highest matching degree as the control command; The split screen of the LCD display screen is adjusted according to the control instruction.
8. The LCD display screen multi-image sorting system according to claim 1, characterized in that: The generating of adjustment strategies according to the problem characteristics and optimization characteristics in the evaluation results includes: Determine the steps to be optimized of the object tracking module and / or the screen display module according to the problem characteristics; determine the strategy to be optimized according to the steps to be optimized and the corresponding optimization characteristics; integrate the strategies to be optimized to obtain the adjustment strategy.
9. The LCD display screen multi-image sorting system according to claim 3, characterized in that: Also includes: When the target object loses its trace, the monitoring data at the time of the target object losing its trace is subjected to human behavior recognition analysis to determine the secondary target object carrying the target object; Use the secondary target object as the new target object.
10. The LCD display screen multi-image sorting system according to claim 1, characterized in that: Also includes: The lost item query module obtains the submitted lost items; calls the object tracking module to analyze the lost items to determine the owner and related owners of the lost items; A lost property association database of lost property owners, associated lost property owners and lost items is established, and the lost property association database is partially displayed in a split screen of an LCD display.
Citation Information
Patent Citations
Moving target monitoring method and device and readable storage medium
CN110557603A
Tracking system based on pedestrian re-identification and hierarchical search strategy
CN117037057A
Moving object monitoring apparatus using a plurality of cameras
JP2007267294A
Method and system for tracking with extraction object using coarse to fine techniques
KR101542206B1
Blur object tracker using group lasso method and apparatus
US20160125249A1
Cited By
Remote video monitoring method and system for road construction site
CN120416440A