Elevator advertising board compliance judgment method and device, storage medium and electronic equipment

Abstract

The invention provides an elevator advertising board compliance judgment method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring an image of an elevator advertising board area; preprocessing the image of the advertising board area; performing deep analysis and identification on the preprocessed image to obtain multi-modal information of the advertising board; acquiring description features corresponding to the advertising board according to the multi-modal information; and judging the compliance of the advertising board according to the description characteristics. According to the method, the accuracy and efficiency of compliance judgment of the elevator advertising board can be improved.

Description

Technical Field

[0001] The present application belongs to the technical field of elevators and relates to a compliance judgment method, and in particular to an elevator billboard compliance judgment method, device, storage medium and electronic equipment. Background Art

[0002] Elevators are important vertical transportation tools in modern buildings and are widely used in various high-rise buildings, such as residential buildings, commercial centers, office buildings, and hotels. The main function of elevators is to transport people and goods safely and efficiently, reduce travel time between floors, and improve the convenience of building use. Elevators are places where people flow together, and the length of time passengers stay in elevators is relatively fixed, so the space inside elevators is widely used as an important place for advertising. With its unique geographical location and high exposure rate, elevator billboards have become one of the preferred ways for many businesses to promote their products and brands. However, with the increasing prosperity of the elevator advertising market, the traditional management methods of elevator billboards have gradually exposed many shortcomings. Summary of the invention

[0003] The embodiments of the present application provide a method, device, storage medium and electronic device for judging the compliance of an elevator billboard, which are used to judge the compliance of an elevator billboard.

[0004] In a first aspect, an embodiment of the present application provides a method for judging the compliance of an elevator billboard, the method comprising: acquiring an image of an elevator billboard area; preprocessing the image of the billboard area; performing in-depth analysis and recognition on the preprocessed image to obtain multimodal information of the billboard; acquiring descriptive features corresponding to the billboard based on the multimodal information; and judging the compliance of the billboard based on the descriptive features.

[0005] In an implementation of the first aspect, preprocessing the image of the billboard area includes: performing denoising processing, image enhancement processing, image segmentation and correction processing and / or image compression processing on the image of the billboard area.

[0006] In an implementation of the first aspect, performing in-depth analysis and identification on the preprocessed image to obtain multimodal information of the billboard includes: processing the preprocessed image using a feature extraction and classification model to obtain the type of the billboard; and based on the type of the billboard, analyzing and identifying the preprocessed image using an information recognition model to obtain multimodal information of the billboard.

[0007] In an implementation of the first aspect, using an information recognition model to analyze and recognize the preprocessed image to obtain multimodal information of the billboard includes: using an optical character recognition model to process the preprocessed image to obtain text information; based on the preprocessed image, using a visual large model to obtain image information and / or video information.

[0008] In an implementation of the first aspect, obtaining the descriptive features corresponding to the billboard according to the multimodal information includes: fusing the multimodal information to obtain fused information; and extracting text features from the fused information to obtain the descriptive features.

[0009] In an implementation of the first aspect, judging the compliance of the billboard includes: using sensitive word detection technology and image recognition technology to judge whether the content of the billboard contains sensitive words and / or images; comparing the descriptive features with the data in the compliant advertisement feature library to judge whether the content of the billboard is compliant.

[0010] In an implementation of the first aspect, the elevator billboard compliance judgment method also includes: providing a visual interactive interface through a management module, and the visual interactive interface is used to realize the interaction between the user and the system; and / or generating a billboard replacement plan based on the relevant information of the billboard, and the relevant information includes the compliance of the billboard, display effect, content update requirements and / or contract period.

[0011] In a second aspect, an embodiment of the present application provides an elevator billboard compliance judgment device, the device comprising: an image acquisition module, used to acquire an image of an elevator billboard area; a preprocessing module, used to preprocess the image of the billboard area; a multimodal information acquisition module, used to perform in-depth analysis and identification on the preprocessed image to obtain multimodal information of the billboard; a description feature acquisition module, used to acquire the description features corresponding to the billboard according to the multimodal information; and a compliance judgment module, used to judge the compliance of the billboard according to the description features.

[0012] In a third aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method described in any one of the first aspects of the embodiment of the present application is implemented.

[0013] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising: a memory storing a computer program; and a processor communicatively connected to the memory, for executing any of the methods described in the first aspect of the embodiment of the present application when the computer program is called.

[0014] The elevator billboard compliance judgment method provided in the embodiment of the present application obtains multimodal information of the elevator billboard through deep analysis and recognition technology, obtains descriptive features based on the multimodal information, and performs compliance judgment based on the descriptive features. This method has the advantages of high accuracy and low cost.

[0015] In the embodiment of the present application, a 360-degree rotatable camera technology with a top view can be used to achieve comprehensive and no-dead-angle shooting of the advertising area inside the elevator, thereby obtaining high-quality original data.

[0016] In the embodiment of the present application, the image quality can be improved by preprocessing the image of the billboard area, and the calculation amount and time cost in the subsequent processing process can be reduced, thereby improving the operating efficiency of the system.

[0017] The elevator billboard compliance judgment method provided in the embodiment of the present application can automatically calculate and optimize the billboard replacement time, thereby improving the use efficiency of the billboard. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 Shown is a schematic diagram of an overall implementation of an embodiment of the present application.

[0019] Figure 2 Shown is a flow chart of the elevator billboard compliance judgment method provided in an embodiment of the present application.

[0020] Figure 3 Shown is a flowchart for obtaining multimodal information in an embodiment of the present application.

[0021] Figure 4 Shown is a schematic diagram of identifying the type of billboards in an embodiment of the present application.

[0022] Figure 5 Shown is a schematic diagram for obtaining the described features in an embodiment of the present application.

[0023] Figure 6 Shown is a flow chart of generating and optimizing a replacement plan in an embodiment of the present application.

[0024] Figure 7 Shown is a schematic diagram of the structure of an elevator billboard compliance judgment device provided in an embodiment of the present application.

[0025] Figure 8 Shown is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0026] Component number description

[0027] 700 Elevator billboard compliance judgment device

[0028] 701 Image acquisition module

[0029] 702 Preprocessing Module

[0030] 703 Multimodal Information Acquisition Module

[0031] 704 Description feature acquisition module

[0032] 705 Compliance Judgment Module

[0033] 800 Electronic equipment

[0034] 801 Processor

[0035] 802 Memory

[0036] 8021 Operating System

[0037] 8022 Applications

[0038] 803 Network Interface

[0039] 804 bus system

[0040] 805 User Interface

[0041] Steps S21 to S25

[0042] Steps S31 to S32

[0043] Steps S61 to S65 DETAILED DESCRIPTION

[0044] The following describes the embodiments of the present application through specific examples, and those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0045] It should be noted that the illustrations provided in the following embodiments are only used to illustrate the basic concept of the present application in a schematic manner, and therefore the illustrations only show components related to the present application rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0046] In the embodiments of the present application, the words "exemplary" or "for example" represent examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0047] In the embodiments of the present application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, ab, ac, bc or abc, where a, b, c can be single or multiple.

[0048] The compliance judgment and management of elevator billboards are mainly completed manually. However, the content of elevator billboards is diverse, involving different products, brands, and promotional information. Auditors who make compliance judgments need to have certain professional knowledge and judgment, which places high demands on auditors.

[0049] Some technical solutions use sensors to detect billboard replacements, or use QR code technology to achieve digital management of advertising content. However, these technologies still have some limitations. For example, the use of sensors for monitoring can only record replacement behavior, but cannot understand and review advertising content. Although QR code technology can achieve digital management, the operation is cumbersome and the user experience is poor.

[0050] At least to address the above-mentioned issues, an embodiment of the present application provides a method for determining the compliance of an elevator billboard. Figure 1 It is a schematic diagram of an overall implementation of the embodiment of the present application. Figure 1 As shown, a camera is arranged in the elevator, and the camera is used to collect images of the elevator billboard area and send the images to an electronic device.

[0051] In some implementations, the electronic device is, for example, a computer, but the present application is not limited thereto.

[0052] In some implementations, the camera can be a 360-degree rotatable camera with a top view, and is deployed in the central top area of ​​the elevator to capture a complete image of the billboard area in the elevator. In addition, the camera can use a high-resolution sensor to ensure that clear images are captured, thereby providing high-quality raw data for subsequent image processing and advertisement recognition.

[0053] In some implementations, the camera is equipped with an intelligent control system, which is used to control the camera to rotate and shoot according to specified shooting parameters and user instructions, thereby improving shooting efficiency and accuracy.

[0054] In some implementations, a fixed structure can be used to stably fix the camera on the top of the elevator, and anti-shake technology can be used to ensure shooting stability during elevator operation to avoid image blur or distortion caused by vibration or shaking.

[0055] In some implementations, a small and lightweight camera can be selected and deployed in the elevator to reduce the difficulty of installation and debugging and avoid affecting the normal operation of the elevator.

[0056] Figure 2 The flowchart of the elevator billboard compliance judgment method provided in the embodiment of the present application is shown. The method can be applied to Figure 1 The electronic equipment shown. Figure 2 As shown, the elevator billboard compliance judgment method provided in the embodiment of the present application includes the following steps S21 to S25.

[0057] S21, acquiring an image of the elevator billboard area.

[0058] S22, preprocessing the image of the billboard area to improve the image quality.

[0059] S23, performing deep analysis and recognition on the preprocessed image to obtain multimodal information of the billboard. Exemplarily, a deep analysis and recognition model may be used to recognize the preprocessed image to obtain multimodal information, wherein the deep analysis and recognition model is, for example, a trained deep learning network model.

[0060] S24, obtaining description features corresponding to the billboard according to the multimodal information.

[0061] S25, judging the compliance of the billboard based on the descriptive features.

[0062] In some implementations, preprocessing the image of the billboard area includes: performing denoising, image enhancement, image segmentation and correction, and / or image compression on the image of the billboard area.

[0063] Specifically, due to the acquisition environment, the acquisition device itself, and various interferences during the transmission process, there may be some noise in the acquired image, which will affect the clarity of the image and thus have an adverse effect on subsequent image recognition. To address this problem, in the embodiments of the present application, the image can be denoised to remove the noise in the image and restore the original details of the image.

[0064] In order to improve the visual effect and recognition accuracy of the image, the image can be enhanced in the embodiment of the present application. Among them, the image enhancement processing is, for example, contrast enhancement, brightness adjustment, color correction, etc. By adjusting the contrast, brightness and color of the image, the advertising area in the image can be made more prominent, which is convenient for subsequent image recognition and analysis.

[0065] In order to separate the advertising area in the image from other background areas in the elevator so that the advertising area can be analyzed and processed separately later, the image can be segmented in the embodiment of the present application. In addition, the image acquisition process may be affected by factors such as angle and light, resulting in problems such as image distortion and deformation. In response to this problem, the image can be corrected in the embodiment of the present application, and the correction process includes geometric correction and / or perspective correction, etc., to ensure the accuracy and authenticity of the image.

[0066] Exemplarily, the segmentation and correction processing of the image may include: gray-scaling the image to reduce the complexity of color information; binarizing the gray-scaled image or applying the Canny edge detection algorithm to clearly identify and extract the outline of the billboard; using the detected billboard outline to obtain the vertex information of the image, and segmenting the image based on the vertex information; correcting the segmented image through perspective changes to make it present a correct rectangular perspective.

[0067] In order to save storage space and improve processing efficiency, in the embodiment of the present application, the image can also be compressed and stored in a specified location for subsequent image recognition.

[0068] As mentioned above, by preprocessing the image, the image quality can be significantly improved, providing strong support for subsequent advertisement recognition, content understanding and compliance judgment. In addition, these preprocessing operations can also reduce the amount of calculation and time cost in the subsequent processing process, and improve the operating efficiency of the entire system.

[0069] It should be noted that the above only lists several pre-processing methods by way of example, but the present application is not limited thereto.

[0070] See also Figure 3In some implementations, performing in-depth analysis and recognition on the preprocessed image to obtain multimodal information of the billboard includes the following steps S31 and S32.

[0071] S31, using a feature extraction and classification model to process the preprocessed image to obtain the type of the billboard.

[0072] See also Figure 4 In some implementations, a specific CNN (Convolutional Neural Network) model can be trained as a feature extraction and classification model to identify the type of billboards in the image, such as static posters, dynamic video ads, and LED display advertising lights. It should be noted that the GLMV-4 visual large model can also be used in the embodiments of the present application to identify the type of billboards, which can improve the consistency and operation and maintenance costs of the overall system.

[0073] S32, based on the type of the billboard, using an information recognition model to analyze and recognize the preprocessed image to obtain multimodal information of the billboard.

[0074] Exemplarily, using an information recognition model to analyze and recognize the preprocessed image to obtain multimodal information of the billboard includes the following steps S321 and S322.

[0075] S321, using an OCR (Optical Character Recognition) model to process the pre-processed image to obtain text information.

[0076] S322, based on the preprocessed image, use the visual big model to obtain image information and / or video information.

[0077] Figure 5 Shown is an example diagram of obtaining multimodal information of a billboard in an embodiment of the present application. Figure 5 As shown, after identifying the type of billboard, the OCR model can be used to extract text information for the text part, the single frame image can be input into the visual model to obtain image information for the image part, and multiple frames of images can be merged and input into the visual model to obtain video information for the video part. The text information, image information and video information are fused to obtain fused information, which includes, for example, subject category, product information, brand information, etc. A text feature extraction model, such as the GLM-4 embedding model, can be used to extract text features in the fused information to obtain description features.

[0078] Exemplarily, in the embodiments of the present application, a multimodal deep learning framework can be used to implement joint learning and analysis of image information, text information and / or video information, thereby improving the level of intelligence in billboard management.

[0079] In some implementations, the feature extraction and classification model and the information recognition model have the ability to update and self-optimize in real time. According to the update of the advertisement form and content, the model continuously improves the accuracy of recognition and understanding through continuous learning and updating, and can self-optimize according to the actual application scenarios and user needs to adapt to different application scenarios and changes. For example, the continuous updating and optimization of the model can be achieved by building an online learning mechanism and using technical means such as incremental learning and transfer learning.

[0080] In some implementations, determining the compliance of the billboard may include comparing the descriptive features with data in a compliant advertisement feature library to determine whether the content of the billboard is compliant.

[0081] Specifically, the GLM-4 embedding model can be used to establish a compliance advertising feature library, which can be regularly updated to ensure the accuracy of compliance judgment. The description features are compared with the content in the compliance advertising feature library to determine whether the content of the billboard is compliant.

[0082] In some implementations, judging the compliance of a billboard may include: using sensitive word detection technology and image recognition technology to judge whether the content of the billboard contains sensitive words and / or images. If the content of the billboard includes sensitive words and / or images, the billboard is judged to be non-compliant. Exemplarily, a trained large model may be used to identify sensitive words and / or sensitive images in the billboard.

[0083] In some implementations, the elevator billboard compliance judgment method provided in the embodiment of the present application may also include: when compliance issues are found in the advertisement content, issuing a risk warning and generating a compliance report. The compliance report may include specific issues existing in the billboard and possible consequences, providing strong support for subsequent rectification and processing.

[0084] In some implementations, the elevator billboard compliance judgment method provided in the embodiment of the present application may also include: providing a visual interactive interface through a management module, and the visual interactive interface is used to realize the interaction between the user and the system. Exemplarily, the visual interactive interface can be an interactive form of a web page, a WeChat applet, a network interface, etc. The user can manage the elevator advertisement through the interface, for example, query the advertisement location information, monitor the advertisement content in real time, and manage the advertisement replacement, etc.

[0085] In some implementations, the elevator billboard compliance judgment method provided in the embodiments of the present application may also include: generating a billboard replacement plan based on relevant information of the billboard, the relevant information including the billboard's compliance, display effect, content update requirements and / or contract period.

[0086] For example, see Figure 6 In the embodiment of the present application, generating a billboard replacement plan based on relevant information of the billboard includes the following steps S61 to S65.

[0087] S61, collect relevant information and integrate them. For example, the display effect of the billboard, such as the number of viewers, dwell time, interaction, etc., can be collected in real time through camera sensors; demand information for content updates can be collected regularly based on advertiser needs, market trends, seasonal changes, etc.; an advertising contract database can be established to record key information such as the start date, end date, and renewal status of each advertisement.

[0088] S62, intelligently analyzing and predicting the collected information to obtain a replacement time. Specifically, the optimal advertisement replacement time can be predicted by using a machine learning algorithm in combination with content update requirements and contract terms to ensure the freshness and timeliness of the advertisement content.

[0089] S63, generate and optimize a replacement plan. Specifically, the process may include: automatically generate a preliminary replacement plan based on the results of intelligent analysis and prediction, including replacement time, replacement content, replacement sequence, etc.; optimize and adjust the preliminary plan based on advertiser feedback, market changes and other factors to ensure the feasibility and effectiveness of the plan; monitor the execution of the replacement plan in real time to ensure that the plan is completed on time, with quality and quantity.

[0090] S64, regularly generate a replacement plan execution report, including detailed information such as replacement time, replacement content, and execution effect, and feed it back to advertisers and managers.

[0091] S65, establish an advertiser feedback mechanism to collect advertisers’ opinions and suggestions on the replacement plan, and continuously optimize and improve the system’s functions and performance.

[0092] The protection scope of the elevator billboard compliance judgment method provided in the embodiment of the present application is not limited to the execution order of the steps listed in this embodiment. All solutions implemented by adding, reducing or replacing steps in the prior art based on the principles of the present application are included in the protection scope of the present application.

[0093] The embodiment of the present application also provides an elevator billboard compliance judgment device, which can implement the elevator billboard compliance judgment method of the present application, but the implementation device of the elevator billboard compliance judgment method of the present application includes but is not limited to the structure of the elevator billboard compliance judgment device listed in this embodiment. All structural deformations and replacements of the prior art made according to the principles of the present application are included in the protection scope of the present application.

[0094] Figure 7 is a schematic block diagram of an elevator billboard compliance judgment device provided in an embodiment of the present application. Figure 7 As shown, the elevator billboard compliance judgment device 700 includes an image acquisition module 701, a preprocessing module 702, a multimodal information acquisition module 703, a description feature acquisition module 704 and a compliance judgment module 705. Among them, the image acquisition module 701 is used to acquire an image of the elevator billboard area. The preprocessing module 702 is used to preprocess the image of the billboard area. The multimodal information acquisition module 703 is used to perform in-depth analysis and recognition on the preprocessed image to obtain multimodal information of the billboard. The description feature acquisition module 704 is used to obtain the description features corresponding to the billboard according to the multimodal information. The compliance judgment module 705 is used to judge the compliance of the billboard according to the description features.

[0095] It should be understood that the specific process of each module executing the above corresponding steps has been described in detail in the above method embodiment, and for the sake of brevity, it will not be repeated here.

[0096] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by the processor, the elevator billboard compliance judgment method provided by the present application is implemented. A person of ordinary skill in the art can understand that all or part of the steps in the method for implementing the above embodiment can be completed by instructing the processor through a program, and the program can be stored in a computer-readable storage medium, and the storage medium is a non-transitory medium, such as a random access memory, a read-only memory, a flash memory, a hard disk, a solid-state hard disk, a magnetic tape, a floppy disk, an optical disc, and any combination thereof. The above storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (DVD)), or a semiconductor medium (e.g., a solid-state disk (SSD)), etc.

[0097] An embodiment of the present application also provides an electronic device. Figure 8 is a schematic block diagram of an electronic device provided in an embodiment of the present application. Figure 8 As shown, the electronic device 800 includes: at least one processor 801, a memory 802, at least one network interface 803 and a user interface 805. The various components in the electronic device 800 are coupled together through a bus system 804. It can be understood that the bus system 804 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 804 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 804 is not described in detail. Figure 8 In the specification, various buses are labeled as bus systems.

[0098] The user interface 805 may include a display, a keyboard, a mouse, a trackball, a click gun, keys, buttons, a touch pad or a touch screen.

[0099] It is understood that the memory 802 can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), which is used as an external cache. By way of exemplary but not limiting explanation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM). The memory described in the embodiments of the present application is intended to include but is not limited to these and any other suitable categories of memory.

[0100] The memory 802 in the embodiment of the present application is used to store various categories of data to support the operation of the electronic device 800. Examples of these data include: any executable program for operating on the electronic device 800, such as an operating system 8021 and an application 8022; the operating system 8021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks. The application 8022 may include various applications, such as a media player (Media Player), a browser (Browser), etc., for implementing various application services. The elevator billboard compliance judgment method provided in the embodiment of the present application may be included in the application 8022.

[0101] The method disclosed in the above embodiment of the present application can be applied to the processor 801, or implemented by the processor 801. The processor 801 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor 801 or an instruction in the form of software. The above processor 801 may be a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 801 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor 801 may be a microprocessor or any conventional processor, etc. In combination with the steps of the accessory optimization method provided in the embodiment of the present application, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium, which is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.

[0102] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application specific integrated circuits (ASIC), DSP, programmable logic device (PLD), complex programmable logic device (CPLD) to execute the aforementioned method.

[0103] The terms "component", "module", "system", etc. used in this specification are used to represent computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program and / or a computer. By way of illustration, both applications running on a computing device and a computing device can be components. One or more components may reside in a process and / or an execution thread, and a component may be located on a computer and / or distributed between two or more computers. In addition, these components may be executed from various computer-readable media having various data structures stored thereon. Components may, for example, communicate through local and / or remote processes according to signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system and / or a network, such as the Internet interacting with other systems through signals).

[0104] Those of ordinary skill in the art will appreciate that the various illustrative logical blocks and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or in a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0105] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0106] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0107] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0108] In the above embodiments, the functions of each functional unit can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions (programs). When loading and executing computer program instructions (programs) on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. Computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center.

[0109] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk.

[0110] In summary, the elevator billboard compliance judgment method provided in the embodiment of the present application obtains the multimodal information of the elevator billboard through deep analysis and recognition technology, obtains the descriptive features according to the multimodal information, and performs compliance judgment based on the descriptive features. This method has the advantages of high accuracy and low cost. In the embodiment of the present application, the top-view 360-degree rotatable camera technology can be used to achieve comprehensive and blind-angle shooting of the elevator internal advertising area, thereby obtaining high-quality original data. In the embodiment of the present application, the image quality can be improved by pre-processing the image of the billboard area, and the calculation amount and time cost in the subsequent processing process can be reduced, thereby improving the operating efficiency of the system. The elevator billboard compliance judgment method provided in the embodiment of the present application can automatically calculate and optimize the replacement time of the billboard, thereby improving the use efficiency of the billboard. Therefore, the present application effectively overcomes the various shortcomings in the prior art and has a high industrial utilization value.

[0111] The above embodiments are merely illustrative of the principles and effects of the present application and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application.

Claims

1. A method for judging the compliance of an elevator billboard, characterized in that: include: Get an image of the elevator billboard area; Preprocessing the image of the billboard area; Perform in-depth analysis and recognition on the preprocessed images to obtain multimodal information of the billboard; Acquire a description feature corresponding to the billboard according to the multimodal information; The compliance of the billboard is judged according to the descriptive features.

2. The method according to claim 1, characterized in that: The preprocessing of the image in the billboard area includes: performing denoising, image enhancement, image segmentation and correction, and / or image compression on the image in the billboard area.

3. The method according to claim 1, characterized in that The pre-processed image is deeply analyzed and recognized to obtain the multimodal information of the billboard, including: Processing the preprocessed image using a feature extraction and classification model to obtain the type of the billboard; Based on the type of the billboard, an information recognition model is used to analyze and recognize the preprocessed image to obtain multimodal information of the billboard.

4. The method according to claim 3, characterized in that Using an information recognition model to analyze and recognize the preprocessed image to obtain multimodal information of the billboard includes: Using an optical character recognition model to process the preprocessed image to obtain text information; Based on the preprocessed image, a visual macro model is used to acquire image information and / or video information.

5. The method according to claim 1, characterized in that Acquiring the description feature corresponding to the billboard according to the multimodal information includes: fusing the multimodal information to obtain fused information; Perform text feature extraction on the fusion information to obtain the description feature.

6. The method according to claim 1, characterized in that The compliance of the billboards is determined by: Using sensitive word detection technology and image recognition technology to determine whether the content of the billboard contains sensitive words and / or images; The descriptive features are compared with data in a compliant advertisement feature library to determine whether the content of the billboard is compliant.

7. The method according to claim 1, characterized in that Also includes: Providing a visual interaction interface through the management module, wherein the visual interaction interface is used to realize the interaction between the user and the system; and / or A billboard replacement plan is generated based on relevant information of the billboard, wherein the relevant information includes compliance, display effect, content update requirements and / or contract period of the billboard.

8. An elevator billboard compliance judgment device, characterized in that: include: An image acquisition module, used to acquire an image of the elevator billboard area; A preprocessing module, used for preprocessing the image of the billboard area; A multimodal information acquisition module is used to perform in-depth analysis and recognition on the preprocessed image to obtain multimodal information of the billboard; A description feature acquisition module, used to acquire the description feature corresponding to the billboard according to the multimodal information; A compliance judgment module is used to judge the compliance of the billboard according to the description features.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

10. An electronic device, characterized in that: The electronic device comprises: A memory storing a computer program; A processor is communicatively connected to the memory, and executes the method according to any one of claims 1 to 7 when calling the computer program.

Images