A label placement identification method, device, equipment and storage medium

Abstract

The application provides a label placement identification method and device, equipment and a storage medium, relates to the technical field of image recognition, can automatically identify the placement of the label and output the result to remind the staff to correct, and can improve the inspection efficiency of the label placement. The method comprises the following steps: acquiring an image of a target area; identifying label information in the image; acquiring personnel information; and determining a label placement result of the target area based on the label information and the personnel information. The application can be used in the process of conference label placement.

Description

Technical Field

[0001] This application relates to the field of image recognition technology, and in particular to a method, apparatus, device and storage medium for recognizing sign placement. Background Technology

[0002] In some scenarios, signs are often placed at the participants' seats to indicate the identity information of the person at each seat. After the signs are placed, relevant staff members usually manually verify whether the signs match the people at the corresponding seats and then adjust the placement of the signs accordingly. However, this manual verification method by staff is inefficient in checking the placement of the signs. Summary of the Invention

[0003] This application provides a method, apparatus, device, and storage medium for identifying sign placement, which can improve the efficiency of sign placement inspection.

[0004] In a first aspect, this application provides a sign placement recognition method, which includes: acquiring an image of a target area; recognizing sign information in the image; acquiring personnel information; and determining the sign placement result of the target area based on the sign information and the personnel information.

[0005] The sign placement recognition method provided in this application acquires an image of a target area, identifies sign information based on the image, further acquires personnel information, and determines the sign placement result based on the sign information and personnel information. This solution can automatically determine the sign placement result, and is more efficient than traditional manual judgment methods.

[0006] In one possible implementation, the sign placement result of the target area is determined based on the sign information and personnel information, including: determining whether the signs in the target area have been placed based on the number of signs in the sign information and the number of personnel in the personnel information; and / or determining whether the signs in the target area are placed correctly based on the sign information and personnel information; the sign information includes the sign location and sign content, or the sign information includes the number of signs, sign location, and sign content.

[0007] In another possible implementation, based on the number of signs in the signage information and the number of people in the personnel information, it is determined whether the signs in the target area have been placed, including: if the number of signs is less than the number of people, the sign placement result in the target area is determined as the first result, which indicates that the signs have not been placed or that the signs have not been placed completely; if the number of signs is greater than or equal to the number of people, the sign placement result in the target area is determined as the second result, which indicates that the signs have been placed.

[0008] In another possible implementation, the personnel information includes the preset personnel positions in the image and the preset identities corresponding to those positions. Based on the sign information and the personnel information, it is determined whether the sign placement in the target area is correct, including: identifying the sign positions corresponding to the preset personnel positions; determining whether the sign content at the sign position is the preset identity; if yes, the sign placement result in the target area is determined as the third result, indicating that the sign placement is correct; if no, the sign placement result in the target area is determined as the fourth result, indicating that the sign placement is incorrect.

[0009] In another possible implementation, personnel information includes the number of personnel; based on the signage information and personnel information, it is determined whether the signage placement in the target area is correct, including:

[0010] When there is 1 person and 1 sign, determine whether the sign content is the first preset identity; if yes, determine the sign placement result in the target area as the third result, indicating that the sign is placed correctly; if no, determine the sign placement result in the target area as the fourth result, indicating that the sign is placed incorrectly.

[0011] or,

[0012] When the number of people is 1 and the number of signs is an odd number greater than 1, determine whether the content of the first sign is the first preset identity; the first sign is the sign located in the middle position on the image; if not, determine the sign placement result of the target area as the fifth result, the fifth result indicates that the first sign is placed incorrectly; if yes, determine the sign placement result of the target area as the sixth result, the sixth result indicates that the first sign is placed correctly.

[0013] or,

[0014] When the number of people is 1 and the number of signs is an even number greater than 1, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect.

[0015] or,

[0016] When the number of people is an odd number greater than 1, and the number of signs is greater than or equal to the number of people and the number of signs is odd, determine whether the content of the first sign is the second preset identity. The second preset identity is different from the first preset identity. The first sign is the sign that is in the middle position on the image. If not, determine the sign placement result of the target area as the fifth result. The fifth result indicates that the first sign is placed incorrectly.

[0017] or,

[0018] When the number of people is an odd number greater than 1 and the number of signs is an even number greater than the number of people, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect.

[0019] or,

[0020] Based on the number of people, determine the preset identity of the preset sign location; identify the sign content at the preset sign location; if the sign content matches the preset identity, determine the sign placement result in the target area as the third result, indicating that the sign is placed correctly; if the sign content does not match the preset identity, determine the sign placement result in the target area as the fourth result, indicating that the sign is placed incorrectly.

[0021] In another possible implementation, if the content of the first sign is determined to be a second preset identity, then based on the sign information and personnel information, determining whether the sign placement in the target area is correct also includes: determining whether the content of the second sign is a third preset identity; the second sign is the sign located to the left and right of the first sign in the image; if the content of each second sign is a third preset identity, then the sign placement result in the target area is determined to be a third result, indicating that the sign placement is correct; if the content of at least one second sign is inconsistent with the third preset identity, then the sign placement result in the target area is determined to be a fourth result, indicating that the sign placement is incorrect.

[0022] Secondly, this application provides a sign placement recognition device, which includes: an acquisition module, an identification module, and a determination module; the acquisition module is used to acquire an image of a target area; the identification module is used to identify sign information in the image; the acquisition module is also used to acquire personnel information; the determination module is used to determine the sign placement result of the target area based on the sign information and the personnel information.

[0023] In one possible implementation, the determining module is specifically used to: determine whether signs in the target area have been placed based on the number of signs in the signage information and the number of people in the personnel information; and / or, determine whether the signs in the target area are placed correctly based on the signage information and the personnel information; the signage information includes the signage location and the signage content, or the signage information includes the number of signs, the signage location, and the signage content.

[0024] In another possible implementation, the determining module is specifically used to determine the sign placement result of the target area as the first result if the number of signs is less than the number of people, indicating that the signs are not placed or are not fully placed; if the number of signs is greater than or equal to the number of people, the determining module is the second result, indicating that the signs are placed.

[0025] In another possible implementation, the personnel information includes the preset personnel location in the image and the preset identity corresponding to the preset personnel location; the determining module is specifically used to identify the sign location corresponding to the preset personnel location; determine whether the sign content at the sign location is the preset identity; if yes, then the sign placement result in the target area is determined as the third result, and the third result indicates that the sign placement is correct; if no, then the sign placement result in the target area is determined as the fourth result, and the fourth result indicates that the sign placement is incorrect.

[0026] In another possible implementation, personnel information includes the number of personnel; the determination module is specifically used for...

[0027] When there is 1 person and 1 sign, determine whether the sign content is the first preset identity; if yes, determine the sign placement result in the target area as the third result, indicating that the sign is placed correctly; if no, determine the sign placement result in the target area as the fourth result, indicating that the sign is placed incorrectly.

[0028] or,

[0029] When the number of people is 1 and the number of signs is an odd number greater than 1, determine whether the content of the first sign is the first preset identity; the first sign is the sign located in the middle position on the image; if not, determine the sign placement result of the target area as the fifth result, the fifth result indicates that the first sign is placed incorrectly; if yes, determine the sign placement result of the target area as the sixth result, the sixth result indicates that the first sign is placed correctly.

[0030] or,

[0031] When the number of people is 1 and the number of signs is an even number greater than 1, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect.

[0032] or,

[0033] When the number of people is an odd number greater than 1, and the number of signs is greater than or equal to the number of people and the number of signs is odd, determine whether the content of the first sign is the second preset identity. The second preset identity is different from the first preset identity. The first sign is the sign that is in the middle position on the image. If not, determine the sign placement result of the target area as the fifth result. The fifth result indicates that the first sign is placed incorrectly.

[0034] or,

[0035] When the number of people is an odd number greater than 1 and the number of signs is an even number greater than the number of people, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect.

[0036] or,

[0037] Based on the number of people, determine the preset identity of the preset sign location; identify the sign content at the preset sign location; if the sign content matches the preset identity, determine the sign placement result in the target area as the third result, indicating that the sign is placed correctly; if the sign content does not match the preset identity, determine the sign placement result in the target area as the fourth result, indicating that the sign is placed incorrectly.

[0038] In another possible implementation, if the content of the first sign is determined to be a second preset identity, the determining module is further specifically used to determine whether the content of the second sign is a third preset identity; the second sign is the sign located to the left or right of the first sign in the image; if the content of each second sign is a third preset identity, then the sign placement result in the target area is determined to be a third result, and the third result indicates that the sign placement is correct; if the content of at least one second sign is inconsistent with the third preset identity, then the sign placement result in the target area is determined to be a fourth result, and the fourth result indicates that the sign placement is incorrect.

[0039] Thirdly, this application provides a sign placement recognition device, which includes a processor and a memory; the memory stores instructions executable by the processor; when the processor is configured to execute the instructions, the sign placement recognition device implements the method described in the first aspect.

[0040] Fourthly, this application provides a computer-readable storage medium comprising: computer software instructions; which, when executed in a computer, cause the computer to implement the method described in the first aspect.

[0041] Fifthly, this application provides a computer program product that, when run on a computer, causes the computer to perform the steps of the relevant method described in the first aspect above, so as to implement the method of the first aspect above.

[0042] The beneficial effects of the second to fifth aspects mentioned above can be referred to the corresponding description of the first aspect, and will not be repeated here. Attached Figure Description

[0043] Figure 1 A schematic diagram illustrating the application environment of a sign placement and recognition method provided in this application;

[0044] Figure 2 A flowchart illustrating a sign placement and identification method provided in this application;

[0045] Figure 3 This application provides a schematic diagram of a sign placement scenario;

[0046] Figure 4 This application provides an illustration of another sign placement scenario;

[0047] Figure 5 This application provides another illustration of a sign placement scenario;

[0048] Figure 6 This application provides another illustration of a sign placement scenario;

[0049] Figure 7 A flowchart illustrating a sign placement and recognition process provided in this application;

[0050] Figure 8 A schematic diagram illustrating the composition of a sign placement and identification device provided in this application;

[0051] Figure 9 This is a schematic diagram illustrating the composition of a sign placement and recognition device provided in this application. Detailed Implementation

[0052] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0053] It should be noted that in the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design scheme described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.

[0054] To facilitate a clear description of the technical solutions of the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish the same or similar items with essentially the same function and effect. Those skilled in the art can understand that the terms "first" and "second" are not intended to limit the quantity or execution order.

[0055] As described in the background section, in some scenarios, signs are often placed at the participants' seats to indicate the identity information of the target person at each seat. Currently, relevant staff members typically manually check whether the placement of the signs corresponds to the identity of the person at each seat and adjust the placement of the signs accordingly. However, manual verification is inefficient.

[0056] In conclusion, improving the efficiency of confirming the placement of signs is an urgent problem that needs to be solved.

[0057] Based on this, embodiments of this application provide a sign placement recognition method. This method acquires images of a target area using a camera, employs image recognition technology to identify sign information within the images, and then automatically determines the sign placement result based on the acquired personnel and sign information. This method can replace manual verification, significantly improving efficiency.

[0058] The sign placement identification method provided in this application can be applied to, for example... Figure 1 The sign placement and recognition application environment is shown below. For example... Figure 1 As shown, the application environment may include a sign placement recognition device 101 and a camera 102. The sign placement recognition device 101 and the camera 102 are interconnected.

[0059] The sign placement recognition device 101 can be applied to a server. The server referred to here can be a server cluster consisting of multiple servers, a single server, or a computer. Specifically, the sign placement recognition device 101 can be a processor or processing chip within the server. This application embodiment does not limit the specific device form of the server described above. Figure 1 The Sino-Israeli sign placement identification device 101 is illustrated using a single server as an example.

[0060] The aforementioned camera 102 can be deployed in a meeting setting, facing the target area (such as the area where the main seats of the meeting are located) to capture images of the target area, and transmit the images to the sign placement recognition device for image recognition processing.

[0061] It should be noted that the above embodiments are illustrated using the camera and the sign placement recognition device as two different devices. In other embodiments, the two devices can be the same device, such as a smart camera with an intelligent processing module, which can independently perform image capture and image recognition processing. This application does not impose specific limitations on these embodiments.

[0062] For ease of description, the implementing entity of this solution will be referred to as the sign placement recognition device. It can be understood that when the camera is a smart camera, the sign placement recognition device refers to the intelligent processing module within the smart camera. When the camera is a regular camera, the sign placement recognition device refers to the server connected to the camera for image processing.

[0063] Figure 2 This is a flowchart illustrating a sign placement recognition method provided in an embodiment of this application. Exemplarily, the sign placement recognition method provided in this application can be applied to... Figure 1The application environment shown.

[0064] like Figure 2 As shown, the sign placement and identification method provided in this application may specifically include the following steps:

[0065] S201, The sign placement recognition device acquires an image of the target area.

[0066] When it is necessary to confirm whether the signage is placed correctly, staff can pre-position a camera facing the target area of ​​the scene to be identified, i.e., the area where the signage is placed, to capture an image of the target area. In some embodiments, the signage placement recognition device can acquire an image of the target area from the camera. This image can be a single frame captured by the camera or a video stream composed of multiple frames; this application embodiment does not impose specific limitations on this.

[0067] S202, The sign placement recognition device recognizes the sign information in the image.

[0068] In some embodiments, after acquiring an image of the target area, the sign placement recognition device can identify the sign information in the image using methods such as quantity detection, target recognition, or facial recognition. For example, an algorithm model can be pre-trained, the image can be input into the algorithm model, and the output result can be the sign information.

[0069] The signage information may include one or more of the following: the number of signs, the location information of each sign, and the content of each sign. The content of a sign is used to indicate the identity of the person at the seat where the sign is placed.

[0070] S203, Sign placement identification device to obtain personnel information.

[0071] In some embodiments, the sign placement recognition device can also acquire personnel information to subsequently determine the placement of the sign based on the personnel information and the sign information. The personnel information may include the number of personnel, their identities, and their positions in the image.

[0072] For example, personnel information can be obtained by having staff manually input the information into the signage placement recognition device beforehand, allowing the device to acquire information such as the number and identity of personnel. Additionally, staff can mark the seating position of each person in the camera, enabling the signage placement recognition device to capture their location in the image. This method can be applied to identify the placement of signs before personnel are seated, allowing for timely adjustments.

[0073] In other examples, when people are seated, the signage placement recognition device can use facial recognition to automatically obtain people's information. That is, it identifies each person's face from the image captured by the camera, matches it with facial information in a database, and thus determines the identity of each person in the image. Furthermore, facial recognition can also determine the number of people and their positions in the image.

[0074] S204. The sign placement recognition device determines the sign placement result in the target area based on sign information and personnel information.

[0075] In some embodiments, after obtaining signage information and personnel information, the signage placement recognition device can determine whether the placement of signs in the target area matches the personnel based on the signage information and personnel information, and then output the signage placement result to remind staff of the signage placement situation so that timely adjustments can be made.

[0076] For example, the reminder can be displayed on a screen to remind staff of the sign placement result, or it can be given by a voice broadcast through a voice module. The screen and the voice module can be external devices to the sign placement recognition device or built into the sign placement recognition device. This application embodiment does not limit the specific reminder method or the specific device form.

[0077] The process of determining the placement of signs in the target area based on signage information and personnel information can specifically include the following:

[0078] A. Based on the number of signs in the signage information and the number of people in the personnel information, determine whether signs have been placed in the target area;

[0079] Alternatively, B, based on the sign content and location in the sign information, as well as personnel information, determine whether the signs in the target area are placed correctly.

[0080] Alternatively, based on the number of signs in the signage information and the number of people in the personnel information, determine whether the signs in the target area have been placed, and based on the signage content and location in the signage information, as well as the personnel information, determine whether the signs in the target area are placed correctly.

[0081] In determining whether signs have been placed in a target area, in some embodiments, if the number of signs is less than the number of people, the sign placement recognition device determines the sign placement result in the target area as a first result, which indicates that signs have not been placed or that signs have not been fully placed. If the number of signs is greater than or equal to the number of people, the sign placement recognition device determines the sign placement result in the target area as a second result, which indicates that signs have been placed.

[0082] For example, in a review meeting scenario, each reviewer needs to vote to determine the meeting's outcome. To prevent a tie, the number of reviewers is generally odd; three reviewers are used as an example. The sign placement recognition device identifies the target area of ​​the review meeting by scanning an image. It counts each identified sign and each identified person (the number of people can also be determined using the pre-set method mentioned above). If the number of signs is 2 and the number of people is 3, it means that someone has not placed their corresponding sign. The sign placement recognition device determines that either the sign is not fully placed or not placed at all, and outputs the first result "Sign not fully placed" or "Sign not placed" on the display screen to remind the staff. For example, if the sign placement recognition device does not identify any signs, it determines the sign placement result as "Sign not placed" and displays it on the screen as a reminder. Conversely, if the number of signs is greater than or equal to the number of people, it determines that the signs have been placed, and the sign placement recognition device can output the second result "Sign placed" on the display screen.

[0083] In determining whether signs are correctly placed in a target area, in some embodiments, personnel information includes preset personnel locations in an image and preset identities corresponding to those locations. The sign placement recognition device identifies the sign location corresponding to the preset personnel location and determines whether the sign content at that location matches the preset identity. If yes, the sign placement recognition device determines the sign placement result in the target area as a third result, indicating that the signs are correctly placed; otherwise, the sign placement recognition device determines the sign placement result in the target area as a fourth result, indicating that the signs are incorrectly placed.

[0084] In this embodiment, the preset personnel positions can be determined by pre-marking. After the camera is placed, staff can mark the preset personnel positions in the image captured by the camera. The preset identity corresponding to the preset personnel position can be obtained through various existing methods. The position of the sign corresponding to the preset personnel position can be marked in the image. In addition, considering the relationship between the placement of signs and the positions of personnel in a real scene, that is, if the personnel position and the sign position are on the same vertical line in the image, it can be said that there is a correspondence. Therefore, the sign placement recognition device can identify the corresponding sign position based on the preset personnel position in the captured image, and then determine the sign content of the sign at the sign position through existing technologies such as optical character recognition (OCR) for comparison with the preset personnel's preset identity, thereby determining the sign placement result.

[0085] It is understood that the sign recognition method provided in the above embodiments only needs to determine whether the sign corresponding to the preset personnel position is placed correctly. For example, if there is one preset personnel and only one sign is placed, it is determined whether the content of the sign matches the preset identity. Alternatively, if there is one preset personnel but more than one sign is placed, it is not necessary to identify the content of all signs; it is sufficient to identify whether the content of the sign corresponding to the preset personnel position matches the preset personnel identity. Furthermore, if there are three preset personnel, one of whom is the preset head reviewer, it is determined whether the content of the sign at the head reviewer's position matches. Further, if the preset personnel are other preset personnel whose preset identities are reviewers, it is also possible to determine whether the content of the signs at the other preset personnel's positions matches. This method can be applied to scenarios where there is interference from other signs; it only needs to determine whether the required sign is placed correctly, avoiding interference from irrelevant targets and wasting computing resources.

[0086] The above embodiments are illustrated using the example of pre-marking personnel positions in the camera. The following embodiments illustrate how to determine sign placement results by directly identifying sign information in the image without needing to mark personnel or sign positions. Based on sign information and the number of personnel (which can be determined through facial recognition or pre-entered by staff), the correctness of sign placement in the target area is determined, specifically including scenarios 1-5.

[0087] Scenario 1: When there is 1 person and 1 sign, determine whether the sign content is the first preset identity; if yes, determine the sign placement result in the target area as the third result, indicating that the sign is placed correctly; if no, determine the sign placement result in the target area as the fourth result, indicating that the sign is placed incorrectly.

[0088] Taking the example of obtaining both sign information and the number of people from images, the sign placement recognition device counts each time it identifies a person and each time it identifies a sign, in order to determine the number of people and signs. In addition, the sign placement recognition device can also use methods such as target recognition and OCR to identify the sign content in the image, so that the placement result of the signs can be determined based on the sign content.

[0089] For example, in a review meeting scenario, if there is only one reviewer and only one nameplate, it is a single-person review meeting, and the nameplate should be for the reviewer (i.e., the first pre-defined identity). Figure 3 As shown, Figure 3 There is only one reviewer and only one sign (sign 1). The sign placement recognition device can identify the content of sign 1. For example... Figure 3As shown, if the content of sign 1 is "Lead Judge" instead of the first preset identity such as "Judge," then the sign placement result is determined to be the fourth result. This means the fourth result, "Sign Placement Incorrect," can be displayed on the screen to remind staff to adjust sign 1 as soon as possible. Conversely, if the content of sign 1 is identified as the first preset identity such as "Judge," then the sign placement result is determined to be the third result. This means the third result, "Sign Placement Correct," can be displayed on the screen.

[0090] Scenario 2: When the number of people is 1 and the number of signs is an odd number greater than 1, determine whether the content of the first sign is the first preset identity; the first sign is the sign in the middle position on the image; if not, determine the sign placement result of the target area as the fifth result, the fifth result indicates that the first sign is placed incorrectly; if yes, determine the sign placement result of the target area as the sixth result, the sixth result indicates that the first sign is placed correctly.

[0091] For example, let's continue with the above example. In the scenario of the review meeting described above, if the number of participants is 1 and the number of signs is an odd number greater than 1, it is still considered a single-person review meeting. For example... Figure 4 As shown, an example with three signs is used for illustration. Generally, when the sign placement recognition device determines that the number of reviewers is 1, it identifies whether the sign content of the sign in the middle position of the image corresponds to the first preset identity, such as a reviewer. Figure 4 As shown, sign 1 is the first sign. If its content is "Lead Judge" instead of "Judge" (as per the first preset identity), then the sign placement recognition device determines the sign placement result as the fifth result, and can output "Sign 1 is placed incorrectly" on the display screen. Conversely, if the content of sign 1 is "Judge," then the sign placement result is determined as the sixth result, and can output "Sign 1 is placed correctly" on the display screen.

[0092] Scenario 3: When the number of people is 1 and the number of signs is an even number greater than 1, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect.

[0093] As mentioned earlier, it's understandable that the number of participants in a review meeting is odd to avoid a tie during the voting process. Therefore, if the sign placement recognition device identifies an even number of signs in an image (greater than 1), it determines that the sign placement in the target area is incorrect.

[0094] Scenario 4: When the number of people is an odd number greater than 1, and the number of signs is greater than or equal to the number of people and the number of signs is odd, determine whether the content of the first sign is the second preset identity. The second preset identity is different from the first preset identity. The first sign is the sign that is in the middle position on the image. If not, determine the sign placement result of the target area as the fifth result. The fifth result indicates that the first sign is placed incorrectly.

[0095] For example, when the number of people is an odd number greater than 1, and the number of signs is greater than or equal to the number of people and is also odd, the sign placement recognition device can determine the sign in the middle position as the first sign based on the positions of all signs in the image, and then recognize the content of the first sign. For example, combined with Figure 5 To clarify, when the number of participants is an odd number greater than one, a head judge is required, whose voting opinion plays a crucial and decisive role in the multi-person review meeting. Furthermore, the head judge's position is located in the center of the review panel. Therefore, the aforementioned second presupposed role is the head judge. Figure 5 In the diagram, sign 1 is positioned between sign 2 and sign 3, thus serving as the first sign. If the sign placement recognition device identifies the content of sign 1 as "reviewer" instead of the second preset identity "reviewer chief," then the sign placement result for the target area is determined to be the fifth result, and the second result indicates that sign 1 is placed incorrectly.

[0096] For scenario 4, the main focus is on determining whether the sign in the middle position is placed correctly. Therefore, after determining that the content of the first sign is the second preset identity, this embodiment of the application can further determine whether the other signs are placed correctly, specifically by performing the following steps ab.

[0097] a. Determine whether the content of the second sign is the third preset identity. The second sign is the sign located to the left and right of the first sign among the identified signs.

[0098] b. If the content of each second sign is the third preset identity, then the sign placement result of the target area is determined to be the third result, and the third result indicates that the sign placement is correct; if the content of at least one second sign is inconsistent with the third preset identity, then the sign placement result of the target area is determined to be the fourth result, and the fourth result indicates that the sign placement is incorrect.

[0099] For example, let's illustrate this with the examples above. In a multi-person review meeting scenario, such as... Figure 6As shown, after determining that the content of sign 1 is "Lead Judge," the device further determines whether the content of sign 2 to the left of sign 1 matches the third preset identity of judge 2, and whether the content of sign 3 to the right of sign 1 matches the third preset identity of judge 3. If they match, the sign placement result in the target area is determined to be the third result, and the third result is output as "Sign placement is correct." If they do not match, for example, the third preset identity of judge 2 is "Judge," but the content of the corresponding sign 2 is "Judge," then the sign placement recognition device determines the sign placement result to be the fourth result, and the fourth result is output as "Sign placement is incorrect."

[0100] It should be noted that the third preset identity can be determined in advance by staff marking it on the camera, or it can be determined through facial recognition after the person is seated. The identity information of the person at the seat corresponding to the second sign is the third preset identity.

[0101] Specifically, a person's identity information can be determined using the following steps ab:

[0102] a. The sign placement recognition device obtains the correspondence between each person's facial information and identity information.

[0103] Before a review meeting begins, a schedule is typically provided, which records the ID photos of all attendees and their respective identities for the meeting. In other words, the schedule records the correspondence between each person's facial information and their identity information. Therefore, in some embodiments, staff can input the schedule information into the signage placement device, enabling the signage placement recognition device to obtain the correspondence between each person's facial information and their identity information.

[0104] b. The sign placement recognition device determines the identity information of each person based on the correspondence and the facial information of each person in the image.

[0105] In some embodiments, the sign placement recognition device may employ facial recognition technology to determine the facial information of each person in the image captured by the camera. Based on the correspondence obtained in step a, the sign placement recognition device can determine the identity information of each target person, and thus determine the third preset identity that each second sign should correspond to.

[0106] It should be noted that facial recognition and sign recognition can be performed simultaneously, or facial recognition can be performed only when personnel information is required. This application does not impose specific restrictions on the order of execution.

[0107] Scenario 5: When the number of people is an odd number greater than 1 and the number of signs is an even number greater than the number of people, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect.

[0108] Similarly, if the number of signs is even, it is considered that the signs are placed incorrectly. For details, please refer to scenario 3 above, which will not be repeated here.

[0109] Scenario 6: Based on the number of people, determine the preset identity of the preset sign location; identify the sign content at the preset sign location; if the sign content matches the preset identity, determine the sign placement result of the target area as the third result, indicating that the sign placement is correct; if the sign content does not match the preset identity, determine the sign placement result of the target area as the fourth result, indicating that the sign placement is incorrect.

[0110] This scenario allows for the determination of different preset identities for different numbers of people at preset sign positions. For example, staff can pre-mark the preset identities for the preset sign positions in the camera. Referring to the example above, if it's a single-person review meeting, the preset identity is "reviewer." If it's a multi-person review meeting, the preset identity is "head reviewer." Therefore, when the sign placement recognition device identifies a person in the image, it determines the preset identity as "reviewer." It further identifies whether the sign content corresponding to the preset sign position is that of a reviewer. If so, it outputs a third result: "Sign placement is correct"; otherwise, it outputs a fourth result: "Sign placement is incorrect."

[0111] Similarly, if the sign placement recognition device identifies three people in an image, it determines the pre-defined identity of the sign at the preset sign location as the head reviewer, and further determines the sign placement result by recognizing the content of the sign at the preset sign location. Additionally, in multi-person meetings, staff can also assign pre-defined identities to the signs to the left or right of the aforementioned preset sign locations, such as reviewers. After confirming that the preset sign is correctly placed, the sign placement recognition device can further determine whether the content of the signs to the left or right of the preset sign location corresponds to their respective pre-defined identities, thereby determining the final sign placement result.

[0112] Figure 7 A flowchart of a sign placement and recognition process is provided as an embodiment of this application, combined with Figure 7The following explanation is provided. First, a front-end camera is set up at the meeting to capture images. Then, based on these images, sign count recognition (i.e., the aforementioned number of signs), people count (i.e., the aforementioned number of people), and facial recognition are performed. First, based on the recognition results of the sign count and people count, it is determined whether the number of signs exceeds the number of people. If yes, a message indicating that a sign has been placed is output. If not, a message indicating that a sign has not been placed is output. Additionally, the content of the signs is also recognized based on the images. When there are three or fewer people, it is determined whether the middle sign represents a reviewer. If yes, a message indicating that the sign is correctly placed is output. If not, a message indicating that the sign is incorrectly placed is output. When there are three or more people, it is determined whether the middle sign represents the head reviewer. If not, a message indicating that the sign is incorrectly placed is output. If yes, it is further determined whether the display of the signs on both sides matches the facial recognition result. If both match, a message indicating that the sign is correctly placed is output. If either sign does not match the facial recognition result, a message indicating that the sign is incorrectly placed is output.

[0113] The technical solutions provided in the above embodiments offer at least the following beneficial effects: the sign placement recognition method provided in this application acquires an image of a target area, identifies sign information based on the image, further acquires personnel information, and determines the sign placement result based on the sign information and personnel information. This solution can automatically determine the sign placement result, and is more efficient than the traditional manual judgment method.

[0114] Furthermore, this application combines technologies such as people detection, sign recognition, and facial recognition to determine the placement of signs. This combination of technologies makes the identification of sign placement more accurate. Moreover, embodiments of this application provide sign placement identification methods for various scenarios, applicable to most meeting settings, assisting staff in conducting routine inspections.

[0115] As can be seen, the above mainly describes the solutions provided by the embodiments of this application from a methodological perspective. To achieve the above functions, the embodiments of this application provide corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, in conjunction with the modules and algorithm steps of the various examples described in the embodiments disclosed herein, the embodiments of this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0116] In an exemplary embodiment, this application also provides a sign placement recognition device. This sign placement recognition device may include one or more functional modules for implementing the sign placement recognition method of the above method embodiments.

[0117] For example, Figure 8 This is a schematic diagram illustrating the composition of a sign placement and identification device provided in an embodiment of this application. Figure 8 As shown, the sign placement identification device includes: an acquisition module 801, an identification module 802, and a determination module 803. The acquisition module 801, the identification module 802, and the determination module 803 are interconnected.

[0118] The acquisition module 801 is used to acquire an image of the target area.

[0119] The recognition module 802 is used to recognize sign information in an image.

[0120] The acquisition module 801 is also used to acquire personnel information.

[0121] The determination module 803 is used to determine the sign placement result in the target area based on sign information and personnel information.

[0122] In some embodiments, the determining module 803 is specifically used to determine whether signs in the target area have been placed based on the number of signs in the signage information and the number of people in the personnel information; and / or to determine whether the signs in the target area are placed correctly based on the signage information and the personnel information; the signage information includes the signage location and the signage content, or the signage information includes the number of signs, the signage location, and the signage content.

[0123] In some embodiments, the determining module 803 is specifically used to: if the number of signs is less than the number of people, determine the sign placement result of the target area as a first result, the first result indicating that the signs are not placed or are not fully placed; if the number of signs is greater than or equal to the number of people, determine the sign placement result of the target area as a second result, the second result indicating that the signs have been placed.

[0124] In some embodiments, the personnel information includes the preset personnel location in the image and the preset identity corresponding to the preset personnel location; the determining module 803 is specifically used to identify the sign location corresponding to the preset personnel location; determine whether the sign content of the sign at the sign location is the preset identity; if yes, then determine the sign placement result of the target area as the third result, the third result indicating that the sign placement is correct; if no, then determine the sign placement result of the target area as the fourth result, the fourth result indicating that the sign placement is incorrect.

[0125] In some embodiments, personnel information includes the number of personnel; the determining module 803 is specifically used for,

[0126] When there is 1 person and 1 sign, determine whether the sign content is the first preset identity; if yes, determine the sign placement result in the target area as the third result, indicating that the sign is placed correctly; if no, determine the sign placement result in the target area as the fourth result, indicating that the sign is placed incorrectly.

[0127] or,

[0128] When the number of people is 1 and the number of signs is an odd number greater than 1, determine whether the content of the first sign is the first preset identity; the first sign is the sign located in the middle position on the image; if not, determine the sign placement result of the target area as the fifth result, the fifth result indicates that the first sign is placed incorrectly; if yes, determine the sign placement result of the target area as the sixth result, the sixth result indicates that the first sign is placed correctly.

[0129] or,

[0130] When the number of people is 1 and the number of signs is an even number greater than 1, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect.

[0131] or,

[0132] When the number of people is an odd number greater than 1, and the number of signs is greater than or equal to the number of people and the number of signs is odd, determine whether the content of the first sign is the second preset identity. The second preset identity is different from the first preset identity. The first sign is the sign that is in the middle position on the image. If not, determine the sign placement result of the target area as the fifth result. The fifth result indicates that the first sign is placed incorrectly.

[0133] or,

[0134] When the number of people is an odd number greater than 1 and the number of signs is an even number greater than the number of people, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect.

[0135] or,

[0136] Based on the number of people, determine the preset identity of the preset sign location; identify the sign content at the preset sign location; if the sign content matches the preset identity, determine the sign placement result in the target area as the third result, indicating that the sign is placed correctly; if the sign content does not match the preset identity, determine the sign placement result in the target area as the fourth result, indicating that the sign is placed incorrectly.

[0137] In some embodiments, if the sign content of the first sign is determined to be a second preset identity, the determining module 803 is further specifically used to determine whether the sign content of the second sign is a third preset identity; the second sign is a sign located to the left or right of the first sign in the image; if the content of each second sign is a third preset identity, then the sign placement result of the target area is determined to be a third result, and the third result indicates that the sign placement is correct; if the content of at least one second sign is inconsistent with the third preset identity, then the sign placement result of the target area is determined to be a fourth result, and the fourth result indicates that the sign placement is incorrect.

[0138] In the case of implementing the functions of the integrated modules described above in hardware, this application embodiment provides a schematic diagram of the composition of a sign placement recognition device, which can be the aforementioned sign placement recognition apparatus. For example... Figure 9 As shown, the sign placement recognition device 900 includes: a processor 902, a communication interface 903, and a bus 904. Optionally, the sign placement recognition device may also include a memory 901.

[0139] Processor 902 may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 902 may be a central processing unit, a general-purpose processor, a digital signal processor, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 902 may also be a combination that implements computing functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

[0140] The communication interface 903 is used to connect to other devices via a communication network. This communication network can be Ethernet, wireless access network, wireless local area network (WLAN), etc.

[0141] The memory 901 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto.

[0142] As one possible implementation, the memory 901 can exist independently of the processor 902. The memory 901 can be connected to the processor 902 via a bus 904 and is used to store instructions or program code. When the processor 902 calls and executes the instructions or program code stored in the memory 901, it can implement the sign placement recognition method provided in this application embodiment.

[0143] In another possible implementation, the memory 901 can also be integrated with the processor 902.

[0144] The 904 bus can be an extended industry standard architecture (EISA) bus, etc. The 904 bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 9 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0145] Through the above description of the implementation methods, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the sign placement and identification device can be divided into different functional modules to complete all or part of the functions described above.

[0146] This application also provides a computer-readable storage medium. All or part of the processes in the above method embodiments can be executed by computer instructions instructing related hardware. The program can be stored in the aforementioned computer-readable storage medium, and when executed, it can include the processes of the above method embodiments. The computer-readable storage medium can be any of the foregoing embodiments or memory. The aforementioned computer-readable storage medium can also be an external storage device for the aforementioned signage placement and recognition device, such as a plug-in hard drive, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the aforementioned signage placement and recognition device. Further, the aforementioned computer-readable storage medium can also include both internal storage units of the aforementioned signage placement and recognition device and external storage devices. The aforementioned computer-readable storage medium is used to store the aforementioned computer program and other programs and data required by the aforementioned signage placement and recognition device. The aforementioned computer-readable storage medium can also be used to temporarily store data that has been output or will be output.

[0147] This application also provides a computer program product, which includes a computer program that, when run on a computer, causes the computer to execute any of the sign placement and recognition methods provided in the above embodiments.

[0148] Although this application has been described herein in conjunction with various embodiments, those skilled in the art, by reviewing the accompanying drawings, disclosure, and appended claims, will understand and implement other variations of the disclosed embodiments in carrying out the claimed application. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple components. A single processor or other unit can implement several functions listed in the claims. While different dependent claims may recite certain measures, this does not mean that these measures cannot be combined to produce good results.

[0149] Although this application has been described in conjunction with specific features and embodiments, it is obvious that various modifications and combinations can be made thereto without departing from the spirit and scope of this application. Accordingly, this specification and drawings are merely exemplary illustrations of this application as defined by the appended claims, and are considered to cover any and all modifications, variations, combinations, or equivalents within the scope of this application. Clearly, those skilled in the art can make various alterations and modifications to this application without departing from the spirit and scope of this application. Thus, if such modifications and modifications of this application fall within the scope of the claims of this application and their equivalents, this application is also intended to include such modifications and modifications.

[0150] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for identifying sign placement, characterized in that, The method includes: Acquire an image of the target region; Identify the signage information in the image; Obtain personnel information; Based on the signage information and the personnel information, the signage placement result for the target area is determined; The step of determining the sign placement result of the target area based on the sign information and the personnel information includes: Based on the signage information and the personnel information, determine whether the signage placement in the target area is correct; the signage information includes signage location and signage content, and the personnel information includes the preset personnel location in the image and the preset identity corresponding to the preset personnel location; or, the signage information includes the number of signs, signage location, and signage content, and the personnel information includes the number of personnel.

2. The method according to claim 1, characterized in that, The step of determining the sign placement result of the target area based on the sign information and the personnel information includes: Based on the number of signs in the signage information and the number of people in the personnel information, it is determined whether signs have been placed in the target area.

3. The method according to claim 2, characterized in that, Determining whether signs have been placed in the target area based on the number of signs in the signage information and the number of people in the personnel information includes: If the number of signs is less than the number of people, then the sign placement result in the target area is determined to be the first result, which indicates that the signs are not placed or the signs are not completely placed. If the number of signs is greater than or equal to the number of people, then the sign placement result in the target area is determined to be the second result, which indicates that the signs have been placed.

4. The method according to claim 2, characterized in that, The step of determining whether the signage placement in the target area is correct based on the signage information and the personnel information includes: Identify the sign location corresponding to the preset personnel location; Determine whether the content of the sign at the specified sign location matches the preset identity; If so, the sign placement result in the target area is determined as the third result, and the third result indicates that the sign placement is correct; If not, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect.

5. The method according to claim 2, characterized in that, The step of determining whether the signage placement in the target area is correct based on the signage information and the personnel information includes: When the number of personnel is 1 and the number of signs is 1, determine whether the content of the sign is a first preset identity; if yes, determine the sign placement result of the target area as a third result, the third result indicating that the sign placement is correct; if no, determine the sign placement result of the target area as a fourth result, the fourth result indicating that the sign placement is incorrect. or, When the number of people is 1 and the number of signs is an odd number greater than 1, determine whether the content of the first sign is the first preset identity; the first sign is the sign located in the middle position on the image; if not, determine the sign placement result of the target area as the fifth result, the fifth result indicating that the first sign is placed incorrectly; if yes, determine the sign placement result of the target area as the sixth result, the sixth result indicating that the first sign is placed correctly. or, When the number of personnel is 1 and the number of signs is an even number greater than 1, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect. or, When the number of people is an odd number greater than 1, and the number of signs is greater than or equal to the number of people and the number of signs is odd, it is determined whether the content of the first sign is a second preset identity, which is different from the first preset identity; the first sign is the sign located in the middle position on the image; if not, the sign placement result of the target area is determined to be the fifth result, which indicates that the first sign is placed incorrectly; or, When the number of people is an odd number greater than 1 and the number of signs is an even number greater than the number of people, the sign placement result in the target area is determined to be the fourth result, and the fourth result indicates that the sign placement is incorrect. or, Based on the number of people, determine the preset identity of the preset sign location; Identify the sign content at the preset sign location; If the sign content matches the preset identity, the sign placement result in the target area is determined to be the third result, indicating that the sign placement is correct; if the sign content does not match the preset identity, the sign placement result in the target area is determined to be the fourth result, indicating that the sign placement is incorrect.

6. The method according to claim 5, characterized in that, If it is determined that the content of the first sign is the second preset identity, then determining whether the sign placement in the target area is correct based on the sign information and the personnel information further includes: Determine whether the content of the second sign is a third preset identity; the second sign is the sign located to the left and right of the first sign in the image. If the content of each second sign is the third preset identity, then the sign placement result of the target area is determined to be the third result, and the third result indicates that the sign placement is correct; If the content of at least one of the second signs is inconsistent with the third preset identity, then the sign placement result of the target area is determined to be the fourth result, and the fourth result indicates that the sign placement is incorrect.

7. A sign placement identification device, characterized in that, The device includes: an acquisition module, an identification module, and a determination module; The acquisition module is used to acquire an image of the target area; The recognition module is used to recognize sign information in the image; The acquisition module is also used to acquire personnel information; The determining module is used to determine the sign placement result of the target area based on the sign information and the personnel information; The determining module is further configured to determine whether the sign placement in the target area is correct based on the sign information and the personnel information; the sign information includes the sign position and sign content, and the personnel information includes the preset personnel position in the image and the preset identity corresponding to the preset personnel position; or, the sign information includes the number of signs, sign position, and sign content, and the personnel information includes the number of personnel.

8. The apparatus according to claim 7, characterized in that, The determining module is specifically used to determine whether signs have been placed in the target area based on the number of signs in the signage information and the number of people in the personnel information; The determining module is specifically used to: if the number of signs is less than the number of people, determine the sign placement result of the target area as a first result, the first result indicating that the signs are not placed or are not completely placed; if the number of signs is greater than or equal to the number of people, determine the sign placement result of the target area as a second result, the second result indicating that the signs are placed. The determining module is specifically used to: identify the sign position corresponding to the preset personnel position; determine whether the sign content at the sign position is the preset identity; if so, determine the sign placement result of the target area as the third result, and the third result indicates that the sign placement is correct; If not, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect; If the content of the first sign is determined to be a second preset identity, the determining module is further specifically used to determine whether the content of the second sign is a third preset identity; the second sign is the sign located to the left or right of the first sign in the image; if the content of each second sign is the third preset identity, then the sign placement result of the target area is determined to be a third result, and the third result indicates that the sign placement is correct; If the content of at least one of the second signs is inconsistent with the third preset identity, then the sign placement result of the target area is determined to be the fourth result, and the fourth result indicates that the sign placement is incorrect; The determining module is specifically used for, When the number of personnel is 1 and the number of signs is 1, determine whether the content of the sign is a first preset identity; if so, determine the sign placement result of the target area as a third result, and the third result indicates that the sign placement is correct. If not, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect; or, When the number of people is 1 and the number of signs is an odd number greater than 1, determine whether the content of the first sign is the first preset identity; the first sign is the sign located in the middle position on the image; if not, determine the sign placement result of the target area as the fifth result, the fifth result indicating that the first sign is placed incorrectly; if yes, determine the sign placement result of the target area as the sixth result, the sixth result indicating that the first sign is placed correctly. or, When the number of personnel is 1 and the number of signs is an even number greater than 1, the sign placement result in the target area is determined to be the fourth result, which indicates that the sign placement is incorrect. or, When the number of people is an odd number greater than 1, and the number of signs is greater than or equal to the number of people and the number of signs is odd, it is determined whether the content of the first sign is a second preset identity, which is different from the first preset identity; the first sign is the sign located in the middle position on the image; if not, the sign placement result of the target area is determined to be the fifth result, which indicates that the first sign is placed incorrectly; or, When the number of people is an odd number greater than 1 and the number of signs is an even number greater than the number of people, the sign placement result in the target area is determined to be the fourth result, and the fourth result indicates that the sign placement is incorrect. or, Based on the number of people, determine the preset identity of the preset sign location; Identify the sign content at the preset sign location; If the sign content matches the preset identity, the sign placement result in the target area is determined to be the third result, indicating that the sign placement is correct; if the sign content does not match the preset identity, the sign placement result in the target area is determined to be the fourth result, indicating that the sign placement is incorrect. If it is determined that the content of the first sign is the second preset identity, the determining module is further specifically used to determine whether the content of the second sign is the third preset identity; the second sign is the sign located to the left or right of the first sign in the image; if the content of each second sign is the third preset identity, then the sign placement result of the target area is determined to be the third result, and the third result indicates that the sign placement is correct; If the content of at least one of the second signs is inconsistent with the third preset identity, then the sign placement result of the target area is determined to be the fourth result, and the fourth result indicates that the sign placement is incorrect.

9. A sign placement and recognition device, characterized in that, The sign placement recognition device includes: a processor and a memory; The memory stores instructions that the processor can execute; When the processor is configured to execute the instructions, the sign placement recognition device shall implement the method as described in any one of claims 1-6.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes: computer software instructions; When the computer software instructions are executed in the computer, the computer causes the computer to perform the method as described in any one of claims 1-6.

Images