Video recording annotation method, electronic device, system, medium and product

Abstract

This disclosure provides a method, electronic device, system, medium, and product for annotation in video recording. The method is applied to an electronic device recording a target video. The method includes: receiving annotation instructions input by a staff member during the recording of the target video; wherein the annotation instructions include quality evaluation information capable of annotating target items currently displayed in the target video; determining annotation time information corresponding to the annotation instructions, the annotation time information indicating the time when the target item appears in the target video; and generating a project quality evaluation table based on the annotation time information and the quality evaluation information.

Description

Technical Field

[0001] This disclosure relates to the technical fields of information recording, and in particular to a method, electronic device, system, medium and product for annotation in video recording. Background Technology

[0002] With the development of technology, quality inspectors now primarily use video recording to document the actual construction work during site inspections. After the inspection, to understand the results, the quality inspectors review the recorded video files and manually record their evaluations of the construction items shown in the videos.

[0003] Quality inspectors need to record video files during the inspection process, but they cannot record their evaluation opinions on the construction project during the inspection. They can only evaluate the construction project after the inspection is over and after watching the recorded video file. As a result, the evaluation opinions of the construction project need to take up the quality inspectors' time to record, so the efficiency is low.

[0004] Therefore, how to improve the efficiency of marking and evaluating construction projects has become an urgent problem to be solved. Summary of the Invention

[0005] This disclosure provides a method, electronic device, system, medium, and product for annotation in video recording.

[0006] According to a first aspect of this disclosure, a method for annotation during video recording is provided. The method is applied to an electronic device that is recording a target video. The method includes: receiving annotation instructions input by a staff member during the recording of the target video; wherein the annotation instructions include quality evaluation information capable of annotating a target item currently displayed in the target video; determining annotation time information corresponding to the annotation instructions, the annotation time information indicating the time when the target item appears in the target video; and generating a project quality evaluation table based on the annotation time information and the quality evaluation information.

[0007] According to at least one embodiment of the annotation method in video recording of the present disclosure, after receiving annotation instructions input by staff, the method further includes: determining quality evaluation information in the annotation instructions.

[0008] According to at least one embodiment of the annotation method in video recording of this disclosure, the annotation instruction is a confirmation instruction, and the quality evaluation information is used to indicate that the target item is in a qualified state; or, the annotation instruction is a negative instruction, and the quality evaluation information is used to indicate that the target item is in a non-qualified state; or, the annotation instruction is a pending confirmation instruction, and the quality evaluation information is used to indicate that the target item is in a pending confirmation state.

[0009] According to at least one embodiment of the annotation method in video recording of the present disclosure, after generating a project quality evaluation table based on annotation time information and quality evaluation information, the method further includes: determining the video frame corresponding to the annotation time information in the target video; determining the project name corresponding to the target project in the video frame; and establishing a mapping relationship between the project name, annotation time information and quality evaluation information in the project quality evaluation table.

[0010] According to at least one embodiment of the annotation method in video recording of the present disclosure, after receiving the annotation instruction input by the staff, the method further includes: determining the light-emitting device corresponding to the annotation instruction; activating the light-emitting device to emit light, wherein the light is used to illuminate the target item currently displayed in the target video, or the light is used to illuminate the target item among multiple items currently displayed in the target video.

[0011] According to at least one embodiment of the annotation method in video recording of this disclosure, the annotation instruction is a confirmation instruction, and the light emitted by the light-emitting device is a first color; or, the annotation instruction is a negation instruction, and the light emitted by the light-emitting device is a second color; or, the annotation instruction is a pending confirmation instruction, and the light emitted by the light-emitting device is a third color; the first color, the second color, and the third color are all different colors.

[0012] According to a second aspect of this disclosure, a method for annotation in video recording is provided. This method is applied to a recording device and a remote control device that works in conjunction with the recording device. The recording device is capturing a target video, and the recording device and the remote control device are in a communicative connection. The method includes: during the recording of the target video, the remote control device receives annotation instructions input by a staff member; wherein the annotation instructions include quality evaluation information capable of annotating target items currently displayed in the target video; the remote control device sends the quality evaluation information to the recording device; the recording device receives the quality evaluation information sent by the remote control device; the recording device determines annotation time information corresponding to the annotation instructions, the annotation time information indicating the time when the target item appears in the target video; and the recording device generates an item quality evaluation table based on the annotation time information and the quality evaluation information.

[0013] According to at least one embodiment of the annotation method in video recording of the present disclosure, after the remote control device receives the annotation instruction input by the staff, the method further includes: the remote control device determining the quality evaluation information in the annotation instruction.

[0014] According to at least one embodiment of the annotation method in video recording of this disclosure, the annotation instruction is a confirmation instruction, and the quality evaluation information is used to indicate that the target item is in a qualified state; or, the annotation instruction is a negative instruction, and the quality evaluation information is used to indicate that the target item is in a non-qualified state; or, the annotation instruction is a pending confirmation instruction, and the quality evaluation information is used to indicate that the target item is in a pending confirmation state.

[0015] According to at least one embodiment of the annotation method in video recording of the present disclosure, after the recording device generates a project quality evaluation table based on annotation time information and quality evaluation information, the method further includes: the recording device determining the video frame corresponding to the annotation time information in the target video; the recording device determining the project name corresponding to the target project in the video frame; and the recording device establishing a mapping relationship between the project name, annotation time information and quality evaluation information in the project quality evaluation table.

[0016] According to at least one embodiment of the annotation method in video recording of the present disclosure, after the remote control device receives the annotation instruction input by the staff, the method further includes: the remote control device determining the light-emitting device corresponding to the annotation instruction; the remote control device activating the light-emitting device to emit light, the light being used to illuminate the target item currently displayed in the target video, or the light being used to illuminate the target item among multiple items currently displayed in the target video.

[0017] According to at least one embodiment of the annotation method in video recording of this disclosure, the annotation instruction is a confirmation instruction, and the light emitted by the light-emitting device is a first color; or, the annotation instruction is a negation instruction, and the light emitted by the light-emitting device is a second color; or, the annotation instruction is a pending confirmation instruction, and the light emitted by the light-emitting device is a third color; the first color, the second color, and the third color are all different colors.

[0018] According to a third aspect of this disclosure, a video recording annotation system is provided, including a recording device and a remote control device that works in conjunction with the recording device. The recording device is recording a target video, and the recording device and the remote control device are in a communicative connection state. The remote control device is used to receive annotation instructions input by a staff member during the recording of the target video. The annotation instructions include quality evaluation information that can annotate the target item currently displayed in the target video. The system determines annotation time information corresponding to the annotation instructions, which indicates the time when the target item appears in the target video. It sends the quality evaluation information and the annotation time information to the recording device. The recording device receives the quality evaluation information and the annotation time information sent by the remote control device. Based on the annotation time information and the quality evaluation information, it generates a project quality evaluation table.

[0019] According to a fourth aspect of this disclosure, an electronic device is provided, comprising: a memory storing execution instructions; and a processor executing the execution instructions stored in the memory, causing the processor to perform a annotation method in video recording according to any embodiment of this disclosure.

[0020] According to a fifth aspect of this disclosure, a readable storage medium is provided, wherein executable instructions are stored therein, which, when executed by a processor, are used to implement a annotation method in video recording according to any embodiment of this disclosure.

[0021] According to a sixth aspect of this disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements a annotation method in video recording according to any embodiment of this disclosure. Attached Figure Description

[0022] The accompanying drawings illustrate exemplary embodiments of the present disclosure and, together with the description thereof, serve to explain the principles of the present disclosure. These drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification.

[0023] Figure 1 This illustration demonstrates an application scenario of a annotation method in video recording according to one embodiment of the present disclosure.

[0024] Figure 2 This illustrates an application scenario of a annotation method in video recording according to another embodiment of this disclosure.

[0025] Figure 3 A schematic diagram of the overall process of a annotation method M100 in video recording according to one embodiment of the present disclosure is shown.

[0026] Figure 4 This illustrates an application scenario of the annotation method in video recording according to yet another embodiment of the present disclosure.

[0027] Figure 5 This illustrates an application scenario of the annotation method in video recording according to yet another embodiment of the present disclosure.

[0028] Figure 6 A schematic diagram of the overall process of a annotation method M200 in video recording according to another embodiment of this disclosure is shown.

[0029] Figure 7 This is a schematic diagram of a video recording annotation system provided in this disclosure.

[0030] Figure 8 This is a schematic block diagram of an electronic device according to one embodiment of the present disclosure.

[0031] Figure 9 This is a schematic block diagram of an electronic device 3000 according to another embodiment of the present disclosure. Detailed Implementation

[0032] The present disclosure will now be described in further detail with reference to the accompanying drawings and examples. It should be understood that the specific examples described herein are for illustrative purposes only and are not intended to limit the scope of the disclosure. Furthermore, it should be noted that, for ease of description, only the parts relevant to the present disclosure are shown in the accompanying drawings.

[0033] It should be noted that, where there is no conflict, the embodiments and features described in this disclosure can be combined with each other. The technical solutions of this disclosure will now be described in detail with reference to the accompanying drawings and embodiments.

[0034] Currently, during quality inspectors' inspections of construction projects at renovation sites, they record videos to document the work. After the inspection, the inspectors review the recorded video files to determine whether the construction projects meet the required standards, and then record their evaluation results.

[0035] For example, after the inspection, while the quality inspector is watching the video file, if the video shows the construction project "Master Bedroom Wall" at the 25-second mark, and the quality inspector deems the "Master Bedroom Wall" to be compliant, then the quality inspector will manually record in the document: 25 seconds - Master Bedroom Wall - Qualified.

[0036] For example, after the inspection, while the quality inspector is watching the video file, at the 35-second mark, the construction project shown in the video file is "Master Bedroom Power Supply". If the quality inspector believes that the "Master Bedroom Power Supply" does not meet the requirements, then the quality inspector will manually record in the document: 35 seconds - Master Bedroom Power Supply - Unqualified.

[0037] For example, after the inspection, while the quality inspector is watching the video file, at the 45-second mark, the construction project shown in the video is "Master Bedroom Floor". If the quality inspector believes that it is not yet possible to confirm whether the "Master Bedroom Floor" meets the requirements, then the quality inspector will manually record in the document: 45 seconds - Master Bedroom Floor - Pending Confirmation.

[0038] Therefore, it can be seen that quality inspectors need to take videos during the inspection process, but they cannot record their evaluation opinions for each construction project. They can only record their evaluation opinions for each construction project by reviewing the video files after the inspection. This makes marking evaluation opinions take up extra time for quality inspectors and reduces work efficiency.

[0039] To address this, this disclosure proposes a method for annotation during video recording, enabling quality inspectors to add their evaluation comments while recording videos, thereby improving work efficiency.

[0040] Figure 1This illustration shows an application scenario of a video recording annotation method according to one embodiment of the present disclosure. In this application scenario, an electronic device 100, construction project X, construction project Y, and construction project Z are mainly shown. The electronic device 100 includes a camera 101, touch buttons 102, 103, and 104.

[0041] Figure 1 The annotation method shown in the video recording is more suitable for the scene where various construction projects are relatively scattered in the inspection site. This allows the shooting angle α of the electronic device 100 to shoot only one construction project, without other construction projects being mixed into the shooting angle α of the electronic device 100. Therefore, the electronic device 100 does not need to emit light to distinguish multiple construction projects.

[0042] exist Figure 1 In the example shown, when the quality inspector begins his inspection of the construction site, he will turn on the electronic device 100 to capture the target video V1 and point the electronic device 100 at the construction project X to capture the video.

[0043] Please refer to Table 1, which shows the mapping relationship between touch buttons, annotation commands, and quality evaluation information stored in electronic device 100. Different touch buttons trigger an annotation command, and each annotation command contains quality evaluation information for the target item currently displayed in target video V1. Quality evaluation information Y indicates that the construction project is qualified; quality evaluation information N indicates that the construction project is unqualified; and quality evaluation information P indicates that the construction project needs confirmation. As shown in Table 1, each touch button on electronic device 100 corresponds to a quality evaluation message, and quality inspectors can press different touch buttons according to the specific situation of the construction project.

[0044] Table 1 Please combine Figure 1 As per Table 1, during the recording of target video V1 using electronic device 100, if the quality inspector deems construction project X to meet the requirements, the inspector will press touch button 102 on electronic device 100. After touch button 102 is triggered, electronic device 100 automatically generates annotation instruction K1 and determines the corresponding quality evaluation information Y through the mapping relationship in Table 1. Quality evaluation information Y indicates that the construction project is qualified.

[0045] Then, the electronic device 100 determines the annotation time information t1 corresponding to the annotation instruction K1, wherein the annotation time information t1 indicates the time when the target item X appears in the target video V1. Finally, the electronic device 100 generates an item quality evaluation table based on the annotation time information t1 and the quality evaluation information Y.

[0046] Please refer to Table 2, which is the project quality evaluation table generated by electronic device 100.

[0047] Table 2 pass Figure 1 As shown in the example, after the electronic device 100 generates the project quality evaluation table (as shown in Table 2), since the time information t1 is used to indicate the time when the target project X appears in the target video V1, the quality evaluation information Y corresponding to the construction project X can be obtained through the target video V1 and the project quality evaluation table. Therefore, while the quality inspector is using the electronic device 100 to shoot the target video V1, the quality evaluation of each construction project can be completed through the electronic device 100, thereby improving work efficiency.

[0048] Figure 2 An application scenario of the annotation method in video recording according to another embodiment of this disclosure is illustrated. In this application scenario, electronic device 200, construction project H, construction project I, and construction project J are mainly shown. Among them, electronic device 200 includes camera 201, touch button 202, touch button 203, touch button 204, and light-emitting device 205.

[0049] Figure 2 The annotation method shown in the video recording is more suitable for scenarios where various construction projects are concentrated in a construction site. When multiple construction projects are captured simultaneously by the shooting angle α of the electronic device 200, the light-emitting device 205 of the electronic device 200 can emit light, and the construction project that needs to be evaluated is distinguished by whether the light shines on it.

[0050] exist Figure 2 In the example shown, when the quality inspector begins his inspection of the construction site, he will turn on the electronic device 200 to capture the target video V1 and point the electronic device 200 at the construction project H to capture the video.

[0051] Please refer to Table 3, which shows the mapping relationship between touch buttons, annotation commands, and quality evaluation information stored in electronic device 200. Different touch buttons trigger an annotation command and a light-emitting device. Each annotation command contains quality evaluation information that can annotate the target item currently displayed in target video V1, and each light-emitting device emits light of a specific color.

[0052] Among them, quality evaluation information Y indicates that the construction project is qualified; quality evaluation information N indicates that the construction project is unqualified; and quality evaluation information P indicates that the construction project needs to be confirmed. Light-emitting device L1 emits green light; light-emitting device L2 emits red light; and light-emitting device L3 emits yellow light.

[0053] As shown in Table 3, each touch button on the electronic device 200 corresponds to a quality evaluation information and a light-emitting device. The quality inspector can press different touch buttons according to the specific situation of the construction project.

[0054] Table 3 Please combine Figure 2 As per Table 3, during the recording of target video V1 using electronic device 200, if the quality inspector wants to review construction project H, they will point electronic device 200 at construction project H to film it. Because construction projects H, I, and J are relatively close together, when filming construction project H, the shooting angle α of electronic device 200 will also cover construction projects I and J.

[0055] At this point, if the quality inspector deems construction item H unqualified, they will point the light-emitting device 205 of the electronic device 200 towards construction item H and press the touch button 203 on the electronic device 200, causing the light-emitting device L2 of the electronic device 200 to emit red light towards construction item H. Furthermore, the electronic device 200 will automatically generate a labeling instruction K2 and determine the corresponding quality evaluation information N through the mapping relationship in Table 3. The quality evaluation information N indicates that the construction item is unqualified.

[0056] Then, the electronic device 200 determines the annotation time information t2 corresponding to the annotation instruction K2, wherein the annotation time information t2 is used to indicate the time when the target item H appears in the target video V1. Finally, the electronic device 200 generates an item quality evaluation table based on the annotation time information t2 and the quality evaluation information N.

[0057] Please refer to Table 4, which is the project quality evaluation table generated by electronic device 200.

[0058] Table 4 pass Figure 2As shown in the example, after the electronic device 200 generates the project quality evaluation table (as shown in Table 4), since the time information t2 is used to indicate the time when the target project H appears in the target video V1, the quality evaluation information N corresponding to the construction project H can be obtained through the target video V1 and the project quality evaluation table.

[0059] Therefore, during the process of quality inspectors using electronic equipment 200 to capture target video V1, the quality evaluation of each construction project can be completed through electronic equipment 200, thereby improving work efficiency. Furthermore, the light-emitting device 205 of electronic equipment 200 can emit light of different colors. Multiple construction projects may be captured simultaneously from the shooting angle α of electronic equipment 200, requiring the light-emitting device 205 of electronic equipment 200 to emit light to indicate the construction project requiring evaluation, thus avoiding confusion.

[0060] Figure 3 A schematic diagram illustrating the overall flow of a video recording annotation method M100 according to one embodiment of this disclosure is shown. Figure 3 The method shown includes steps S110 to S130. This method can be executed by an electronic device, which has components such as touch buttons, a camera, a light-emitting device, a processor, and a memory.

[0061] In execution Figure 3 The method shown indicates that the electronic device has already enabled the recording function, and the electronic device is currently recording the target video.

[0062] Specifically, Figure 3 The methods shown include: S110. During the recording of the target video, receive annotation instructions input by the staff.

[0063] The annotation instructions include quality assessment information for the target items currently displayed in the target video. This quality assessment information is the evaluation information for the target items currently displayed in the target video. Quality assessment information includes various types, such as "item qualified," "item unqualified," and "item pending confirmation."

[0064] In S110, the following solution can be adopted: During the process of the electronic device starting the camera to record the target video, the touch button of the electronic device receives the pressing operation of the staff, and the electronic device determines the annotation instruction corresponding to the touch button.

[0065] The annotation instructions are generated by staff pressing touch buttons on electronic devices. Pressing different touch buttons on the electronic devices will produce different annotation instructions.

[0066] During the process of staff using electronic devices to film a target video of a construction project, after reviewing the project, they will press a touch button on the electronic device to record their evaluation of the project. Once the touch button receives the staff's press, the electronic device will determine the corresponding annotation instruction.

[0067] S120. Determine the annotation time information corresponding to the annotation instruction.

[0068] The time information is used to indicate when the target item appears in the target video.

[0069] There are two specific methods for determining the time information of electronic devices.

[0070] In the first method, the electronic device determines the first duration. The first duration is the length of time the electronic device takes to capture the target video after receiving the annotation instruction.

[0071] In the first approach, in order to record the time when the target item appears in the target video, it is necessary to determine the length of time the electronic device takes to capture the target video when it receives the annotation instruction.

[0072] The second method involves the electronic device determining a first time and a second time. The first time is the time when the electronic device begins capturing the target video, and the second time is the time when the electronic device receives the annotation instruction.

[0073] In the second approach, in order to record when the target item appears in the target video, it is necessary to determine when the electronic device starts recording the target video and when the electronic device receives the annotation information.

[0074] S130. Based on the annotation time information and quality evaluation information, generate a project quality evaluation table.

[0075] exist Figure 3 In the example shown, while staff are using electronic devices to film target videos, the quality of each construction project can be evaluated through these devices, thereby improving work efficiency.

[0076] In one alternative approach, Figure 3 After the S110, Figure 3 The method shown may also include: determining the quality evaluation information in the labeling instructions.

[0077] Specifically, when the annotation instruction is a confirmation instruction, the quality evaluation information indicates that the target item is in a qualified state. When the annotation instruction is a negative instruction, the quality evaluation information indicates that the target item is in a non-qualified state. When the annotation instruction is a pending confirmation instruction, the quality evaluation information indicates that the target item is in a pending confirmation state.

[0078] In one alternative approach, Figure 3 After the S110, Figure 3 The method shown may also include: determining the light-emitting device corresponding to the annotation instruction; activating the light-emitting device to emit light, the light being used to illuminate the target item currently displayed in the target video, or the light being used to illuminate the target item among multiple items currently displayed in the target video.

[0079] The electronic device stores a mapping relationship between touch buttons, labeling instructions, quality evaluation information, and light-emitting devices. After the electronic device receives the touch buttons input by the staff, it can determine the light-emitting device corresponding to the labeling instruction based on the mapping relationship and activate the light-emitting device to emit light so that the light shines on the construction project that needs to be evaluated, thus avoiding confusion.

[0080] Of course, different touch buttons can trigger different light-emitting devices, and different light-emitting devices can emit light of different colors. Specifically, when the instruction is a confirmation instruction, the light emitted by the light-emitting device is the first color. When the instruction is a negation instruction, the light emitted by the light-emitting device is the second color. When the instruction is a pending confirmation instruction, the light emitted by the light-emitting device is the third color. The first, second, and third colors are all different colors; for example, the first color might be green, the second color red, and the third color yellow.

[0081] exist Figure 3 In the example shown, steps S140 to S160 may be included after step S130.

[0082] S140. Identify the video frames in the target video that correspond to the labeled time information.

[0083] The time information is used to indicate when the target item appears in the target video. Electronic devices can then use the time information to determine the video frame corresponding to the target item in the target video.

[0084] S150. Determine the name of the target item in the video frame.

[0085] Among them, electronic devices can use image recognition technology to identify video frames in order to identify the name of the target item in the video frame.

[0086] S160. In the project quality evaluation table, establish a mapping relationship between project name, time information, and quality evaluation information.

[0087] Therefore, electronic devices can automatically identify the project name corresponding to the target project based on the target video and the labeled time information, and automatically establish a mapping relationship between the project name, labeled time information and quality evaluation information in the project quality evaluation table without manual organization, thus automatically updating the information in the project quality evaluation table.

[0088] Figure 4 This illustration shows an application scenario of a video recording annotation method according to yet another embodiment of the present disclosure. In this application scenario, recording device 301, remote control device 302, construction project A, construction project B, and construction project C are mainly shown.

[0089] Figure 4 The annotation method shown in the video recording is more suitable for the scene where various construction projects are relatively scattered in the inspection site. This allows the shooting angle α of the recording device 301 to shoot only one construction project, without other construction projects being mixed into the shooting angle α of the recording device 301. Therefore, there is no need to remotely control the device 302 to aim at the construction project and emit light.

[0090] exist Figure 4 In the example shown, before the quality inspector inspects the construction site, the inspector establishes a wireless connection between the recording device 301 and the remote control device 302. When the quality inspector begins the inspection, the recording device 301 is activated to capture target video V1, and the recording device 301 is pointed at construction project A to capture the video.

[0091] Please refer to Table 5, which shows the mapping relationship between the touch buttons, annotation commands, and quality evaluation information stored in the remote control device 302. Quality evaluation information Y indicates that the construction project is qualified; quality evaluation information N indicates that the construction project is unqualified; and quality evaluation information P indicates that the construction project needs confirmation. As shown in Table 5, each touch button on the remote control device 302 corresponds to a quality evaluation message, and the quality inspector can press different touch buttons according to the specific circumstances of the construction project.

[0092] Table 5 Please combine Figure 4As per Table 5, during the recording process of target video V1 using recording device 301, if the quality inspector deems construction project A to meet the requirements, the inspector will press touch button B1 on remote control device 302. After touch button B1 on remote control device 302 is triggered, remote control device 302 will automatically generate a labeling instruction K1 and determine the corresponding quality evaluation information Y through the mapping relationship in Table 5. Quality evaluation information Y indicates that the construction project is qualified. Then, remote control device 302 will send the quality evaluation information Y to recording device 301.

[0093] When recording device 301 receives quality evaluation information Y sent by remote control device 302, recording device 301 determines the annotation time information t3 corresponding to annotation instruction K1. This annotation time information t3 is used to indicate the time when target item A appears in target video V1. Finally, electronic device 100 generates an item quality evaluation table based on annotation time information t3 and quality evaluation information Y. Please refer to Table 6, which is the project quality evaluation table generated by electronic device 100.

[0094] Table 6 pass Figure 4 As shown in the example, after the recording device 301 generates the project quality evaluation table (as shown in Table 6), since the time information t3 is used to indicate the time when target project A appears in target video V1, the quality evaluation information Y corresponding to construction project A can be obtained through target video V1 and the project quality evaluation table. Therefore, while the quality inspector is using the recording device 301 to shoot target video V1, the quality evaluation of each construction project can be completed through the remote control device 302, thereby improving work efficiency.

[0095] Figure 5 This illustration shows an application scenario of a video recording annotation method according to yet another embodiment of the present disclosure. In this application scenario, recording device 401, remote control device 402, construction item D, construction item E, and construction item F are mainly shown.

[0096] Figure 5 The annotation method shown in the video recording is more suitable for scenarios where various construction projects are concentrated in a construction site. The shooting angle α of the recording device 401 will capture multiple construction projects at the same time, so the remote control device 402 needs to emit light to indicate the construction project that needs to be evaluated.

[0097] exist Figure 5In the example shown, before the quality inspector inspects the construction site, the inspector establishes a wireless connection between the recording device 401 and the remote control device 402. When the quality inspector begins the inspection of the construction site, the recording device 401 is activated to capture target video V1.

[0098] Please refer to Table 7, which shows the mapping relationship between the touch buttons, annotation commands, quality evaluation information, and light-emitting devices stored in the remote control device 402. Among them, quality evaluation information Y indicates that the construction project is qualified; quality evaluation information N indicates that the construction project is unqualified; and quality evaluation information P indicates that the construction project needs confirmation. Light-emitting device L1 emits green light; light-emitting device L2 emits red light; and light-emitting device L3 emits yellow light.

[0099] As shown in Table 7, each touch button on the remote control device 402 corresponds to a quality evaluation information and a light-emitting device. The quality inspector can press different touch buttons according to the specific situation of the construction project.

[0100] Table 7 Please combine Figure 5 As per Table 7, during the recording of target video V1 by the quality inspector using recording device 301, if the quality inspector wants to review construction project E, the quality inspector will point recording device 401 at construction project E to film it. Since construction projects D, E, and F are located relatively close together, when recording device 401 films construction project E, the shooting angle α of recording device 401 will also cover construction projects D and F.

[0101] At this point, if the quality inspector deems construction item E unqualified, they will point the light-emitting device L2 of the remote control device 402 towards construction item E and press the touch button B2 on the remote control device 402, causing the light-emitting device L2 of the remote control device 402 to emit a red light towards construction item E. Furthermore, the remote control device 402 will automatically generate a labeling instruction K2 and determine the corresponding quality evaluation information N through the mapping relationship in Table 7. Quality evaluation information N indicates that the construction item is unqualified. Then, the remote control device 402 will send the quality evaluation information N to the recording device 401.

[0102] When the recording device 401 receives the quality evaluation information N sent by the remote control device 402, the recording device 401 determines the annotation time information t4 corresponding to the annotation instruction K2. This annotation time information t4 is used to indicate the time when the construction project E appears in the target video V1. Finally, the recording device 401 generates a project quality evaluation table based on the annotation time information t4 and the quality evaluation information N.

[0103] Please refer to Table 8, which is the project quality evaluation table generated by recording device 401.

[0104] Table 8 pass Figure 5 As shown in the example, after the recording device 401 generates the project quality evaluation table (as shown in Table 8), since the time information t4 is used to indicate the time when the target project E appears in the target video V1, the quality evaluation information N corresponding to the construction project E can be obtained through the target video V1 and the project quality evaluation table.

[0105] Therefore, while the quality inspector is using the recording device 401 to film the target video V1, the quality evaluation of each construction project can be completed through the remote control device 402, thereby improving work efficiency. Furthermore, the light-emitting device of the remote control device 402 can emit different colors of light. When the shooting angle α of the recording device 401 simultaneously captures multiple construction projects, the light-emitting device of the remote control device 402 needs to emit light to indicate the construction project that needs to be evaluated, thus avoiding confusion.

[0106] Figure 6 A schematic diagram illustrating the overall flow of a video recording annotation method M200 according to another embodiment of this disclosure is shown. Figure 6 The method shown includes steps S210 to S250. This method can be executed by a remote control device and a recording device, respectively. The remote control device needs to have components such as touch buttons and a wireless module, while the recording device needs to have components such as a camera, a wireless module, a processor, and a memory.

[0107] In execution Figure 6 Previously, the remote control device and the recording device needed to be connected to each other via a wireless module and in a communication connection state. Moreover, the recording device had already enabled the recording function and was currently recording the target video.

[0108] It should be noted that, Figure 6 The annotation method shown in the video recording is more suitable for scenarios where various construction projects are relatively scattered in the inspection site. This allows the recording device to shoot only one construction project from its shooting angle, without other construction projects being mixed into the recording device's shooting angle. Therefore, there is no need to remotely control the device to point the light at the construction project.

[0109] Specifically, Figure 6 The methods shown include: S210. During the recording of the target video, the remote control device receives annotation instructions input by the staff.

[0110] The annotation instructions include quality assessment information for the target items currently displayed in the target video. This quality assessment information is the evaluation information for the target items currently displayed in the target video. Quality assessment information includes various types, such as "item qualified," "item unqualified," and "item pending confirmation."

[0111] In S210, the following solution can be adopted: During the recording process of the recording device starting the camera to record the target video, the touch button of the remote control device receives the pressing operation of the staff, and the remote control device determines the annotation command corresponding to the touch button.

[0112] The annotation instructions are generated by the staff pressing touch buttons on the remote control device. Pressing different touch buttons on the remote control device will produce different annotation instructions.

[0113] During the process of staff using recording equipment to film a target video of a construction project, after reviewing the project, staff will press a touch button on the remote control device to record their evaluation of the project. Once the touch button on the remote control device receives the staff's press, the device will determine the corresponding annotation command.

[0114] S220: The remote control device sends quality evaluation information to the recording device.

[0115] S230, The recording device receives quality evaluation information sent by the remote control device.

[0116] S240. Recording device determines the annotation time information corresponding to the annotation instruction.

[0117] The time information is used to indicate when the target item appears in the target video.

[0118] There are two specific methods for determining the time information of remote control devices.

[0119] In the first method, the remote control device determines the first duration. The first duration is the length of time the remote control device takes to capture the target video after receiving the annotation command.

[0120] In the first method, in order to record the time when the target item appears in the target video, it is necessary to determine the length of time the remote control device takes the target video when it receives the annotation command.

[0121] The second method involves using a remote-controlled device to determine a first time and a second time. The first time is the time when the electronic device begins recording the target video, and the second time is the time when the electronic device receives the annotation instruction.

[0122] In the second approach, in order to record when the target item appears in the target video, it is necessary to determine when the electronic device starts recording the target video and when the electronic device receives the annotation information.

[0123] S250: The recording device generates a project quality evaluation table based on the labeled time information and quality evaluation information.

[0124] exist Figure 6 In the example shown, while staff are using recording equipment to film the target video, the quality evaluation of each construction project can be completed by remotely controlling the equipment, thereby improving work efficiency.

[0125] In one alternative approach, Figure 6 After the S210, Figure 6 The method shown may also include: remotely controlling the device to determine the quality evaluation information in the labeling instruction.

[0126] Specifically, when the annotation instruction is a confirmation instruction, the quality evaluation information indicates that the target item is in a qualified state. When the annotation instruction is a negative instruction, the quality evaluation information indicates that the target item is in a non-qualified state. When the annotation instruction is a pending confirmation instruction, the quality evaluation information indicates that the target item is in a pending confirmation state.

[0127] In one alternative approach, Figure 6 After the S210, Figure 6 The method may also include: the remote control device determining the light-emitting device corresponding to the annotation command; the remote control device activating the light-emitting device to emit light, the light being used to illuminate the target item currently displayed in the target video, or the light being used to illuminate the target item among multiple items currently displayed in the target video.

[0128] The remote control device stores a mapping relationship between touch buttons, labeling instructions, quality evaluation information, and light-emitting devices. After the remote control device receives the touch buttons input by the staff, it can determine the light-emitting device corresponding to the labeling instruction based on the mapping relationship and activate the light-emitting device to emit light so that the light shines on the construction project that needs to be evaluated, thus avoiding confusion.

[0129] Of course, different touch buttons can trigger different light-emitting devices, and different light-emitting devices can emit light of different colors. Specifically, when the instruction is a confirmation instruction, the light emitted by the light-emitting device is the first color. When the instruction is a negation instruction, the light emitted by the light-emitting device is the second color. When the instruction is a pending confirmation instruction, the light emitted by the light-emitting device is the third color. The first, second, and third colors are all different colors; for example, the first color might be green, the second color red, and the third color yellow.

[0130] exist Figure 6 In the example shown, steps S260 to S280 may be included after step S250.

[0131] S260. The recording device determines the video frame in the target video that corresponds to the labeled time information.

[0132] The time information is used to indicate when the target item appears in the target video. The recording device can then use the time information to determine the video frame corresponding to the target item in the target video.

[0133] S270, The recording device determines the name of the target item in the video frame.

[0134] The recording device can use image recognition technology to identify video frames in order to identify the name of the target item in the video frame.

[0135] S280. The recording device establishes a mapping relationship between the project name, the marked time information, and the quality evaluation information in the project quality evaluation table.

[0136] Therefore, the recording device can automatically identify the project name corresponding to the target project based on the target video and the labeled time information, and automatically establish a mapping relationship between the project name, labeled time information and quality evaluation information in the project quality evaluation table without manual organization, thus automatically updating the information in the project quality evaluation table.

[0137] Please see Figure 7 As shown, Figure 7 This is a schematic diagram of a video recording annotation system provided in this disclosure. Figure 7 The annotation system shown in the video recording includes a remote control device 601 and a recording device 602. The remote control device 601 is in a communicative connection with the recording device 602, which is currently capturing the target video. The remote control device 601 and the recording device 602 can perform actions such as... Figure 6 The annotation method shown in the video recording.

[0138] exist Figure 7 In the example shown, remote control device 601 is used to receive annotation instructions input by staff during the recording of the target video. These annotation instructions include quality evaluation information for annotating the target item currently displayed in the target video. The device determines the annotation time information corresponding to the annotation instructions, which indicates the time the target item appears in the target video. It then sends the quality evaluation information and annotation time information to recording device 602. Recording device 602 receives the quality evaluation information and annotation time information sent by remote control device 601 and generates a project quality evaluation table based on the annotation time information and the quality evaluation information.

[0139] Please see Figure 8 As shown, Figure 8 This is a schematic block diagram of an electronic device according to one embodiment of the present disclosure.

[0140] like Figure 8 As shown, the electronic device includes: The receiving module 110 is used to receive annotation instructions input by the staff during the recording of the target video.

[0141] The determination module 120 is used to determine the annotation time information corresponding to the annotation instruction.

[0142] The generation module 130 is used to generate a project quality evaluation table based on the annotation time information and quality evaluation information.

[0143] The aforementioned electronic device can be in the form of computer software, and the various modules of the aforementioned electronic device can be implemented through computer software modules.

[0144] The specific implementation process of the functions and roles of each module in the above electronic device can be found in the implementation process of the corresponding steps in the above method, and will not be repeated here.

[0145] Please see Figure 9 As shown, Figure 9 This is a schematic block diagram of an electronic device 3000 according to another embodiment of the present disclosure.

[0146] The hardware structure of the electronic device 3000 can be implemented using a bus architecture. The bus architecture can include any number of interconnect buses and bridges, depending on the specific application of the hardware and overall design constraints. The bus 3100 will connect various circuits including one or more processors 3200, memory 3300, touch buttons 3500, wireless modules 3600, light-emitting devices 3700, cameras 3800, and / or hardware modules. The bus 3100 can also connect various other circuits 3400 such as peripheral devices, voltage regulators, power management circuits, external antennas, etc.

[0147] Bus 3100 can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Component (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of representation, this diagram uses only one connection line, but this does not imply that there is only one bus or one type of bus.

[0148] This disclosure also provides a readable storage medium storing a computer program that, when executed by a processor, is used to implement the methods described above. A "readable storage medium" can be any means capable of containing, storing, communicating, propagating, or transmitting a program for use by or in conjunction with an instruction execution system, apparatus, or device. More specific examples of a readable storage medium include: an electrical connection with one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and programmable read-only memory (EPROM or flash memory), fiber optic devices, and portable read-only memory (CDROM), etc.

[0149] This disclosure also provides a computer program product, the methods of which can be implemented wholly or partially through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented wholly or partially as a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instructions are loaded and executed, all or part of the processes or functions of this disclosure are performed.

[0150] Computer programs or instructions can be stored in a readable storage medium or transferred from one readable storage medium to another. For example, the computer program or instructions can be transferred from one website, computer, server, or data center to another website, computer, server, or data center via wired or wireless means. The readable storage medium can be any available medium capable of access, or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium, such as a floppy disk, hard disk, or magnetic tape; an optical medium, such as a digital video optical disc; or a semiconductor medium, such as a solid-state drive. The computer-readable storage medium can be a volatile or non-volatile storage medium, or it can include both volatile and non-volatile types of storage media.

[0151] Those skilled in the art will understand that embodiments of this disclosure can be provided as methods, systems, or computer program products. Therefore, this disclosure can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this disclosure can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0152] This disclosure is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0153] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0154] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0155] In the description of this specification, the references to terms such as "one embodiment / mode," "some embodiments / modes," "example," "specific example," or "some examples," etc., refer to specific features, structures, or characteristics described in connection with that embodiment / mode or example, which are included in at least one embodiment / mode or example of this disclosure. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment / mode or example. Moreover, the specific features, structures, or characteristics described may be combined in any suitable manner in one or more embodiments / modes or examples. Furthermore, without contradiction, those skilled in the art can combine and integrate the different embodiments / modes or examples described in this specification, as well as the features of different embodiments / modes or examples.

[0156] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this disclosure, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0157] Those skilled in the art should understand that the above embodiments are merely for illustrating the present disclosure and are not intended to limit the scope of the disclosure. Those skilled in the art can make other changes or modifications based on the above disclosure, and these changes or modifications still fall within the scope of the present disclosure.

Claims

1. A method for labeling in video recording, characterized by, The method is applied to an electronic device that is recording target video, and the method includes: During the recording of the target video, annotation instructions input by staff are received; wherein, the annotation instructions include quality evaluation information that can annotate the target items currently displayed in the target video; Determine the annotation time information corresponding to the annotation instruction, wherein the annotation time information is used to indicate the time when the target item appears in the target video; Based on the labeled time information and the quality evaluation information, a project quality evaluation table is generated.

2. The labeling method of claim 1, wherein After receiving the annotation instructions input by the staff, the method further includes: Determine the quality evaluation information in the annotation instructions.

3. The annotation method as described in claim 2, characterized in that: The labeling instruction is a confirmation instruction, and the quality evaluation information is used to indicate that the target item is in a qualified state. Alternatively, the labeling instruction may be a negative instruction, and the quality evaluation information may be used to indicate that the target item is in a non-compliant state. Alternatively, the labeling instruction may be a pending confirmation instruction, and the quality evaluation information may be used to indicate that the target item is in a pending confirmation state.

4. The labeling method of claim 1, wherein After generating the project quality evaluation table based on the labeled time information and the quality evaluation information, the method further includes: Determine the video frame in the target video that corresponds to the labeled time information; Determine the name of the project corresponding to the target project in the video frame; In the project quality evaluation table, a mapping relationship is established between the project name, the labeled time information, and the quality evaluation information.

5. The labeling method of claim 1, wherein After receiving the annotation instructions input by the staff, the method further includes: Identify the light-emitting device corresponding to the annotation instruction; The light-emitting device is activated to emit light, which is used to illuminate the target item currently displayed in the target video, or the light is used to illuminate the target item among multiple items currently displayed in the target video.

6. The annotation method as described in claim 5, characterized in that: The labeling instruction is a confirmation instruction, and the light emitted by the light-emitting device is the first color; Alternatively, the labeling instruction may be a negative instruction, and the light emitted by the light-emitting device may be a second color; Alternatively, the labeling instruction may be a confirmation instruction, and the light emitted by the light-emitting device may be a third color; The first color, the second color, and the third color are all different colors.

7. A method for annotation in video recording, characterized in that, The method is applied to a recording device and a remote control device that works with the recording device. The recording device is capturing a target video, and the recording device and the remote control device are in a communication connection state. The method includes: During the recording of the target video, the remote control device receives annotation instructions input by the staff; wherein, the annotation instructions include quality evaluation information that can annotate the target items currently displayed in the target video; The remote control device sends the quality evaluation information to the recording device; The recording device receives the quality evaluation information sent by the remote control device; The recording device determines the annotation time information corresponding to the annotation instruction, and the annotation time information is used to indicate the time when the target item appears in the target video; The recording device generates a project quality evaluation table based on the labeled time information and the quality evaluation information.

8. The annotation method as described in claim 7, characterized in that, After the remote control device receives the annotation command input by the worker, the method further includes: The remote control device determines the quality evaluation information in the labeling instruction.

9. The annotation method as described in claim 8, characterized in that: The labeling instruction is a confirmation instruction, and the quality evaluation information is used to indicate that the target item is in a qualified state. Alternatively, the labeling instruction may be a negative instruction, and the quality evaluation information may be used to indicate that the target item is in a non-compliant state. Alternatively, the labeling instruction may be a pending confirmation instruction, and the quality evaluation information may be used to indicate that the target item is in a pending confirmation state.

10. The annotation method as described in claim 7, characterized in that, After the recording device generates a project quality evaluation table based on the labeled time information and the quality evaluation information, the method further includes: The recording device determines the video frame in the target video that corresponds to the labeled time information; The recording device determines the name of the project corresponding to the target project in the video frame; The recording device establishes a mapping relationship between the project name, the labeled time information, and the quality evaluation information in the project quality evaluation table.

11. The annotation method as described in claim 7, characterized in that, After the remote control device receives the annotation command input by the worker, the method further includes: The remote control device determines the light-emitting device corresponding to the labeling command; The remote control device activates the light-emitting device to emit light, which is used to illuminate the target item currently displayed in the target video, or the light is used to illuminate the target item among multiple items currently displayed in the target video.

12. The annotation method as described in claim 11, characterized in that: The labeling instruction is a confirmation instruction, and the light emitted by the light-emitting device is the first color; Alternatively, the labeling instruction may be a negative instruction, and the light emitted by the light-emitting device may be a second color; Alternatively, the labeling instruction may be a confirmation instruction, and the light emitted by the light-emitting device may be a third color; The first color, the second color, and the third color are all different colors.

13. A annotation system for video recording, characterized in that, It includes a recording device and a remote control device that works with the recording device. The recording device is recording a target video, and the recording device and the remote control device are in a communication connection state. The remote control device is used to receive annotation instructions input by staff during the recording of the target video; wherein the annotation instructions include quality evaluation information that can annotate the target item currently displayed in the target video; determine the annotation time information corresponding to the annotation instructions, the annotation time information being used to indicate the time when the target item appears in the target video; and send the quality evaluation information and the annotation time information to the recording device. The recording device is used to receive the quality evaluation information and the annotation time information sent by the remote control device; and to generate a project quality evaluation table based on the annotation time information and the quality evaluation information.

14. An electronic device, characterized in that, include: The memory stores computer programs; as well as A processor that executes a computer program stored in the memory, causing the processor to perform the annotation method in video recording as described in any one of claims 1 to 12.

15. A readable storage medium, characterized in that, The readable storage medium stores a computer program, which, when executed by a processor, is used to implement the annotation method in video recording according to any one of claims 1 to 12.

16. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the annotation method in video recording as described in any one of claims 1 to 12.

Images