Recording state identification method and device, electronic equipment and storage medium

By analyzing the image frame of the recording device to determine the recording status, the problem of loss of recording trigger signal during the SDI signal transmission of the recording device is solved, and the reliability of recording and real-time status feedback is achieved, which is suitable for a variety of shooting scenes.

CN119299667APending Publication Date: 2025-01-10BEIJING IQIYI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411371582.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-29
Publication Date
2025-01-10

AI Technical Summary

Technical Problem

During film and television shooting, the SDI signal of the recording device may cause the recording trigger signal to be lost during transmission, resulting in the downstream device being unable to judge the recording status of the recording device, affecting the normal progress of the recording.

Method used

By analyzing the image frames of the recording device, selecting the area image that represents the recording state, calculating its color average value, and determining the recording state according to the setting conditions, avoiding relying on volatile recording trigger signals.

Benefits of technology

Improves the reliability of recording, ensures that the recording is carried out normally, and feedbacks the status of the recording device in real time. It is suitable for all types of recording devices and shooting scenes, with high versatility and practicality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119299667A_ABST
    Figure CN119299667A_ABST
Patent Text Reader

Abstract

The invention provides a recording state recognition method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a first recording side image frame of recording equipment; selecting a regional image representing a recording state from the first recording side image frame; and feeding back the recording state of the recording device based on the regional image. The recording state is judged by directly analyzing the image frame of the recording equipment instead of depending on a recording trigger signal which is easy to lose, so that the problem that the recording trigger signal is lost in the process of transmitting the image at the recording side in the form of an SDI signal can be effectively avoided, the recording reliability is greatly improved, and normal recording is ensured. Besides, the state of the recording equipment can be fed back in real time, so that shooting personnel can know the recording condition in time so as to take measures quickly when problems occur, and the method and the device can be suitable for various different types of recording equipment and shooting scenes and have relatively high universality and practicability.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the technical field of film and television shooting, and in particular to a recording status recognition method, device, electronic equipment and storage medium. Background Art

[0002] During the image capture process (such as when a crew is shooting a video), the image frames on the recording side of the recording device (such as a camera) are generally transmitted in the form of SDI signals, and the SDI signals of the recording device actually need to pass through multiple devices before they are given to the electronic device (such as a monitor), such as image transmission equipment, on-site image auxiliary equipment (such as QTAKE equipment, QTAKE is a professional digital imaging auxiliary system. It can collect, monitor, record and play back the camera's image signals in real time, and provide a variety of auxiliary functions), on-site color grading equipment, etc. After passing through the above-mentioned multiple devices, the image frames on the recording side may cause some information loss in the SDI signal, which may cause the loss of the recording trigger signal, making it impossible for downstream devices (such as monitors) to determine whether the recording device is currently in a recording state through the SDI signal of the recording device, thereby affecting the normal progress of image recording and providing a poor experience. Summary of the invention

[0003] In view of this, in order to solve the above technical problems, the present disclosure provides a recording status recognition method, device, electronic device and storage medium.

[0004] According to a first aspect of an embodiment of the present disclosure, a recording status recognition method is provided, the recording status recognition method comprising:

[0005] Acquire a first recording side image frame of a recording device;

[0006] Selecting a regional image representing a recording state from the first recording side image frame;

[0007] Determining a color average of the image of the region;

[0008] If it is determined that the color average value meets the set condition, then determining that the first recording side image frame corresponds to a recording state;

[0009] If the first recording side image frames acquired for n consecutive times correspond to a recording state, then feedback is given that the recording device is in a recording state; wherein n is a positive integer greater than or equal to 2.

[0010] Optionally,

[0011] The selecting a regional image representing a recording state from the first recording side image frame includes:

[0012] Based on the target position information, the regional image representing the recording state is selected from the first recording side image frame; wherein the target position information is the position information corresponding to the region representing the recording state in the recording side image frame of the recording device;

[0013] The target location information is determined by:

[0014] Acquire a second recording side image frame when the recording device is in a recording state;

[0015] The target position information is determined from the second recording side image frame.

[0016] Optionally, determining the target position information from the second recording side image frame includes:

[0017] The target position information is determined in response to the position selection information of the area representing the recording state in the second recording side image frame.

[0018] Optionally, the selecting the regional image representing the recording state from the first recording side image frame based on the target position information includes:

[0019] Determine the target area with the position center represented by the target position information as the center and the set size as the size;

[0020] An image of the target area is selected from the first recording side image frame to obtain the area image.

[0021] Optionally, determining the color average value of the regional image includes:

[0022] When the regional image corresponds to an RGB color space, the average values ​​of the red channel, the green channel, and the blue channel of all pixels in the regional image are calculated respectively to obtain the color average value of the regional image in the RGB color space.

[0023] Optionally, determining that the color average value satisfies a set condition includes:

[0024] Convert the color average value into color information in HSV color space;

[0025] If it is determined that at least the saturation of the color information satisfies the saturation threshold and the hue of the color information satisfies the hue threshold, it is determined that the color average value satisfies the set condition.

[0026] Optionally, the acquiring a first recording side image frame of a recording device;

[0027] The first recording side image frame of the recording device is acquired once every m frames; wherein m is a positive integer greater than or equal to 1.

[0028] According to a second aspect of an embodiment of the present disclosure, a recording state recognition device is provided, the recording state recognition device comprising:

[0029] An acquisition module, used to acquire a first recording side image frame of a recording device;

[0030] A determination module is used to select an area image representing a recording state from the first recording side image frame; it is also used to determine the color average value of the area image; it is also used to determine that the first recording side image frame corresponds to a recording state if it is determined that the color average value meets a set condition; it is also used to feedback that the recording device is in a recording state if the first recording side image frame obtained for n consecutive times corresponds to a recording state; wherein n is a positive integer greater than or equal to 2.

[0031] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising:

[0032] processor;

[0033] a memory for storing instructions executable by the processor;

[0034] Wherein, the processor is configured to execute the recording status identification method as described in any one of the first aspects.

[0035] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute the recording status identification method as described in any one of the first aspects.

[0036] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: the present disclosure no longer relies on the recording trigger signal which is easy to be lost, but directly analyzes the image frame of the recording device to judge the recording status, which can effectively avoid the problem of the recording trigger signal being lost during the transmission of the recording side image in the form of an SDI signal, greatly improving the reliability of the recording and ensuring the normal recording. In addition, the present disclosure can provide real-time feedback on the status of the recording device, so that the shooting personnel can understand the recording situation in a timely manner, so as to take quick measures when problems arise, and can be applied to various types of recording devices and shooting scenes, with high versatility and practicality.

[0037] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0039] Figure 1 The figure is a flowchart of a recording status identification method according to an exemplary embodiment.

[0040] Figure 2 It is a block diagram of a recording status recognition device according to an exemplary embodiment.

[0041] Figure 3 is a block diagram of an electronic device according to an exemplary embodiment.

[0042] Figure 4 is a schematic diagram of a recording side image frame according to an exemplary embodiment.

[0043] Figure 5 is a schematic diagram of a recording side image frame according to another exemplary embodiment.

[0044] Figure 6 is a schematic diagram of a recording side image frame according to another exemplary embodiment.

[0045] Figure 7 The figure is a schematic diagram of a process of determining target location information according to an exemplary embodiment. DETAILED DESCRIPTION

[0046] The following will describe the implementation methods of the present application with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific implementation methods, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be understood that the preferred embodiments are only for illustrating the present application, not for limiting the scope of protection of the present application.

[0047] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present application, and thus the drawings only show components related to the present application rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed at will, and the component layout may also be more complicated.

[0048] To facilitate understanding of the embodiments of the present application, further explanation will be given below with reference to specific embodiments in conjunction with the accompanying drawings. The embodiments do not constitute a limitation on the embodiments of the present application.

[0049] The embodiments of the present disclosure provide a recording status identification method, device, electronic device and storage medium. The present disclosure no longer relies on recording trigger signals that are easily lost, but instead directly analyzes the image frames of the recording device to determine the recording status, which can effectively avoid the problem of recording trigger signal loss during the transmission of the recording side image in the form of SDI signals, greatly improving the reliability of recording and ensuring the normal recording. In addition, the present disclosure can provide real-time feedback on the status of the recording device, allowing the shooting personnel to understand the recording situation in a timely manner so that they can take quick measures when problems arise, and can be applicable to various types of recording devices and shooting scenes, with high versatility and practicality.

[0050] In an exemplary embodiment, a recording status recognition method is provided, which can be applied to an electronic device. Figure 1 As shown, the method may include:

[0051] S110, obtaining a first recording side image frame of a recording device;

[0052] S120, selecting a region image representing a recording state from the first recording side image frame;

[0053] S130, determining the color average value of the regional image;

[0054] S140: If it is determined that the color average value meets the set condition, then determine that the first recording side image frame corresponds to a recording state;

[0055] S150. If the first recording side image frames acquired for n consecutive times correspond to a recording state, feedback is given that the recording device is in a recording state; wherein n is a positive integer greater than or equal to 2.

[0056] In step S110, the first recording side image frame refers to the image frame recorded by the recording device, that is, the first recording side image frame includes the screen content captured by the recording device at the current moment. It should be noted that the first recording side image frame is not necessarily an image frame in the recording state of the recording device, and may also be an image frame in the non-recording state, and there is no limitation on this. For example, when the recording device is currently in the non-recording state, but the recording device is still collecting the current captured screen content, which is a static non-recording state image, and the image frame corresponding to the screen content at this time is the image frame in the non-recording state.

[0057] In the case of recording an image (e.g., a film and television shooting scene), a first recording side image frame of the recording device is acquired in real time through a data acquisition module connected to the recording device. The data acquisition module may be a specially designed hardware device or an image acquisition function implemented by software.

[0058] In step S120, it should be noted that when the recording device is in the recording state, in addition to providing the corresponding recording trigger signal, a recording identifier indicating that it is in the recording state (refer to Figures 4 to 6 ) will also be displayed accordingly, such as a red dot.

[0059] In this step, the image of the area where the recording mark is located (recorded as the area image) can be selected from the first recording side image frame, and then the subsequent recording status is analyzed and judged.

[0060] The specific area that can represent the recording state can be determined by analyzing the characteristics of the image frame of the recording device in the recording state. For example, for some recording devices, a specific red dot will be displayed in a corner of the picture in the recording state.

[0061] In some embodiments, an image recognition algorithm can be used to accurately select a region image representing a recording state from the first recording side image frame. The image recognition algorithm can be used to identify and locate based on features such as color, shape, and texture, which are not limited thereto.

[0062] In some embodiments,

[0063] After the recording device starts recording, the electronic device can first obtain the second recording side image frame in the recording state. The electronic device can be directly connected to the recording device, or it can obtain the image frame wirelessly. It should be noted that it is necessary to ensure that the obtained second recording side image frame is clear and complete, and can accurately reflect the picture characteristics of the recording device in the recording state. Then, the obtained second recording side image frame is analyzed to find specific elements or areas that can represent the recording state. For example, some recording devices will display a flashing icon at a specific position of the screen in the recording state.

[0064] Then, the position information of the specific element or area in the second recording side image frame is determined by an image recognition algorithm and used as the target position information. The target position information may include coordinate position, size range, etc., which is not limited.

[0065] In the subsequent recording process, after obtaining the first recording side image frame of the recording device, the previously determined target position information is used to accurately select the area image representing the recording state from the first recording side image frame. Then, according to the coordinate position and size range of the target position information, the corresponding area image is extracted from the first recording side image frame. This area image can contain key information that can determine the recording state.

[0066] It should be noted that, in addition to selecting the regional image through the image recognition algorithm, other methods may also be used, which are not limited to this. For example, the recording state area representing the recording state may also be selected by the user.

[0067] Among them, since different recording devices may correspond to different recording status areas, in view of this, in this embodiment, the second recording side image frame of the recording device in the recording state can be first obtained, and then the target position information can be determined from the second recording side image frame. The target position information is the position information corresponding to the area representing the recording state in the recording side image frame of the recording device.

[0068] When determining the target position information, the target position information may be determined in response to the position selection information of the area representing the recording state in the second recording side image frame. The position selection information may be directly input by the user or indirectly input by the user through other devices, which is not limited.

[0069] In some embodiments,

[0070] refer to Figure 7 As shown, when the recording device starts recording, the electronic device may first obtain a second recording side image frame in a recording state. In this embodiment, an interactive interface may be provided in the electronic device to allow the user to select an area representing the recording state in the second recording side image frame. The user may select a position on the image frame through an input device such as a mouse or a touch screen to determine an area that may contain a recording mark. After receiving the user's position selection information for the area representing the recording state in the second recording side image frame, the position information is recorded as the target position information. For example, if the user selects a specific icon area in the upper right corner of the image frame, the system determines the coordinate position and other information of the area as the target position information.

[0071] The process of the user determining the target ketchup information can be referred to Figure 7 As shown, the user can first select a positioning point. When the positioning point is not moved, the positioning point is in the first state, that is, Figure 7 When the user moves the above positioning point to locate the position of the selected recording mark, the positioning point in the dragging process can present a second state, that is, Figure 7 The dotted state shown in "Drag the positioning point" is combined with the enlarged state of the positioned area, so that it is easier for users to accurately select the location information of the required recording mark.

[0072] In this implementation, when the user selects the area representing the recording status, the second recording side image frame can be enlarged first to facilitate the user's selection. With different models of cameras and different aspect ratio settings, the size and position of the recording status area (e.g., the recording red dot) are different. This implementation can better adapt to different scenes through user selection.

[0073] It should be noted that the target location information may include location coordinates, or may include the size range of the area. When the target location information includes location coordinates, the location coordinates may be the location coordinates of the center point of the area selected by the user.

[0074] Among them, when selecting the area image representing the recording state from the first recording side image frame based on the target position information, the target area can be determined with the position center represented by the target position information as the center and the set size as the size. The set size can be the content of the target position information or the information preset to the electronic device, and there is no limitation on this. When the set size is the information preset to the electronic device, it can be modified later according to the actual request to better meet the different needs of users.

[0075] After the target area is determined, the image of the target area can be selected from the first recording side image frame to obtain the area image.

[0076] In some embodiments,

[0077] First, the center of the position represented by the target position information is taken as the center. For example, if the target position information is determined as the coordinates (x, y) in the image frame, then the coordinate point is taken as the center. Next, the set size is determined. This set size can be adjusted according to the actual situation, for example, it can be a fixed pixel size range (such as a 10X10 pixel range), or dynamically calculated according to the resolution of the recording device and the image characteristics.

[0078] In this embodiment, the target area is determined with the determined position center as the center and the set size as the size. In this way, a target area with the target position as the center and a specific size is obtained. Then, an image of the target area is selected from the first recording side image frame to obtain a regional image. Among them, by performing an accurate image extraction operation on the first recording side image frame, it can be ensured that the selected regional image accurately reflects the key information that may characterize the recording state.

[0079] It should be noted that, in addition to obtaining the regional image in the above manner, the regional image may also be obtained in other manners, which are not limited thereto.

[0080] In step S130, the selected area image is further analyzed and processed to determine whether the recording device is in a recording state. For example, if a specific recording mark is present in the area image, it is determined that the recording device is recording, and the recording state information is fed back to the relevant personnel or system. The feedback method may be displaying state indication information on the electronic device, or sending a notification message to the corresponding device, etc., which is not limited.

[0081] In this embodiment, the image frames of the recording device can be continuously monitored and the recording status feedback can be updated in real time to ensure that recording abnormalities can be discovered in time during the shooting process and corresponding measures can be taken.

[0082] When the recording state of the recording device is fed back based on the regional image, the color average value of the regional image may be determined first, and then the color average value may be analyzed.

[0083] In some embodiments, after obtaining the regional image, the regional image may be subjected to color analysis to calculate its color average. The calculation may be performed using a common color space model (such as RGB, HSV, etc.). For example, for the RGB color space, the average values ​​of the red, green, and blue channels of all pixels in the regional image are calculated respectively to obtain the color average value of the regional image in the RGB color space. In other words, the color average value may include the average values ​​of multiple red channels, the average values ​​of green channels, and the average values ​​of blue channels.

[0084] In step S140, after analyzing the color average value, if it is determined that the color average value meets the set condition, it is determined that the first recording side image frame corresponds to the recording state. The specific content of the set condition can be set according to the actual situation and is not limited to this. In addition, the set condition can also be modified according to the actual situation to better meet the different needs of users.

[0085] In some embodiments,

[0086] If the average value of the regional image on a specific color channel is within a certain range, the set condition is considered to be met. The set condition can be adjusted and modified according to different recording devices, shooting scenes and user needs. For example, different models of cameras may show different color characteristics when recording, so it is necessary to set corresponding set conditions according to actual conditions.

[0087] In some embodiments,

[0088] The calculated color average is converted into color information in the HSV (hue, saturation, value) color space. This conversion can be achieved by a known color space conversion algorithm to better analyze color features, which will not be described in detail here. In this embodiment, the saturation threshold and hue threshold can be set in advance. These thresholds can be adjusted according to the actual shooting situation and the characteristics of the recording device. After obtaining the color information, the converted color information can be analyzed.

[0089] If it is determined that the saturation of the color information satisfies the saturation threshold and the hue of the color information satisfies the hue threshold, then it is determined that the color average value satisfies the set condition. For example, if the saturation threshold is set to a certain value range, and the calculated saturation of the color information falls within this range, and the hue also satisfies the corresponding hue threshold requirement, then it can be considered that the color average value satisfies the set condition. For example, the saturation threshold and the hue threshold can be set to be less than or equal to 10%.

[0090] It should be noted that, when judging whether the color average value meets the set conditions, in addition to judging the saturation and hue of the color information, it is also possible to further judge whether the brightness of the color information meets the brightness threshold. That is, if it is determined that the saturation of the color information meets the saturation threshold, the hue of the color information meets the hue threshold, and the brightness of the color information meets the brightness threshold, then it is determined that the color average value meets the set conditions. The above-mentioned saturation threshold, hue threshold, and brightness threshold can be set according to actual conditions, and their specific contents are not limited.

[0091] In step S140, if the first recording side image frames obtained for n consecutive times correspond to the recording state, it is considered that the recording device is in the recording state, and feedback is given that the recording device is in the recording state; wherein n is a positive integer greater than or equal to 2. By setting a suitable parameter n, it is possible to better avoid misjudgment caused by signal jitter or intermittent judgment caused by signal interference, and the reliability of the recording state judgment of this embodiment can be better improved.

[0092] In some embodiments,

[0093] After obtaining the regional image, the regional image can be color analyzed to calculate its color average. Common color space models (such as RGB, HSV, etc.) can be used for calculation. For example, for the RGB color space, the average values ​​of the red, green, and blue channels of all pixels in the regional image are calculated respectively to obtain the color average value of the regional image in the RGB color space.

[0094] Then, the calculated color average value is analyzed to determine whether it meets the set condition. The set condition can be set according to the actual situation. For example, if the average value of the regional image on a specific color channel is within a certain range, it is considered that the set condition is met. The set condition can be adjusted and modified according to different recording devices, shooting scenes and user needs. For example, different models of cameras may present different color characteristics in the recording state, so it is necessary to set the corresponding setting conditions according to the actual situation.

[0095] In this embodiment, if it is determined that the color average value meets the set conditions, it is determined that the first recording side image frame corresponds to the recording state. By analyzing the color characteristics of the regional image, the recording state of the recording device can be judged more accurately. Among them, in order to improve the accuracy and reliability of the judgment, the first recording side image frame can be acquired and analyzed for multiple times in succession. If the first recording side image frame acquired for n consecutive times corresponds to the recording state, it is considered that the recording device is in the recording state. Among them, n is a positive integer greater than or equal to 2, which can be set according to actual needs. For example, when n=2, if the first recording side image frames acquired for 2 consecutive times are both determined to be in the recording state, then it can be determined that the recording device is recording, that is, it is determined that the recording device is in the recording state.

[0096] The image recorded by the recording device is generally an image in the RGB color space, so the color average value in this embodiment is generally the color average value in the RGB color space. In this embodiment, when judging whether the color average value meets the set conditions, the color average value can be first converted into color information in the HSV color space, and then, based on the saturation and hue of the above color information, it is judged whether the color average value meets the set conditions.

[0097] If it is determined that at least the saturation of the color information satisfies the saturation threshold and the hue of the color information satisfies the hue threshold, it is determined that the color average value satisfies the set condition.

[0098] In some embodiments,

[0099] The calculated color average is converted into color information in the HSV (hue, saturation, value) color space. This conversion can be achieved by a known color space conversion algorithm to better analyze color features, which will not be described in detail here. In this embodiment, the saturation threshold and hue threshold can be set in advance. These thresholds can be adjusted according to the actual shooting situation and the characteristics of the recording device. After obtaining the color information, the converted color information can be analyzed.

[0100] If it is determined that the saturation of the color information satisfies the saturation threshold and the hue of the color information satisfies the hue threshold, then it is determined that the color average value satisfies the set condition. For example, if the saturation threshold is set to a certain value range, and the calculated saturation of the color information falls within this range, and the hue also satisfies the corresponding hue threshold requirement, then it can be considered that the color average value satisfies the set condition. For example, the saturation threshold and the hue threshold can be set to be less than or equal to 10%.

[0101] It should be noted that, when judging whether the color average value meets the set conditions, in addition to judging the saturation and hue of the color information, it is also possible to further judge whether the brightness of the color information meets the brightness threshold. That is, if it is determined that the saturation of the color information meets the saturation threshold, the hue of the color information meets the hue threshold, and the brightness of the color information meets the brightness threshold, then it is determined that the color average value meets the set conditions. The above-mentioned saturation threshold, hue threshold, and brightness threshold can be set according to actual conditions, and their specific contents are not limited.

[0102] This embodiment no longer relies on the recording trigger signal that is easily lost, but directly analyzes the image frame of the recording device to determine the recording status. This can effectively avoid the problem of the recording trigger signal being lost during the transmission of the recording side image in the form of an SDI signal, greatly improving the reliability of the recording and ensuring the normal recording. In addition, this embodiment can provide real-time feedback on the status of the recording device, so that the shooting personnel can understand the recording situation in a timely manner so that they can take quick measures when problems arise. It can also be applied to various types of recording devices and shooting scenes, and has high versatility and practicality. In addition, this embodiment can more accurately determine the recording status of the recording device. Using the color information of the HSV color space for analysis can better capture the color characteristics of the image and improve the accuracy and reliability of the judgment.

[0103] In addition, it should be noted that for film and television shooting scenes, the staff on the shooting site need to monitor the shooting effect of the camera in real time, and the on-site video management personnel also need to record the SDI signal of the camera. Because the equipment link on the shooting site is relatively complex, many devices (such as image transmission equipment) will cause the recording machine to be unable to automatically identify the recording status of the camera, and manual operation is required to control the recording. The recorded video can be edited on-site to improve shooting efficiency. It can also be synchronized to the main creative staff to carry out the work of taking over the play and improve the shooting quality, which is extremely valuable. This embodiment can be applied to the side-recording cloud system, achieving fully automated recording on the cloud, greatly improving the efficiency and quality of on-site shooting, and enhancing the supervision timeliness of producers and management over shooting.

[0104] It should be noted that "side recording" means that this is an auxiliary recording method, usually not the main recording channel. The purpose of side recording may be various, such as making highlights, conducting on-site monitoring records, providing additional backup in case of problems with the main recording, etc.

[0105] For example, at a concert recording site, the main recording device is a professional camera, which is responsible for capturing high-quality performance images. Some storage devices or special recording devices connected to it may perform on-site side recording. These devices, as downstream devices, record the received signals synchronously. If the main recording device fails or the recorded content needs additional analysis and processing, the side recording content can come into play.

[0106] In a recording system, the signal usually starts from the source (such as a recording device such as a camera) and goes through a series of processing and transmission links. The "downstream device" mentioned here refers to the device that is further behind the recording device in the signal transmission direction. For example, during filming, the image signal generated by the recording device (such as a camera) may first be processed and transmitted by an image transmission device, QTAKE device, etc., and the monitors, storage devices, etc. connected to these devices can be considered downstream devices.

[0107] In addition, in this embodiment, when acquiring the first recording side image frame of the recording device, the first recording side image frame of the recording device may be acquired once every m frames. Wherein, m is a positive integer greater than or equal to 1. For example, if m=3, the first recording side image frame is acquired once every 3 frames. This embodiment selectively extracts a specific image frame from the image stream output by the recording device by setting the interval parameter m.

[0108] It should be noted that continuously acquiring each frame of image for processing will consume a lot of computing resources, especially in high-resolution, high-frame-rate shooting scenarios. By acquiring image frames at intervals, the number of images that need to be processed can be greatly reduced, thereby reducing the computing burden and improving the operating efficiency of the system.

[0109] For example, in a 4K resolution, 60 frames per second shooting project, if each frame is processed continuously, the performance requirements for the computing device are very high. However, by adopting the interval acquisition method, such as acquiring an image frame every 10 frames, the amount of calculation can be reduced to one tenth of the original, so that efficient recording status judgment can be achieved on ordinary computing devices.

[0110] In addition, by setting an appropriate m, the number of image frames processed can be reduced, which can reduce the system load and improve the stability of the system. During long-term shooting, the stability of the system is crucial. If the system crashes or freezes due to excessive computing load, it may cause errors in recording status judgment and even affect the entire shooting process.

[0111] For example, in the shooting scene of a large-scale TV series, continuous shooting is required for several hours or even days. The method of acquiring image frames at intervals can ensure that the system remains stable during long-term operation and avoid affecting the shooting progress due to system failure.

[0112] For different shooting requirements, the parameter m for interval acquisition of image frames can be flexibly adjusted. For example, in some scenarios where the real-time requirement for recording status judgment is not high, a larger m value can be selected to further reduce the calculation burden and improve system stability. In some scenarios where the real-time requirement is high, a smaller m value can be selected to ensure that key image frames can be obtained in time for recording status judgment.

[0113] For example, when shooting documentaries, the requirements for real-time judgment of the recording status may be relatively low, and image frames can be acquired every 20 frames. In scenes such as shooting sports games where the recording status needs to be judged quickly, image frames can be acquired every 2 or 3 frames to meet real-time requirements.

[0114] In summary, by acquiring the first recording side image frame of the recording device at intervals, the calculation burden can be reduced, the system stability can be improved, and different shooting demand scenarios can be adapted while ensuring the accuracy of recording state judgment.

[0115] In an exemplary embodiment, a recording state recognition device is provided, which is applied to an electronic device. The device is used to implement the above-mentioned recording state recognition method. For example, referring to Figure 2 As shown, the device may include:

[0116] An acquisition module 10 is used to acquire a first recording side image frame of a recording device;

[0117] The determination module 20 is used to select an area image representing a recording state from the first recording side image frame; it is also used to determine the color average value of the area image; it is also used to determine that the first recording side image frame corresponds to a recording state if it is determined that the color average value meets the set conditions; it is also used to feedback that the recording device is in a recording state if the first recording side image frame obtained for n consecutive times corresponds to a recording state; wherein n is a positive integer greater than or equal to 2.

[0118] In an exemplary embodiment, a recording status recognition device is provided, which is applied to an electronic device. Figure 2 As shown, in the device,

[0119] The determination module 20 can be used to select the area image representing the recording state from the first recording side image frame based on the target position information; wherein the target position information is the position information corresponding to the area representing the recording state in the recording side image frame of the recording device.

[0120] The target location information is determined in the following manner:

[0121] Acquire a second recording side image frame when the recording device is in a recording state;

[0122] The target position information is determined from the second recording side image frame.

[0123] In an exemplary embodiment, a recording status recognition device is provided, which is applied to an electronic device. Figure 2 As shown, in the device, the determination module 20 can be used to:

[0124] The target position information is determined in response to the position selection information of the area representing the recording state in the second recording side image frame.

[0125] In an exemplary embodiment, a recording status recognition device is provided, which is applied to an electronic device. Figure 2 As shown, in the device, the determination module 20 can be used to:

[0126] Determine the target area with the position center represented by the target position information as the center and the set size as the size;

[0127] An image of the target area is selected from the first recording side image frame to obtain the area image.

[0128] In an exemplary embodiment, a recording status recognition device is provided, which is applied to an electronic device. Figure 2 As shown, in the device, the determination module 20 can be used to:

[0129] Convert the color average value into color information in HSV color space;

[0130] If it is determined that at least the saturation of the color information satisfies the saturation threshold and the hue of the color information satisfies the hue threshold, it is determined that the color average value satisfies the set condition.

[0131] In an exemplary embodiment, a recording status recognition device is provided, which is applied to an electronic device. Figure 2 As shown, in the device, the acquisition module 10 can be used for:

[0132] The first recording side image frame of the recording device is acquired once every m frames; wherein m is a positive integer greater than or equal to 1.

[0133] In an exemplary embodiment, an electronic device is provided, which can be used as a monitor for monitoring a recording side image frame of a recording device, or can be other devices, which are not limited.

[0134] Among them, reference Figure 4 As shown, the electronic device 100 includes: at least one processor 101, a memory 102, at least one network interface 104 and a user interface 103. The various components in the electronic device 100 are coupled together through a bus system 105. It can be understood that the bus system 105 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 105 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity of the description, various buses are marked as bus systems 105 in the figure.

[0135] The user interface 103 may include a display, a keyboard, or a pointing electronic device (eg, a mouse, a trackball), a touch pad, or a touch screen.

[0136] It can be understood that the memory 102 in the embodiment of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 102 described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0137] In some implementations, the memory 102 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 1021 and application programs 1022 .

[0138] Among them, the operating system 1021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 1022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., which are used to implement various application services. The program that implements the method of the embodiment of the present application can be included in the application 1022.

[0139] In the embodiment of the present application, by calling the program or instructions stored in the memory 102, specifically, the program or instructions stored in the application 1022, the processor 101 is used to execute the method steps provided by each method embodiment.

[0140] The method disclosed in the above embodiment of the present application can be applied to the processor 101, or implemented by the processor 101. The processor 101 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 101 or the instruction in the form of software. The above processor 101 can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to execute, or the hardware and software units in the decoding processor can be executed. The software unit can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 102, and the processor 101 reads the information in the memory 102 and completes the steps of the above method in combination with its hardware.

[0141] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing electronic devices (DSPD), programmable logic electronic devices (PLD), field programmable gate arrays (FPGA), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions of the present application, or a combination thereof.

[0142] For software implementation, the technology of this article can be implemented by a unit that performs the functions of this article. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.

[0143] The terminal provided in this embodiment can execute all the steps of the above-mentioned data processing method, thereby achieving the technical effect of the above-mentioned data processing method. Please refer to the relevant description of the above-mentioned data processing method for details. For the sake of concise description, it will not be repeated here.

[0144] The embodiment of the present application also provides a storage medium (computer-readable storage medium). The storage medium here stores one or more programs. The storage medium may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory may also include a combination of the above-mentioned types of memory.

[0145] When one or more programs in the storage medium can be executed by one or more processors, the above method executed on the electronic device side is implemented.

[0146] The processor is used to execute the program stored in the memory to implement the following steps of the method performed on the electronic device side.

[0147] The professionals should also be further aware that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0148] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0149] It should be noted that the phrases "one implementation", "an embodiment", "an exemplary embodiment", "some embodiments", etc. mentioned in the specification indicate that the described embodiments may include certain features, structures or characteristics, but not every embodiment may include the certain features, structures or characteristics. In addition, such phrases do not necessarily refer to the same embodiment. In addition, when describing certain features, structures or characteristics in conjunction with an embodiment, it is within the knowledge of those skilled in the art to implement such features, structures or characteristics in conjunction with other embodiments, whether explicitly or not explicitly described.

[0150] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or electronic device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or electronic device. In the absence of more limitations, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or electronic device including the elements.

[0151] The above embodiments are only preferred embodiments for fully illustrating the present application, and the protection scope of the present application is not limited thereto. Any equivalent substitution or change made by a person skilled in the art based on the present application is within the protection scope of the present application.

Claims

1. A recording status recognition method, characterized in that: The recording status identification method comprises: Acquire a first recording side image frame of a recording device; Selecting a regional image representing a recording state from the first recording side image frame; Determining a color average of the image of the region; If it is determined that the color average value meets the set condition, then determining that the first recording side image frame corresponds to a recording state; If the first recording side image frames acquired for n consecutive times correspond to a recording state, then feedback is given that the recording device is in a recording state; wherein n is a positive integer greater than or equal to 2.

2. The recording status recognition method according to claim 1, characterized in that: The selecting a regional image representing a recording state from the first recording side image frame includes: Based on the target position information, the regional image representing the recording state is selected from the first recording side image frame; wherein the target position information is the position information corresponding to the region representing the recording state in the recording side image frame of the recording device; The target location information is determined by: Acquire a second recording side image frame when the recording device is in a recording state; The target position information is determined from the second recording side image frame.

3. The recording status recognition method according to claim 2, characterized in that: The determining the target position information from the second recording side image frame includes: The target position information is determined in response to the position selection information of the area representing the recording state in the second recording side image frame.

4. The recording status recognition method according to claim 2, characterized in that: The selecting, based on the target position information, the regional image representing the recording state from the first recording side image frame comprises: Determine the target area with the position center represented by the target position information as the center and the set size as the size; An image of the target area is selected from the first recording side image frame to obtain the area image.

5. The recording status recognition method according to claim 1, characterized in that: Determining the color average value of the regional image includes: When the regional image corresponds to an RGB color space, the average values ​​of the red channel, the green channel, and the blue channel of all pixels in the regional image are calculated respectively to obtain the color average value of the regional image in the RGB color space.

6. The recording status recognition method according to claim 1, characterized in that: The determining that the color average value satisfies a set condition includes: Convert the color average value into color information in HSV color space; If it is determined that at least the saturation of the color information satisfies the saturation threshold and the hue of the color information satisfies the hue threshold, it is determined that the color average value satisfies the set condition.

7. The recording status recognition method according to any one of claims 1 to 6, characterized in that: The step of obtaining a first recording side image frame of the recording device; The first recording side image frame of the recording device is acquired once every m frames; wherein m is a positive integer greater than or equal to 1.

8. A recording status recognition device, characterized in that: The recording status recognition device comprises: An acquisition module, used to acquire a first recording side image frame of a recording device; A determination module is used to select an area image representing a recording state from the first recording side image frame; it is also used to determine the color average value of the area image; it is also used to determine that the first recording side image frame corresponds to a recording state if it is determined that the color average value meets a set condition; it is also used to feedback that the recording device is in a recording state if the first recording side image frame obtained for n consecutive times corresponds to a recording state; wherein n is a positive integer greater than or equal to 2.

9. An electronic device, characterized in that: The electronic device comprises: processor; a memory for storing instructions executable by the processor; Wherein, the processor is configured to execute the recording status identification method as described in any one of claims 1-7.

10. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the recording status identification method as described in any one of claims 1 to 7.