Intelligent Adjustment System for Image Data Playback Strategy

Abstract

The present invention relates to an intelligent adjustment system for an image data playback strategy, comprising: a spacing detection device, which is arranged between a wireless video recording device and a live broadcast background wall, and is used for detecting the real-time spacing from the center position of the video recording lens of the wireless video recording device to the center position of the live broadcast background wall, and sending out a spacing abnormality signal when the real-time spacing is not equal to a set spacing value; a center judgment device, which is used for visually identifying whether an area to be analyzed is at the center position of a smoothed filtered image when receiving a host detection success command. The intelligent adjustment system for the image data playback strategy of the present invention has a compact logic and stable operation. Since it can visually identify whether the imaging area of a set host is at the central position of a live broadcast picture when it is determined that there is a set host in the live broadcast picture, and give a corresponding solution based on the visual identification result, the playback effect of the live broadcast picture is ensured.

Description

Technical Field

[0001] The present invention relates to the field of playback strategy management, and in particular, to an intelligent adjustment system for image data playback strategies. Background Art

[0002] Simply understood, a radio announcer reads others' words; a host speaks their own words. A live streamer has to do much more work than a radio announcer and is a combination of a radio announcer and a host. For example, an ordinary radio announcer just reads the manuscript, while a live streamer often needs to do a series of work such as planning, editing, interviewing, production, live directing, hosting, etc.

[0003] In live applications, the importance of the live streamer is particularly crucial and can directly affect the data of live commerce. At this time, the image of the live streamer and the position of the live streamer in the live video are very important. For example, if the live streamer is not always in the central position of the live video, it will cause discomfort to the viewers watching the live video, thereby affecting various live data.

[0004] Relevant reference materials in the field of images disclose a "facial recognition preview image adjustment method, intelligent access control system, and intelligent door", with an application publication number of CN115830759A, including: S101: Set a target board at a first distance in front of a first camera and a second camera; S102: Collect a first image of the target board through the first camera; S103: Project a preset pattern on the target board through a projection unit and collect a second image of the target board through the second camera; S104: Determine a first offset of the first image relative to the second image and write the first offset into a storage unit; S105: Start performing a facial recognition operation. The first camera collects a facial image, and based on the first offset and the facial image, display the facial recognition preview image on a first display screen. The second camera collects facial depth information, and the intelligent access control system performs facial recognition according to the facial depth information. The technical solution of this invention can achieve the imaging position matching of the first camera and the second camera, and the facial recognition preview image does not shift. Summary of the Invention

[0005] In order to overcome the technical problems in the prior art, the present invention proposes an intelligent adjustment system for image data playback strategies, which can visually identify whether the imaging area of a set live streamer is in the central position of the live video when it is determined that there is a set live streamer in the live video, and issue a position adjustment request when the imaging area of the set live streamer is not in the central position of the live video to ensure the live visual effect, thereby providing an effective solution for ensuring various live data.

[0006] Therefore, the system includes:

[0007] A spacing detection device is set between a wireless video recording device and a live broadcast background wall, and is used to detect the real-time distance from the center position of the video recording lens of the wireless video recording device to the center position of the live broadcast background wall, and send out a spacing abnormal signal when the real-time distance is not equal to the set spacing value, and send out a spacing standard signal when the real-time distance is equal to the set spacing value;

[0008] A wireless video recording device is set at the front end of the live broadcast background wall and is used to perform wireless video recording actions facing the center position of the live broadcast background wall to obtain on-site video frames;

[0009] A real-time filtering device is connected to the wireless video recording device and is used to perform Gaussian high-pass filtering processing on the received on-site video image to obtain and output a corresponding real-time filtered image;

[0010] A morphological processing device is connected to the real-time filtering device and is used to perform morphological processing of first dilation and then erosion on the received real-time filtered image in sequence to obtain and output a corresponding morphological processing image;

[0011] A smoothing filtering device is connected to the morphological processing device and is used to perform edge-preserving smoothing filtering processing on the received morphological processing image to obtain and output a corresponding smoothing filtered image;

[0012] A feature storage device is connected to the smoothing filtering device and is used to pre-store the set host corresponding set host external form imaging features, and the set host external form imaging features are set host reference external form patterns;

[0013] A front-end analysis device is connected to the feature storage device and is used to receive the set host external form imaging features, and judge the image area matching the set host external form imaging features from the smoothing filtered image as the image area to be analyzed;

[0014] A middle-end analysis device is connected to the front-end analysis device and is used to receive the image area to be analyzed, detect each background pixel point from the smoothing filtered image based on the gray value range corresponding to the background, and calculate the number of background pixel points existing in the image area to be analyzed;

[0015] A back-end analysis device is connected to the middle-end analysis device and is used to receive the number of background pixel points, and issue a host detection failure command when the number of background pixel points exceeds or is equal to the set number limit, otherwise, issue a host detection success command;

[0016] A central judgment device, connected to the backend analysis device, is configured to visually identify whether the image area to be analyzed is at the center position of the smoothed filter image when receiving a successful anchor detection command, issue a position adjustment request when the image area to be analyzed is not at the center position of the smoothed filter image, and issue a position reliability request when the image area to be analyzed is at the center position of the smoothed filter image.

[0017] The image data playback strategy intelligent adjustment system of the present invention has a compact logic and stable operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The embodiments of the present invention will be described below with reference to the accompanying drawings.

[0019] Figure 1 FIG. is a block diagram of the internal structure of the image data playback strategy intelligent adjustment system shown in Embodiment 1 of the present invention.

[0020] Figure 2 FIG. is a block diagram of the internal structure of the image data playback strategy intelligent adjustment system shown in Embodiment 2 of the present invention.

[0021] Figure 3 FIG. is a block diagram of the internal structure of the image data playback strategy intelligent adjustment system shown in Embodiment 3 of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0022] The embodiments of the image data playback strategy intelligent adjustment system of the present invention will be described in detail below with reference to the accompanying drawings.

[0023] Embodiment 1

[0024] Figure 1 FIG. is a block diagram of the internal structure of the image data playback strategy intelligent adjustment system shown in Embodiment 1 of the present invention, and the system includes:

[0025] A spacing detection device, arranged between the wireless video recording device and the live broadcast background wall, is configured to detect the real-time spacing between the center position of the video recording lens of the wireless video recording device and the center position of the live broadcast background wall, issue a spacing abnormality signal when the real-time spacing is not equal to the set spacing value, and issue a spacing standard signal when the real-time spacing is equal to the set spacing value;

[0026] Exemplarily, the spacing detection device, arranged between the wireless video recording device and the live broadcast background wall, is configured to detect the real-time spacing between the center position of the video recording lens of the wireless video recording device and the center position of the live broadcast background wall, issue a spacing abnormality signal when the real-time spacing is not equal to the set spacing value, and issue a spacing standard signal when the real-time spacing is equal to the set spacing value includes: the front surface of the live broadcast background wall has a square contour;

[0027] A wireless video recording device is set at the front end of the live background wall and is used to perform wireless video recording actions facing the central position of the live background wall to obtain on-site video frames;

[0028] A real-time filtering device is connected to the wireless video recording device and is used to perform Gaussian high-pass filtering processing on the received on-site video images to obtain and output corresponding real-time filtered images;

[0029] A morphological processing device is connected to the real-time filtering device and is used to perform morphological processing of first dilating and then eroding on the received real-time filtered images to obtain and output corresponding morphological processing images;

[0030] A smoothing filtering device is connected to the morphological processing device and is used to perform edge-preserving smoothing filtering processing on the received morphological processing images to obtain and output corresponding smoothing filtered images;

[0031] A feature storage device is connected to the smoothing filtering device and is used to pre-store the set host's corresponding set host external form imaging features, and the set host external form imaging features are set host reference external form patterns;

[0032] A front-end analysis device is connected to the feature storage device and is used to receive the set host external form imaging features and judge the image area matching the set host external form imaging features from the smoothing filtered images according to the set host external form imaging features as the image area to be analyzed;

[0033] A middle-end analysis device is connected to the front-end analysis device and is used to receive the image area to be analyzed, detect each background pixel point from the smoothing filtered images based on the gray value range corresponding to the background, and calculate the number of background pixel points existing in the image area to be analyzed;

[0034] A back-end analysis device is connected to the middle-end analysis device and is used to receive the number of background pixel points, and issue a host detection failure command when the number of background pixel points exceeds or is equal to the set number limit, otherwise, issue a host detection success command;

[0035] A center judgment device is connected to the back-end analysis device and is used to visually identify whether the image area to be analyzed is at the central position of the smoothing filtered images when receiving the host detection success command, issue a position adjustment request when the image area to be analyzed is not at the central position of the smoothing filtered images, and issue a position reliability request when the image area to be analyzed is at the central position of the smoothing filtered images;

[0036] Among them, when receiving the successful host detection command, visually identify whether the image area to be analyzed is at the center position of the smoothed filtered image, issue a position adjustment request when the image area to be analyzed is not at the center position of the smoothed filtered image, and issue a position reliability request when the image area to be analyzed is at the center position of the smoothed filtered image, including: determining whether the image area to be analyzed is at the center position of the smoothed filtered image based on the number of pixel points between the pixel point at the centroid position of the image area to be analyzed and the pixel point at the centroid position of the smoothed filtered image;

[0037] Among them, determining whether the image area to be analyzed is at the center position of the smoothed filtered image based on the number of pixel points between the pixel point at the centroid position of the image area to be analyzed and the pixel point at the centroid position of the smoothed filtered image includes: when the number of pixel points between the pixel point at the centroid position of the image area to be analyzed and the pixel point at the centroid position of the smoothed filtered image is less than or equal to the set number threshold, determine that the image area to be analyzed is at the center position of the smoothed filtered image.

[0038] Embodiment 2

[0039] Figure 2 It is a block diagram of the internal structure of the image data playback strategy intelligent adjustment system shown according to Embodiment 2 of the present invention.

[0040] Compared with Figure 1 , Figure 2 the image data playback strategy intelligent adjustment system in

[0041] The pressure detection mechanism includes multiple pressure detection units for respectively detecting the current surface pressure values of the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device;

[0042] Among them, the pressure detection mechanism includes multiple pressure detection units for respectively detecting the current surface pressure values of the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device, including: the multiple pressure detection units respectively adopted for the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device are multiple contact pressure sensors;

[0043] Among them, the pressure detection mechanism includes multiple pressure detection units for respectively detecting the current surface pressure values of the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device further includes: the internal structures of the multiple contact pressure sensors respectively adopted for the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device are the same;

[0044] Among them, the pressure detection mechanism includes multiple pressure detection units for respectively detecting the current surface pressure values of the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device. It further includes: multiple non-contact pressure sensors respectively adopted for the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device having the same upper threshold value and lower threshold value of pressure measurement;

[0045] And among them, the pressure detection mechanism includes multiple pressure detection units for respectively detecting the current surface pressure values of the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device. It further includes: multiple contact pressure sensors respectively adopted for the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device all perform the detection of the corresponding current surface pressure value based on the difference between the air pressure and the internal pressure of the device to be detected.

[0046] Embodiment 3

[0047] Figure 3 It is a block diagram of the internal structure of the image data playback strategy intelligent adjustment system shown according to Embodiment 3 of the present invention.

[0048] Compared with Figure 1 , Figure 3 the image data playback strategy intelligent adjustment system in

[0049] The real-time warning mechanism is respectively connected to multiple contact pressure sensors respectively adopted for the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device, and is used for performing corresponding pressure warning operations based on the pressure measurement results of the multiple contact pressure sensors respectively adopted for the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device;

[0050] Among them, the real-time warning mechanism is respectively connected to multiple contact pressure sensors respectively adopted for the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device, and is used for performing corresponding pressure warning operations based on the pressure measurement results of the multiple contact pressure sensors respectively adopted for the front-end analysis device, the middle-end analysis device, the back-end analysis device, and the central judgment device, including: the real-time warning mechanism includes a timing analysis unit and a warning operation unit;

[0051] And among them, the real-time warning mechanism is respectively connected to a plurality of contact pressure sensors respectively adopted by the front-end analysis device, the middle-end analysis device, the back-end analysis device and the central judgment device, and is used to perform corresponding pressure warning operations based on the pressure measurement results of the plurality of contact pressure sensors respectively adopted by the front-end analysis device, the middle-end analysis device, the back-end analysis device and the central judgment device. It further includes: within the real-time warning mechanism, the timing analysis unit is connected to the warning operation unit.

[0052] In addition, in the intelligent adjustment system for the image data playback strategy, determining whether the image area to be analyzed is at the central position of the smoothed filtered image based on the number of pixel points between the pixel point at the centroid position of the image area to be analyzed and the pixel point at the centroid position of the smoothed filtered image further includes: when the number of pixel points between the pixel point at the centroid position of the image area to be analyzed and the pixel point at the centroid position of the smoothed filtered image is more than the set number threshold, it is determined that the image area to be analyzed is not at the central position of the smoothed filtered image.

[0053] Thus, the present invention has at least the following three important inventive points:

[0054] (1) When it is determined that a set host exists in the live broadcast picture, visually identify whether the imaging area of the set host is at the central position of the live broadcast picture, and when the imaging area of the set host is not at the central position of the live broadcast picture, issue a position adjustment request to ensure the live broadcast visual effect;

[0055] (2) Determine the total number of background pixel points in the image area matching the imaging feature of the set host judged from the smoothed filtered image according to the imaging feature of the set host, and determine whether the set host is successfully detected based on the total number of background pixel points, so as to complete the targeted recognition of the set host;

[0056] (3) Sequentially perform Gaussian high-pass filtering, dilation followed by erosion, and edge-preserving smoothing filtering on the received live video images, so as to improve the visual playback effect of the live video images.

[0057] Therefore, by visually identifying whether the imaging area of the set host is at the central position of the live broadcast picture when it is determined that a set host exists in the live broadcast picture, and giving corresponding solutions based on the visual identification result, the playback effect of the live broadcast picture is ensured.

[0058] Although the matter which is considered to be the preferred embodiment of the present invention has been described, those skilled in the art will recognize that other and further modifications thereof can be made without departing from the spirit of the present invention, and it is intended to claim the rights of all such embodiments which fall within the true scope of the present invention.

Claims

1. An intelligent adjustment system for image data playback strategy, characterized in that: The system comprises: A spacing detection device is arranged between the wireless video recording device and the live broadcast background wall, and is used to detect the real-time spacing from the center position of the video lens of the wireless video recording device to the center position of the live broadcast background wall, and to send out a spacing abnormality signal when the real-time spacing is not equal to the set spacing value, and to send out a spacing standard signal when the real-time spacing is equal to the set spacing value; A wireless video recording device is arranged at the front end of the live broadcast background wall and is used to perform wireless video recording actions facing the center of the live broadcast background wall to obtain live video frames; A real-time filtering device, connected to the wireless video recording device, for performing Gaussian high-pass filtering on the received live video images to obtain and output corresponding real-time filtered images; A morphological processing device, connected to the real-time filtering device, for sequentially performing a morphological processing of first dilation and then erosion on the received real-time filtered image to obtain and output a corresponding morphologically processed image; a smoothing filter device connected to the morphological processing device, and configured to perform edge-preserving smoothing filter processing on the received morphologically processed image to obtain and output a corresponding smoothing filter image; A feature storage device, connected to the smoothing filter device, for pre-storing a set anchor appearance imaging feature corresponding to the set anchor, wherein the set anchor appearance imaging feature is a set anchor reference appearance pattern; A front-end analysis device connected to the feature storage device, configured to receive the set host appearance imaging feature, and determine an image region matching the set host appearance imaging feature from the smoothing filter image according to the set host appearance imaging feature as the image region to be analyzed; A mid-end analysis device, connected to the front-end analysis device, for receiving the image area to be analyzed, detecting each background pixel from the smoothing filter image based on the grayscale value range corresponding to the background, and calculating the number of background pixels existing in the image area to be analyzed; A back-end analysis device is connected to the mid-end analysis device, and is used to receive the number of background pixels, and when the number of background pixels exceeds or equals to a set number limit, issue a host detection failure command, otherwise, issue a host detection success command; A central judgment device connected to the back-end analysis device is used to visually identify whether the image area to be analyzed is located at the center of the smoothing filter image when receiving the anchor detection success command, and to issue a position adjustment request when the image area to be analyzed is not located at the center of the smoothing filter image, and to issue a position reliability request when the image area to be analyzed is located at the center of the smoothing filter image; Upon receiving the anchor detection success command, visually identifying whether the image area to be analyzed is located at the center of the smoothing filter image, and issuing a position adjustment request when the image area to be analyzed is not located at the center of the smoothing filter image, and issuing a position reliability request when the image area to be analyzed is located at the center of the smoothing filter image, including: determining whether the image area to be analyzed is located at the center of the smoothing filter image based on the number of pixels spaced between the pixel points at the centroid position of the image area to be analyzed and the pixel points at the centroid position of the smoothing filter image; Wherein, determining whether the image area to be analyzed is located at the center of the smoothing filtered image based on the number of pixels spaced between the pixel points at the centroid position of the image area to be analyzed and the pixel points at the centroid position of the smoothing filtered image includes: when the number of pixels spaced between the pixel points at the centroid position of the image area to be analyzed and the pixel points at the centroid position of the smoothing filtered image is less than or equal to a set number threshold, determining that the image area to be analyzed is located at the center of the smoothing filtered image; when the number of pixels spaced between the pixel points at the centroid position of the image area to be analyzed and the pixel points at the centroid position of the smoothing filtered image is greater than the set number threshold, determining that the image area to be analyzed is not located at the center of the smoothing filtered image.

2. The image data playback strategy intelligent adjustment system according to claim 1, characterized in that: The system further comprises: The pressure detection mechanism includes a plurality of pressure detection units, which are used to respectively detect the current surface pressure values ​​of the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device; Among them, the pressure detection mechanism includes multiple pressure detection units, which are used to respectively detect the current surface pressure values ​​of the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device, including: the multiple pressure detection units respectively used for the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device are multiple contact pressure sensors.

3. The image data playback strategy intelligent adjustment system according to claim 2, characterized in that: The pressure detection mechanism includes multiple pressure detection units, which are used to respectively detect the current surface pressure values ​​of the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device. It also includes: the internal structures of multiple contact pressure sensors respectively used for the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device are the same.

4. The system for intelligently adjusting the image data playback strategy according to claim 2, characterized in that: The pressure detection mechanism includes multiple pressure detection units, which are used to respectively detect the current surface pressure values ​​of the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device. It also includes: multiple non-contact pressure sensors respectively used for the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device have the same pressure measurement upper limit threshold and pressure measurement lower limit threshold.

5. The image data playback strategy intelligent adjustment system according to claim 4, characterized in that: The pressure detection mechanism includes multiple pressure detection units, which are used to respectively detect the current surface pressure values ​​of the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device. It also includes: multiple contact pressure sensors respectively used for the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device all perform corresponding current surface pressure value detection based on the difference between the air pressure and the internal pressure of the detected device.

6. The image data playback strategy intelligent adjustment system according to any one of claims 2 to 5, characterized in that: The system further comprises: The real-time warning mechanism is respectively connected to multiple contact pressure sensors respectively used by the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device, and is used to perform corresponding pressure warning operations based on the pressure measurement results of the multiple contact pressure sensors respectively used by the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device.

7. The image data playback strategy intelligent adjustment system according to claim 6, characterized in that: The real-time warning mechanism is respectively connected to multiple contact pressure sensors respectively used by the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device, and is used to perform corresponding pressure warning operations based on the pressure measurement results of the multiple contact pressure sensors respectively used by the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device, including: the real-time warning mechanism includes a timing analysis unit and a warning operation unit.

8. The image data playback strategy intelligent adjustment system according to claim 7, characterized in that: The real-time warning mechanism is respectively connected to multiple contact pressure sensors respectively used by the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device, and is used to perform corresponding pressure warning operations based on the pressure measurement results of the multiple contact pressure sensors respectively used by the front-end analysis device, the mid-end analysis device, the back-end analysis device and the central judgment device. It also includes: within the real-time warning mechanism, the timing analysis unit is connected to the warning operation unit.

Images