Video transmission control method based on scene change and related device
Patent Information
- Application Number
- CN202211242633.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-10-11
- Publication Date
- 2026-09-18
- Estimated Expiration
- 2042-10-11
AI Technical Summary
本申请通过持续获取目标区域的场景信息,将所述场景信息以第一分辨率的形式传输至目标显示设备;获取当前监控模式,根据所述当前监控模式匹配对应的触发行为集合;在所述目标区域的场景信息满足所述触发行为集合对应的触发条件时,将当前场景信息以第二分辨率的形式传输至所述目标显示设备;通过将场景信息以第一分辨率的形式传输至目标显示设备;并在当前场景信息满足触发行为对应的触发条件时将当前场景信息以第二分辨率的形式传输至目标显示设备,在满足触发条件时,以不同的分辨率显示同一目标区域的场景信息,实现了减少资源消耗的技术效果。
Smart Images

Figure CN115695725B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of video transmission, and in particular to a video transmission control method and related apparatus based on scene changes. Background Technology
[0002] With the rapid development of technology, electronic devices have become an indispensable part of people's lives. Some electronic devices are used for monitoring, capturing video information through cameras and transmitting it to corresponding display devices. However, currently, video transmission is often based on the camera's resolution. While camera resolution continues to improve, video transmission quality is also gradually increasing. Because it's real-time monitoring, it inevitably consumes network bandwidth resources for extended periods.
[0003] Therefore, how to reduce resource consumption during the transmission of high-definition video has become a pressing technical problem. Summary of the Invention
[0004] In order to reduce resource consumption during the transmission of high-definition video, this application provides a video transmission control method and related apparatus based on scene changes.
[0005] Firstly, the video transmission control method based on scene changes provided in this application adopts the following technical solution: A video transmission control method based on scene changes includes: Continuously acquire scene information of the target area and transmit the scene information to the target display device in the form of a first resolution; Obtain the current monitoring mode, and match the corresponding set of trigger behaviors based on the current monitoring mode; When the scene information in the target area meets the triggering conditions corresponding to the set of triggering behaviors, the current scene information is transmitted to the target display device in the form of a second resolution.
[0006] Optionally, the step of continuously acquiring scene information of the target area and transmitting the scene information to the target display device in the form of a first resolution includes: Continuously acquire scene information of the target area, and generate a video stream to be sent based on the scene information; Obtain a preset first resolution, and adjust the video stream to be sent according to the first resolution; After the sending conditions are met, the video stream to be sent is sent to the target display device.
[0007] Optionally, the step of obtaining the current monitoring mode and matching the corresponding set of trigger behaviors based on the current monitoring mode includes: Obtain the current monitoring mode and determine if a preset mode command exists; If not, generate the current monitoring status based on the current monitoring mode and the scene information; Match the set of triggered behaviors based on the current monitoring status; If so, the current monitoring mode is updated according to the preset mode instruction, and the corresponding set of trigger behaviors is matched according to the current monitoring mode.
[0008] Optionally, the step of generating the current monitoring status based on the current monitoring mode and the scene information includes: The surrounding environment information is determined based on the scene information, and the surrounding environment information includes: objective information, task information, and character behavior information; Based on the surrounding environment information, determine whether the current scene is static or dynamic; The current monitoring status is generated based on the judgment result.
[0009] Optionally, the step of transmitting the current scene information to the target display device in the form of a second resolution when the scene information in the target area satisfies the triggering condition corresponding to the triggering behavior set includes: All contour information in the target scene information is obtained through contour analysis technology; Based on the set of all contour information and the set of trigger behaviors, determine whether the preset conditions are met. If so, the second resolution is obtained, and a video adjustment instruction is generated based on the second resolution to transmit the current scene information to the target display device.
[0010] Optionally, the step of determining whether the preset conditions are met based on all the contour information and the set of triggering behaviors includes: The contour information of the target region is classified based on all the contour information. Obtain preset weight information and generate a contour weight set based on the classification results; Based on the set of triggering behaviors and the set of contour weights, it is determined whether the current condition is met.
[0011] Optionally, the step of determining whether the preset conditions are met based on the set of triggering behaviors combined with the set of contour weights includes: When there is a contour change in all the contour information, the set of triggering behaviors is matched to determine whether the contour change is valid. If so, then match the corresponding weight value in the contour weight set according to the effective contour variation; Based on the matching results and preset weight conditions, determine whether the current conditions are met.
[0012] Secondly, this application provides a path planning device based on a geographic information system, characterized in that the path planning device based on a geographic information system includes: The first resolution module is used to continuously acquire scene information of the target area and transmit the scene information to the target display device in the form of the first resolution. The behavior triggering module is used to obtain the current monitoring mode and match the corresponding set of triggering behaviors according to the current monitoring mode; The second resolution module is used to transmit the current scene information to the target display device in the form of a second resolution when the scene information in the target area meets the triggering conditions corresponding to the triggering behavior set.
[0013] Thirdly, this application provides a computer device, the device comprising: a memory and a processor, wherein the processor, when executing computer instructions stored in the memory, performs the method as described in any one of the above.
[0014] Fourthly, this application provides a computer-readable storage medium including instructions that, when executed on a computer, cause the computer to perform the method described above.
[0015] In summary, this application includes the following beneficial technical effects: This application continuously acquires scene information of a target area and transmits the scene information to a target display device in the form of a first resolution; acquires the current monitoring mode and matches a corresponding set of trigger behaviors according to the current monitoring mode; when the scene information of the target area meets the trigger conditions corresponding to the set of trigger behaviors, the current scene information is transmitted to the target display device in the form of a second resolution; by transmitting the scene information to the target display device in the form of a first resolution and transmitting the current scene information to the target display device in the form of a second resolution when the current scene information meets the trigger conditions, the same target area scene information is displayed at different resolutions when the trigger conditions are met, thus achieving the technical effect of reducing resource consumption. Attached Figure Description
[0016] Figure 1 This is a schematic diagram of the computer device structure of the hardware operating environment involved in the embodiments of the present invention; Figure 2 This is a flowchart illustrating the first embodiment of the video transmission control method based on scene changes according to the present invention; Figure 3 This is a flowchart illustrating the second embodiment of the video transmission control method based on scene changes according to the present invention; Figure 4 This is a structural block diagram of the first embodiment of the video transmission control device based on scene change according to the present invention. Detailed Implementation
[0017] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.
[0018] Reference Figure 1 , Figure 1 This is a schematic diagram of the computer device structure of the hardware operating environment involved in the embodiments of the present invention.
[0019] like Figure 1 As shown, the computer device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen or an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wireless-Fidelity (Wi-Fi) interface). The memory 1005 may be high-speed random access memory (RAM) or stable non-volatile memory (NVM), such as a disk drive. The memory 1005 may also optionally be a storage device independent of the aforementioned processor 1001.
[0020] Those skilled in the art will understand that Figure 1 The structure shown does not constitute a limitation on the computer device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.
[0021] like Figure 1 As shown, the memory 1005, which serves as a storage medium, may include an operating system, a network communication module, a user interface module, and a video transmission control program based on scene changes.
[0022] exist Figure 1In the computer device shown, the network interface 1004 is mainly used for data communication with the network server; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the computer device of the present invention can be set in the computer device, and the computer device calls the scene-change-based video transmission control program stored in the memory 1005 through the processor 1001 and executes the scene-change-based video transmission control method provided in the embodiment of the present invention.
[0023] This invention provides a video transmission control method based on scene changes, referring to... Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the video transmission control method based on scene changes according to the present invention.
[0024] In this embodiment, the video transmission control method based on scene changes includes the following steps: Step S10: Continuously acquire scene information of the target area and transmit the scene information to the target display device in the form of a first resolution.
[0025] Understandably, resolution determines the level of detail in a bitmap image. Generally, the higher the image resolution, the more pixels it contains, resulting in a clearer image and better print quality. However, it also increases the file size. Units describing resolution include dpi (dots per inch), lpi (lines per inch), ppi (pixels per inch), and PPD (PPPixels Per Degree). Only lpi describes optical resolution. While dpi and ppi are also units within the resolution category, their meanings differ from lpi. Furthermore, lpi and dpi cannot be directly converted; they can only be estimated empirically. Additionally, ppi and dpi are often used interchangeably. However, their application areas differ. Technically speaking, "pixels" exist only in the field of computer displays, while "dots" appear only in the field of printing.
[0026] It should be noted that in this embodiment, scene information of the target area is collected by a device with video capture function. The specific device can be a mobile phone, computer or other device with video capture function, and this embodiment does not limit it.
[0027] It is understood that the scene information is the scene information obtained by analyzing the image information of the target area.
[0028] It should be noted that in this embodiment, the first resolution is actually a lower resolution than that of the current acquisition device. Transmitting at the first resolution will save more network resources than transmitting at the current resolution of the acquisition device.
[0029] In practice, continuously acquiring scene information of the target area and transmitting the scene information to the target display device in the form of the first resolution involves acquiring scene information of the target area through a preset acquisition device, and analyzing the acquired information to determine the scene information of the target area.
[0030] Furthermore, in order to reduce errors when sending video at the first resolution, the step of continuously acquiring scene information of the target area and transmitting the scene information to the target display device in the form of the first resolution includes: continuously acquiring scene information of the target area and generating a video stream to be sent based on the scene information; acquiring a preset first resolution and adjusting the video stream to be sent based on the first resolution; and sending the video stream to be sent to the target display device after the sending conditions are met.
[0031] It should be noted that, in order to save resources, the size of the video stream generated based on the first resolution will be judged. If the size exceeds the preset condition, it will be determined that the sending condition is not met. The specific sending condition is set according to the actual use case. This embodiment does not limit the specific data of this step.
[0032] Step S20: Obtain the current monitoring mode and match the corresponding set of trigger behaviors based on the current monitoring mode.
[0033] Furthermore, in order to accurately match the set of triggered behaviors, the step of obtaining the current monitoring mode and matching the corresponding set of triggered behaviors according to the current monitoring mode includes: obtaining the current monitoring mode and determining whether there is a preset mode instruction; if not, generating the current monitoring state based on the current monitoring mode and the scene information; matching the set of triggered behaviors according to the current monitoring state; if yes, updating the current monitoring mode according to the preset mode instruction and matching the corresponding set of triggered behaviors according to the current monitoring mode.
[0034] It should be noted that in specific implementation, if there are preset instructions, that is, in the current situation, it is not necessary to make an automatic judgment, but to directly use the preset mode instructions entered manually to carry out the next step of the work.
[0035] It is understood that the set of triggering behaviors, i.e., the set of specific actions, is determined by identifying the action information of the target area to see if it matches the set of triggering behaviors. For example, if movement is considered as one of the actions in the set of triggering behaviors, then detecting movement in the target area will be considered as recognizing an action in the set of triggering behaviors.
[0036] In specific implementation, the step of generating the current monitoring status based on the current monitoring mode and the scene information includes: determining the surrounding environment information based on the scene information, wherein the surrounding environment information includes: objective information, task information and human behavior information; determining whether the current scene is a static scene or a dynamic scene based on the surrounding environment information; and generating the current monitoring status based on the determination result.
[0037] Step S30: When the scene information in the target area meets the triggering conditions corresponding to the triggering behavior set, the current scene information is transmitted to the target display device in the form of a second resolution.
[0038] It should be noted that when the scene information in the target area meets the triggering conditions corresponding to the triggering behavior set, it is determined that the conditions for transmission at the second resolution are met, which in this embodiment means improving the clarity of the transmitted video. The second resolution is higher than the first resolution, and can at most meet the resolution of the current target area information acquisition device.
[0039] refer to Figure 3 The figure is a flowchart illustrating the second embodiment of the video transmission control method based on scene change according to the present invention.
[0040] Based on the first embodiment described above, step S30 of the video transmission control method based on scene change in this embodiment further includes: Step S301: Obtain all contour information in the target scene information through contour analysis technology.
[0041] It's important to note that object recognition is a fundamental research area in computer vision. Its task is to identify objects in an image and report their position and orientation within the scene represented by the image. Currently, object recognition methods can be categorized into two types: model-based or context-based methods, and 2D or 3D object recognition methods. Regarding the evaluation criteria for object recognition methods, Grimson summarized four criteria that are widely accepted by researchers: robustness, correctness, efficiency, and scope.
[0042] It is understandable that the contour recognition technology used in this implementation belongs to image feature extraction technology. Image feature extraction is the process of extracting the fundamental attributes that distinguish one image from another, in order to differentiate between them. Features such as grayscale, brightness, texture, and shape correspond to the visual appearance of an image; while others lack natural correspondence, such as color histograms, grayscale histograms, and spatial spectrograms. Object recognition based on image features essentially determines the category of an object in the image based on the extracted features. Shape, texture, and color are the most commonly used visual features and are the main features currently employed in image-based object recognition technologies.
[0043] Step S302: Determine whether the preset conditions are met based on the set of all contour information and the set of triggered behaviors.
[0044] Furthermore, to improve the accuracy of the determination, the step of determining whether the current condition is met based on all the contour information and the set of triggering behaviors includes: classifying the contour information of the target region based on all the contour information; obtaining preset weight information and generating a contour weight set based on the classification results; and determining whether the current condition is met based on the set of triggering behaviors and the set of contour weights.
[0045] It should be noted that the outline weight set refers to the classification of different people and objects based on specific usage scenarios, followed by weighting. Key people or items are assigned higher weights, while irrelevant items are assigned lower weights. When a person with a higher weight is detected performing an action corresponding to the trigger behavior set, it is compared with a preset weight in the preset conditions. If the weight exceeds the preset weight, the execution condition for switching to the second resolution is met. When irrelevant items perform actions corresponding to the trigger behavior set, because they are assigned lower weights, the execution condition for switching to the second resolution is not met, thus achieving the energy-saving effect of this embodiment. The specific weight settings are determined based on actual usage scenarios. For example, during exam proctoring, student actions are set as actions with higher weights in the trigger behavior set, while the actions of classroom fans are set as actions with lower weights. Unless an accident occurs, the operation of the fan will not satisfy the effect of switching to the second resolution for video transmission.
[0046] Step S303: If yes, then obtain the second resolution and generate video adjustment instructions based on the second resolution to transmit the current scene information to the target display device.
[0047] In practice, a second resolution is obtained, which is higher than the first resolution but not exceeding the resolution of the device actually acquiring the video information. By improving the clarity of video transmission, the richness of information in the target area can be increased as needed in actual use.
[0048] This embodiment uses contour analysis technology to obtain all contour information in the target scene information; it determines whether the current condition is met based on the set of all contour information and the set of triggering behaviors; if so, it obtains the second resolution and generates a video adjustment instruction based on the second resolution to transmit the current scene information to the target display device; by recognizing the contour information and making a judgment based on the set of triggering behaviors, when the judgment condition is met, the video of the current scene information is generated at the second resolution and sent to the display device, achieving the technical effect of switching the display resolution of the monitoring video according to different situations.
[0049] Furthermore, embodiments of the present invention also propose a computer-readable storage medium storing a program for video transmission control based on scene changes. When the program for video transmission control based on scene changes is executed by a processor, it implements the steps of the video transmission control method based on scene changes as described above.
[0050] Reference Figure 4 , Figure 4 This is a structural block diagram of the first embodiment of the video transmission control device based on scene change according to the present invention.
[0051] like Figure 4 As shown, the video transmission control device based on scene change proposed in this embodiment of the invention includes: The first resolution module 10 is used to continuously acquire scene information of the target area and transmit the scene information to the target display device in the form of the first resolution. Behavior triggering module 20 is used to obtain the current monitoring mode and match the corresponding set of triggering behaviors according to the current monitoring mode; The second resolution module 30 is used to transmit the current scene information to the target display device in the form of a second resolution when the scene information in the target area meets the triggering conditions corresponding to the triggering behavior set.
[0052] It should be understood that the above are merely illustrative examples and do not constitute any limitation on the technical solutions of the present invention. In specific applications, those skilled in the art can make settings as needed, and the present invention does not impose any restrictions on this.
[0053] This embodiment continuously acquires scene information of the target area and transmits the scene information to the target display device in the form of a first resolution; it acquires the current monitoring mode and matches the corresponding set of trigger behaviors according to the current monitoring mode; when the scene information of the target area meets the trigger conditions corresponding to the set of trigger behaviors, the current scene information is transmitted to the target display device in the form of a second resolution; by transmitting the scene information to the target display device in the form of a first resolution and transmitting the current scene information to the target display device in the form of a second resolution when the current scene information meets the trigger conditions, the scene information of the same target area is displayed at different resolutions when the trigger conditions are met, thus achieving the technical effect of reducing resource consumption.
[0054] In one embodiment, the first resolution module 10 is further configured to continuously acquire scene information of the target area and generate a video stream to be sent based on the scene information; acquire a preset first resolution and adjust the video stream to be sent based on the first resolution; and send the video stream to be sent to the target display device after the sending conditions are met.
[0055] In one embodiment, the behavior triggering module 20 is further configured to obtain the current monitoring mode and determine whether there is a preset mode instruction; if not, generate the current monitoring state based on the current monitoring mode and the scene information; match a set of triggering behaviors based on the current monitoring state; if yes, update the current monitoring mode based on the preset mode instruction and match the corresponding set of triggering behaviors based on the current monitoring mode.
[0056] In one embodiment, the behavior triggering module 20 is further configured to determine surrounding environment information based on the scene information, the surrounding environment information including: objective information, task information and human behavior information; determine whether the current scene is static or dynamic based on the surrounding environment information; and generate the current monitoring status based on the determination result.
[0057] In one embodiment, the second resolution module 30 is further configured to acquire all contour information in the target scene information through contour analysis technology; determine whether the current condition is met based on the set of all contour information and the set of triggering behaviors; if so, acquire the second resolution and generate a video adjustment instruction based on the second resolution to transmit the current scene information to the target display device.
[0058] In one embodiment, the second resolution module 30 is further configured to classify the contour information of the target region according to all the contour information; obtain preset weight information and generate a contour weight set in combination with the classification results; and determine whether the current preset conditions are met based on the trigger behavior set and the contour weight set.
[0059] In one embodiment, the second resolution module 30 is further configured to, when there is a contour change in all the contour information, match according to the set of triggering behaviors to determine whether the contour change is valid; if so, match the corresponding weight value in the contour weight set according to the valid contour change; and determine whether the current preset condition is met based on the matching result and the preset weight condition.
[0060] It should be noted that the workflow described above is merely illustrative and does not limit the scope of protection of this invention. In practical applications, those skilled in the art can select some or all of the workflow to achieve the purpose of this embodiment according to actual needs, and no restrictions are imposed here.
[0061] In addition, for technical details not described in detail in this embodiment, please refer to the video transmission control method based on scene change provided in any embodiment of the present invention, which will not be repeated here.
[0062] Furthermore, it should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.
[0063] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0064] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as read-only memory (ROM) / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of the present invention.
[0065] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.
Claims
1. A scene change based video transmission control method, characterized by, include: Continuously acquire scene information of the target area and transmit the scene information to the target display device in the form of a first resolution; Obtain the current monitoring mode, and match the corresponding set of trigger behaviors based on the current monitoring mode; All contour information in the scene information of the target region is obtained through contour analysis technology, and the contour information of the target region is classified according to all the contour information. Obtain preset weight information and generate a contour weight set by combining the classification results. In this set, higher weights are assigned to key people or items, and lower weights are assigned to other items that are irrelevant to the classification. When there is a contour change in all the contour information, the set of triggering behaviors is matched to determine whether the contour change is valid. If so, then match the corresponding weight value in the contour weight set according to the effective contour variation; The system determines whether the preset conditions are met based on the matching results and preset weight conditions. Specifically, the preset conditions are met when a character with a higher weight is detected to perform an action corresponding to the set of triggered actions, and the action exceeds the preset weight in the preset conditions. When an unrelated item performs an action corresponding to the set of triggered actions, the preset conditions are not met because a lower weight is set. When the preset conditions are met, a second resolution is obtained, and a video adjustment instruction is generated based on the second resolution to transmit the current scene information to the target display device.
2. The scene change based video transmission control method of claim 1, wherein, The step of continuously acquiring scene information of the target area and transmitting the scene information to the target display device in the form of a first resolution includes: Continuously acquire scene information of the target area, and generate a video stream to be sent based on the scene information; Obtain a preset first resolution, and adjust the video stream to be sent according to the first resolution; After the sending conditions are met, the video stream to be sent is sent to the target display device. 3.The scene change based video transmission control method according to claim 1, wherein, The step of obtaining the current monitoring mode and matching the corresponding set of trigger behaviors based on the current monitoring mode includes: Obtain the current monitoring mode and determine if a preset mode command exists; If not, generate the current monitoring status based on the current monitoring mode and the scene information; Match the set of triggered behaviors based on the current monitoring status; If so, the current monitoring mode is updated according to the preset mode instruction, and the corresponding set of trigger behaviors is matched according to the current monitoring mode.
4. The video transmission control method based on scene change according to claim 3, characterized in that, The step of generating the current monitoring status based on the current monitoring mode and the scene information includes: The surrounding environment information is determined based on the scene information, and the surrounding environment information includes: objective information, task information, and character behavior information; Based on the surrounding environment information, determine whether the current scene is static or dynamic; The current monitoring status is generated based on the judgment result.
5. A video transmission control device based on scene change, applied to the video transmission control method based on scene change as described in any one of claims 1-4, characterized in that, The scene-change-based video transmission control device includes: The first resolution module is used to continuously acquire scene information of the target area and transmit the scene information to the target display device in the form of the first resolution. The behavior triggering module is used to obtain the current monitoring mode and match the corresponding set of triggering behaviors according to the current monitoring mode; The second resolution module is used to transmit the current scene information to the target display device in the form of a second resolution when the scene information in the target area meets the triggering conditions corresponding to the triggering behavior set.
6. A computer device, characterized in that, The device includes a memory and a processor, wherein the processor, when executing computer instructions stored in the memory, performs the method as described in any one of claims 1 to 4.
7. A computer-readable storage medium, characterized in that, Includes instructions that, when executed on a computer, cause the computer to perform the method as described in any one of claims 1 to 4.
Citation Information
Patent Citations
Network video monitoring system based on resolution ratio grading transmission
CN101938638A
Method and system for automatic positioning and identifying target based on high definition video images
CN102768731A
Method and device for transmitting surveillance video, and equipment
CN108702492A