Monitoring display screen switching system, method, storage medium and electronic device
By using multiple cameras and wind sensors in the monitoring system of the offshore photovoltaic construction site, the event monitoring level of video frame images is automatically analyzed, and the problem of human operation switching of display content in the existing technology is solved, and the automatic monitoring display screen switching is realized, which improves the monitoring efficiency and intelligence of the construction site.
Patent Information
- Application Number
- CN202411857903.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-17
- Publication Date
- 2025-04-01
- Estimated Expiration
- 2044-12-17
AI Technical Summary
The display interface configuration of the existing construction site monitoring system is fixed, and the display content needs to be switched manually, resulting in the possible missed monitoring focus and affecting the construction progress.
A monitoring display screen switching system is designed for offshore photovoltaic construction sites. Through multiple cameras, wind sensors and data processing equipment, video frame images are automatically analyzed, event monitoring levels are determined, and display modes and contents are automatically switched according to the levels.
Automatic monitoring display screen switching is realized, which avoids delays in human operations, can timely focus on problems at the construction site, and improves the intelligence and efficiency of monitoring.
Smart Images

Figure CN119316570B_ABST
Abstract
Description
Background Art
[0002] The construction process of offshore photovoltaic projects is numerous and complex, and each process is crucial. Implementing on-site monitoring as comprehensively as possible is of great significance to construction progress, problem discovery, production safety, and work backtracking.
[0003] At present, the display interface configuration of the monitoring system at the construction site is fixed, and manual operation is often required to switch the display content. If the operator does not operate in time, the monitoring focus may be missed, which may seriously affect the normal project construction. In other words, this manual operation method is not conducive to timely focusing on the problems at the construction site.
[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention
[0005] The purpose of the present disclosure is to provide a monitoring display screen switching system for an offshore photovoltaic construction site, a monitoring display screen switching method for an offshore photovoltaic construction site, a computer-readable storage medium and an electronic device, thereby at least to a certain extent overcoming the situation in which the construction site problems cannot be focused on in a timely manner during the monitoring process.
[0006] According to a first aspect of the present disclosure, a monitoring display screen switching system for an offshore photovoltaic construction site is provided, comprising: a plurality of cameras, arranged at different positions of the offshore photovoltaic construction site, the plurality of cameras including an offshore camera arranged at the offshore construction site; a wind sensor for acquiring offshore wind data; a data processing device for acquiring video frame images acquired by each camera, performing event analysis on the video frame images, determining an event monitoring level corresponding to the video frame images acquired by each camera in combination with a result of the event analysis, determining one or more video frame images acquired by a target camera as target display content according to the event monitoring level corresponding to the video frame images acquired by each camera, determining an event monitoring level distribution of the video frame images included in the target display content, and classifying the event monitoring levels according to the event monitoring levels. The target display mode is determined and the identification of the target camera is obtained; wherein the event monitoring level distribution includes the event monitoring level involved in the target display content and the number of video frame images under each event monitoring level; in the target display mode, at least the target display content is displayed; the display device is used to obtain the target display mode and the identification of the target camera sent by the data processing device, obtain the video frame image collected by the target camera in real time according to the identification of the target camera, switch the current display mode to the target display mode, and display the video frame image collected by the target camera in real time in the interface style of the target display mode; wherein the difference in interface style of different display modes includes one or more of different arrangement of the screens corresponding to the video frame image, different number of screens, and different display size of the screen. wherein the data processing device determines the event monitoring level corresponding to the video frame image collected by the offshore camera, including: the data processing device obtains the offshore wind data collected by the wind sensor, and converts the offshore wind data into a coefficient to obtain the target coefficient; obtains the video frame image collected by the offshore camera and performs event analysis to obtain the event analysis score; multiplies the target coefficient by the event analysis score, and converts the product result into the event monitoring level corresponding to the video frame image collected by the offshore camera.
[0007] Optionally, the data processing device performs event analysis on the video frame image, including: obtaining a historical image that is captured and pre-calibrated by a camera corresponding to the video frame image; wherein the event monitoring level of the historical image is any one of all event monitoring levels; comparing the video frame image with the historical image to determine the difference in image content; using a trained convolutional neural network and determining an event analysis score based on the image content difference, and using the event analysis score as the result of event analysis on the video frame image.
[0008] Optionally, the data processing device determines the video frame images captured by one or more target cameras as target display content based on the event monitoring level corresponding to the video frame images captured by each camera, including: comparing the event monitoring level corresponding to the video frame images captured by each camera with the level threshold; determining a camera whose event monitoring level is greater than or equal to the level threshold as the target camera, and using the video frame images captured by the target camera as the target display content.
[0009] Optionally, the event monitoring level distribution includes the event monitoring levels involved in the target display content and the number of video frame images at each event monitoring level; wherein, determining the target display mode based on the event monitoring level distribution includes: pre-constructing a mapping relationship between the event monitoring level and the number of video frame images at each event monitoring level and the display mode; and determining the target display mode using the mapping relationship and the event monitoring level distribution.
[0010] Optionally, the target display content includes a first video frame image captured by a first camera and a second video frame image captured by a second camera; if the event monitoring level corresponding to the first video frame image is higher than the event monitoring level corresponding to the second video frame image, then in the target display mode, the display size of the screen corresponding to the first video frame image is larger than the display size of the screen corresponding to the second video frame image.
[0011] Optionally, the display device is also used to control the locking of one or more video frame images in response to a locking operation on one or more video frame images on the interface while displaying the video frame images captured in real time by the target camera in the interface style of the target display mode; wherein the interface style of the screen corresponding to the locked video frame image remains unchanged.
[0012] According to a second aspect of the present disclosure, a monitoring display screen switching method for an offshore photovoltaic construction site is provided, comprising: obtaining video frame images acquired by multiple cameras, each camera being configured at a different position of the offshore photovoltaic construction site, and the multiple cameras including an offshore camera configured at the offshore construction site; performing event analysis on the video frame images, and determining an event monitoring level corresponding to the video frame images acquired by each camera in combination with the result of the event analysis; determining the video frame images acquired by one or more target cameras as target display content according to the event monitoring level corresponding to the video frame images acquired by each camera; determining the event monitoring level distribution of the video frame images included in the target display content, and determining the target display mode according to the event monitoring level distribution; wherein the event monitoring The control level distribution includes the event monitoring level involved in the target display content and the number of video frame images under each event monitoring level; in the target display mode, at least the target display content is displayed; the differences in the interface styles of different display modes include one or more of different arrangements of the corresponding screens of the video frame images, different numbers of screens, and different display sizes of the screens; obtain the identification of the target camera; send the target display mode and the identification of the target camera to the display device; wherein the identification of the target camera indicates that the display device obtains the video frame images collected by the target camera in real time, and the target display mode indicates that the display device switches the current display mode to the target display mode, and displays the video frame images collected by the target camera in real time in the interface style of the target display mode. Wherein, determining the event monitoring level corresponding to the video frame images collected by the offshore camera includes: obtaining the offshore wind data collected by the wind sensor, and converting the offshore wind data into coefficients to obtain the target coefficients; obtaining the video frame images collected by the offshore camera and performing event analysis to obtain the event analysis score; multiplying the target coefficient by the event analysis score, and converting the product result into the event monitoring level corresponding to the video frame images collected by the offshore camera.
[0013] According to a third aspect of the present disclosure, a monitoring display screen switching device for an offshore photovoltaic construction site is provided, comprising: an image acquisition module, for acquiring video frame images acquired by multiple cameras, each camera being arranged at a different position of the offshore photovoltaic construction site, and the multiple cameras including an offshore camera arranged at the offshore construction site; an image analysis module, for performing event analysis on the video frame images, and determining an event monitoring level corresponding to the video frame images acquired by each camera in combination with the result of the event analysis; a display content determination module, for determining the video frame images acquired by one or more target cameras as target display content according to the event monitoring level corresponding to the video frame images acquired by each camera; a display mode determination module, for determining the event monitoring level distribution of the video frame images contained in the target display content, and determining the target according to the event monitoring level distribution Display mode; wherein the event monitoring level distribution includes the event monitoring level involved in the target display content and the number of video frame images under each event monitoring level; in the target display mode, at least the target display content is displayed; the differences in the interface styles of different display modes include one or more of different arrangement methods of the corresponding screens of the video frame images, different numbers of screens, and different display sizes of the screens; an identification acquisition module is used to obtain the identification of the target camera; an information sending module is used to send the target display mode and the identification of the target camera to the display device; wherein the identification of the target camera indicates that the display device obtains the video frame images collected by the target camera in real time, and the target display mode indicates that the display device switches the current display mode to the target display mode, and displays the video frame images collected by the target camera in real time in the interface style of the target display mode. Wherein, determining the event monitoring level corresponding to the video frame images collected by the offshore camera includes: obtaining the offshore wind data collected by the wind sensor, and converting the offshore wind data into coefficients to obtain the target coefficients; obtaining the video frame images collected by the offshore camera and performing event analysis to obtain the event analysis score; multiplying the target coefficient by the event analysis score, and converting the product result into the event monitoring level corresponding to the video frame images collected by the offshore camera.
[0014] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned monitoring display screen switching method for an offshore photovoltaic construction site is implemented.
[0015] According to a fifth aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; the processor is configured to implement the above-mentioned monitoring display screen switching method for an offshore photovoltaic construction site by executing the executable instructions.
[0016] In the technical solutions provided in some embodiments of the present disclosure, on the one hand, the system of the solution of the present disclosure can automatically switch the display content and display mode of the monitoring interface according to the current construction site conditions, avoiding manual observation, analysis and switching operations, so that the monitoring can focus on the problems on the construction site in a timely manner, and the intelligence of the monitoring is greatly improved; on the other hand, the solution of the present disclosure is based on the visual technology of image recognition and analysis, with high analysis efficiency and good accuracy; on the other hand, given that the cameras at the construction site must be configured in advance, the implementation of the solution of the present disclosure does not require additional hardware, and can be achieved only through the existing construction monitoring platform, with low cost and great effect.
[0017] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.
[0019] Figure 1 A block diagram of a monitoring display screen switching system for an offshore photovoltaic construction site according to an exemplary embodiment of the present disclosure is schematically shown.
[0020] Figure 2 A schematic diagram showing a display mode of an embodiment of the present disclosure is shown.
[0021] Figure 3 A schematic diagram showing another display mode of an embodiment of the present disclosure is shown.
[0022] Figure 4 A schematic diagram showing yet another display mode of an embodiment of the present disclosure is shown.
[0023] Figure 5 A flowchart of a monitoring display screen switching method for an offshore photovoltaic construction site according to an exemplary embodiment of the present disclosure is schematically shown.
[0024] Figure 6 A block diagram of a monitoring display screen switching device for an offshore photovoltaic construction site according to an exemplary embodiment of the present disclosure is schematically shown.
[0025] Figure 7 A block diagram of an electronic device according to an exemplary embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION
[0026] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be more comprehensive and complete, and the concepts of the example embodiments are fully conveyed to those skilled in the art. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.
[0027] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.
[0028] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the steps. For example, some steps may be decomposed, while some steps may be combined or partially combined, so the actual execution order may change according to the actual situation. In addition, all the terms "first", "second", etc. below are only for the purpose of distinction and should not be used as limitations of the present disclosure.
[0029] Figure 1 The block diagram of the monitoring display screen switching system for an offshore photovoltaic construction site according to an exemplary embodiment of the present disclosure is schematically shown. Figure 1 The monitoring display screen switching system 1 for offshore photovoltaic construction sites of the embodiment of the present disclosure may include multiple cameras 110, a data processing device 12 and a display device 13. The multiple cameras 110 may be respectively connected to the data processing device 12 and the display device 13 in communication to transmit the collected on-site video frame images. The data processing device 12 may be connected to the display device 13 in communication to realize the display control of the display device 13 by the data processing device 12.
[0030] Multiple cameras 110 can be configured at different locations of the offshore photovoltaic construction site. Specifically, these cameras can be distributed in various areas related to the offshore photovoltaic site, such as the offshore construction area, the ground construction area, the project command and management area, etc. The present disclosure does not limit the number of cameras installed on site.
[0031] The data processing device 12 can be used to obtain the video frame images collected by each camera, perform event analysis on the video frame images, determine the event monitoring level corresponding to the video frame images collected by each camera based on the result of the event analysis, determine the video frame images collected by one or more target cameras as the target display content according to the event monitoring level corresponding to the video frame images collected by each camera, determine the event monitoring level distribution of the video frame images included in the target display content, determine the target display mode according to the event monitoring level distribution, and obtain the identification of the target camera. In the target display mode, at least the target display content is displayed.
[0032] The display device 13 can be used to obtain the target display mode and the target camera identifier sent by the data processing device 12, obtain the video frame image captured by the target camera in real time according to the target camera identifier, switch the current display mode to the target display mode, and display the video frame image captured by the target camera in real time in the interface style of the target display mode. The difference in interface style of different display modes includes one or more of different arrangement of the screens corresponding to the video frame images, different numbers of screens, and different display sizes of the screens.
[0033] refer to Figure 1 The monitoring display screen switching system 1 may also include a wind sensor 14, which is used to obtain offshore wind data. In this case, for the offshore camera, the process of the data processing device 12 determining the event monitoring level may also include: obtaining the offshore wind data collected by the wind sensor 14, and performing coefficient conversion on the offshore wind data to obtain a target coefficient; obtaining the video frame image collected by the offshore camera and performing event analysis to obtain an event analysis score; and determining the event monitoring level corresponding to the video frame image collected by the offshore camera using the target coefficient and the event analysis score.
[0034] The specific processing process of the data processing device 12 is described below.
[0035] For the event analysis process based on video frame images, first, a historical image collected by a camera corresponding to the video frame image and pre-calibrated can be obtained, wherein the event monitoring level of the historical image is any one of all event monitoring levels.
[0036] In an exemplary embodiment of the present disclosure, the event monitoring level can be divided into A, B, C, D, etc., or can be divided into level 1, level 2, level 3, etc., and the present disclosure does not limit the number of level divisions for event monitoring levels. In some embodiments, the earlier the number, the higher the need and urgency for event monitoring. For example, the monitoring urgency of level A is higher than the monitoring urgency of level B, and the monitoring urgency of level 1 is higher than the monitoring urgency of level 2. In other embodiments, the later the number, the higher the need and urgency for event monitoring. For example, the monitoring urgency of level B is lower than the monitoring urgency of level C, and the monitoring urgency of level 3 is higher than the monitoring urgency of level 2. These can be adjusted according to needs and habits, and the present disclosure does not limit this.
[0037] Taking the event monitoring levels as A, B, C, and D as an example, the event monitoring level of the above historical images can be any one of A, B, C, and D, and the present disclosure does not limit the selection of historical images.
[0038] Next, the video frame image can be compared with the historical image to determine the image content difference. The image content difference can include differences caused by human factors or differences caused by natural factors. Differences caused by human factors include, for example, vehicles, personnel, ships, etc. Differences caused by natural factors include, for example, waves, heavy rain, etc.
[0039] Specifically, the image content difference between the video frame image and the historical image can be deducted from the video frame image as the image foreground to obtain a separate image content difference. It can be understood that the pixel value of the image background corresponding to the image content difference can be unified to 0 or 255. In order to use the separate image content difference for subsequent analysis.
[0040] Then, the event analysis score can be determined according to the image content difference, and the event analysis score can be used as the result of event analysis on the video frame image.
[0041] Specifically, the scoring process can rely on the existing mature convolutional neural network to achieve classification scoring of the model by constructing sample pairs to train the convolutional neural network in advance. In other words, the image content difference can be input into the convolutional neural network, and the convolutional neural network outputs the event analysis score. The present disclosure does not limit the specific structure and training process of the convolutional neural network.
[0042] According to some embodiments of the present disclosure, the event monitoring level corresponding to the video frame image captured by the camera can be directly determined based on the result of the event analysis. Specifically, the corresponding event monitoring level can be determined according to the event analysis score. Taking the event monitoring levels as A, B, C, and D as an example, event analysis scores greater than or equal to 75 are classified as level A, event analysis scores between 50 and 75 are classified as level B, event analysis scores between 25 and 50 are classified as level C, and event analysis scores below 25 are classified as level D. It should be noted that this is only an exemplary description and the present disclosure does not limit this.
[0043] For the scheme of determining the event monitoring level in combination with offshore wind data from a wind sensor, it should be understood that the greater the wind force, the greater the target coefficient, and the greater the impact on the event monitoring level. In other words, the wind force value of the offshore wind data is positively correlated with the target coefficient, and the representation of the positive correlation can be simulated through multiple tests, and the present disclosure does not limit this.
[0044] In other embodiments of the present disclosure, the positive correlation relationship can be artificially defined in advance to construct a mapping relationship between wind force value and target coefficient. Thus, when the wind force value of offshore wind force data is known, the target coefficient corresponding to the wind force value can be determined by means of the mapping relationship.
[0045] In addition, the target coefficient can be multiplied by the event analysis score, and then the product result can be converted into the event monitoring level. Taking the event monitoring level as A, B, C, and D as an example, the multiplied value is greater than or equal to 75 and is classified as level A, the value between 50 and 75 is classified as level B, the value between 25 and 50 is classified as level C, and the value below 25 is classified as level D. It should be noted that this is only an exemplary description, and the present disclosure does not limit this.
[0046] Regarding the process of determining the target display content, first, the event monitoring level corresponding to the video frame image captured by each camera can be compared with the level threshold. Next, the camera whose event monitoring level is greater than or equal to the level threshold can be determined as the target camera, and the video frame image captured by the target camera is used as the target display content. Among them, the level threshold can be set to level B, level 2, etc. It can be understood that the level threshold is related to the level division and the probability of occurrence of the event to be monitored on site, and the present disclosure does not limit this.
[0047] As described above, the embodiment of the present disclosure also includes a process of determining a target display mode. First, the display mode mentioned in the present disclosure is described.
[0048] In an exemplary embodiment of the present disclosure, the differences in interface styles of different display modes include one or more of different arrangement modes of the screens corresponding to the video frame images, different numbers of screens, and different display sizes of the screens. Among them, the arrangement mode of the screens refers to the arrangement order of the screens on the entire interface, the number of screens refers to the total number of screens presented on the entire interface, and the display size of the screens refers to the size of each screen presented on the interface.
[0049] Figure 2 A schematic diagram showing a display mode of an embodiment of the present disclosure is shown. Figure 2 In this display mode, the display size of the corresponding images of the cameras is the same. This display mode can usually be configured as the default display mode or when the current event monitoring level is not high.
[0050] Figure 3 FIG. 2 is a schematic diagram showing another display mode of an embodiment of the present disclosure. Figure 3 In this display mode, the display size of the camera corresponding to the screen is also the same, but compared to Figure 2 , the display size of the corresponding camera screen is larger.
[0051] When this display mode is applied as the target display mode, the video frame images of the cameras involved can be interpolated to improve the resolution of the picture, thereby improving the viewing experience of the viewer.
[0052] Figure 4 A schematic diagram showing another display mode of an embodiment of the present disclosure is shown. Figure 4 ,In this display mode, the display sizes of the corresponding images of the cameras are not exactly the same, and the ,visual effects presented include that the image of camera 1 is enlarged, proving that the image of camera 1 is the ,construction event image that the computer analyzes itself and should receive special ,attention.
[0053] Similarly, when this display mode is applied as the target display mode, the enlarged picture may be interpolated to improve the resolution of the picture, thereby improving the viewing experience.
[0054] It should be noted that Figures 2 to 4 This is only an exemplary description of the display mode of the present disclosure. Through the above description, other screen configuration methods can also be associated, and the present disclosure does not limit this.
[0055] Regarding the process of determining the target display mode, it should be noted that the event monitoring level distribution mentioned in the present disclosure may include the event monitoring level involved in the target display content and the number of video frame images at each event monitoring level. For example, the event monitoring level involved in the target display content includes level A and level B, the number of video frame images corresponding to level A is 1, and the number of video frame images corresponding to level B is 11.
[0056] According to some embodiments of the present disclosure, a mapping relationship between event monitoring levels and the number of video frame images at each event monitoring level and display mode can be pre-constructed, and the target display mode can be determined using the mapping relationship. Still using the above example, the number of video frame images corresponding to level A is 1, and the number of video frame images corresponding to level B is 11. In this case, the target display mode can be, for example, Figure 4 in the form of.
[0057] For example, the target display content includes a first video frame image captured by a first camera and a second video frame image captured by a second camera. If the event monitoring level corresponding to the first video frame image is higher than the event monitoring level corresponding to the second video frame image, then in the target display mode, the display size of the screen corresponding to the first video frame image is larger than the display size of the screen corresponding to the second video frame image.
[0058] In addition, the present disclosure also provides a solution for locking the interface of part or all of the images after switching the display screen.
[0059] Specifically, when the video frame images captured by the target camera in real time are displayed in the interface style of the target display mode, in response to the locking operation on one or more video frame images on the interface, one or more video frame images are controlled to be locked. The locking means that the interface style of the corresponding screen of the locked video frame image remains unchanged. The present disclosure does not limit the locking operation, such as the mouse click operation of the operator, the text input operation, etc.
[0060] In addition, for the process of switching the monitoring display screen executed by the above system, in order to save resources, the data processing device 12 can execute the above processing process every predetermined time, and the predetermined time can be, for example, 5 minutes, 10 minutes, etc. This aspect is related to the current monitoring needs. For example, when there is no construction on site, the predetermined time can be set to a larger value. Conversely, if construction is in progress, the predetermined time can be set to a smaller value, at least less than the situation when there is no construction on site.
[0061] The following describes the method for switching monitoring display screens for an offshore photovoltaic construction site executed by the data processing device 12 according to an embodiment of the present disclosure.
[0062] Figure 5The flowchart of the monitoring display screen switching method for an offshore photovoltaic construction site according to an exemplary embodiment of the present disclosure is schematically shown. Figure 5 The monitoring display screen switching method may include the following steps:
[0063] S502. Obtain video frame images collected by multiple cameras, where each camera is configured at a different location on the offshore photovoltaic construction site.
[0064] S504. Perform event analysis on the video frame images, and determine the event monitoring level corresponding to the video frame images collected by each camera based on the result of the event analysis.
[0065] S506. Determine the video frame images captured by one or more target cameras as target display content according to the event monitoring level corresponding to the video frame images captured by each camera.
[0066] S508. Determine the event monitoring level distribution of the video frame images included in the target display content, and determine the target display mode according to the event monitoring level distribution.
[0067] Specifically, in the target display mode, at least the target display content is displayed. In addition, the differences in interface styles of different display modes include one or more of different arrangements of video frame images corresponding to screens, different numbers of screens, and different display sizes of screens.
[0068] S510. Obtain the ID of the target camera.
[0069] S512. Send the target display mode and the identifier of the target camera to the display device.
[0070] Specifically, the target camera identifier instructs the display device to obtain the video frame image captured by the target camera in real time, and the target display mode instructs the display device to switch the current display mode to the target display mode, and display the video frame image captured by the target camera in real time in the interface style of the target display mode.
[0071] Since the detailed process of the monitoring display screen switching method for an offshore photovoltaic construction site in the embodiment of the present disclosure is the same as that in the above-mentioned system implementation, it will not be repeated here.
[0072] It should be noted that although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.
[0073] Furthermore, the present disclosure also provides a monitoring display screen switching device for an offshore photovoltaic construction site.
[0074] refer to Figure 6 The monitoring display screen switching device 6 for an offshore photovoltaic construction site of the embodiment of the present disclosure may include an image acquisition module 61, an image analysis module 62, a display content determination module 63, a display mode determination module 64, an identification acquisition module 65 and an information sending module 66.
[0075] Specifically, the image acquisition module 61 can be used to acquire video frame images captured by multiple cameras, each camera being configured at a different position of the offshore photovoltaic construction site; the image analysis module 62 can be used to perform event analysis on the video frame images, and determine the event monitoring level corresponding to the video frame images captured by each camera in combination with the result of the event analysis; the display content determination module 63 can be used to determine the video frame images captured by one or more target cameras as the target display content according to the event monitoring level corresponding to the video frame images captured by each camera; the display mode determination module 64 can be used to determine the event monitoring level distribution of the video frame images contained in the target display content, and determine the target display mode according to the event monitoring level distribution; Among them, in the target display mode, at least the target display content is displayed; the differences in the interface styles of different display modes include one or more of different arrangements of the video frame images corresponding to the screens, different numbers of screens, and different display sizes of the screens; the identification acquisition module 65 can be used to obtain the identification of the target camera; the information sending module 66 can be used to send the target display mode and the identification of the target camera to the display device; wherein the identification of the target camera indicates that the display device obtains the video frame image captured in real time by the target camera, and the target display mode indicates that the display device switches the current display mode to the target display mode, and displays the video frame image captured in real time by the target camera in the interface style of the target display mode.
[0076] Since the functional modules of the monitoring display screen switching device for an offshore photovoltaic construction site in the embodiment of the present disclosure are the same as those in the above-mentioned system implementation, they will not be described in detail here.
[0077] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary implementations of the present disclosure described in the above "Exemplary Method" section of the present specification.
[0078] The program product for implementing the above method according to the embodiment of the present disclosure can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.
[0079] The program product may adopt any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical disk, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.
[0080] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0081] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.
[0082] Program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).
[0083] In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.
[0084] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods or program products. Therefore, various aspects of the present disclosure may be specifically implemented in the following forms, namely: complete hardware implementation, complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as "circuits", "modules" or "systems".
[0085] Refer to the following Figure 7 An electronic device 700 according to this embodiment of the present disclosure is described. Figure 7 The electronic device 700 shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0086] like Figure 7 As shown, the electronic device 700 is in the form of a general computing device. The components of the electronic device 700 may include but are not limited to: the at least one processing unit 710, the at least one storage unit 720, a bus 730 connecting different system components (including the storage unit 720 and the processing unit 710), and a display unit 740.
[0087] The storage unit stores program codes, which can be executed by the processing unit 710, so that the processing unit 710 executes the steps according to various exemplary embodiments of the present disclosure described in the above “Exemplary Method” section of this specification. For example, the processing unit 710 can execute various steps of the monitoring display screen switching method for an offshore photovoltaic construction site according to an embodiment of the present disclosure.
[0088] The storage unit 720 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 7201 and / or a cache memory unit 7202 , and may further include a read-only memory unit (ROM) 7203 .
[0089] The storage unit 720 may also include a program / utility 7204 having a set (at least one) of program modules 7205, such program modules 7205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.
[0090] Bus 730 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
[0091] The electronic device 700 may also communicate with one or more external devices 800 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), one or more devices that enable a user to interact with the electronic device 700, and / or any device that enables the electronic device 700 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed via an input / output (I / O) interface 750. Furthermore, the electronic device 700 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 760. Figure 7 As shown, the network adapter 760 communicates with other modules of the electronic device 700 via the bus 730. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0092] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.
[0093] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present disclosure, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.
[0094] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.
[0095] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing what is disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and embodiments are to be considered merely as exemplary, and the true scope and spirit of the present disclosure are indicated by the claims.
[0096] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A monitoring display screen switching system for an offshore photovoltaic construction site, characterized in that: include: A plurality of cameras are arranged at different locations of the offshore photovoltaic construction site, wherein the plurality of cameras include an offshore camera arranged at the offshore construction site; Wind sensors, used to obtain offshore wind data; A data processing device, used for acquiring the video frame images captured by each of the cameras, performing event analysis on the video frame images, determining the event monitoring level corresponding to the video frame images captured by each of the cameras in combination with the result of the event analysis, comparing the event monitoring level corresponding to the video frame images captured by each of the cameras with a level threshold, determining the camera whose event monitoring level is greater than or equal to the level threshold as the target camera, using the video frame images captured by the target camera as the target display content, determining the event monitoring level distribution of the video frame images contained in the target display content, determining the target display mode according to a pre-constructed mapping relationship and the event monitoring level distribution, wherein the mapping relationship is a mapping relationship between the event monitoring level and the number of video frame images at each event monitoring level and the display mode, and obtaining the identifier of the target camera; wherein the event monitoring level distribution includes the event monitoring level involved in the target display content and the number of video frame images at each event monitoring level; in the target display mode, at least the target display content is displayed; A display device, used to obtain the target display mode and the identifier of the target camera sent by the data processing device, obtain the video frame image captured by the target camera in real time according to the identifier of the target camera, switch the current display mode to the target display mode, and display the video frame image captured by the target camera in real time in the interface style of the target display mode; wherein the difference in interface style of different display modes includes one or more of different arrangement of pictures corresponding to the video frame image, different number of pictures, and different display size of the pictures; The data processing device determines the event monitoring level corresponding to the video frame image collected by the marine camera, including: The data processing device obtains offshore wind data collected by the wind sensor, performs coefficient conversion on the offshore wind data to obtain a target coefficient; obtains the video frame image collected by the offshore camera and performs event analysis to obtain an event analysis score; multiplies the target coefficient by the event analysis score, and converts the product result into an event monitoring level corresponding to the video frame image collected by the offshore camera; The data processing device performs event analysis on the video frame image, including: Obtain a historical image captured and pre-calibrated by a camera corresponding to the video frame image; wherein the event monitoring level of the historical image is any one of all event monitoring levels; Comparing the video frame image with the historical image to determine the difference in image content; Determine an event analysis score using a trained convolutional neural network and according to the image content difference, and use the event analysis score as a result of event analysis on the video frame image; Among them, the display device is also used to respond to a locking operation on one or more video frame images on the interface while displaying the video frame images captured in real time by the target camera in the interface style of the target display mode, and control the locking of the one or more video frame images, and the interface style of the corresponding screen of the locked video frame image remains unchanged.
2. The monitoring display screen switching system according to claim 1, characterized in that: The target display content includes a first video frame image captured by a first camera and a second video frame image captured by a second camera; If the event monitoring level corresponding to the first video frame image is higher than the event monitoring level corresponding to the second video frame image, then in the target display mode, the display size of the screen corresponding to the first video frame image is larger than the display size of the screen corresponding to the second video frame image.
3. A monitoring display screen switching method for an offshore photovoltaic construction site, characterized in that: include: Acquire video frame images collected by a plurality of cameras, each of the cameras being arranged at a different position of an offshore photovoltaic construction site, and the plurality of cameras including an offshore camera arranged at the offshore construction site; Obtain a historical image captured by a camera corresponding to a video frame image and pre-calibrated, compare the video frame image with the historical image, determine the difference in image content, use a trained convolutional neural network and determine an event analysis score based on the difference in image content, and use the event analysis score as the result of event analysis on the video frame image, and determine the event monitoring level corresponding to each video frame image captured by the camera in combination with the result of the event analysis; the event monitoring level of the historical image is any one of all event monitoring levels; Compare the event monitoring level corresponding to the video frame image collected by each camera with the level threshold, determine the camera whose event monitoring level is greater than or equal to the level threshold as the target camera, and use the video frame image collected by the target camera as the target display content; Determine the event monitoring level distribution of the video frame images included in the target display content, and determine the target display mode according to a pre-constructed mapping relationship and the event monitoring level distribution, wherein the mapping relationship is a mapping relationship between the event monitoring level and the number of video frame images at each event monitoring level and the display mode, wherein the event monitoring level distribution includes the event monitoring level involved in the target display content and the number of video frame images at each event monitoring level; in the target display mode, at least the target display content is displayed; the differences in interface styles of different display modes include one or more of different arrangements of screens corresponding to video frame images, different numbers of screens, and different display sizes of screens; Obtaining the identification of the target camera; Sending the target display mode and the identifier of the target camera to a display device; The target camera identifier instructs the display device to obtain the video frame image captured by the target camera in real time, and the target display mode instructs the display device to switch the current display mode to the target display mode, and display the video frame image captured by the target camera in real time in the interface style of the target display mode; Wherein, determining the event monitoring level corresponding to the video frame image collected by the marine camera includes: Obtain offshore wind data collected by a wind sensor, and perform coefficient conversion on the offshore wind data to obtain a target coefficient; obtain the video frame image collected by the offshore camera and perform event analysis to obtain an event analysis score; multiply the target coefficient by the event analysis score, and convert the product into an event monitoring level corresponding to the video frame image collected by the offshore camera; Among them, the display device is also used to respond to a locking operation on one or more video frame images on the interface while displaying the video frame images captured in real time by the target camera in the interface style of the target display mode, and control the locking of the one or more video frame images, and the interface style of the corresponding screen of the locked video frame image remains unchanged.
4. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by the processor, the monitoring display screen switching method for an offshore photovoltaic construction site described in claim 3 is implemented.
5. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; Wherein, the processor is configured to implement the monitoring display screen switching method for an offshore photovoltaic construction site as described in claim 3 by executing the executable instructions.
Citation Information
Patent Citations
Watching control system having an auto picture pop-up function and controlling method for the same
KR1020080044936A
Image monitoring system and method thereof
KR1020130113680A