Image display method and device

Abstract

The present application provides an image display method and device, which relates to the field of image processing technology and can enable users to more conveniently and quickly view different types of surveillance images of the same surveillance scene, thereby improving the user experience. The specific scheme includes: first displaying a first image in a display window; obtaining an image viewing instruction, the image viewing instruction being used to request viewing a portion of a second image corresponding to a target area in a target area of ​​the display window; the portion of the image being the image displayed in the target area when the second image is displayed through the display window; and in response to the image viewing instruction, displaying the portion of the second image corresponding to the target area in the target area of ​​the display window, so as to display the portion of the image at a position corresponding to the target area in the first image.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to an image display method and device. Background Art

[0002] Infrared thermal imaging uses photoelectric technology to detect infrared signals in specific wavelength bands, which are then converted into visually discernible images and graphics, displaying the surface temperature distribution of the object in different colors. Thermal imaging can accurately reflect the characteristics of thermal targets and is not affected by light intensity, making it highly practical.

[0003] Currently, infrared thermal imaging technology is widely used in video surveillance systems. Existing surveillance equipment equipped with infrared thermal imaging technology can simultaneously capture thermal and visible light images of the monitored scene, then merge and process the two captured image sources, displaying them as a single frame on the client. Typically, the client displays the visible light image of the monitored scene on the surveillance screen, and displays fixed areas within the surveillance screen, such as doorways and important machinery, as thermal images. In this case, the user cannot view thermal images of other areas in the surveillance screen. Summary of the Invention

[0004] The present application provides an image display method and device, which can enable users to view different types of surveillance images of the same surveillance scene more conveniently and quickly, thereby improving the user experience.

[0005] To achieve the above technical objectives, this application adopts the following technical solutions:

[0006] In a first aspect, the present application provides an image display method, the method comprising: first displaying a first image in a display window; obtaining an image viewing instruction, the image viewing instruction being used to request viewing a portion of an image corresponding to a target area in a second image in a target area in the display window; the portion of the image being the image displayed in the target area when the second image is displayed through the display window; and in response to the image viewing instruction, displaying the portion of the image corresponding to the target area in the second image in the target area in the display window, so as to display the portion of the image at a position corresponding to the target area in the first image.

[0007] Based on the image display method provided by the present application, the image display device can first display the first image displayed by default in the display window, and then when the user needs to view the partial image corresponding to the target area in the second image, the partial image is displayed at the position corresponding to the target area in the first image. On the one hand, the method does not limit the size and position of the target area, and the user can select any area on the display window as the above-mentioned target area, that is, the user can freely select the area to view the second image, so that the user can view the second image of the monitoring scene more conveniently and quickly. On the other hand, the first image and the second image can be different types of monitoring images of the same monitoring scene, so that the image display device displays the partial image corresponding to the target area in the second image at the position corresponding to the target area in the first image, while satisfying the user's normal need to view the first image of the monitoring scene, and can also highlight the partial image corresponding to the target area in the second image.

[0008] In a possible implementation, the first image and the second image are images obtained based on different imaging principles.

[0009] Optionally, the first image is a visible light image, and the second image is a thermal imaging image; or, the first image is a thermal imaging image, and the second image is a visible light image.

[0010] It should be noted that visible light images can better reflect the details of the scene where the target is located and have higher clarity, but are significantly affected by lighting. Thermal images can better reflect the thermal characteristics of the image, but the image clarity is lower. Therefore, the method provided in the embodiment of the present application can display both visible light images and thermal images in the display window, which can meet the user's need to understand the monitoring scene through the monitoring screen under different lighting conditions.

[0011] In another possible implementation, the above-mentioned display of the first image in the display window includes: displaying the first image and the second image overlappingly in the display window; when the first image is displayed on the upper layer of the second image, the above-mentioned display of the partial image in the target area in the display window includes: adjusting the transparency of the image corresponding to the target area in the first image to fully transparent, and adjusting the transparency of the partial image to opaque.

[0012] In another possible implementation, the above-mentioned displaying of the first image in the display window includes: displaying the first image and the second image overlappingly in the display window; when the second image is displayed on the upper layer of the first image, the above-mentioned displaying of the partial image in the target area in the display window includes: adjusting the transparency of the partial image to opaque.

[0013] It should be noted that when an image display device displays a first image and a second image in an overlapping manner, the image display device can adjust the transparency of the first image and the second image to display the portion of the second image corresponding to the target area in the display window. In this case, there is no need to fuse or merge the first and second images, which can reduce the delay caused by the fusion or merging process and improve the user experience.

[0014] In another possible implementation, displaying the partial image at a position corresponding to the target area in the display window includes: replacing the image of the first image displayed in the target area with the partial image; or covering the image of the first image displayed in the target area with the partial image.

[0015] In another possible implementation, the obtaining of the image viewing instruction specifically includes: receiving a user operation of selecting a target area in the display window; and obtaining the image viewing instruction in response to the user operation.

[0016] In another possible implementation, the above-mentioned obtaining of the image viewing instruction specifically includes: receiving a user operation of selecting a target object in the display window; in response to the user operation, obtaining the image viewing instruction, and the first image includes the target object in the image displayed in the target area of ​​the display window.

[0017] In a second aspect, the present application provides an image display device, which includes a transceiver module and a display module, wherein the display module is used to display a first image in a display window; the transceiver module is used to obtain an image viewing instruction, and the image viewing instruction is used to request viewing a partial image corresponding to a target area in a second image in a target area in the display window; the partial image is an image displayed in the target area when the second image is displayed through the display window; the display module is also used to display the partial image in the target area in the display window in response to the instruction, so as to display the partial image at a position corresponding to the target area in the first image.

[0018] In one possible implementation, the display module is specifically used to: display the first image and the second image overlappingly in the display window; when the first image is displayed on the upper layer of the second image, the display module is also specifically used to: adjust the transparency of the image corresponding to the target area in the first image to fully transparent, and adjust the transparency of part of the image to opaque.

[0019] In another possible implementation, the display module is specifically configured to: display the first image and the second image overlappingly in the display window; when the second image is displayed on top of the first image, the display module is further specifically configured to: adjust the transparency of part of the image to opaque.

[0020] In another possible implementation, the display module is further specifically configured to: replace the image of the first image displayed in the target area with a partial image; or cover the image of the first image displayed in the target area with the partial image.

[0021] In another possible implementation, the receiving module is specifically configured to: receive a user operation of selecting the target area in the display window; and obtain an image viewing instruction in response to the user operation.

[0022] In another possible implementation, the receiving module is specifically configured to: receive a user operation of selecting a target object in the display window; and in response to the user operation, obtain an image viewing instruction, wherein the first image displayed in the target area of ​​the display window includes the target object.

[0023] In a third aspect, the present application provides an electronic device comprising a memory and a processor. The memory and the processor are coupled. The memory is configured to store computer program code, the computer program code comprising computer instructions. When the processor executes the computer instructions, the electronic device performs any one of the image display methods provided in the first aspect.

[0024] In a fourth aspect, the present application provides a chip system, which is applied to an image display device; the chip system includes one or more interface circuits and one or more processors. The interface circuits and processors are interconnected via circuits; the interface circuits are configured to receive signals from the memory of the image display device and send signals to the processors, the signals including computer instructions stored in the memory. When the processor executes the computer instructions, the electronic device performs any one of the image display methods provided in the first aspect above.

[0025] In a fifth aspect, the present application provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on a computer, the computer executes any one of the image display methods provided in the first aspect above.

[0026] In a sixth aspect, the present application provides a computer program product, which includes computer instructions. When the computer instructions are executed on a computer, the computer executes any one of the image display methods provided in the first aspect above.

[0027] For the specific descriptions of the second to sixth aspects and their various implementations in this application, reference can be made to the detailed descriptions in the first aspect and its various implementations; and for the beneficial effects of the second to sixth aspects and their various implementations, reference can be made to the analysis of the beneficial effects in the first aspect and its various implementations, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A schematic diagram of a monitoring system provided in an embodiment of the present application;

[0029] Figure 2 A schematic diagram of another monitoring system provided in an embodiment of the present application;

[0030] Figure 3 A schematic diagram of the hardware structure of an image display device provided in an embodiment of the present application;

[0031] Figure 4 A flowchart of an image display method provided in an embodiment of the present application;

[0032] Figure 5 A schematic diagram of an image display interface provided in an embodiment of the present application;

[0033] Figure 6 A schematic diagram of another image display interface provided in an embodiment of the present application;

[0034] Figure 7 A schematic diagram of another image display interface provided in an embodiment of the present application;

[0035] Figure 8 A schematic structural diagram of an image display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0036] In the description of this application, unless otherwise specified, " / " means "or". For example, A / B can mean A or B. "And / or" in this document is simply a description of the association relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0037] In addition, "at least one" means one or more, and "plurality" means two or more. The words "first" and "second" do not limit the quantity and execution order, and the words "first" and "second" do not necessarily mean different.

[0038] It should be noted that, in the description of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0039] To improve the convenience for users to view different types of surveillance images of the same surveillance scene, the present application provides an image display method and device, the specific scheme comprising: first displaying a first image in a display window; obtaining an image viewing instruction, the image viewing instruction being used to request viewing a portion of a second image corresponding to a target area in a target area of ​​the display window; the partial image being the image displayed in the target area when the second image is displayed through the display window; and responding to the image viewing instruction, displaying the portion of the second image corresponding to the target area in the target area of ​​the display window, so as to display the portion of the image at a position corresponding to the target area in the first image. Thus, the user can freely select the target area without being restricted by size and position, that is, the user can view the second image of the surveillance scene more conveniently and quickly.

[0040] like Figure 1 As shown, an embodiment of the present application provides a schematic diagram of a monitoring system. The monitoring system 100 includes a client 10 and a camera 20. The client 10 is connected to the camera 20.

[0041] It should be understood that the above-mentioned connection method can be a wireless connection, such as a Bluetooth connection, a Wi-Fi connection, etc.; or, the above-mentioned connection method can also be a wired connection, such as an optical fiber connection, etc., without limitation.

[0042] The photographing device 20 is used to photograph images of the monitored scene, which include a first image and a second image of the monitored scene.

[0043] Optionally, the shooting device 20 may be a binocular camera. Exemplarily, the binocular camera includes a first camera for shooting a first image and a second camera for shooting a second image. The first camera and the second camera are cameras using different imaging principles. For example, the first camera may be one of a visible light camera and a thermal imaging camera. When the first camera is a visible light camera, the second camera may be a thermal imaging camera. Alternatively, when the first camera is a thermal imaging camera, the second camera may be a visible light camera. For another example, the first camera may also be one of a visible light camera and a depth camera. When the first camera is a visible light camera, the second camera may be a depth camera. Alternatively, when the first camera is a depth camera, the second camera may be a visible light camera. The embodiments of the present application do not limit the specific type of camera of the shooting device 20.

[0044] Thus, if the first camera is a visible light camera, the first image is a visible light image, and if the second camera is a thermal imaging camera, the second image is a thermal imaging image. If the first camera is a thermal imaging camera, the first image is a thermal imaging image, and if the second camera is a visible light camera, the second image is a visible light image. These examples are not listed here one by one.

[0045] Optionally, when the camera 20 is a binocular camera, the image display device can obtain two video signals sent by the binocular camera. A first video signal of the two video signals is a video signal of the surveillance image captured by the first camera of the binocular camera. A second video signal of the two video signals is a video signal of the surveillance image captured by the second camera of the binocular camera.

[0046] Optionally, in the monitoring system 100, there may be multiple monitoring scenes, and thus the number of camera devices 20 may also be multiple. The multiple camera devices 20 correspond one-to-one to the multiple monitoring scenes, and the camera devices 20 are used to capture the first image and the second image of the corresponding monitoring scene. For example, the monitoring system 100 may include multiple camera devices 20 set up in multiple scenes such as the living room, kitchen, and study of the same residence. For another example, the monitoring system 100 may include multiple camera devices 20 set up in multiple scenes such as classroom 1, classroom 2, the main entrance, and the playground of the same school.

[0047] Alternatively, a monitoring scene may correspond to multiple shooting devices 20, so that the above-mentioned first image may be an image taken by a shooting device 20 set in the monitoring scene, and the above-mentioned second image may be an image taken by another shooting device 20 set in the monitoring scene.

[0048] The client 10 is used to display the image of the monitoring scene captured by the shooting device 20, and can be any electronic device with an image display function.

[0049] For example, the client 20 in the embodiments of the present application may be, for example, a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook computer, cellular phone, personal digital assistant (PDA), augmented reality (AR) or virtual reality (VR) device, etc. The present application does not impose any particular restrictions on the specific form of the client 10. It can interact with the user through one or more methods such as a keyboard, touchpad, touch screen, remote control, voice interaction, or handwriting device.

[0050] Taking the client 10 as a tablet computer as an example, an application for controlling the camera 20 may be installed on the tablet computer. By operating the application, the user can view the surveillance images captured by the camera 20 on the tablet computer, and view the first image and the second image on the tablet computer using the method provided in the embodiments of the present application.

[0051] Optionally, there may be more than one client 10 . For example, any client 10 may be used to display images captured by all the cameras 20 in the monitoring system 100 .

[0052] Optional, such as Figure 2 As shown, the monitoring system 100 may further include a server 30. The client 10 and the camera 20 are connected to the server 30 respectively.

[0053] The server 30 can serve as a management server for the application program used to control the camera 20. The server 30 can acquire surveillance footage captured by the camera 20 in real time, process the acquired footage, and then display the footage via an application program installed on the client 10. For example, in actual use, the server 30 can assist a user in remotely viewing images captured by the camera 20 via the client 10. For example, when a user is away from home, the server 30 can transmit the acquired surveillance footage to the client 10 for the user to view on the client 10.

[0054] In some embodiments, the server 30 may also be configured to control the client to display the first image and the second image in an overlapping manner in the display window, or to control the client to adjust the transparency of the first image and the second image.

[0055] Exemplarily, server 30 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, big data servers, etc.

[0056] The present application also provides an image display device for executing the image display method provided herein. For example, the image display device may be the client 10 in the monitoring system 100, or the image display device may be a functional module in the client 10. The present application is not limited to this.

[0057] The following combination Figure 3 A hardware structure of the image display device 200 is introduced.

[0058] like Figure 3As shown, the image display device 200 includes a processor 210 , a communication line 220 and a communication interface 230 .

[0059] Optionally, the image display device 200 may further include a memory 240 , wherein the processor 210 , the memory 240 and the communication interface 230 may be connected via a communication line 220 .

[0060] The processor 210 may be a central processing unit (CPU), a general-purpose processor, a network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller, a programmable logic device (PLD), or any combination thereof. The processor 201 may also be any other device with processing capabilities, such as a circuit, a device, or a software module, without limitation.

[0061] In one example, the processor 210 may include one or more CPUs, such as Figure 3 CPU0 and CPU1 in.

[0062] As an optional implementation, the image display device 200 includes multiple processors. For example, in addition to the processor 210, it may also include a processor 270. The communication line 220 is used to transmit information between the various components included in the image display device 200.

[0063] Communication interface 230 is used to communicate with other devices or other communication networks. Such other communication networks may be Ethernet, radio access networks (RAN), wireless local area networks (WLAN), etc. Communication interface 230 may be a module, circuit, transceiver, or any other device capable of communication.

[0064] Memory 240 is used to store instructions. The instructions may be computer programs. Memory 240 may be a read-only memory (ROM) or other types of static storage devices that can store static information and / or instructions, or a random access memory (RAM) or other types of dynamic storage devices that can store information and / or instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, etc., without limitation.

[0065] It should be noted that the memory 240 can exist independently of the processor 210 or can be integrated with the processor 210. The memory 240 can be used to store instructions, program codes, or some data. The memory 240 can be located inside the image display device 200 or outside the image display device 200, without limitation.

[0066] The processor 210 is configured to execute instructions stored in the memory 240 to implement the communication method provided in the following embodiments of the present application. For example, when the image display device 200 is a terminal or a chip or system on a chip in the terminal, the processor 210 may execute instructions stored in the memory 240 to implement the steps performed by the transmitting end in the following embodiments of the present application.

[0067] As an optional implementation, the image display device 200 further includes an output device 250 and an input device 260. The output device 250 may be a device such as a display screen or a speaker that can output data from the image display device 200 to a user. The input device 260 may be a device such as a keyboard, a mouse, a microphone, or a joystick that can input data to the image display device 200.

[0068] As an example, the output device 250 may be configured to display the first image and the second image overlappingly in a display window.

[0069] It should be pointed out that Figure 3 The structure shown in the figure does not constitute a limitation on the image display device, except Figure 3 In addition to the components shown, the image display device may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0070] The image display method provided by this application is described in detail below with reference to the accompanying drawings.

[0071] like Figure 4 As shown, the embodiment of the present application provides an image display method, optionally, the method can be Figure 4 The image display device shown is implemented and applied to Figure 1 In the monitoring system shown, the method includes the following steps:

[0072] S101: An image display device displays a first image in a display window.

[0073] The display window refers to a user interface displayed on a display screen of an image display device. One or more display windows may be displayed on a display screen of an image display device.

[0074] It should be noted that whenever an application is running on the image display device, the application creates and displays a display window. This display window can display information related to the application, such as video images, webpage information, and so on. When a user manipulates an object in the display window, the application responds accordingly. For example, when a user closes a display window, the application corresponding to that display window terminates. Alternatively, the display window can be a display window created and displayed by an application in the monitoring system 100 used to control the camera 20.

[0075] The image type of the first image is the default image type displayed by the image display device. For example, the first image may be a visible light image, a thermal imaging image, or the like.

[0076] In some embodiments, when the image display device receives a display instruction, the image display device displays the first image in the display window in response to the display instruction.

[0077] The display instruction is an instruction input by a user to the image display device, and is used to instruct the image display device to display the first image.

[0078] For example, the display instruction may be an instruction for the user to open an application in the monitoring system 100 for controlling the photographing device 20. After receiving the display instruction, the application creates and displays the display window on the image display device, and displays the first image in the display window.

[0079] For another example, when the monitoring system 100 includes multiple monitoring scenes, the display instruction may be an instruction for the user to select a desired monitoring scene in a display window. When the image display device begins running the application for controlling the camera 20 in the monitoring system 100, the application creates and displays the display window on the image display device. The display window may display one or more monitoring scenes in the monitoring system 100. In response to the user's instruction to select the desired monitoring scene, the image display device captures a first image captured by the camera 20 installed in the monitoring scene and displays the captured first image in the display window.

[0080] In some embodiments, the image display device displays only the first image in the display window.

[0081] In some other embodiments, the image display device displays the first image and the second image in an overlapping manner in a display window. The image display device sets the transparency of the first image and the second image so that the display window displays the first image.

[0082] The first image and the second image are surveillance images of the same surveillance scene.

[0083] In actual use, the image display device can display the surveillance video of the surveillance scene captured by the shooting device in real time. The first image and the second image can be understood as a video frame of the surveillance video of the surveillance scene, that is, a static picture of the surveillance video at a moment.

[0084] In some embodiments, the image display device displays a first image using a first channel and displays a second image using a second channel.

[0085] Optionally, when the camera 20 is a binocular camera, the first channel is used to play the first video signal, and the second channel is used to play the second video signal. The first image is a video frame in the first video signal, and the second image is a video frame in the second video signal.

[0086] In this way, there is no need to fuse or merge the first video signal with the second video signal, which can reduce the delay of signal processing.

[0087] In some embodiments, the first image and the second image may be images obtained based on different imaging principles.

[0088] Optionally, the first image may be one of a visible light image and a thermal image. For example, if the first image is a thermal image, the second image may be a visible light image. For another example, if the first image is a visible light image, the second image may be a thermal image.

[0089] Visible light images can effectively depict the shape, structure, color, and other details of each object in the monitoring scene, and have good outline representation. However, the acquisition process of visible light images has high lighting requirements. In low light conditions, such as in nighttime monitoring scenes, the rendering effect of visible light images is poor.

[0090] Thermal imaging is the process of detecting infrared heat radiation from an object using non-contact detection equipment and converting it into an image of its temperature distribution. The temperature distribution in a thermal image can be used to determine whether there are objects with inconsistent temperatures or temperature distribution trends with the surrounding environment, thereby determining whether there are intruders within the captured area. Alternatively, the image can be used to determine whether abnormal temperature values ​​or temperature distributions exist in the monitored scene, enabling anomaly detection, such as in forest fire monitoring, regional temperature monitoring, and circuit / chip fault detection.

[0091] Therefore, in the embodiment of the present application, the image display device displays both visible light images and thermal images in the display window, which can meet the user's need to understand the monitoring scene through the monitoring screen under different lighting conditions. In addition, the thermal image can also meet the need to monitor the temperature distribution of the monitoring scene.

[0092] In some embodiments, the first image and the second image may be images at different times.

[0093] For example, the first image and the second image can be a surveillance image of the same surveillance scene during the day (e.g., 7:00 AM to 6:00 PM) and a surveillance image of the same surveillance scene at night (e.g., 6:00 PM to 7:00 AM the following day). Alternatively, the first image and the second image can be surveillance images of the same surveillance scene at the same time (e.g., 6:00 AM) on different days. In this way, the first image and the second image can reflect the changes of a certain object in the surveillance scene at different times.

[0094] Optionally, the first image and the second image may completely fill the display window, or a portion of the display window may be used to display the first image and the second image.

[0095] Optionally, the image size of the first image is the same as the image size of the second image, and the shooting angle of the first image is the same as the shooting angle of the second image.

[0096] The overlapping display refers to displaying the first image and the second image of the same size in a stacked manner in the display window, wherein the first image and the second image completely overlap.

[0097] It can be understood that when the image size and shooting angle of view of the first image are the same as those of the second image, the first image and the second image can completely overlap in the above display window.

[0098] In a possible implementation, the first image is displayed on an upper layer of the second image.

[0099] Optionally, the image display device sets the transparency of the first image to opaque, so that the image display device displays the first image in the display window.

[0100] For example, the image display device can display a first layer and a second layer in the above display window, with the first layer being on top of the second layer. The first layer is used to display the first image, and the second layer is used to display the second image. At this time, the transparency of the first image located in the first layer is opaque, and the transparency of the second image located in the second layer can be opaque or fully transparent, so that the image display device displays the first image by default. For example, Figure 5 As shown in (a) in FIG. 5 , the display window 51 includes a first layer and a second layer that overlap. It should be understood that in actual display, the first layer and the second layer should completely overlap. Figure 5 The display window 51 shown in (a) is for illustrative purposes only.

[0101] The transparency is a property of an image. For example, the transparency of an image can be expressed as a percentage, such as 0% to 100%. The higher the transparency, the closer the image is to a colorless and transparent state. In the embodiment of the present application, opaque means that the transparency of the image is 0%. Figure 5 As shown in (b) in FIG, when the transparency of the first image is opaque, the second image will not be displayed through the first image in the display window 51. Full transparency means that the transparency of the image is 100%. When the transparency of the image is fully transparent, the image is in a colorless and transparent state, and the user cannot see the image with the naked eye. Figure 5 As shown in (c) in FIG. 5 , when the transparency of the first image is fully transparent, the second image can be displayed through the first image. At this time, the user cannot view the first image in the first layer in the display window 51 .

[0102] It should be noted that, since the first layer and the second layer should completely overlap, and the first layer is on top of the second layer, when the transparency of the first image displayed on the first layer is opaque, Figure 5As shown in (b), the second image displayed on the second layer is completely blocked by the first image displayed on the first layer, that is, the display window 51 only displays the first image displayed on the first layer. Alternatively, when the transparency of the first image is fully transparent, the first image displayed on the first layer will not block the second image displayed on the second layer, that is, the second image displayed on the second layer can be displayed through the first layer, as shown in FIG. Figure 5 As shown in (c) in FIG. 5 , the display window 51 only displays the second image displayed in the second layer.

[0103] In another possible implementation, the second image is displayed on top of the first image.

[0104] Optionally, the image display device sets the transparency of the second image to fully transparent and the transparency of the first image to opaque, so that the image display device displays the first image in the display window.

[0105] For example, the image display device may display a first layer and a second layer in the display window, with the second layer positioned above the first layer. The first layer is used to display the first image, and the second layer is used to display the second image. In this case, the transparency of the first image in the first layer is opaque, while the transparency of the second image in the second layer is fully transparent, thereby enabling the image display device to display the first image by default.

[0106] S102: The image display device obtains an image viewing instruction.

[0107] The image viewing instruction is used to request viewing a portion of the second image corresponding to the target area in the target area of ​​the display window.

[0108] In addition, the partial image is the image displayed in the target area when the second image is displayed through the display window.

[0109] The target area refers to any area in the display window of the displayed first image. This application does not impose any restrictions on the size, position, shape, etc. of the target area.

[0110] For example, the target area may be Figure 6 The rectangular area shown in (a) Figure 6 The elliptical area shown in (b) in FIG.

[0111] In some embodiments, the image display device receives a user operation of selecting the target area, and in response to the user operation, the image display device obtains an image viewing instruction.

[0112] In a possible implementation, the user operation of selecting the target area may be a user operation of selecting a frame around the target area.

[0113] For example, Figure 5 As shown in (c) of FIG. 1 , the image display device displays the first image in the display window. At this time, the user can select an image in the display window by using the mouse, keyboard or other input device of the image display device. Figure 6 The rectangular area in the display window shown in (a) is the target area. Accordingly, the image display device can receive an instruction to view the portion of the second image corresponding to the rectangular area, that is, the image viewing instruction.

[0114] In another possible implementation, the user operation of selecting the target area may be an operation of the image display device receiving a user input of a target area boundary.

[0115] For example, the user can input the following information in the display window through the mouse, keyboard and other input devices of the image display device: Figure 6 The rectangular area shown in (a) Figure 6 The boundary of the elliptical area or other shape shown in (b) in FIG.

[0116] In another possible implementation, the user operation of selecting the target area may be a user operation of selecting the target object in the display window.

[0117] Therefore, when the image display device receives the user operation, the image display device can obtain the above-mentioned image viewing instruction in response to the user operation, and the first image displayed in the target area of ​​the display window includes the target object.

[0118] The target object may be a person or object included in the first image. For example, the target object may be a person or vehicle appearing in the surveillance scene of the first image. Another example is an abnormal object appearing in the surveillance scene of the first image, such as a fire source or a person with a high body temperature. Alternatively, the target area may be the outline of the target object. Alternatively, the target area may be another area that includes the target object.

[0119] In some embodiments, the image display device determines that the image viewing instruction is obtained when a preset target object or a preset event is detected in the first image.

[0120] The image viewing instruction is used to request viewing a portion of the second image corresponding to the target area in the target area of ​​the display window, and the target area is an area in the display window where an image in which a preset target object or preset event is detected is displayed.

[0121] It should be understood that the preset target objects are pre-set objects to be detected, such as people, vehicles, etc. that appear in the monitoring scene of the first image. The preset events can be events such as fire, abnormal ambient temperature (e.g., too high or too low temperature), circuit / chip failure, etc.

[0122] It should be noted that in this embodiment, the user can pre-set the target object for which the second image should be displayed. Consequently, upon detecting the target object, the image display device automatically receives the upper image viewing instruction and displays the portion of the second image corresponding to the target area containing the target object, without requiring any user interaction. This reduces user interaction and improves the user experience.

[0123] S103 . In response to the received instruction, the image display device displays the partial image corresponding to the target area in the second image in the target area of ​​the display window, so as to display the partial image at a position corresponding to the target area in the first image.

[0124] In one possible implementation, if the display device displays only the first image in the display window, then in response to the received instruction, the image display device obtains a portion of the second image corresponding to the target area, and displays the obtained portion of the image in the target area of ​​the display window. This enables the portion of the image to be displayed at a position in the first image corresponding to the target area.

[0125] In some embodiments, the image display device may replace the first image displayed in the target area with the partial image.

[0126] Optionally, in response to the received instruction, the image display device may obtain one or more pixels of the partial image corresponding to the target area in the second image. Furthermore, the image display device may split the first image into a first sub-image and a second sub-image. The first sub-image is the image displayed in the target area, and the second sub-image is the image displayed in areas other than the target area in the display window. Thus, the image display device may replace the first sub-image with the partial image, and then display an image composed of the second sub-image and the partial image.

[0127] In some embodiments, the image display device may cover the image displayed by the first image in the target area with the partial image.

[0128] Optionally, in response to the received instruction, the image display device may obtain one or more pixels of the partial image corresponding to the target area in the second image. Furthermore, the image display device may place the obtained partial image on top of the first image, with the placement of the partial image corresponding to the location of the target area in the display window. It should be understood that the transparency of the partial image is opaque, so that the image display device can cover the image displayed in the target area of ​​the first image with the partial image.

[0129] In another possible implementation, when the image display device displays the first image and the second image overlappingly in the display window, the image display device can adjust the transparency of the above-mentioned partial image and the transparency of the image corresponding to the target area in the first image to display the partial image corresponding to the target area in the target area of ​​the display window.

[0130] It should be noted that when an image display device displays a first image and a second image in an overlapping manner, the image display device can adjust the transparency of the first image and the second image to display the portion of the second image corresponding to the target area in the display window. In this case, there is no need to fuse or merge the first and second images, which can reduce the delay caused by the fusion or merging process and improve the user experience.

[0131] In some embodiments, when the image display device displays a first image and a second image overlappingly in a display window, and the first image is displayed on an upper layer of the second image, the image display device adjusts the transparency of the image corresponding to the target area in the first image to fully transparent in response to the received instruction, and adjusts the transparency of the above-mentioned partial image to opaque.

[0132] Thus, the image display device can display the partial image corresponding to the target area in the second image in the target area of ​​the display window, so as to realize displaying the partial image at the position corresponding to the target area in the first image.

[0133] It should be understood that when the image display device displays a first image and a second image in an overlapping manner in a display window, and the first image is displayed on top of the second image, when the image display device displays the first image in the display window, the transparency of the first image is opaque, and the second image displayed on the lower layer of the first image cannot be displayed through the first image. Furthermore, when the image display device adjusts the transparency of the image corresponding to the target area in the first image to fully transparent and adjusts the transparency of the aforementioned partial image to opaque, the aforementioned partial image can be displayed in the aforementioned display window through the fully transparent image corresponding to the target area in the first image.

[0134] For example, Figure 7As shown, when the image display device receives an instruction to view the rectangular area in the second image, in response to the instruction, the image display device can set the transparency of the second image in the rectangular area to opaque to display the image of the rectangular area in the second image.

[0135] In some embodiments, when the image display device displays a first image and a second image overlapping in a display window, and the second image is displayed on top of the first image, the image display device adjusts the transparency of the above-mentioned part of the image to opaque in response to the received instruction.

[0136] Thus, the image display device can display the partial image corresponding to the target area in the second image in the target area of ​​the display window, so as to realize displaying the partial image at the position corresponding to the target area in the first image.

[0137] It should be understood that when an image display device displays a first image and a second image overlapping in a display window, with the second image displayed on top of the first image, when the image display device displays the first image in the display window, the transparency of the second image is fully transparent, while the transparency of the first image is opaque, and the first image displayed on the bottom layer of the second image is displayed through the fully transparent second image. Furthermore, when the image display device adjusts the transparency of the aforementioned portion of the image to opaque, the image corresponding to the target area in the first image cannot be displayed through the aforementioned portion of the image, thereby allowing the image display device to display the aforementioned portion of the image in the target area of ​​the display window.

[0138] Based on the image display method provided by the present application, the image display device can first display the first image displayed by default in the display window, and then when the user needs to view the partial image corresponding to the target area in the second image, the partial image is displayed at the position corresponding to the target area in the first image. On the one hand, this method does not limit the size and position of the target area, and the user can select any area on the display window as the above-mentioned target area, that is, the user can freely choose the area to view the second image, so that the user can view the second image of the monitoring scene more conveniently and quickly. On the other hand, the first image and the second image can be different types of monitoring images of the same monitoring scene, so that the image display device displays the partial image corresponding to the target area in the second image at the position corresponding to the target area in the first image, while satisfying the user's normal need to view the first image of the monitoring scene, and can also highlight the partial image corresponding to the target area in the second image. Of course, the image display method provided by the present application can also be applied to Figure 2 In the monitoring system shown. Optionally, Figure 2The server 30 can obtain the first and second images of the surveillance scene captured by the camera 20 and send the obtained first and second images to the client 10, thereby controlling the client 10 to display the received first image in an overlapping manner in the display window. Furthermore, the client 10 can receive a user input requesting that a portion of the second image corresponding to the target area be viewed in the target area of ​​the display window, and send the instruction to the server 30. Thus, in response to the received instruction, the server 30 controls the client 10 to display the portion of the second image corresponding to the target area in the target area of ​​the display window, thereby displaying the portion of the image corresponding to the target area in the first image.

[0139] In this way, the client 10 can directly display the monitoring image sent by the server 30, which can meet the user's demand for viewing the second image or the first image, and reduce the use of computing resources of the client 10 during the image display process.

[0140] The above mainly introduces the solution provided by the present application from the perspective of the method. It is understandable that, in order to realize the above functions, the image display device includes hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the algorithm steps of each example described in the embodiments disclosed herein, the present invention can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0141] The present application can divide the functional modules of the image display device according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in this application is schematic and is only a logical function division. In actual implementation, there may be other division methods.

[0142] Figure 8 FIG. 1 is a schematic diagram showing the composition of an image display device provided by an embodiment of the present application. Figure 8 As shown, the image display device 300 includes a display module 301 and a transceiver module 302 .

[0143] Wherein, the display module 301 is used to display the first image in the display window.

[0144] The transceiver module 302 is used to obtain an image viewing instruction, which is used to request viewing a partial image corresponding to the target area in the second image in the target area of ​​the display window. The partial image is the image displayed in the target area when the second image is displayed through the display window.

[0145] The display module 301 is further configured to display the portion of the image in the target area of ​​the display window in response to an instruction, so as to display the portion of the image at a position corresponding to the target area in the first image.

[0146] In one possible implementation, the display module 301 is specifically configured to display the first image and the second image overlapping in a display window. When the first image is displayed on top of the second image, the display module 301 is further configured to adjust the transparency of the image corresponding to the target area in the first image to fully transparent, and adjust the transparency of part of the image to opaque.

[0147] In another possible implementation, the display module 301 is specifically configured to display the first image and the second image overlappingly in the display window. When the second image is displayed on top of the first image, the display module 301 is further specifically configured to adjust the transparency of part of the image to opaque.

[0148] In another possible implementation, the display module 301 is further specifically configured to: replace the image of the first image displayed in the target area with a partial image; or cover the image of the first image displayed in the target area with the partial image.

[0149] In another possible implementation, the receiving module 302 is specifically configured to: receive a user operation of selecting the target area in the display window, and obtain an image viewing instruction in response to the user operation.

[0150] In another possible implementation, the receiving module 302 is specifically configured to: receive a user operation of selecting a target object in the display window; and in response to the user operation, obtain an image viewing instruction, wherein the first image displayed in the target area of ​​the display window includes the target object.

[0151] For the detailed description of the above optional methods, please refer to the above method embodiments, which will not be repeated here. In addition, the explanation and description of the beneficial effects of any of the above image display devices 300 can refer to the above corresponding method embodiments, which will not be repeated here.

[0152] As an example, combined with Figure 3 , the functions realized by the transceiver module 302 can be achieved by Figure 3 The display module 301 can be realized by the communication line 220 in Figure 3The output device 250 in is implemented, but is certainly not limited to this.

[0153] Figure 8 The units in the can also be called units, for example, the processing module can be called a processing unit. Figure 8 In the illustrated embodiment, the names of the modules may not be the names shown in the figure. For example, the transceiver module may also be called a communication module.

[0154] Figure 8 If the various units in the embodiment are implemented in the form of software function modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The storage medium for storing computer software products includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0155] It should be noted that Figure 8 The module division described is illustrative and represents only one logical functional division. Actual implementations may employ different divisions. For example, two or more functions may be integrated into a single processing module. These integrated modules may be implemented as either hardware or software functional modules.

[0156] The present application also provides a computer-readable storage medium including computer-executable instructions, which, when executed on a computer, enables the computer to execute any one of the methods provided in the above embodiments. For example, Figure 4 One or more features of S101 to S103 may be performed by one or more computer-executable instructions stored in the computer-readable storage medium.

[0157] An embodiment of the present application further provides a computer program product comprising computer-executable instructions, which, when executed on a computer, enables the computer to execute any one of the methods provided in the above embodiments.

[0158] An embodiment of the present application also provides a chip, including: a processor and an interface, the processor is coupled to a memory through the interface, and when the processor executes a computer program or computer execution instruction in the memory, any one of the methods provided in the above embodiments is executed.

[0159] An embodiment of the present application further provides a computer-readable storage medium, comprising computer-executable instructions, which, when executed on a computer, enables the computer to execute any one of the methods provided in the above embodiments.

[0160] An embodiment of the present application further provides a computer program product comprising computer-executable instructions, which, when executed on a computer, enables the computer to execute any one of the methods provided in the above embodiments.

[0161] An embodiment of the present application also provides a chip, including: a processor and an interface, the processor is coupled to a memory through the interface, and when the processor executes a computer program or computer execution instruction in the memory, any one of the methods provided in the above embodiments is executed.

[0162] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using a software program, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer-executable instructions. When the computer-executable instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer-executable instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer-executable instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more media integrated therein. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)).

[0163] Although the present application is described herein in conjunction with various embodiments, in the process of implementing the claimed application, those skilled in the art may understand and implement other variations of the disclosed embodiments by reviewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple situations. A single processor or other unit may implement several functions listed in the claims. Certain measures are recorded in different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0164] Although the present application has been described with reference to specific features and embodiments thereof, it is apparent that various modifications and combinations may be made thereto without departing from the spirit and scope of the present application. Accordingly, this specification and the drawings are merely illustrative of the present application as defined by the appended claims and are deemed to cover any and all modifications, variations, combinations or equivalents within the scope of the present application. Obviously, those skilled in the art may make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, the present application is intended to include such modifications and variations as fall within the scope of the claims of the present application and their equivalents.

[0165] The above is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or replacements within the technical scope disclosed in the present application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. An image display method, characterized in that: The method comprises: displaying a first image in a display window; Obtaining an image viewing instruction, the image viewing instruction being used to request viewing a portion of the second image corresponding to the target area in the target area of ​​the display window; the portion of the image being the image displayed in the target area when the second image is displayed through the display window; the first image and the second image being captured at the same time or at different times with respect to the same shooting scene, one being a visible light image and the other being a thermal imaging image; The acquiring of the image viewing instruction includes: when a preset target object or a preset event is detected in the first image, determining that the image viewing instruction is acquired, wherein the target area is an area in the display window where the image in which the preset target object or the preset event is detected is displayed; or The acquiring of the image viewing instruction comprises: receiving a user operation of selecting a target object in the display window; acquiring the image viewing instruction in response to the user operation; wherein the first image includes the target object in an image displayed in a target area of ​​the display window; In response to the instruction, displaying the partial image in the target area in the display window, so as to display the partial image at a position corresponding to the target area in the first image; The displaying of the first image in the display window includes: Overlappingly displaying the first image and the second image in the display window; When the first image is displayed on an upper layer of the second image, the transparency of the first image is opaque; displaying the partial image in the target area in the display window includes: adjusting the transparency of the image corresponding to the target area in the first image to fully transparent, and adjusting the transparency of the partial image to opaque; When the second image is displayed on the upper layer of the first image, the transparency of the first image is opaque and the transparency of the second image is fully transparent; then displaying the partial image in the target area in the display window includes: adjusting the transparency of the partial image to opaque.

2. The method according to claim 1, characterized in that Displaying the portion of the image at a position corresponding to the target area in the display window includes: replacing the image of the first image displayed in the target area with the partial image; or, The image displayed in the target area by the first image is covered by the partial image.

3. An image display device, characterized in that: The device comprises: A display module, configured to display a first image in a display window; a transceiver module configured to obtain an image viewing instruction, wherein the image viewing instruction is configured to request viewing of a portion of a second image corresponding to a target area in the display window; the portion of the image being an image displayed in the target area when the second image is displayed through the display window; the first image and the second image being captured at the same time or at different times with respect to the same shooting scene, one of the images being a visible light image and the other being a thermal imaging image; The transceiver module is specifically configured to: determine that an image viewing instruction is obtained when a preset target object or a preset event is detected in the first image, and the target area is an area in the display window where the image in which the preset target object or the preset event is detected is displayed; or The transceiver module is specifically configured to: receive a user operation of selecting a target object in the display window; obtain the image viewing instruction in response to the user operation; and the first image includes the target object in an image displayed in a target area of ​​the display window; The display module is further configured to display the partial image in the target area in the display window in response to the instruction, so as to display the partial image at a position corresponding to the target area in the first image; The display module is specifically configured to: display the first image and the second image overlappingly in the display window; When the first image is displayed on an upper layer of the second image, the transparency of the first image is opaque; the display module is further specifically configured to: adjust the transparency of the image corresponding to the target area in the first image to fully transparent, and adjust the transparency of the portion of the image to opaque; When the second image is displayed on an upper layer of the first image, the transparency of the first image is opaque and the transparency of the second image is fully transparent; the display module is further specifically configured to adjust the transparency of the partial image to opaque.

4. The image display device according to claim 3, wherein The display module is further specifically used for: replacing the image of the first image displayed in the target area with the partial image; or, The image displayed in the target area by the first image is covered by the partial image.

5. An electronic device, characterized in that: The electronic device includes a memory and a processor; the memory and the processor are coupled; the memory is used to store computer program code, and the computer program code includes computer instructions; When the processor executes the computer instructions, the electronic device executes the image display method according to any one of claims 1 to 2.

6. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the image display method according to any one of claims 1 to 2.

Images