Image processing method, device, equipment and computer readable storage medium

Abstract

The present invention discloses an image processing method, device, equipment and computer-readable storage medium, the method comprising: responding to an image viewing operation triggered by a user on a display device, and determining feature information of a first image area corresponding to the image viewing operation in an object detection image acquired by an image acquisition device; acquiring first image data, the first image data being extracted from the object detection image data based on the feature information and uploaded to the image processing device at a specific upload frequency; rendering the first image data, and sending the image rendering result to the display device for display, thereby reducing computing resource consumption without affecting the image display effect perceived by the user.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to an image processing method, device, equipment and computer-readable storage medium. Background Art

[0002] At present, in many fields, it is necessary to collect, process and display images in real time. For example, when detecting objects based on X-ray imaging, ultrasonic imaging and other technologies, the image of the object is collected by the image acquisition device and displayed to the user in real time, so that the user can detect the details of the object. At present, the data collected by the image acquisition device needs to be processed by software before being displayed. When the user needs to view a part of the area, all the data collected by the image acquisition device still needs to be processed, resulting in a waste of computing resources. Summary of the invention

[0003] The main purpose of the present invention is to provide an image processing method, device, equipment and computer-readable storage medium, aiming to solve the technical problem that when a user needs to view a partial area, all data collected by the image acquisition device still needs to be processed, resulting in a waste of computing resources.

[0004] To achieve the above object, the present invention provides an image processing method, which comprises the following steps:

[0005] In response to an image viewing operation triggered by a user on a display device, determining feature information of a first image region corresponding to the image viewing operation in an object detection image acquired by an image acquisition device;

[0006] Acquire first image data, where the first image data is extracted from the object detection image data according to the feature information and uploaded to the image processing device at a specific upload frequency;

[0007] The first image data is rendered, and the image rendering result is sent to the display device for display.

[0008] Optionally, in the process of extracting the first image data from the object detection image data according to the feature information, acquisition parameters of the image acquisition device for acquiring the object detection image remain unchanged; the acquisition parameters include at least an acquisition frequency and a size of a perception area of ​​the image acquisition device on a placement plane; the placement plane is used to carry the object to be detected.

[0009] Optionally, the feature information includes position information of the first image area in the object detection image, and / or image feature information of displayed content in the first image area; the image feature information is used to describe displayed content in the first image area;

[0010] The method further comprises:

[0011] The feature information is sent to the image acquisition device, so that the image acquisition device extracts the first image data from the object detection image data according to the feature information and uploads it to the image processing device at a specific upload frequency.

[0012] Optionally, the first image data is extracted from the second image data according to the feature information, wherein:

[0013] The second image data is image data corresponding to the first specific frame image in the later acquisition sequence among the multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time, or,

[0014] The second image data is image data corresponding to a second specific frame image whose image quality meets the preset quality requirement among the multiple frames of object detection images acquired by the image acquisition device within the preset acquisition time, or,

[0015] The second image data is image data corresponding to a fused image obtained by fusion processing of multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time;

[0016] The first specific frame image, the second specific frame image or the fused image all include display content in the first image area.

[0017] Optionally, the feature information includes position information of the first image area in the object detection image, and determining the feature information of the first image area corresponding to the image viewing operation in the object detection image acquired by the image acquisition device includes:

[0018] Determine first coordinate information of a preset number of first feature points in a first image area corresponding to the image viewing operation in a preset image coordinate system;

[0019] Based on the image adjustment coefficient corresponding to the image viewing operation, determine the second coordinate information of a preset number of second feature points in the operation image corresponding to the image viewing operation in the preset image coordinate system; wherein the size of the operation image is the same as the size of the object detection image acquired by the image acquisition device, and the image adjustment coefficient includes an image magnification or image reduction ratio of the first image area relative to the operation image;

[0020] Based on the first coordinate information and the second coordinate information, position information of the first image area in the object detection image acquired by the image acquisition device is determined.

[0021] Optionally, determining, based on the first coordinate information and the second coordinate information, position information of the first image area in the object detection image acquired by the image acquisition device includes:

[0022] Based on the first coordinate information and the second coordinate information, the relative position relationship of the first image area with respect to the operation image and the size information of the first image area are determined, so as to use the relative position relationship and the size information of the first image area as the position information of the first image area in the object detection image.

[0023] Optionally, determining, based on the first coordinate information and the second coordinate information, position information of the first image area in the object detection image acquired by the image acquisition device includes:

[0024] Determine a position offset of the object detection image acquired by the image acquisition device relative to the operation image corresponding to the image viewing operation in the preset image coordinate system;

[0025] Determine candidate position information of the first image area in the object detection image based on the first coordinate information and the second coordinate information;

[0026] The candidate position information is corrected using the position offset to obtain position information of the first image area in the object detection image.

[0027] Optionally, if the image viewing operation includes an image moving operation, the method further includes:

[0028] Monitoring an image movement rate corresponding to the image movement operation;

[0029] If the image moving rate is greater than a rate threshold, determining that the specific uploading frequency is less than an uploading frequency threshold;

[0030] or,

[0031] If the image moving rate is less than the rate threshold, it is determined that the specific uploading frequency is greater than the uploading frequency threshold.

[0032] To achieve the above object, the present invention further provides an image processing device, which is deployed in an image processing device, and the device includes:

[0033] a determination module, configured to respond to an image viewing operation triggered by a user on a display device and determine feature information of a first image region corresponding to the image viewing operation in an object detection image acquired by an image acquisition device;

[0034] an acquisition module, used for acquiring first image data, wherein the first image data is extracted from the object detection image data according to the feature information and uploaded to the image processing device at a specific upload frequency;

[0035] The processing module is used to render the first image data and send the image rendering result to the display device for display.

[0036] To achieve the above-mentioned purpose, the present invention also provides an image processing device, which includes: a memory, a processor, and an image processing program stored in the memory and executable on the processor, wherein the image processing program implements the steps of the image processing method described above when executed by the processor.

[0037] In addition, to achieve the above-mentioned purpose, the present invention further proposes a computer-readable storage medium, on which an image processing program is stored, and when the image processing program is executed by a processor, the steps of the image processing method described above are implemented.

[0038] In the present invention, when the user triggers the image viewing operation on the display device, the characteristic information of the first image area corresponding to the image viewing operation in the object detection image collected by the image acquisition device is determined; the first image data extracted from the object detection image data according to the characteristic information and uploaded to the image processing device according to a specific upload frequency is obtained; the first image data is rendered, and the image rendering result is sent to the display device for display. In this way, not only can the image acquisition device acquire clear images according to user needs without affecting the user's perception of the image display effect, but also the computing resources consumed by the image processing device during image processing can be effectively reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 A schematic diagram of the structure of the hardware operating environment involved in the embodiment of the present invention;

[0040] Figure 2 Schematic diagram of the process of the image processing method of the present invention;

[0041] Figure 3 A schematic diagram of an image display related to an embodiment of the image processing method of the present invention;

[0042] Figure 4 Schematic diagram of functional modules of a preferred embodiment of the image processing device of the present invention.

[0043] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0044] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0045] like Figure 1 As shown, Figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention.

[0046] It should be noted that the image processing device in the embodiment of the present invention can be a smart phone, a personal computer, a server or other device, and no specific limitation is made here.

[0047] like Figure 1 As shown, the image processing device may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0048] Those skilled in the art will understand that Figure 1 The device structure shown in the figure does not constitute a limitation on the image processing device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0049] like Figure 1 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an image processing program. The operating system is a program that manages and controls the hardware and software resources of the device and supports the operation of the image processing program and other software or programs. Figure 1 In the device shown, the user interface 1003 is mainly used for data communication with the client; the network interface 1004 is mainly used for establishing a communication connection with the server; and the processor 1001 can be used to call the image processing program stored in the memory 1005 and perform the following operations:

[0050] In response to an image viewing operation triggered by a user on a display device, determining feature information of a first image region corresponding to the image viewing operation in an object detection image acquired by an image acquisition device;

[0051] Acquire first image data, where the first image data is extracted from the object detection image data according to the feature information and uploaded to the image processing device at a specific upload frequency;

[0052] The first image data is rendered, and the image rendering result is sent to the display device for display.

[0053] Furthermore, in the process of extracting the first image data from the object detection image data according to the feature information, acquisition parameters of the image acquisition device for acquiring the object detection image remain unchanged; the acquisition parameters at least include an acquisition frequency and a size of a perception area of ​​the image acquisition device on a placement plane; the placement plane is used to carry the object to be detected.

[0054] Further, the feature information includes position information of the first image area in the object detection image, and / or image feature information of displayed content in the first image area; the image feature information is used to describe displayed content in the first image area;

[0055] The processor 1001 may also be used to call the image processing program stored in the memory 1005 to perform the following operations:

[0056] The feature information is sent to the image acquisition device, so that the image acquisition device extracts the first image data from the object detection image data according to the feature information and uploads it to the image processing device at a specific upload frequency.

[0057] Furthermore, the first image data is extracted from the second image data according to the feature information, wherein:

[0058] The second image data is image data corresponding to the first specific frame image in the later acquisition sequence among the multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time, or,

[0059] The second image data is image data corresponding to a second specific frame image whose image quality meets the preset quality requirement among the multiple frames of object detection images acquired by the image acquisition device within the preset acquisition time, or,

[0060] The second image data is image data corresponding to a fused image obtained by fusion processing of multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time;

[0061] The first specific frame image, the second specific frame image or the fused image all include display content in the first image area.

[0062] Further, the feature information includes position information of the first image area in the object detection image, and determining the feature information of the first image area corresponding to the image viewing operation in the object detection image acquired by the image acquisition device includes:

[0063] Determine first coordinate information of a preset number of first feature points in a first image area corresponding to the image viewing operation in a preset image coordinate system;

[0064] Based on the image adjustment coefficient corresponding to the image viewing operation, determine the second coordinate information of a preset number of second feature points in the operation image corresponding to the image viewing operation in the preset image coordinate system; wherein the size of the operation image is the same as the size of the object detection image acquired by the image acquisition device, and the image adjustment coefficient includes an image magnification or image reduction ratio of the first image area relative to the operation image;

[0065] Based on the first coordinate information and the second coordinate information, position information of the first image area in the object detection image acquired by the image acquisition device is determined.

[0066] Further, based on the first coordinate information and the second coordinate information, determining the position information of the first image area in the object detection image acquired by the image acquisition device includes:

[0067] Based on the first coordinate information and the second coordinate information, the relative position relationship of the first image area with respect to the operation image and the size information of the first image area are determined, so as to use the relative position relationship and the size information of the first image area as the position information of the first image area in the object detection image.

[0068] Further, based on the first coordinate information and the second coordinate information, determining the position information of the first image area in the object detection image acquired by the image acquisition device includes:

[0069] Determine a position offset of the object detection image acquired by the image acquisition device relative to the operation image corresponding to the image viewing operation in the preset image coordinate system;

[0070] Determine candidate position information of the first image area in the object detection image based on the first coordinate information and the second coordinate information;

[0071] The candidate position information is corrected using the position offset to obtain position information of the first image area in the object detection image.

[0072] Further, if the image viewing operation includes an image moving operation, the method further includes:

[0073] Monitoring an image movement rate corresponding to the image movement operation;

[0074] If the image moving rate is greater than a rate threshold, determining that the specific uploading frequency is less than an uploading frequency threshold;

[0075] or,

[0076] If the image moving rate is less than the rate threshold, it is determined that the specific uploading frequency is greater than the uploading frequency threshold.

[0077] Based on the above structure, various embodiments of the image processing method are proposed.

[0078] Reference Figure 2 , Figure 2 Schematic diagram of the process of the image processing method of the present invention.

[0079] The embodiments of the present invention provide embodiments of the image processing method. It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in an order different from that here. In this embodiment, the executor of the image processing method is an image processing device, or the executor may also be a device or apparatus for controlling the image acquisition device, such as a smart phone, a personal computer, a server, or the like connected to the image acquisition device, which is not limited in this embodiment. For ease of explanation and understanding, the following description of each embodiment is based on an image processing device instead of the above-mentioned executor. In this embodiment, the image processing method includes:

[0080] Step S10, responding to an image viewing operation triggered by a user on a display device, and determining feature information of a first image region corresponding to the image viewing operation in an object detection image acquired by an image acquisition device;

[0081] In this embodiment, the user triggers the image viewing operation through the user graphical interface output by the display device, and the image processing device responds when the user triggers the image viewing operation, thereby determining the first image area selected by the user when triggering the image viewing operation, and determining the feature information of the first image area in the object detection image acquired by the image acquisition device. The feature information may include the position information and / or image feature information of the first image area in the object detection image.

[0082] In this embodiment, the image viewing operation refers to the operation related to image viewing performed by the user through the user graphical interface, such as opening an image, enlarging an image, reducing an image, moving an image, or selecting a portion of an image, etc., which is not limited in this embodiment.

[0083] In addition, the image acquisition device can be an image acquisition device that can be used to acquire image data and output the image data for real-time display by the display device, for example, it can be an image acquisition device based on X-ray imaging, an image acquisition device based on ultrasonic imaging, etc., which is not limited in this embodiment. For example, the embodiment of the present application can be applied to the scene of detecting objects based on X-ray imaging or detecting objects using camera imaging, and the image acquired by the X-ray detection device or the camera is the object detection image.

[0084] Step S20, obtaining first image data, where the first image data is extracted from the object detection image data according to the feature information and uploaded to the image processing device at a specific upload frequency;

[0085] In this embodiment, in a specific implementation, after determining the above-mentioned characteristic information, the image processing device may first transmit the characteristic information to the image acquisition device, so that the image acquisition device extracts the first image data from the item detection image data corresponding to the item detection image according to the characteristic information during the process of acquiring the image to obtain the item detection image, and then the image acquisition device uploads the first image data to the image processing device according to a specific upload frequency, so that the image processing device obtains the first image data. In another specific implementation, after determining the above-mentioned characteristic information, the image processing device may also first transmit the characteristic information to an image data extraction device specifically used to extract image data, and the image data extraction device extracts the first image data from the item detection image obtained from the image acquisition device according to the acquired characteristic information, and uploads it to the image processing device according to a specific upload frequency. The various virtual modules mentioned in the embodiments of the present application may be integrated in the same hardware device or in different hardware devices, and data communication is supported between the various virtual modules.

[0086] In this embodiment, the object detection image includes an image of the collected object, and the collected object is within the sensing area of ​​the image acquisition device. For example, when object detection is performed based on X-ray imaging, the detected object is the collected object.

[0087] It should be noted that, in some feasible implementations, when the image acquisition device extracts the first image data from the object detection image data according to the feature information, the acquisition parameters of the image acquisition device for acquiring the object detection image remain unchanged. That is, the embodiment of the present application can achieve that the acquisition state of the image acquisition device is not adjusted during the process of dynamically determining the processing data of the image processing device according to the user's image viewing operation.

[0088] In this embodiment, the acquisition parameters at least include but are not limited to the acquisition frequency, the size of the sensing area of ​​the image acquisition device on the placement plane, exposure parameters and other information, which are not specifically limited in this embodiment of the application; the placement plane is used to carry the objects to be detected.

[0089] The perception area of ​​the image acquisition device refers to the range of the image area that the image acquisition device can capture, which can be compared to the range that the human eye can see. In the process of controlling the image acquisition device to capture image data, the captured object may change its position in the perception area of ​​the image acquisition device; the reason for this phenomenon may be that the perception area of ​​the image acquisition device is stationary (for example, relative to the earth's reference system) while the position of the captured object changes, which is similar to the situation that the head and eyeballs of a person are stationary while the position of the observed object changes; the reason for this phenomenon may also be that the position of the captured object is stationary (for example, relative to the earth's reference system) while the perception area of ​​the image acquisition device changes, which is similar to the situation that the head or eyeballs of a person are rotating while the position of the observed object remains unchanged.

[0090] In a specific implementation, the first image data can be extracted from a frame of object detection image most recently captured by an image acquisition device, or a specific image frame can be determined from multiple frames of images captured within a preset time period as needed, and the first image data can be extracted from the specific image frame. This is not limited in the present embodiment.

[0091] The specific method of extracting the first image data from the object detection image according to the characteristic information is not limited in this embodiment. For example, in one embodiment, when the characteristic information includes the position information of the first image area in the object detection image, the image data of the area corresponding to the position information can be extracted from the object detection image data as the first image data. In another embodiment, when the characteristic information includes image characteristic information, the image data containing the image characteristic information can be extracted from the object detection image data as the first image data; further, in order to meet the display requirements of the display device, the display size of the display device or the size of the first image area can be obtained, and the image data corresponding to the size (for example, the size of the extracted image area is adapted to the display size of the display device, which can achieve the effect of full-screen or full-interface display, or the required image area is extracted according to the size of the first image area) and containing the image characteristic information is extracted from the object detection image data as the first image data. In another embodiment, when the characteristic information includes image characteristic information and position information of the first image area in the object detection image, image data containing the image characteristic information can be extracted from the object detection image, and image data whose position is closest to the position information (for example, is completely the same as the position information or the position error with the position information is within an allowable error range) can be extracted from the image data as the first image data.

[0092] Step S30, rendering the first image data, and sending the image rendering result to the display device for display.

[0093] In this embodiment, after acquiring the above-mentioned first image data, the image processing device immediately renders the first image data, and then sends the image rendering result after rendering the first image data to the display device triggered by the user to view the image, so that the display device displays the corresponding image.

[0094] It should be noted that, in some embodiments, the feature information of the first image area in the object detection image includes: position information of the first image area in the object detection image, and / or image feature information of the content displayed in the first image area.

[0095] In this embodiment, the image feature information is used to describe the display content in the first image area. For example, the image feature information is the object outline, texture features, pixels of the object area, color information of the object area, etc., to describe the display content in the first image area - such as the above-mentioned collected object.

[0096] Based on this, the image processing method provided by the present invention further includes:

[0097] The feature information is sent to the image acquisition device, so that the image acquisition device extracts the first image data from the object detection image data according to the feature information and uploads it to the image processing device at a specific upload frequency.

[0098] In this embodiment, after determining the characteristic information of the first image area in the object detection image, including position information and / or image characteristic information, the image processing device can further transmit the position information and / or image characteristic information to the image acquisition device, so that after receiving the position information and / or image characteristic information, the image acquisition device, that is, in the process of performing image acquisition on the collected object, extracts the first image data from the collected object detection image data according to the position information and / or image characteristic information, and uploads the first image data to the image processing device at a specific upload frequency, so that the image processing device can perform subsequent rendering processing on the first image data.

[0099] In addition, in this embodiment, in order to solve the problem that the image acquisition device always uses a higher acquisition frequency for image acquisition, which consumes a lot of computing resources, a solution is proposed to set the image acquisition frequency according to the position change data of the acquired object in the perception area of ​​the image acquisition device.

[0100] Specifically, during the process of the image acquisition device acquiring images, position change data of the captured object in the sensing area of ​​the image acquisition device is obtained. The acquisition frequency of the image acquisition device is set according to the position change data, so as to control the image acquisition device to acquire the image of the captured object according to the set acquisition frequency to obtain the first image data. Wherein, when the position change data indicates that the captured object has a position change in the sensing area of ​​the image acquisition device, the acquisition frequency set is less than the acquisition frequency when the captured object is stationary in the sensing area of ​​the image acquisition device.

[0101] In this embodiment, the position change data is data that can characterize whether the position of the captured object changes in the perception area of ​​the image acquisition device; in one implementation, the position change data can be the moving speed of the captured object in the perception area of ​​the image acquisition device, and when the speed is greater than 0, it indicates that the position of the captured object in the image acquisition device has changed; in another implementation, the position change data can be data indicating whether the position of the captured object changes in the perception area of ​​the image acquisition device, for example, "1" indicates that a position change occurs, and "0" indicates that no position change occurs (that is, it is stationary in the perception area).

[0102] The method of acquiring the position change data varies according to the image acquisition device used in the specific implementation, and is not limited in this embodiment. For example, in one implementation, when the image acquisition device is fixed and the captured object can be controlled to change position relative to the image acquisition device, control data can be acquired from the device that controls the position change of the captured object, and the position change data can be determined based on the control data. For example, the control data can be the moving speed of the device that installs or places the captured object, and the moving speed can be directly used as the position change data.

[0103] The position change data may be actively acquired in real time or at a fixed time, or may be passively received and reported, and there is no limitation in this embodiment. For example, in one embodiment, the control data may be acquired from the control device of the collected object at regular intervals (the shorter the interval, the higher the real-time performance); the control device may feedback the control data upon receiving the acquisition request, and the acquired position change data may indicate that the collected object has changed its position in the sensing area, or may indicate that the collected object is stationary in the sensing area; or the control data may be fed back only when the control data indicates that the collected object has changed its position upon receiving the acquisition request. In another embodiment, the control device of the collected object may actively report the control data, and the position change data may be determined based on the control data; the control device may report the control data once at regular intervals, and the acquired position change data may indicate that the collected object has changed its position in the sensing area, or may indicate that the collected object is stationary in the sensing area; the control device may also report the control data only when the position of the collected object changes.

[0104] After acquiring the position change data, the acquisition frequency of the image acquisition device is set according to the position change data. The set acquisition frequency may be the number of image data frames acquired per second, or may be other data forms that can represent the number of image data frames acquired per second, for example, data related to the acquisition interval between two adjacent frames of image data.

[0105] It should be noted that when setting the acquisition frequency according to the position change data, it is necessary to ensure that the acquisition frequency set when the position change data indicates that the position of the collected object has changed in the perception area is lower than the acquisition frequency when the collected object is stationary in the perception area. In this embodiment, there is no limitation on the specific setting method of the acquisition frequency, and any setting method that can make the acquisition frequency set when the position change data indicates that the position of the collected object has changed in the perception area lower than the acquisition frequency when the collected object is stationary in the perception area can be adopted. For example, in one embodiment, when the position change data indicates that the position of the collected object has changed in the perception area, the acquisition frequency is directly set to the lowest acquisition frequency that the image acquisition device can achieve, and the acquisition frequency when the collected object is stationary in the perception area is higher than the lowest acquisition frequency.

[0106] The acquisition frequency when the object is stationary in the perception area can be a pre-selected frequency value, for example, it can be the maximum acquisition frequency that the selected image acquisition device can achieve, or it can be selected based on the user's demand for image clarity. When the user has higher requirements for clarity, a higher acquisition frequency can be selected, and when the user has lower requirements for clarity, a lower acquisition frequency can be selected.

[0107] The manner of setting the acquisition frequency when the collected object is stationary in the perception area is not limited in this embodiment. For example, in one embodiment, when the position change data may be data representing the position change of the collected object in the perception area, the acquisition frequency may be set to the pre-selected acquisition frequency when the collected object is stationary in the perception area if the next position change data is not received within a certain period of time after the position change data is received. In another embodiment, when the position change data may represent that the collected object has a position change in the perception area, or may represent that the collected object is stationary in the perception area, the acquisition frequency may be set to the pre-selected acquisition frequency when the collected object is stationary in the perception area when the position change data representing that the collected object is stationary in the perception area is received.

[0108] It should be noted that, in some embodiments, when using an image acquisition device to acquire image data, the acquisition frequency when the acquired object is stationary in the perception area can be dynamically changed according to user needs. Based on this, when setting the acquisition frequency according to the position change data, when the position change data represents a position change of the acquired object in the perception area, the current acquisition frequency when the acquired object is stationary in the perception area can be used as the standard speed, and the set acquisition frequency can be lower than this standard speed.

[0109] The principle of solving the problem in this embodiment is: the original data collected by the image acquisition device is processed by software to obtain image data. In order to obtain clearer image data, the image acquisition device needs to collect data at a higher acquisition frequency, so as to obtain more and richer original acquisition data to assist the software processing to obtain clearer image data; and in the image display process, it is found that when the user needs to view different areas of the collected object and uses the control function provided by the control device to control the change of the perception area of ​​the image acquisition device or the change of the position of the collected object, even if the acquisition is performed at a higher acquisition frequency, because the position of the collected object changes in the perception area of ​​the image acquisition device, the collected original acquisition data contains complex displacement data of the collected object, and the computing and processing resources are consumed more, and the image clarity cannot be improved. The image quality is obviously improved; and at this time, the user often needs to see the image of the captured object after it is stabilized in the perception area of ​​the image acquisition device, and the requirement for the image clarity during the position change is not high; therefore, in this embodiment, the acquisition frequency when the position of the captured object changes in the perception area of ​​the image acquisition device is set to be lower than the level when the captured object is stationary in the perception area of ​​the image acquisition device, so as to ensure that the image clarity meets the user's requirements with the higher acquisition frequency when the captured object is stationary in the perception area of ​​the image acquisition device. At the same time, at this clarity level, the acquisition frequency when the position of the captured object changes in the perception area of ​​the image acquisition device is lowered, so that the computing resources consumed in the image data acquisition process and the image display process can be reduced without affecting the image display effect felt by the user.

[0110] In the present invention, when the user triggers the image viewing operation on the display device, the characteristic information of the first image area corresponding to the image viewing operation in the object detection image collected by the image acquisition device is determined; the first image data extracted from the object detection image data according to the characteristic information and uploaded to the image processing device according to a specific upload frequency is obtained; the first image data is rendered, and the image rendering result is sent to the display device for display. In this way, not only can the image acquisition device acquire clear images according to user needs without affecting the user's perception of the image display effect, but also the computing resources consumed by the image processing device during image processing can be effectively reduced.

[0111] Furthermore, in this embodiment, the above-mentioned first image data is extracted from the second image data based on the feature information, wherein the second image data is image data corresponding to the first specific frame image in the later acquisition order among the multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time.

[0112] In this embodiment, after the image processing device transmits the determined feature information: the position information of the first image area in the object detection image, and / or the image feature information of the display content in the first image area, to the image acquisition device, the image acquisition device can acquire multiple frames of object detection images containing the object to be acquired within a preset time during the acquisition process of the object detection image acquisition for the object to be acquired through the above acquisition parameters: including the acquisition frequency, the size of the sensing area and other information, and then the image acquisition device can sort the acquired multiple frames of object detection images according to the acquisition time, so that the frame of object detection image (for example, the last frame of object detection image, which can be selected according to the number of image frames) arranged in sequence in the multiple frames of object detection images is used as the first specific frame image, and the image data corresponding to the first specific frame image is determined as the second image data to extract the first image data according to the above feature information: including the position information and / or the image feature information. The image frame with the later acquisition time is relatively close to the image display time, which helps to achieve the effect of close acquisition and display synchronization.

[0113] Alternatively, in this embodiment, the second image data is image data corresponding to a second specific frame image whose image quality meets preset quality requirements among multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time.

[0114] In this embodiment, the image acquisition device can obtain in advance the quality requirements that the captured object detection image must meet. Therefore, in the process of acquiring the image of the captured object by using the above-mentioned acquisition parameters within the preset acquisition time to obtain the object detection image, the image acquisition device detects whether each frame of the captured object detection image meets the quality requirements, and after detecting that a certain frame of the object detection image meets the quality requirements, the frame of the object detection image is determined as the second specific frame image, and the image data corresponding to the second specific frame image is determined as the second image data for the subsequent process of extracting the first image data according to the above-mentioned feature information.

[0115] In this embodiment, the preset quality requirements may be uploaded by the user to the image acquisition device in advance, and the quality requirements may be requirements such as the clarity or resolution, brightness, hue, contrast, and size of the object detection image obtained by the image acquisition device for the captured object, which are not specifically limited in this embodiment. The image quality meeting the preset quality requirements may include, for example, that the resolution, brightness, hue, and contrast of the image reach corresponding preset thresholds, etc.

[0116] Alternatively, the second image data is the image data corresponding to the fused image obtained after the fusion processing of multiple frames of object detection images collected by the image acquisition device within the preset acquisition time. In this embodiment, after the image acquisition device performs image acquisition on the collected object by using the above-mentioned acquisition parameters within the preset acquisition time to obtain multiple frames of object detection images, it further performs fusion processing on the multiple frames of object detection images. Then, the image acquisition device determines the image data corresponding to the fused image obtained after the fusion processing of the multiple frames of object detection images as the second image data for the subsequent process of extracting the first image data according to the above-mentioned feature information. The image fusion processing can be implemented with reference to the prior art, and the embodiment of the present application is not specifically limited. By fusing multiple frames of images to obtain a fused image and extracting the first image data as the second image, the characteristics of different frames of images can be combined to obtain a fused image with a higher display effect, thereby improving the image display quality corresponding to the first image data.

[0117] It should be noted that, in this embodiment, the preset acquisition time can be a time period preset by the user for the image acquisition device to acquire the object detection image for the above-mentioned object to be acquired. The image acquisition device can specifically acquire the same object to be acquired or multiple different objects to be acquired cyclically according to the time period to acquire the object detection image corresponding to the object to be acquired. In this example, the specific size of the preset acquisition time can be reasonably set based on different design requirements of actual applications (such as different performance of the image acquisition device itself, etc.), and this embodiment does not make specific limitations. In addition, the above-mentioned first specific frame image, second specific frame image or fused image each include the display content in the above-mentioned first image area - such as the above-mentioned object to be acquired.

[0118] It should be noted that the above-mentioned process of extracting the first image data using the image acquisition device as the execution subject is exemplified and should not be understood as a specific limitation on the embodiments of the present application, and the extraction of the first image data may also be performed by a dedicated image data extraction device. For example, the image data extraction device extracts the first image data from the object detection image obtained from the image acquisition device based on the acquired feature information, and uploads it to the image processing device at a specific upload frequency.

[0119] Further, in this embodiment, the feature information includes position information of the first image region in the object detection image. In the above step S10, the step of "determining feature information of the first image region corresponding to the image viewing operation in the object detection image acquired by the image acquisition device" may include:

[0120] Step S101, determining first coordinate information of a preset number of first feature points in a first image area corresponding to the image viewing operation in a preset image coordinate system;

[0121] It should be noted that, in this embodiment, the preset number of first feature points in the first image area may be any feature points that can be used to characterize the position of the image area, for example, two diagonal vertices in the first image area, or the preset number of first feature points may be four diagonal vertices in the first image area, which is not specifically limited in this embodiment. In addition, the preset image coordinate system may be a coordinate system with the lower left corner of the image captured by the image acquisition device as the coordinate origin, and the image width direction and height direction as the two coordinate axis directions, or may be an image coordinate system flexibly set according to processing requirements, which is not specifically limited in this embodiment.

[0122] Step S102, based on the image adjustment coefficient corresponding to the image viewing operation, determining second coordinate information of a preset number of second feature points in the operation image corresponding to the image viewing operation in the preset image coordinate system; wherein the size of the operation image is the same as the size of the object detection image acquired by the image acquisition device, and the image adjustment coefficient includes an image magnification or image reduction ratio of the first image area relative to the operation image;

[0123] In this embodiment, the operation image corresponding to the image of the original size collected by the image acquisition device when the user triggers the image viewing operation in the display device is an image corresponding to the original size. The preset number of second feature points in the operation image can be any feature points that can be used to characterize the position of the operation image, for example, two diagonal vertices or four diagonal vertices of the operation image. After determining the first coordinate information of the preset number of first feature points in the first image area in the preset image coordinate system, the image processing device further determines the second coordinate information of the two diagonal vertices or four diagonal vertices in the operation image in the same preset image coordinate system based on the image magnification or image reduction of the first image area corresponding to the image viewing operation triggered by the user in the display device relative to the operation image. The image magnification or image reduction can be calculated based on the original size image collected by the image acquisition device. For example, after the image acquisition device collects the object detection image, the display device displays the object detection image in full. When the user triggers the image viewing operation, the object detection image displayed by the display device is the operation image. The display device can display the image area after magnification or reduction based on the image adjustment coefficient corresponding to the image viewing operation.

[0124] It should be noted that, in this embodiment, when the user triggers an image zoom-in or zoom-out operation, the operating image to which the first image area belongs also performs an image zoom-in or zoom-out operation at the same time. The above-mentioned image adjustment coefficient: image magnification factor or image reduction factor is associated with the operating image used as a reference. For example, the main display window in the user graphical interface displayed by the display device currently displays an enlarged image area. If the user selects the image area to trigger an image viewing operation to zoom out the image, although the first image area newly displayed on the main display window is smaller in size than the image area enlarged in the previous frame, the reduced first image area may still be enlarged compared to the operating image.

[0125] Exemplarily, the above-mentioned diagonal vertices are two vertices on the diagonal line of the image, and the first image area and the operating image each have two pairs of diagonal vertices in the zoom-in mode (the above-mentioned image adjustment coefficient is the image magnification factor) or the zoom-out mode (the above-mentioned image adjustment coefficient is the image reduction factor). The above-mentioned first coordinate information and second coordinate information are the coordinate values ​​of the diagonal vertices of the first image area and the operating image in the same preset image coordinate system, wherein the coordinate value of a vertex includes a horizontal axis coordinate value and a vertical axis coordinate value. The specific calculation of the first coordinate information of a preset number of first feature points in the first image area corresponding to the image viewing operation in the preset image coordinate system involves the coordinate conversion between the screen coordinate system of the display device and the preset image coordinate system. The embodiment of the present application does not limit its specific implementation process, and it can be implemented with reference to the prior art.

[0126] It should be noted that in the zoom mode, only the enlarged image area is displayed on the screen of the display device, and the part of the image area of ​​the original-size operation image captured by the image acquisition device except the enlarged image area is not displayed on the screen. Therefore, the two diagonal vertices of the operation image may be outside the screen but in the above-mentioned preset image coordinate system.

[0127] Step S103: determining the position information of the first image region in the object detection image acquired by the image acquisition device based on the first coordinate information and the second coordinate information.

[0128] In this embodiment, after determining the above-mentioned first coordinate information and the second coordinate information, the image processing device calculates and determines the position information of the above-mentioned first image area in the object detection image obtained by the image acquisition device performing image acquisition on the collected object based on the first coordinate information, the second coordinate information and the size information of the above-mentioned operation image.

[0129] It should be noted that, in some feasible embodiments, step S103 may include:

[0130] Based on the first coordinate information and the second coordinate information, the relative position relationship of the first image area with respect to the operation image and the size information of the first image area are determined, so as to use the relative position relationship and the size information of the first image area as the position information of the first image area in the object detection image.

[0131] In this embodiment, after acquiring the first coordinate information and the second coordinate information, the image processing device can determine the relative position relationship of the first image area with respect to the operation image and the size information of the first image area according to the first coordinate information and the second coordinate information.

[0132] For example, Figure 3 As shown, the four areas represented by numbers 14, 15, 19 and 20 are the magnified display image areas, that is, the first image area displayed on the screen in the magnified mode. The first coordinate information is the coordinate values ​​of the two diagonal vertices P2 and P3 of the magnified image area, which are (P2.x, P2.y) and (P3.x, P3.y) respectively. The second coordinate information is the coordinate values ​​of the two diagonal vertices P1 and P4 after the operation image is magnified, which are (P1.x, P1.y) and (P4.x, P4.y) respectively. It is known that the size of the operation image is (W, H), W represents width, and H represents height. In this way, the calculation method of the offset of the magnified image area in the operation image (including the offset X in the width direction and the offset Y in the height direction) and the size information (w, h) can be:

[0133] X=W*(P2.x-P1.x) / (P4.x-P1.x)

[0134] Y=H*(P2.y-P1.y) / (P4.y-P1.y)

[0135] w=W*(P3.x-P2.x) / (P4.x-P1.x)

[0136] h=H*(P3.y-P2.y) / (P4.y-P1.y)

[0137] It should be noted that when the two diagonal vertices corresponding to the first coordinate information and the two diagonal vertices corresponding to the second coordinate information are not diagonal vertices in the same direction, one set of coordinate values ​​can be converted to the coordinate values ​​of another pair of diagonal vertices and then used in the above method to calculate the offset and size information (w, h). The offset represents the relative position relationship of the first image area relative to the operation image. After the relative position relationship of the first image area relative to the operation image and the size information of the first image area are calculated, the relative position relationship and the size information can be directly used as the position information of the first image area in the object detection image.

[0138] It should be noted that, in some other feasible embodiments, the above step S103 may also include:

[0139] Determine a position offset of the object detection image acquired by the image acquisition device relative to the operation image corresponding to the image viewing operation in the preset image coordinate system;

[0140] Determine candidate position information of the first image area in the object detection image based on the first coordinate information and the second coordinate information;

[0141] The candidate position information is corrected using the position offset to obtain position information of the first image area in the object detection image.

[0142] In this embodiment, when the detected object moves relative to the image acquisition device, the position of the detected object in two adjacent frames of images acquired by the image acquisition device will change. The position information of the first image area in the currently displayed object detection image (i.e., the operation image) determined based on the first coordinate information and the second coordinate information needs to be used as candidate position information first, and the candidate position information is corrected based on the offset between the position of the detected object in the currently displayed object detection image and the position in the next frame of the object detection image to be displayed (i.e., the position offset of the object detection image acquired by the image acquisition device relative to the operation image in the preset image coordinate system). For example, if the candidate position information includes the coordinate values ​​of multiple points, then the position offset is added to each coordinate value to obtain the position information of the first image area in the object detection image.

[0143] Determining the positional offset of the object detection image captured by the image acquisition device relative to the operation image in the preset image coordinate system may specifically be: pre-calculating the correspondence between the positional displacement of the detected object relative to the image acquisition device in the spatial coordinate system and the positional offset in the preset image coordinate system, and according to the correspondence, when the positional displacement of the detected object relative to the image acquisition device in the spatial coordinate system is determined, the positional offset of the object detection image captured by the image acquisition device relative to the operation image in the preset image coordinate system may be calculated. The method of determining the positional displacement of the detected object relative to the image acquisition device in the spatial coordinate system varies according to the specific application scenario. For example, in one embodiment, when the detected object is placed on a conveyor belt and conveyed to the sensing area of ​​the image acquisition device via the conveyor belt, the positional displacement of the detected object relative to the image acquisition device in the spatial coordinate system may be determined according to the moving speed of the conveyor belt and the required time interval.

[0144] Furthermore, in one embodiment, when the feature information includes image feature information, the image feature information of the first image area corresponding to the image viewing operation in the object detection image acquired by the image acquisition device is determined. Specifically, it can be: according to the user performing operations such as zooming in, reducing, moving or cropping an area in the operation image, the position selected by the operation in the operation image is determined, and then based on the position, the image feature information contained in the image data at the position is extracted from the original image data corresponding to the operation image, and the image feature information is used as the image feature information of the first image area in the object detection image; or it can be: according to the type of object selected by the user, the image feature information pre-extracted from the image of the object of that type is used as the image feature information of the first image area in the object detection image.

[0145] Furthermore, in one embodiment, when the feature information includes image feature information and position information of the first image area in the object detection image, determining the feature information of the first image area corresponding to the image viewing operation in the object detection image acquired by the image acquisition device may specifically be to separately determine the image feature information and the position information in accordance with the manner in the above-mentioned embodiment.

[0146] Furthermore, in this embodiment, the image viewing operation triggered by the user for the first image area includes an image moving operation. When the image processing device responds to the image moving operation, the image acquisition device sets the uploading frequency of the first image data according to the image movement rate of the first image area in the object detection image obtained by the image acquisition device for capturing the captured object.

[0147] Based on this, the image processing method of the present invention further includes:

[0148] Monitoring an image movement rate corresponding to the image movement operation;

[0149] If the image moving rate is greater than a rate threshold, determining that the specific uploading frequency is less than an uploading frequency threshold;

[0150] or,

[0151] If the image moving rate is less than the rate threshold, it is determined that the specific uploading frequency is greater than the uploading frequency threshold.

[0152] In this embodiment, the rate threshold is used as a basis for whether to adjust the upload frequency, and the upload frequency threshold can be a pre-set standard upload frequency that limits the image acquisition device or the image data extraction device to upload the first image data to the image processing device. It should be understood that based on different design requirements of actual applications, the above-mentioned rate threshold and upload frequency threshold are thresholds set based on the design requirements of actual applications (such as the performance of the image acquisition device and / or the image processing device), and this embodiment does not limit the specific threshold value.

[0153] Exemplarily, when a user selects a displayed image to perform an image movement operation by operating a mouse, keyboard or other peripherals based on a user graphical interface of the display device, the image processing device determines the image movement rate in the user graphical interface as the image movement rate of the first image area corresponding to the image movement operation; or, in the case where the display device supports screen touch operation, the movement rate of the user's finger or touch object (such as a stylus) on the screen can be used as the image movement rate of the first image area corresponding to the image movement operation. Then, the image processing device compares the image movement rate with a preset rate threshold by detecting the image movement rate, so that when the image movement rate is greater than the rate threshold, it is determined that the specific upload frequency of the image acquisition device or the image data extraction device uploading the first image data to the image processing device is less than the preset upload frequency threshold, that is, the specific upload frequency at this time is set to a certain frequency less than the upload frequency threshold; or, when the image movement rate is less than the rate threshold, it is determined that the specific upload frequency of the image acquisition device or the image data extraction device uploading the first image data to the image processing device is greater than the preset upload frequency threshold, that is, the specific upload frequency at this time is set to another frequency greater than the upload frequency threshold.

[0154] It should be noted that when the image moving rate is fast, it is not necessary to have a high image display clarity, so the image acquisition device can appropriately extend the interval of uploading adjacent images to the image processing device, that is, the above-mentioned specific upload frequency becomes smaller. In addition, when the image moving rate is slow, it is necessary to have a high image display clarity to ensure the image display effect and facilitate the user to view the image details. In this way, the image acquisition device can appropriately shorten the interval of uploading adjacent images to the image processing device, that is, the above-mentioned specific upload frequency becomes larger to upload more image frames, and then the clarity of the image displayed by the display device through the main display window is higher.

[0155] In addition, an embodiment of the present invention further provides an image processing device, referring to Figure 4 , the device comprises:

[0156] A determination module 10, for responding to an image viewing operation triggered by a user on a display device, and determining feature information of a first image region corresponding to the image viewing operation in an object detection image acquired by an image acquisition device;

[0157] An acquisition module 20, configured to acquire first image data, wherein the first image data is extracted from the object detection image data according to the feature information and uploaded to the image processing device at a specific upload frequency;

[0158] The processing module 30 is used to render the first image data and send the image rendering result to the display device for display.

[0159] Furthermore, in the process of extracting the first image data from the object detection image data according to the feature information, acquisition parameters of the image acquisition device for acquiring the object detection image remain unchanged; the acquisition parameters at least include an acquisition frequency and a size of a sensing area of ​​the image acquisition device on a placement plane; the placement plane is used to carry the object to be detected;

[0160] Further, the feature information includes position information of the first image area in the object detection image, and / or image feature information of displayed content in the first image area; the image feature information is used to describe displayed content in the first image area;

[0161] The device also includes:

[0162] a sending module, configured to send the feature information to the image acquisition device, so that the image acquisition device extracts the first image data from the object detection image data according to the feature information and uploads the first image data to the image processing device at a specific uploading frequency;

[0163] Furthermore, the first image data is extracted from the second image data according to the feature information, wherein:

[0164] The second image data is image data corresponding to the first specific frame image in the later acquisition sequence among the multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time, or,

[0165] The second image data is image data corresponding to a second specific frame image whose image quality meets the preset quality requirement among the multiple frames of object detection images acquired by the image acquisition device within the preset acquisition time, or,

[0166] The second image data is image data corresponding to a fused image obtained by fusion processing of multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time;

[0167] The first specific frame image, the second specific frame image or the fused image all include display content in the first image area;

[0168] Further, the feature information includes position information of the first image area in the object detection image, and the determination module 10 includes:

[0169] A first determining unit, configured to determine first coordinate information of a preset number of first feature points in a first image region corresponding to the image viewing operation in a preset image coordinate system;

[0170] a second determining unit, configured to determine, based on an image adjustment coefficient corresponding to the image viewing operation, second coordinate information of a preset number of second feature points in the operation image corresponding to the image viewing operation in the preset image coordinate system; wherein the size of the operation image is the same as the size of the object detection image acquired by the image acquisition device, and the image adjustment coefficient includes an image magnification or image reduction multiple of the first image area relative to the operation image;

[0171] a third determining unit, configured to determine, based on the first coordinate information and the second coordinate information, position information of the first image region in the object detection image acquired by the image acquisition device;

[0172] Further, the third determining unit is specifically configured to:

[0173] Determine, based on the first coordinate information and the second coordinate information, a relative position relationship of the first image region relative to the operation image and size information of the first image region, so as to use the relative position relationship and the size information of the first image region as position information of the first image region in the object detection image;

[0174] Further, the third determining unit is specifically configured to:

[0175] Determine a position offset of the object detection image acquired by the image acquisition device relative to the operation image corresponding to the image viewing operation in the preset image coordinate system;

[0176] Determine candidate position information of the first image area in the object detection image based on the first coordinate information and the second coordinate information;

[0177] The candidate position information is corrected using the position offset to obtain position information of the first image area in the object detection image.

[0178] Further, if the image viewing operation includes an image moving operation, the apparatus further includes:

[0179] A detection module, used for monitoring the image movement rate corresponding to the image movement operation;

[0180] The determination module is further configured to determine that the specific upload frequency is less than an upload frequency threshold if the image movement rate is greater than a rate threshold; or, if the image movement rate is less than the rate threshold, determine that the specific upload frequency is greater than the upload frequency threshold.

[0181] The extended contents of the specific implementation of the image processing device provided in the embodiment of the present invention are basically the same as those of the above-mentioned embodiments of the image processing method, and will not be elaborated here.

[0182] In addition, an embodiment of the present invention further provides a computer-readable storage medium, on which an image processing program is stored. When the image processing program is executed by a processor, the steps of the image processing method described below are implemented.

[0183] The various embodiments of the image processing device and the computer-readable storage medium provided by the embodiments of the present invention may refer to the various embodiments of the image processing method of the present invention, and will not be described in detail here.

[0184] It should be noted that, in this article, the terms "comprises", "includes" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, the "first", "second" and other similar terms used in this article are intended to distinguish different technical features and do not contain any sequential limitation meaning.

[0185] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0186] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0187] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. An image processing method, characterized in that: Applied to an image processing device, the method comprises: In response to an image viewing operation triggered by a user on a display device, determining feature information of a first image region corresponding to the image viewing operation in an object detection image acquired by an image acquisition device; Acquire first image data, where the first image data is extracted from the object detection image data according to the feature information and uploaded to the image processing device at a specific upload frequency; Rendering the first image data, and sending the image rendering result to the display device for display; The feature information includes position information of the first image area in the object detection image, and determining the feature information of the first image area corresponding to the image viewing operation in the object detection image acquired by the image acquisition device includes: Determine first coordinate information of a preset number of first feature points in a first image area corresponding to the image viewing operation in a preset image coordinate system; Based on the image adjustment coefficient corresponding to the image viewing operation, determine the second coordinate information of a preset number of second feature points in the operation image corresponding to the image viewing operation in the preset image coordinate system; wherein the size of the operation image is the same as the size of the object detection image acquired by the image acquisition device, and the image adjustment coefficient includes an image magnification or image reduction ratio of the first image area relative to the operation image; Based on the first coordinate information and the second coordinate information, position information of the first image area in the object detection image acquired by the image acquisition device is determined.

2. The image processing method according to claim 1, characterized in that: In the process of extracting the first image data from the object detection image data according to the feature information, the acquisition parameters of the image acquisition device for acquiring the object detection image remain unchanged; the acquisition parameters at least include an acquisition frequency and the size of a sensing area of ​​the image acquisition device on a placement plane; the placement plane is used to carry the object to be detected.

3. The image processing method according to claim 1, characterized in that: The feature information includes position information of the first image region in the object detection image, and / or image feature information of content displayed in the first image region; The image feature information is used to describe the display content in the first image area; The method further comprises: The feature information is sent to the image acquisition device, so that the image acquisition device extracts the first image data from the object detection image data according to the feature information and uploads it to the image processing device at a specific upload frequency.

4. The image processing method according to any one of claims 1 to 3, characterized in that: The first image data is extracted from the second image data according to the feature information, wherein: The second image data is image data corresponding to the first specific frame image in the later acquisition sequence among the multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time, or, The second image data is image data corresponding to a second specific frame image whose image quality meets the preset quality requirement among the multiple frames of object detection images acquired by the image acquisition device within the preset acquisition time, or, The second image data is image data corresponding to a fused image obtained by fusion processing of multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time; The first specific frame image, the second specific frame image or the fused image all include display content in the first image area.

5. The image processing method according to claim 1, wherein: Determining, based on the first coordinate information and the second coordinate information, position information of the first image area in the object detection image acquired by the image acquisition device, includes: Based on the first coordinate information and the second coordinate information, the relative position relationship of the first image area with respect to the operation image and the size information of the first image area are determined, so as to use the relative position relationship and the size information of the first image area as the position information of the first image area in the object detection image.

6. The image processing method according to claim 1, characterized in that: Determining, based on the first coordinate information and the second coordinate information, position information of the first image area in the object detection image acquired by the image acquisition device, includes: Determine a position offset of the object detection image acquired by the image acquisition device relative to the operation image corresponding to the image viewing operation in the preset image coordinate system; Determine candidate position information of the first image area in the object detection image based on the first coordinate information and the second coordinate information; The candidate position information is corrected using the position offset to obtain position information of the first image area in the object detection image.

7. The image processing method according to claim 1, characterized in that: If the image viewing operation includes an image moving operation, the method further includes: Monitoring an image movement rate corresponding to the image movement operation; If the image moving rate is greater than a rate threshold, determining that the specific uploading frequency is less than an uploading frequency threshold; or, If the image moving rate is less than the rate threshold, it is determined that the specific uploading frequency is greater than the uploading frequency threshold.

8. An image processing device, characterized in that: Deployed in an image processing device, the device comprises: a determination module, configured to respond to an image viewing operation triggered by a user on a display device and determine feature information of a first image region corresponding to the image viewing operation in an object detection image acquired by an image acquisition device; an acquisition module, used for acquiring first image data, wherein the first image data is extracted from the object detection image data according to the feature information and uploaded to the image processing device at a specific upload frequency; A processing module, used for rendering the first image data and sending the image rendering result to the display device for display; The feature information includes position information of the first image area in the object detection image, and the determination module includes: A first determining unit, configured to determine first coordinate information of a preset number of first feature points in a first image region corresponding to the image viewing operation in a preset image coordinate system; a second determining unit, configured to determine, based on an image adjustment coefficient corresponding to the image viewing operation, second coordinate information of a preset number of second feature points in the operation image corresponding to the image viewing operation in the preset image coordinate system; wherein the size of the operation image is the same as the size of the object detection image acquired by the image acquisition device, and the image adjustment coefficient includes an image magnification or image reduction multiple of the first image area relative to the operation image; A third determining unit is configured to determine position information of the first image region in the object detection image acquired by the image acquisition device based on the first coordinate information and the second coordinate information.

9. The image processing device according to claim 8, wherein: In the process of extracting the first image data from the object detection image data according to the feature information, acquisition parameters of the image acquisition device for acquiring the object detection image remain unchanged; the acquisition parameters at least include an acquisition frequency and a size of a sensing area of ​​the image acquisition device on a placement plane; the placement plane is used to carry the object to be detected; and / or, the feature information includes position information of the first image region in the object detection image, and / or image feature information of content displayed in the first image region; The image feature information is used to describe the display content in the first image area; The device also includes: a sending module, configured to send the feature information to the image acquisition device, so that the image acquisition device extracts the first image data from the object detection image data according to the feature information and uploads the first image data to the image processing device at a specific uploading frequency; And / or, the first image data is extracted from the second image data according to the feature information, wherein: The second image data is image data corresponding to the first specific frame image in the later acquisition sequence among the multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time, or, The second image data is image data corresponding to a second specific frame image whose image quality meets the preset quality requirement among the multiple frames of object detection images acquired by the image acquisition device within the preset acquisition time, or, The second image data is image data corresponding to a fused image obtained by fusion processing of multiple frames of object detection images acquired by the image acquisition device within a preset acquisition time; The first specific frame image, the second specific frame image or the fused image all include display content in the first image area; and / or, The third determining unit is specifically configured to: Determine, based on the first coordinate information and the second coordinate information, a relative position relationship of the first image region relative to the operation image and size information of the first image region, so as to use the relative position relationship and the size information of the first image region as position information of the first image region in the object detection image; Alternatively, the third determining unit is specifically configured to: Determine a position offset of the object detection image acquired by the image acquisition device relative to the operation image corresponding to the image viewing operation in the preset image coordinate system; Determine candidate position information of the first image area in the object detection image based on the first coordinate information and the second coordinate information; Correcting the candidate position information using the position offset to obtain position information of the first image area in the object detection image; And / or, if the image viewing operation includes an image moving operation, the apparatus further comprises: A detection module, used for monitoring the image movement rate corresponding to the image movement operation; The determination module is further configured to determine that the specific upload frequency is less than an upload frequency threshold if the image movement rate is greater than a rate threshold; or, if the image movement rate is less than the rate threshold, determine that the specific upload frequency is greater than the upload frequency threshold.

10. An image processing device, characterized in that: The image processing device comprises: a memory, a processor, and an image processing program stored in the memory and executable on the processor, wherein the image processing program implements the steps of the image processing method according to any one of claims 1 to 7 when executed by the processor.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores an image processing program, and when the image processing program is executed by a processor, the steps of the image processing method according to any one of claims 1 to 7 are implemented.

Images