Image processing method, apparatus, electronic device, medium, and system

Abstract

The present disclosure provides an image processing method, device, electronic equipment, medium, program product and system, relating to the field of artificial intelligence, in particular to the field of computer vision and image processing technology. The image processing method comprises: in response to determining that an image acquisition device is located at a first side of a sample stage, controlling an auxiliary device to move to a target position, wherein the target position is associated with the position of the image acquisition device and the position of the sample stage; controlling the image acquisition device to acquire an initial image of a to-be-photographed object, wherein the to-be-photographed object is located at a second side of the sample stage, and the auxiliary device is used to avoid the image quality of the initial image from being reduced due to the reflection of the sample stage.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the field of artificial intelligence, in particular to the field of computer vision and image processing, and more particularly to an image processing method, device, electronic device, medium, program product and system. BACKGROUND

[0002] In the related art, an image of an object is usually collected by an image collection device. However, due to the influence of the external environment, the image quality of the collected image is usually low. SUMMARY

[0003] The present disclosure provides an image processing method, device, electronic device, medium, program product and system.

[0004] According to an aspect of the present disclosure, an image processing method is provided, comprising: in response to determining that an image collection device is located at a first side of a stage, controlling a auxiliary device to move to a target position, wherein the target position is associated with a position of the image collection device and a position of the stage; controlling the image collection device to collect an initial image of a to-be-photographed object, wherein the to-be-photographed object is located at a second side of the stage, and the auxiliary device is used to avoid a decrease in image quality of the initial image caused by reflection of the stage.

[0005] According to another aspect of the present disclosure, an image processing device is provided, comprising: a first control module and a second control module. The first control module is configured to, in response to determining that an image collection device is located at a first side of a stage, control a auxiliary device to move to a target position, wherein the target position is associated with a position of the image collection device and a position of the stage; the second control module is configured to control the image collection device to collect an initial image of a to-be-photographed object, wherein the to-be-photographed object is located at a second side of the stage, and the auxiliary device is used to avoid a decrease in image quality of the initial image caused by reflection of the stage.

[0006] According to another aspect of the present disclosure, an electronic device is provided, comprising: at least one processor and a memory connected with the at least one processor in communication. Wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the above-mentioned image processing method.

[0007] According to another aspect of the present disclosure, a non-transitory computer readable storage medium storing computer instructions is provided, the computer instructions are used to enable the computer to perform the above-mentioned image processing method.

[0008] According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the image processing method described above.

[0009] According to another aspect of the present disclosure, there is provided an image processing system comprising an image acquisition device, an auxiliary device, the electronic device described above and a driving device. The image acquisition device is configured to acquire an initial image of an object to be photographed. The auxiliary device is configured to avoid the image quality of the initial image from being degraded due to reflection of the object table. The driving device is connected with the image acquisition device and the auxiliary device, and is configured to drive the image acquisition device and the auxiliary device to move under the control of the electronic device.

[0010] It should be understood that the content described in this section is not intended to identify key or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0011] The accompanying drawings are used to better understand the present scheme, and do not constitute a limitation on the present disclosure. Among them:

[0012] Figure 1 A flow chart of an image processing method according to an embodiment of the present disclosure is schematically shown;

[0013] Figure 2 A schematic diagram of image processing acquisition according to an embodiment of the present disclosure is schematically shown;

[0014] Figure 3 A schematic diagram of image contrast according to an embodiment of the present disclosure is schematically shown;

[0015] Figure 4 A flow chart of an image processing method according to another embodiment of the present disclosure is schematically shown;

[0016] Figure 5 A block diagram of an image processing device according to an embodiment of the present disclosure is schematically shown; and

[0017] Figure 6 A block diagram of an electronic device for performing image processing to implement an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0018] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding, and should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0019] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. The terms “comprising,” “including,” etc., as used herein indicate the presence of the stated features, steps, operations, and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, or components.

[0020] All terms used herein (including technical and scientific terms) have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein are to be interpreted in a manner consistent with the context of this specification, and not in an idealized or overly rigid way.

[0021] When using expressions such as "at least one of A, B, and C", they should generally be interpreted in accordance with the meaning that is commonly understood by a person skilled in the art (e.g., "a system having at least one of A, B, and C" should include, but is not limited to, a system having A alone, a system having B alone, a system having C alone, a system having A and B, a system having A and C, a system having B and C, and / or a system having A, B, and C, etc.).

[0022] In some scenarios, it's often necessary to acquire images of an object, such as images of the object from various angles. The object could be a physical object, a product, or similar item. In one example, the object to be photographed can be placed on a platform, and an image acquisition device can be used to capture images of the object from multiple angles. To capture images of the object's bottom, a transparent glass plate can typically be used as the platform, allowing the bottom image to be captured through the glass.

[0023] However, when capturing images of the bottom of the subject through a glass plate, the reflection from the glass plate causes the captured image to contain reflective information. For example, the image capture device and other unrelated equipment can be seen reflected in the captured image, resulting in lower image quality.

[0024] In view of this, embodiments of the present disclosure provide an image processing method, including: in response to determining that an image acquisition device is located on a first side of a stage, controlling an auxiliary device to move to a target position, the target position being associated with the position of the image acquisition device and the position of the stage. Next, controlling the image acquisition device to acquire an initial image of an object to be photographed, the object being photographed being located on a second side of the stage, the auxiliary device being used to avoid image quality degradation of the initial image due to reflections from the stage.

[0025] This disclosure provides an image processing method, with reference to... Figures 1-4 This document describes an image processing method according to exemplary embodiments of the present disclosure.

[0026] Figure 1 A flowchart illustrating an image processing method according to an embodiment of the present disclosure is shown schematically.

[0027] like Figure 1 As shown, the image processing method 100 of this embodiment may include, for example, operations S110 to S120.

[0028] In operation S110, in response to determining that the image acquisition device is located on the first side of the stage, the auxiliary device is controlled to move to the target position, which is associated with the position of the image acquisition device and the position of the stage.

[0029] In operation S120, the image acquisition device is controlled to acquire an initial image of the object to be photographed, which is located on the second side of the stage.

[0030] For example, the stage includes a first side and a second side opposite to the first side, wherein when the stage is in a horizontal direction, the first side is positioned, for example, below the second side. The object to be photographed is placed on the stage, for example, placed on the second side of the stage. The image acquisition device can be a camera, mobile phone, or other device with a photographing function. The image acquisition device can move around the object to be photographed in order to acquire images of the object from different angles.

[0031] In one example, the image acquisition device can move according to pre-set motion parameters, so the position of the image acquisition device relative to the stage can be determined based on the motion parameters.

[0032] In another example, the position of the image acquisition device can also be identified through technologies such as image recognition. Image recognition technology can determine whether the image acquisition device is located on the first side of the stage.

[0033] When the image acquisition device is determined to be located on the first side of the stage, the auxiliary device can be automatically controlled to move to a target position, which is associated with, for example, the position of the image acquisition device and the position of the stage. For example, the auxiliary device may include a first type of auxiliary device and a second type of auxiliary device, and different types of auxiliary devices can be controlled to move to different target positions.

[0034] After the auxiliary device moves to the target position, the image acquisition device can be controlled to acquire the initial image of the object to be photographed. Because the auxiliary device moves to the target position, it can avoid image quality degradation of the initial image caused by reflections from the stage during image acquisition.

[0035] In one example, the stage can be a glass plate. The object to be photographed is placed on the stage so that an image acquisition device can capture an image of the object's bottom through the glass plate. Therefore, when the image acquisition device is determined to be located on the first side of the stage, it means that the image acquisition device is positioned directly below the object to capture its bottom image. However, because the image acquisition device is located on the first side of the stage, the reflection from the stage will cause the initial image to contain reflections of unrelated equipment such as the image acquisition device, thus affecting the image quality of the initial image.

[0036] Therefore, when the image acquisition device is located on the first side of the stage, the auxiliary device can be controlled to move to the target position. The auxiliary device can avoid the image quality degradation of the initial image caused by the reflection of the stage, thereby improving the image quality of the initial image.

[0037] Additionally, when the image acquisition device is located on the second side of the stage, it indicates that there is no need to capture the bottom of the object to be photographed at this time. In this case, the auxiliary device can be controlled to move away from the target position to avoid the auxiliary device affecting the shooting effect.

[0038] Embodiments of this disclosure also provide an image processing system. The image processing system includes, for example, an image acquisition device, an auxiliary device, an electronic device, and a driving device. Figure 1 The described image processing method can be performed, for example, by an electronic device.

[0039] Image acquisition devices, such as cameras or mobile phones, are used to acquire initial images of the object to be photographed. Auxiliary devices, for example, are used to prevent image quality degradation of the initial image due to reflections from the stage.

[0040] Electronic devices include, for example, computers, servers, and other devices with data processing capabilities. A drive device is connected, for example, to the image acquisition device and the auxiliary device. Furthermore, the drive device is also electrically connected to the electronic device, and when the electronic device determines that the image acquisition device is located on the first side of the stage, the electronic device can control the drive device to move the auxiliary device to the target position.

[0041] For example, the driving device can also be connected to an image acquisition device. Under the control of the electronic device, the driving device can move the image acquisition device so that the image acquisition device can acquire initial images of the object to be photographed at different positions. For example, the electronic device can pre-store the motion parameters of the image acquisition device, and control the driving device to move the image acquisition device based on the motion parameters.

[0042] Figure 2 A schematic diagram illustrating image processing acquisition according to an embodiment of the present disclosure is shown.

[0043] like Figure 2 As shown, the stage 210 can be, for example, a glass plate, and includes a first side 211 and a second side 212. The object to be photographed 220 is placed on the second side 212 of the stage 210.

[0044] The image acquisition device 230 can move around the object to be photographed in order to acquire initial images of the object 220 at different positions. When it is determined that the image acquisition device 230 has moved to the first side 211 of the stage 210, it means that the image acquisition device 230 needs to acquire an initial image of the bottom of the object 220 through the stage 210. In order to avoid the reflection of the image acquisition device 230 and other unrelated devices appearing on the stage 210 (glass plate) and affecting the quality of the initial image, the auxiliary device can be controlled to move to the target position.

[0045] In one example, the auxiliary device includes, for example, a first type of auxiliary device, which includes, for example, a background plate 241. Controlling the movement of the auxiliary device to the target position includes controlling the background plate 241 to move to a first side 211 of the stage 210, such that the distance from the background plate 241 to the stage 210 is greater than the distance from the image acquisition device 230 to the stage 210. That is, the background plate 241 is used to block other unrelated devices located below the image acquisition device 230, preventing the reflections of other unrelated devices from appearing on the stage 210 (glass plate). The background plate 241 can be a black background plate.

[0046] In another example, the auxiliary device may also include a second type of auxiliary device, such as a supplementary lighting device 242. Controlling the movement of the auxiliary device to the target position includes controlling the supplementary lighting device 242 to move to the first side 211 of the stage 210, such that the distance from the supplementary lighting device 242 to the stage 210 is less than the distance from the image acquisition device 230 to the stage 210. The supplementary lighting device 242 may include multiple supplementary lights, and the supplementary lighting device 242 can be moved to a position close to the stage 210. Since a black background panel 241 typically affects the brightness of the initial image acquired, supplementary lighting device 242 can be used to enhance the brightness of the initial image.

[0047] In another example, the image acquisition device 230 can also be equipped with a black outer box to minimize the reflection of the image acquisition device 230 on the stage 210 (glass plate).

[0048] Figure 3 The illustration shows a schematic diagram of image comparison according to an embodiment of the present disclosure.

[0049] like Figure 3 As shown, Figure 3 The image includes three sets of images, each set containing two images. The left image in each set is the image captured without the auxiliary device, and the right image in each set is the image captured with the auxiliary device added.

[0050] from Figure 3 As can be seen, the images acquired after adding the auxiliary device reduced the impact of stage reflection on image quality; that is, the reflection information of other irrelevant devices in the initial acquired image was greatly reduced.

[0051] According to embodiments of this disclosure, the background plate and the supplementary lighting device are controlled to move to the target position by detecting the position of the image acquisition device in real time. This simple device avoids the problem of image quality degradation of the initial image caused by reflection of the stage, reduces the cost of image acquisition, and improves the image quality of the initial image.

[0052] Figure 4 A flowchart illustrating an image processing method according to another embodiment of the present disclosure is shown schematically.

[0053] like Figure 4 As shown, an image captured of the subject can be used as the initial image 410, or the captured image can be brightness-processed and used as the initial image 410. Brightness processing of the captured image includes reducing the brightness of locally overexposed areas and increasing the brightness of dark areas.

[0054] The initial image 410 can be processed to obtain the first reference image 430.

[0055] For example, the initial image 410 is converted to the HSV (Hue Saturation Value) color space to obtain multiple component images. Then, a component image 420 for the brightness of the initial image 410 is determined from the multiple component images. Here, brightness (Value) can also be called luminance.

[0056] For example, the HSV color space represents points in the RGB color space in cylindrical coordinates. The initial image 410 includes component images for hue, saturation, and value in the HSV color space. A component image 420 for value is determined from the multiple component images. Component image 420 is more sensitive to value information.

[0057] For each pixel in component image 420, if the pixel value is within a preset pixel value range, the pixel value is set to a first value; otherwise, it is set to a second value, thereby obtaining a mask image. This mask image is then determined as the first reference image 430. The first value is, for example, 1 (representing white), and the second value is, for example, 0 (representing black). Alternatively, the first value is, for example, 255 (representing white), and the second value is, for example, 0 (representing black). This disclosure does not limit the representation of the first and second values.

[0058] After obtaining the first reference image 430, additional information can be removed from the first reference image 430 to obtain the second reference image 450. The additional information includes, for example, information other than that related to the object to be photographed, such as information about the image acquisition device, information about the stage, and information about the auxiliary device.

[0059] In one example, the stage information in the first reference image 430 can be removed using at least one of a dilation algorithm and an erosion algorithm to obtain a processed image 440. Then, a second reference image 450 can be obtained based on the processed image 440. Removing the stage information in the first reference image 430 includes, for example, removing image information from the edge portions of the stage, such as changing the pixel values ​​of the region where the stage edges are located from a first value to a second value.

[0060] In another example, multiple connected regions in the first reference image 430 (or the processed image 440) can be identified. The pixel value of each connected region is, for example, a first value. For each connected region, the region location and region area can be determined.

[0061] Then, based on at least one of the region location and region area, candidate connected regions are determined from a plurality of connected regions, and additional information within the candidate connected regions is removed. Removing additional information within the candidate connected regions includes, for example, changing the pixel values ​​within the candidate connected regions from a first value to a second value.

[0062] For example, if the region location indicates that the connected region is located at the edge of the first reference image 430 (or the processed image 440), it means that the connected region is likely located in an area containing unrelated devices other than the object to be photographed, and the connected region can be determined as a candidate connected region. The region location can be represented, for example, by the location of the center point of the region.

[0063] For example, if the area of ​​a connected region is smaller than a preset area, it means that the connected region is likely the area where irrelevant devices other than the object to be photographed are located, and the connected region can be determined as a candidate connected region.

[0064] For example, if the region location characterization connected region is located at the edge of the first reference image 430 (or the processed image 440), and the region area of ​​the connected region is smaller than a preset area, it indicates that the connected region is likely the area where an unrelated device other than the object to be photographed is located, and the connected region can be determined as a candidate connected region.

[0065] After obtaining the second reference image 450, the target image 460 can be obtained based on the second reference image 450 and the initial image 410. For example, the pixel values ​​of the initial image 410 can be updated based on the pixel values ​​of the second reference image 450 to obtain the target image 460.

[0066] For example, each pixel in the second reference image 450 is sequentially used as the current pixel. If the pixel value of the current pixel in the second reference image 450 is a first value, then the pixel value of the pixel corresponding to the current pixel is retained in the initial image 410. If the pixel value of the current pixel in the second reference image 450 is a second value, then the pixel value of the pixel corresponding to the current pixel is updated in the initial image 410, for example, by changing the pixel value of the pixel corresponding to the current pixel to a specific value (the specific value is, for example, 255, representing white), thereby obtaining the target image 460. Background information other than the object to be photographed is removed from the target image 460, improving the accuracy of the target image 460.

[0067] According to embodiments of this disclosure, after obtaining an initial image, the initial image is processed to obtain component images, and then the component images are processed to remove stage information and candidate connected region image information from the images. The resulting target image has removed redundant information, thereby obtaining a target image of higher quality.

[0068] Figure 5 A block diagram of an image processing apparatus according to an embodiment of the present disclosure is shown schematically.

[0069] like Figure 5 As shown, the image processing apparatus 500 of this embodiment includes, for example, a first control module 510 and a second control module 520.

[0070] The first control module 510 can be used to control the auxiliary device to move to a target position in response to determining that the image acquisition device is located on the first side of the stage, wherein the target position is associated with the position of the image acquisition device and the position of the stage. According to embodiments of this disclosure, the first control module 510 can, for example, perform the functions described above. Figure 1 The operation S110 described herein will not be repeated here.

[0071] The second control module 520 can be used to control the image acquisition device to acquire an initial image of the object to be photographed, wherein the object to be photographed is located on the second side of the stage, and wherein the auxiliary device is used to avoid image quality degradation of the initial image due to reflection from the stage. According to an embodiment of this disclosure, the second control module 520 can, for example, perform the functions described above. Figure 1 The operation S120 described herein will not be repeated here.

[0072] According to an embodiment of this disclosure, the auxiliary device includes a background plate; the first control module 510 is further configured to: control the background plate to move to a first side of the stage, such that the distance from the background plate to the stage is greater than the distance from the image acquisition device to the stage.

[0073] According to an embodiment of this disclosure, the auxiliary device includes a supplementary lighting device; the first control module 510 is further configured to: control the supplementary lighting device to move to a first side of the stage, such that the distance from the supplementary lighting device to the stage is less than the distance from the image acquisition device to the stage.

[0074] According to embodiments of this disclosure, the apparatus 500 may further include: a processing module, a removal module, and an acquisition module. The processing module processes the initial image to obtain a first reference image; the removal module removes additional information from the first reference image to obtain a second reference image; and the acquisition module obtains a target image based on the second reference image and the initial image, wherein the additional information includes at least one of the following: information about the image acquisition device, information about the stage, and information about the auxiliary device.

[0075] According to embodiments of this disclosure, the removal module is further configured to: remove the stage information from the first reference image using at least one of a dilation algorithm and an erosion algorithm to obtain a second reference image.

[0076] According to embodiments of this disclosure, the removal module further includes: an identification submodule, a first determination submodule, a second determination submodule, and a removal submodule. The identification submodule is used to identify multiple connected regions in the first reference image; the first determination submodule is used to determine at least one of a region location and a region area for each of the multiple connected regions; the second determination submodule is used to determine candidate connected regions from the multiple connected regions based on at least one of the region location and region area; and the removal submodule is used to remove additional information from the candidate connected regions.

[0077] According to an embodiment of this disclosure, the second determining submodule is further configured to, for each connected region: in response to the region location characterization that the connected region is located at the edge of the first reference image, and / or the region area is less than a preset area, determine the connected region as a candidate connected region.

[0078] According to embodiments of this disclosure, the processing module includes: a conversion submodule, a setting submodule, and a third determination submodule. The conversion submodule is used to convert the initial image to the HSV color space to obtain a luminance component image for the initial image; the setting submodule is used to, for each pixel in the component image, set the pixel value to a first value if the pixel value is within a preset pixel value range, and otherwise set it to a second value, to obtain a mask image; the third determination submodule is used to determine the mask image as a first reference image.

[0079] According to embodiments of this disclosure, the obtaining module is further configured to: update the pixel values ​​of the initial image based on the pixel values ​​of the second reference image to obtain the target image.

[0080] The collection, storage, use, processing, transmission, provision, and disclosure of user personal information involved in the technical solution disclosed herein comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0081] According to embodiments of this disclosure, this disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0082] Figure 6 This is a block diagram of an electronic device for performing image processing to implement embodiments of the present disclosure.

[0083] Figure 6A schematic block diagram of an example electronic device 600 that can be used to implement embodiments of the present disclosure is shown. The electronic device 600 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0084] like Figure 6 As shown, device 600 includes a computing unit 601, which can perform various appropriate actions and processes based on a computer program stored in read-only memory (ROM) 602 or a computer program loaded from storage unit 608 into random access memory (RAM) 603. RAM 603 may also store various programs and data required for the operation of device 600. The computing unit 601, ROM 602, and RAM 603 are interconnected via bus 604. Input / output (I / O) interface 605 is also connected to bus 604.

[0085] Multiple components in device 600 are connected to I / O interface 605, including: input unit 606, such as keyboard, mouse, etc.; output unit 607, such as various types of monitors, speakers, etc.; storage unit 608, such as disk, optical disk, etc.; and communication unit 609, such as network card, modem, wireless transceiver, etc. Communication unit 609 allows device 600 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0086] The computing unit 601 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 601 performs the various methods and processes described above, such as image processing methods. For example, in some embodiments, the image processing method may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 608. In some embodiments, part or all of the computer program may be loaded and / or installed on device 600 via ROM 602 and / or communication unit 609. When the computer program is loaded into RAM 603 and executed by the computing unit 601, one or more steps of the image processing method described above may be performed. Alternatively, in other embodiments, the computing unit 601 may be configured to perform image processing methods by any other suitable means (e.g., by means of firmware).

[0087] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0088] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable image processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0089] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0090] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0091] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0092] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.

[0093] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0094] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. An image processing method, comprising: In response to determining that the image acquisition device is located on the first side of the stage, the auxiliary device is controlled to move to a target position, wherein the target position is associated with the position of the image acquisition device and the position of the stage, and the image acquisition device being located on the first side of the stage indicates that the image acquisition device is located below the stage to acquire a bottom image of the object to be photographed on the stage; and The image acquisition device is controlled to acquire an initial image of the object to be photographed, wherein the object to be photographed is located on the second side of the stage, and the second side refers to the area above the stage; The auxiliary device is used to avoid image quality degradation of the initial image caused by reflection from the stage; The method further includes: The image acquisition device is controlled to move around the object to be photographed according to preset motion parameters; The position of the image acquisition device relative to the stage is determined according to the preset motion parameters; The auxiliary device includes a background panel; controlling the movement of the auxiliary device to the target position includes: Control the background plate to move to the first side of the stage, such that the distance from the background plate to the stage is greater than the distance from the image acquisition device to the stage; When the image acquisition device is determined to be located on the second side of the stage, the auxiliary device is controlled to move away from the target position.

2. The method according to claim 1, wherein, The auxiliary device includes a supplementary lighting device; controlling the auxiliary device to move to the target position includes: The supplementary lighting device is controlled to move to the first side of the stage, such that the distance from the supplementary lighting device to the stage is less than the distance from the image acquisition device to the stage.

3. The method according to claim 1, further comprising: The initial image is processed to obtain a first reference image; Remove the additional information from the first reference image to obtain the second reference image; as well as Based on the second reference image and the initial image, the target image is obtained. The additional information includes at least one of the following: information about the image acquisition device, information about the stage, and information about the auxiliary device.

4. The method according to claim 3, wherein, The step of removing additional information from the first reference image to obtain the second reference image includes: The second reference image is obtained by removing the stage information from the first reference image using at least one of the dilation and erosion algorithms.

5. The method according to claim 3 or 4, wherein, The step of removing additional information from the first reference image to obtain the second reference image includes: Identify multiple connected regions in the first reference image; For each of the plurality of connected regions, determine at least one of the region location and region area of ​​the connected region; Candidate connected regions are determined from the plurality of connected regions based on at least one of the region location and the region area; and Remove additional information from the candidate connected regions.

6. The method according to claim 5, wherein, The step of determining candidate connected regions from the plurality of connected regions based on at least one of the region location and the region area includes, for each connected region: In response to the region location characterization indicating that the connected region is located at the edge of the first reference image, and / or the region area is less than a preset area, the connected region is determined to be a candidate connected region.

7. The method according to claim 3, wherein, The process of processing the initial image to obtain the first reference image includes: The initial image is converted to the Hue / Saturation / Lightness HSV color space to obtain a lightness component image of the initial image; For each pixel in the component image, in response to the pixel value being within a preset pixel value range, the pixel value is set to a first value; otherwise, it is set to a second value, to obtain a mask image; and The mask image is determined as the first reference image.

8. The method according to claim 3, wherein, The process of obtaining the target image based on the second reference image and the initial image includes: The pixel values ​​of the initial image are updated based on the pixel values ​​of the second reference image to obtain the target image.

9. An image processing apparatus, comprising: A first control module is configured to, in response to determining that the image acquisition device is located on a first side of the stage, control an auxiliary device to move to a target position, wherein the target position is associated with the position of the image acquisition device and the position of the stage, and the image acquisition device being located on the first side of the stage indicates that the image acquisition device is located below the stage to acquire a bottom image of the object to be photographed on the stage; and The second control module is used to control the image acquisition device to acquire an initial image of the object to be photographed, wherein the object to be photographed is located on the second side of the platform, and the second side means above the platform; The auxiliary device is used to avoid image quality degradation of the initial image caused by reflection from the stage; The device further includes: The third control module is used to control the image acquisition device to move around the object to be photographed according to preset motion parameters; A position determination module is used to determine the position of the image acquisition device relative to the stage based on the preset motion parameters; The auxiliary device includes a background plate; the first control module is further configured to: Control the background plate to move to the first side of the stage, such that the distance from the background plate to the stage is greater than the distance from the image acquisition device to the stage; When the image acquisition device is determined to be located on the second side of the stage, the auxiliary device is controlled to move away from the target position.

10. The apparatus according to claim 9, wherein, The auxiliary device includes a supplementary lighting device; the first control module is further configured to: The supplementary lighting device is controlled to move to the first side of the stage, such that the distance from the supplementary lighting device to the stage is less than the distance from the image acquisition device to the stage.

11. The apparatus according to claim 9, further comprising: The processing module is used to process the initial image to obtain a first reference image; A removal module is used to remove additional information from the first reference image to obtain a second reference image; as well as The acquisition module is used to obtain the target image based on the second reference image and the initial image. The additional information includes at least one of the following: information about the image acquisition device, information about the stage, and information about the auxiliary device.

12. The apparatus according to claim 11, wherein, The removal module is also used for: The second reference image is obtained by removing the stage information from the first reference image using at least one of the dilation and erosion algorithms.

13. The apparatus according to claim 11 or 12, wherein, The removal module further includes: A recognition submodule is used to identify multiple connected regions in the first reference image; The first determining submodule is used to determine at least one of the region location and region area of ​​each of the plurality of connected regions; The second determining submodule is configured to determine candidate connected regions from the plurality of connected regions based on at least one of the region location and the region area; and The removal submodule is used to remove additional information within the candidate connected regions.

14. The apparatus according to claim 13, wherein, The second determining submodule is further configured to, for each connected region: In response to the region location characterization indicating that the connected region is located at the edge of the first reference image, and / or the region area is less than a preset area, the connected region is determined to be a candidate connected region.

15. The apparatus according to claim 11, wherein, The processing module includes: The conversion submodule is used to convert the initial image to the hue-saturation-brightness HSV color space to obtain a brightness component image of the initial image. A setting submodule is configured to, for each pixel in the component image, set the pixel value to a first value if the pixel value is within a preset pixel value range, and otherwise set it to a second value, to obtain a mask image; and The third determining submodule is used to determine the mask image as the first reference image.

16. The apparatus according to claim 11, wherein, The obtaining module is also used for: The pixel values ​​of the initial image are updated based on the pixel values ​​of the second reference image to obtain the target image.

17. An electronic device comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-8.

18. A non-transitory computer-readable storage medium storing computer instructions, wherein, The computer instructions are used to cause the computer to perform the method according to any one of claims 1-8.

19. A computer program product comprising a computer program that, when executed by a processor, implements the method according to any one of claims 1-8.

20. An image processing system, comprising: An image acquisition device used to acquire an initial image of the object to be photographed; An auxiliary device is provided to prevent image quality degradation of the initial image due to reflections from the stage. The electronic device according to claim 17; and A driving device, connected to the image acquisition device and the auxiliary device, drives the image acquisition device and the auxiliary device to move under the control of the electronic device.

Images