Image processing equipment, method and device, computer readable storage medium and computer program product

Abstract

The invention provides an image processing device, method and device, a computer readable storage medium and a computer program product. The image processing device, method and device are applied to various image acquisition scenes such as cloud technology, artificial intelligence, intelligent traffic and games. The image processing equipment comprises a memory, a soft box, a processor, image acquisition equipment and M light sources, the memory is used for storing computer executable instructions or computer programs; the first end of the soft box is used for fixing the processor and the image acquisition equipment, and the second end of the soft box is used for fixing the M light sources; the processor is used for controlling the image acquisition equipment and the M light sources to perform image acquisition on a to-be-acquired object when the soft box is arranged on the to-be-acquired object, responds to an image acquisition request and executes the computer executable instruction or the computer program stored in the memory. According to the invention, the applicability of image processing can be improved.

Description

Technical Field

[0001] The present application relates to image processing technology in the field of computer applications, and in particular to an image processing device, method, apparatus, computer-readable storage medium, and computer program product. Background Art

[0002] Material scanning involves capturing images of an object from multiple light sources. Related technologies often employ a hard-locked support structure, such as wood or metal, to achieve material scanning. This results in the image capture device being heavier than the specified weight, affecting its portability and, consequently, its applicability when used for material scanning. Summary of the Invention

[0003] The embodiments of the present application provide an image processing device, method, apparatus, computer-readable storage medium, and computer program product, which can improve the applicability of image acquisition.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] An embodiment of the present application provides an image processing device, comprising: a memory, a softbox, a processor, an image acquisition device, and M light sources, where M>1 and M is an integer;

[0006] The memory is used to store computer executable instructions or computer programs;

[0007] The first end of the soft box is used to fix the memory, the processor and the image acquisition device, and the second end of the soft box is used to fix the M light sources. The first end of the soft box refers to the end away from the soft light surface, and the second end of the soft box refers to the end where the soft light surface is located;

[0008] The processor is configured to control the image acquisition device and the M light sources to capture an image of the object to be captured when the softbox is placed on the object to be captured and, in response to an image capture request, execute the computer-executable instructions or computer program stored in the memory.

[0009] The present embodiment provides an image processing method, which is applied to the image processing device provided in the embodiment of the present application. The method includes:

[0010] When the softbox is placed on the object to be captured, in response to an image capture request, a target light source among M light sources is turned on, where M>1 and M is an integer;

[0011] When the target light source is in an on state, controlling the image acquisition device to focus;

[0012] When the image acquisition device is in a focusing state, the M light sources are traversed by iteration i, and the following processing is performed on each traversed light source, where i is an integer variable and 1≤i≤M:

[0013] When the light source in the on state is turned off, turning on the i-th light source;

[0014] When the i-th light source is in the on state, controlling the image acquisition device to acquire an image of the object to be acquired to obtain a target image;

[0015] When the iteration ends, the M target images obtained in iteration i are determined as image acquisition results.

[0016] An embodiment of the present application provides an image processing device, comprising:

[0017] a request response module, configured to, when the softbox is placed on the object to be captured, turn on a target light source among the M light sources in response to an image capture request, where M>1 and M is an integer;

[0018] A device focusing module, configured to control the image acquisition device to focus when the target light source is turned on;

[0019] an image acquisition module, configured to, when the image acquisition device is in a focused state, traverse the M light sources by iteration i, and perform the following processing on each traversed light source, where i is an integer variable and 1≤i≤M: when the light source in the turned-on state is turned off, turn on the i-th light source; and when the i-th light source is in the turned-on state, control the image acquisition device to capture an image of the object to be captured, thereby obtaining a target image;

[0020] The result acquisition module is configured to determine the M target images obtained in iteration i as image acquisition results when the iteration ends.

[0021] In an embodiment of the present application, the request response module is also used to obtain the image acquisition request in response to triggering the image acquisition switch when the softbox is placed on the object to be captured; or, when the softbox is placed on the object to be captured, receive the image acquisition request sent by the image acquisition trigger device.

[0022] In an embodiment of the present application, the image processing apparatus further includes a state adjustment module for adjusting the image acquisition device from the focus state to the focus-off state, and turning off the light source in the on state.

[0023] In an embodiment of the present application, the image processing device also includes an object rendering module, which is used to perform the following processing on each target image in the image acquisition result: texture extraction on the target image to obtain a target texture; from the target texture of each target image, a target texture set corresponding to the image acquisition result is obtained, and the target texture set includes M target textures; based on the target texture set, a virtual object corresponding to the object to be acquired is rendered in a virtual scene.

[0024] In an embodiment of the present application, the M light sources correspond to M different light source directions, and the light source direction is any one of the following: the image acquisition direction from the image acquisition device to the object to be acquired, one of the directions parallel to the object to be acquired, and one of the directions higher than a specified height of the plane where the object to be acquired is located.

[0025] An embodiment of the present application provides a computer-readable storage medium storing computer-executable instructions or a computer program. When the computer-executable instructions or the computer program are executed by a processor, the image processing method provided in the embodiment of the present application is implemented.

[0026] An embodiment of the present application provides a computer program product, including computer-executable instructions or a computer program. When the computer-executable instructions or the computer program are executed by a processor, the image processing method provided in the embodiment of the present application is implemented.

[0027] The embodiments of the present application have at least the following beneficial effects: when constructing an image processing device, a soft box is used as a supporting structure to fix the memory, M light sources, processor and image acquisition device used to capture images of the object to be captured, so that the weight of the constructed image processing device is less than the specified weight, thereby improving the portability of the image acquisition device; and further, when the image acquisition device is used to scan materials, the applicability of image acquisition can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 It is an exemplary material scanning device;

[0029] Figure 2 Schematic diagram of the architecture of the image processing system provided by the embodiment of the present application;

[0030] Figure 3 This embodiment of the present application provides a Figure 2 A schematic diagram of the structure of the terminal in FIG.

[0031] Figure 4 This is a schematic diagram of an exemplary image processing device provided in an embodiment of the present application. Figure 1 ;

[0032] Figure 5 This is a schematic diagram of an exemplary image processing device provided in an embodiment of the present application. Figure 2 ;

[0033] Figure 6 This is a schematic diagram of an exemplary image processing device provided in an embodiment of the present application. Figure 3 ;

[0034] Figure 7 This is a schematic diagram of an exemplary image processing device provided in an embodiment of the present application. Figure 4 ;

[0035] Figure 8 This is a flow chart of the image processing method provided in the embodiment of the present application. Figure 1 ;

[0036] Figure 9 This is a flow chart of the image processing method provided in the embodiment of the present application. Figure 2 ;

[0037] Figure 10 This is a connection diagram of an exemplary material scanning device provided in an embodiment of the present application;

[0038] Figure 11 is an exploded view of an exemplary material scanning device provided in an embodiment of the present application;

[0039] Figure 12 is a schematic diagram of an exemplary connection between a camera and a camera connector provided in an embodiment of the present application;

[0040] Figure 13 is a schematic diagram of an exemplary connection between a camera connector and a top flash bracket provided in an embodiment of the present application;

[0041] Figure 14 This is a schematic diagram of an exemplary connection between a circuit board connector and a top flash bracket provided in an embodiment of the present application;

[0042] Figure 15 This is a schematic diagram of an exemplary connection between a top-mounted flash bracket and a deep-throw softbox provided in an embodiment of the present application;

[0043] Figure 16 This is a schematic diagram of an exemplary connection between a lens light and a deep throw softbox provided in an embodiment of the present application;

[0044] Figure 17 This is a schematic diagram of an exemplary connection between a light bar and a deep-throw softbox provided in an embodiment of the present application;

[0045] Figure 18 is a structural diagram of an exemplary material scanning device provided in an embodiment of the present application;

[0046] Figure 19 is an exploded view of another exemplary material scanning device provided in an embodiment of the present application;

[0047] Figure 20 is a schematic diagram of an exemplary on-camera flash bracket provided in an embodiment of the present application;

[0048] Figure 21 is a schematic diagram of the dimensions of an exemplary camera connector provided in an embodiment of the present application;

[0049] Figure 22 is a schematic diagram of an exemplary camera connector provided in an embodiment of the present application;

[0050] Figure 23 is a schematic diagram of another exemplary camera connector provided in an embodiment of the present application;

[0051] Figure 24 is a schematic diagram of the dimensions of an exemplary circuit board connector provided in an embodiment of the present application;

[0052] Figure 25 is a schematic diagram of an exemplary circuit board connector provided in an embodiment of the present application;

[0053] Figure 26 is a schematic diagram of the dimensions of an exemplary lens light provided in an embodiment of the present application;

[0054] Figure 27 is a schematic diagram of an exemplary lens light provided in an embodiment of the present application;

[0055] Figure 28 is a schematic diagram of an exemplary camera provided in an embodiment of the present application;

[0056] Figure 29 is a schematic diagram of an exemplary material scanning device provided in an embodiment of the present application;

[0057] Figure 30 This is an exemplary control diagram provided in an embodiment of the present application;

[0058] Figure 31 is an exemplary control diagram of focusing and shooting provided in an embodiment of the present application;

[0059] Figure 32 is a schematic diagram of an exemplary logic controller provided in an embodiment of the present application;

[0060] Figure 33 is a schematic diagram of an exemplary relay provided in an embodiment of the present application;

[0061] Figure 34 is a schematic diagram of an exemplary connecting line provided in an embodiment of the present application;

[0062] Figure 35 This is an exemplary image acquisition flowchart provided in an embodiment of the present application. DETAILED DESCRIPTION

[0063] In order to make the purpose, technical solutions and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limiting this application. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0064] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0065] In the following description, the terms "first\second\third" etc. are used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" etc. can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0066] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories) or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.

[0067] Unless otherwise defined, all technical and scientific terms used in the embodiments of the present application have the same meanings as those commonly understood by those skilled in the art. The terms used in the embodiments of the present application are only for the purpose of describing the embodiments of the present application and are not intended to limit the present application.

[0068] The relevant data collection and processing in the embodiments of this application should be strictly in accordance with the requirements of relevant national laws and regulations when applied in examples, and the informed consent or separate consent of the personal information subject should be obtained. Subsequent data use and processing should be carried out within the scope of authorization of laws and regulations and the personal information subject.

[0069] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0070] 1) Artificial Intelligence (AI) refers to the theories, methods, techniques, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, to perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that aims to understand the essence of intelligence and produce new intelligent machines that can respond in a manner similar to human intelligence. By studying the design principles and implementation methods of various intelligent machines, AI enables them to possess the capabilities of perception, reasoning, and decision-making.

[0071] It should be noted that artificial intelligence technology is an interdisciplinary subject that covers a wide range of fields, including both hardware-level and software-level technologies. Basic artificial intelligence technologies generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, pre-trained model technology, operation / interaction systems, mechatronics, etc. Among them, the pre-trained model is also called a large model or a basic model; after fine-tuning, the pre-trained model can be widely used in downstream tasks in various directions of artificial intelligence. Artificial intelligence software technology includes several major directions, such as computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning. In the embodiment of the present application, the processing of rendering a virtual object corresponding to the object to be collected in a virtual scene can be achieved through artificial intelligence technology.

[0072] 2) Machine Learning (ML) is a multi-disciplinary interdisciplinary subject involving probability theory, statistics, approximation theory, convex analysis, and algorithmic complexity theory. It is used to study computer simulation or implementation of human learning behavior to acquire new knowledge or skills; reorganize existing knowledge structures to continuously improve their own performance. Machine learning is the core of artificial intelligence and the fundamental way to make computers intelligent. Machine learning applications are spread across all areas of artificial intelligence. Machine learning / deep learning generally includes technologies such as artificial neural networks, belief networks, reinforcement learning, transfer learning, and inductive learning. Large models are the latest developments in machine learning / deep learning, integrating the above technologies. In an embodiment of the present application, the processing of rendering virtual objects corresponding to the objects to be collected in a virtual scene can be implemented in combination with machine learning / deep learning.

[0073] 3) Artificial neural network, which is a mathematical model that imitates the structure and function of biological neural networks. In the embodiments of the present application, exemplary structures of artificial neural networks include graph convolutional networks (GCN, a neural network for processing graph-structured data), deep neural networks (DNN), convolutional neural networks (CNN), recurrent neural networks (RNN), neural state machines (NSM), and phase-function neural networks (PFNN). In the embodiments of the present application, the processing of rendering virtual objects corresponding to the objects to be collected in the virtual scene can be achieved through an artificial neural network model.

[0074] 4) Photometric stereo refers to the process of capturing images of an object from multiple light source directions and obtaining the object's shape and surface texture through the multiple images captured.

[0075] 5) Material scanning refers to the process of obtaining the texture map of the material to be rendered using the photometric stereo method; the image processing device provided in the embodiment of the present application can be implemented as a material scanning device.

[0076] It should be noted that in order to achieve material scanning in the related art, a hard locking method is usually used to support structures such as wood or metal; for example, see Figure 1 , Figure 1 is an exemplary material scanning device; Figure 1 As shown, the material scanning device 1-1 is a material scanning device that uses a metal structure as a support in a locking manner; as a result, the weight of the obtained material scanning device is greater than the specified weight, affecting the portability of the material scanning device; and further, when the material is scanned by the material scanning device, the applicability of image acquisition is affected.

[0077] In addition, because the various structures and support structures in the related-art material scanning devices are hard-locked, the position of the light source cannot be adjusted, thus affecting the image acquisition effect. Furthermore, when using the related-art material scanning devices for image acquisition, multiple physical buttons are often manually operated one by one. For example, during the image acquisition process, the physical switch of the light source is first manually triggered to turn on a specific light source and cut off irrelevant light sources, and then the shutter button of the camera is manually triggered to take the picture. This affects the image acquisition efficiency, and the manual triggering of multiple physical buttons causes the material scanning device to shake, affecting the image acquisition quality.

[0078] Based on this, the embodiments of the present application provide an image processing device, method, apparatus, computer-readable storage medium, and computer program product, which can improve the portability of image acquisition equipment, the applicability, quality, and efficiency of image acquisition. The following describes exemplary applications of the image processing device provided by the embodiments of the present application. The image processing device provided by the embodiments of the present application can be implemented as various types of terminals such as robots, smart phones, laptops, tablet computers, desktop computers, smart home appliances, smart car devices, and portable gaming devices, and can also be implemented as a server. The following describes exemplary applications of the image processing device when it is implemented as a terminal.

[0079] See also Figure 2 , Figure 2 Schematic diagram of the architecture of the image processing system provided in the embodiment of the present application; Figure 2 As shown, to support an image processing application, in an image processing system 100, a terminal 400 is connected to a terminal 600 (terminal 600-1 and terminal 600-2 are shown as examples) and a server 200 via a network 300. The network 300 can be a wide area network or a local area network, or a combination of the two. In addition, the image processing system 100 also includes a database 500 for providing data support to the server 200; and Figure 2 , which shows a case where the database 500 is independent of the server 200. In addition, the database 500 may also be integrated into the server 200, which is not limited in the embodiment of the present application.

[0080] Terminal 400 is configured to, when a softbox is placed on an object to be captured, turn on a target light source among M light sources in response to an image capture request; while the target light source is on, control the image capture device to focus; while the image capture device is in focus, traverse the M light sources through iteration i and perform the following processing on each traversed light source: when an on light source is off, turn on the i-th light source; while the i-th light source is on, control the image capture device to capture an image of the object to be captured to obtain a target image; and when the iteration ends, determine the M target images obtained in iteration i as image capture results. Terminal 400 is also configured to transmit the image capture results to server 200 via network 300.

[0081] The server 200 is configured to receive the image acquisition result sent by the terminal 400 via the network 300, obtain the texture map of the object to be acquired based on the image acquisition result, and send the texture map to the terminal 600 via the network 300.

[0082] The terminal 600 is configured to receive the texture map sent by the server 200 via the network 300 and render a virtual object in a virtual scene based on the texture map (graphic interface 610 - 1 and graphic interface 610 - 2 are shown as examples).

[0083] In some embodiments, the server 200 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It may also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. The terminal and the server may be connected directly or indirectly via wired or wireless communication, which is not limited in the embodiments of the present application.

[0084] See also Figure 3 , Figure 3 This embodiment of the present application provides a Figure 2 The schematic diagram of the terminal structure in Figure 3 As shown, the terminal 400 includes: at least one processor 410, a memory 450, at least one network interface 420 and a user interface 430. The various components in the terminal 400 are coupled together via a bus system 440. It is understood that the bus system 440 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 440 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, Figure 3 Various buses are labeled as bus system 440 .

[0085] The processor 410 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0086] The user interface 430 includes one or more output devices 431 that enable presentation of media content, including one or more speakers and / or one or more visual display screens. The user interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0087] The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memory, hard drives, optical drives, etc. The memory 450 may optionally include one or more storage devices that are physically remote from the processor 410.

[0088] The memory 450 includes volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 450 described in the embodiments of the present application is intended to include any suitable type of memory.

[0089] In some embodiments, the memory 450 can store data to support various operations, examples of which include programs, modules, and data structures, or a subset or superset thereof, as exemplified below.

[0090] Operating system 451, including system programs for processing various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, and driver layer, which are used to implement various basic services and process hardware-based tasks;

[0091] A network communication module 452 for reaching other electronic devices via one or more (wired or wireless) network interfaces 420 , exemplary network interfaces 420 including Bluetooth, Wi-Fi, and Universal Serial Bus (USB);

[0092] a presentation module 453 for enabling presentation of information via one or more output devices 431 (e.g., a display screen, a speaker, etc.) associated with the user interface 430 (e.g., a user interface for operating peripheral devices and displaying content and information);

[0093] The input processing module 454 is configured to detect one or more user inputs or interactions from one of the one or more input devices 432 and to translate the detected inputs or interactions.

[0094] In some embodiments, the image processing device provided in the embodiments of the present application can be implemented in a software manner. Figure 3An image processing device 455 stored in memory 450 is shown. This device can be software in the form of a program or plug-in, and includes the following software modules: a request response module 4551, a device focus module 4552, an image acquisition module 4553, a result acquisition module 4554, a state adjustment module 4555, and an object rendering module 4556. These modules are logical and can be arbitrarily combined or further separated according to the functions they implement. The functions of each module will be described below.

[0095] In some embodiments, the image processing device provided in the embodiments of the present application can be implemented in hardware. As an example, the image processing device provided in the embodiments of the present application can be a processor in the form of a hardware decoding processor, which is programmed to execute the image processing method provided in the embodiments of the present application. For example, the processor in the form of a hardware decoding processor can adopt one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), or other electronic components.

[0096] In some embodiments, the terminal or server can implement the image processing method provided in the embodiment of the present application by running various computer executable instructions or computer programs. For example, the computer executable instructions can be microprogram-level commands, machine instructions or software instructions. The computer program can be a native program or software module in the operating system; it can be a native application (APPlication, APP), that is, a program that needs to be installed in the operating system to run, such as a shooting APP; it can also be a small program that can be embedded in any APP, that is, a program that can be run only by downloading it to a browser environment. In short, the above-mentioned computer executable instructions can be instructions in any form, and the above-mentioned computer program can be an application, module or plug-in in any form.

[0097] Below, exemplary applications and implementations of the image processing device provided by the embodiments of the present application are described.

[0098] See also Figure 4 , Figure 4 This is a schematic diagram of an exemplary image processing device provided in an embodiment of the present application. Figure 1 ;like Figure 4As shown, the image processing device 4-1 includes a memory 4-11, a soft box 4-12, a processor 4-13, an image acquisition device 4-14 and M light sources 4-15; wherein the memory 4-11 is used to store computer-executable instructions or computer programs; the first end of the soft box 4-12 is used to fix the memory 4-11, the processor 4-13 and the image acquisition device 4-14, and the second end of the soft box 4-12 is used to fix the M light sources 4-15; the processor 4-13 is used to control the image acquisition device 4-14 and the M light sources 4-15 to perform image acquisition on the object to be acquired when the soft box 4-12 is placed on the object to be acquired and executes the computer-executable instructions or computer program stored in the memory 4-11 in response to an image acquisition request.

[0099] It should be noted that the softbox 4-12 is used to provide a light-shielded image capture environment within the softbox, thereby improving light softness, eliminating light spots and shadows in the captured image, and enhancing image capture quality. The softbox 4-12 can be at least one of a deep-polished softbox, a rectangular softbox, a square softbox, an octagonal softbox, a columnar softbox, an umbrella softbox, and a honeycomb softbox. The first end of the softbox 4-12 refers to the end facing away from the softlight surface, and the second end of the softbox refers to the end on which the softlight surface is located. Thus, the first end of the softbox 4-12 is opposite the second end of the softbox. The softlight surface refers to the side of the softbox that improves light softness, i.e., the interior of the softbox. Furthermore, the object to be captured is the object to be imaged from multiple light sources, i.e., the surface to be captured; for example, a carpet, a beach, a mountain, leaves, rocks, a building, a forest, etc. Here, the image capture device is used to capture images of the object to be captured, such as a camera, a smartphone, a webcam, etc.

[0100] It should also be noted that the M light sources correspond to M different light source directions, which can be any of the following: an image acquisition direction from the image acquisition device toward the object to be acquired, one of various directions parallel to the object to be acquired, or one of various directions at a specified height above the plane where the object to be acquired resides. Alternatively, the M light sources can be obtained through 3D printing.

[0101] It can be understood that the image acquisition direction can provide a lighting environment from the image acquisition device to the object to be captured; the light sources in various directions parallel to the object to be captured can provide a parallel lighting environment for the object to be captured; the light sources in various directions above the specified height of the plane where the object to be captured is located can provide a lighting environment diagonally above the object to be captured.

[0102] In the embodiment of the present application, the M light sources include N first light sources in the first dimension direction and MN second light sources in the second dimension direction.

[0103] It should be noted that the first dimension refers to the image acquisition direction from the image acquisition device toward the object to be captured, and the second dimension refers to each direction at a specified height above the plane where the object to be captured resides. N is an integer. For example, N first light sources are fixed at the most concave position of the soft light surface of the soft box, and M−N second light sources are fixed at edge positions away from the most concave position. Furthermore, the N first light sources can also be polarized light sources.

[0104] It is understood that when constructing an image processing device, using a softbox as a support structure to secure the memory, M light sources, processor, and image acquisition device used to capture images of the object to be captured makes the constructed image processing device weigh less than a specified weight, thereby improving the portability of the image acquisition device and, furthermore, enhancing the applicability of image capture when scanning materials using the image acquisition device. Furthermore, the M light sources correspond to M different light source directions, enabling the image processing device to capture images of the object to be captured from multiple different light source directions, thereby improving the quality of image capture.

[0105] In an embodiment of the present application, M light sources can be fixed on the soft box in a detachable manner, so that the M light sources are adjustable; furthermore, the types of objects to be captured by the image acquisition device can be broadened, and the quality, applicability and flexibility of image acquisition can be improved.

[0106] based on Figure 4 , see Figure 5 , Figure 5 This is a schematic diagram of an exemplary image processing device provided in an embodiment of the present application. Figure 2 ;like Figure 5 As shown, in the image processing device 4-1, the first end of the soft box 4-12 fixes the memory 4-11, the processor 4-13 and the image acquisition device 4-14 through the bracket 5-1; the first end of the soft box 4-12 is used to fix the first end of the bracket 5-1, the side end of the bracket 5-1 is used to fix the memory 4-11 and the processor 4-13, the second end of the bracket 5-1 is used to fix the image acquisition device 4-14, the first end of the bracket 5-1 is opposite to the second end of the bracket 5-1, and the side end of the bracket 5-1 is located between the first end of the bracket 5-1 and the second end of the bracket 5-1.

[0107] It should be noted that the bracket 5-1 is used to connect the memory 4-11, the soft box 4-12, the processor 4-13 and the image acquisition device 4-14, such as a top flash bracket, which can be obtained by three-dimensional printing.

[0108] In the embodiment of the present application, fixation can be achieved by at least one of detachable fixing methods such as pasting, bayonet and screw hole, and the embodiment of the present application is not limited to this.

[0109] based on Figure 5 , see Figure 6 , Figure 6 This is a schematic diagram of an exemplary image processing device provided in an embodiment of the present application. Figure 3 ;like Figure 6 As shown, in the image processing device 4-1, the second end of the bracket 5-1 fixes the image acquisition device 4-14 through the acquisition device connector 6-1; wherein, the second end of the bracket 5-1 is used to fix the first end of the acquisition device connector 4-14, the second end of the acquisition device connector 6-1 is used to fix the image acquisition device 4-14, and the first end of the acquisition device connector 6-1 is opposite to the second end of the acquisition device connector 6-1.

[0110] It should be noted that the image acquisition device 4-14 can be directly fixed to the second end of the bracket 5-1, or it can be fixed to the second end of the bracket 5-1 through the acquisition device connector 6-1, and this embodiment of the present application does not limit this.

[0111] In an embodiment of the present application, when the image acquisition device 4-14 is fixed to the second end of the bracket 5-1 through the acquisition device connector 6-1, and the fixing method is a screw hole, the second end of the bracket 5-1 includes at least one first screw hole, and the first end of the acquisition device connector 6-1 includes at least one second screw hole corresponding to the at least one first screw hole, and the first end of the acquisition device connector 6-1 is fixed to the second end of the bracket 5-1 through the at least one first screw hole and the at least one second screw hole; the image acquisition device 4-14 includes at least one device screw hole, and the second end of the acquisition device connector 6-1 includes at least one third screw hole corresponding to the at least one device screw hole, and the image acquisition device 4-14 is fixed to the second end of the acquisition device connector 6-1 through the at least one device screw hole and the at least one third screw hole.

[0112] It can be understood that the first end of the acquisition device connector 6-1 is fixed to the second end of the bracket 5-1 by means of screws, at least one first screw hole and at least one second screw hole, and the image acquisition device 4-14 is fixed to the second end of the acquisition device connector 6-1 by means of screws, at least one device screw hole and at least one third screw hole; since the screws are detachable, the acquisition device connector 6-1 and the bracket 5-1 are detachable, and the image acquisition device 4-14 and the acquisition device connector 6-1 are detachable, which improves the flexibility of the image processing device.

[0113] based on Figure 6 , see Figure 7 , Figure 7 This is a schematic diagram of an exemplary image processing device provided in an embodiment of the present application. Figure 4;like Figure 7 As shown, in the image processing device 4-1, the side end of the bracket 5-1 fixes the memory 4-11 and the processor 4-13 through the device connector 7-7; wherein, the side end of the bracket 5-1 is used to fix the side end of the device connector 7-7, and the carrying end of the device connector 7-7 is used to carry the memory 4-11 and the processor 4-13.

[0114] It should be noted that the side end of the device connector 7-7 is adjacent to the bearing end of the device connector 7-7; in addition, the device connector 7-7 can be obtained by three-dimensional printing.

[0115] In an embodiment of the present application, when the memory 4-11 and the processor 4-13 are fixed to the side end of the bracket 5-1 through the device connector 7-7, and the fixing method is screw holes, the side end of the bracket 5-1 includes at least one fourth screw hole, and the side end of the device connector 7-7 includes at least one fifth screw hole corresponding to the at least one fourth screw hole. The side end of the device connector 7-7 is fixed to the side end of the bracket 5-1 through at least one fourth screw hole and at least one fifth screw hole.

[0116] It can be understood that the side end of the device connector 7-7 is fixed to the side end of the bracket 5-1 by means of screws, at least one fourth screw hole and at least one fifth screw hole; since the screws are detachable, the device connector 7-7 and the bracket 5-1 are detachable, thereby improving the flexibility of the image processing equipment.

[0117] In an embodiment of the present application, the image processing device 4-1 also includes a switching device, the image acquisition device is connected to the switching device through an acquisition control line, the acquisition control line includes a focus switch, and the processor controls the focus switch through the switching device; wherein, controlling the focus switch is used to control the focus of the image acquisition device.

[0118] It should be noted that the switching device can be implemented using a relay and can be placed on the load-bearing end of the device connector. Furthermore, when the processor controls the focus switch to be in the closed state via the switching device, the image acquisition device can be controlled to focus; and when the processor controls the focus switch to be in the open state via the switching device, the image acquisition device can be controlled to focus off.

[0119] In an embodiment of the present application, the acquisition control line further includes an image acquisition switch, and the processor controls the image acquisition switch through a switch device; wherein, controlling the image acquisition switch is used to control the image acquisition device to perform image acquisition on the object to be acquired.

[0120] It should be noted that when the processor controls the image acquisition switch to be in the closed state through the switch device, the image acquisition device can be controlled to acquire images; and when the processor controls the image acquisition switch to be in the open state through the switch device, the image acquisition device can be controlled to be in the acquisition standby state. In other words, one end of the acquisition control line is used to connect to the image acquisition device, and the other end is used to connect to the switch device. In addition, the end used to connect to the switch device is a three-level contact, which can form a focus switch and a shutter switch.

[0121] In an embodiment of the present application, M light sources are connected to a switching device, and a processor controls the turning on and off of the M light sources through the switching device; in this way, imaging information of the object to be captured under different light source directions can be obtained.

[0122] The image processing method provided by the embodiment of the present application is described below. In addition, the image processing method provided by the embodiment of the present application is applied to various image acquisition scenarios such as cloud technology, artificial intelligence, smart transportation and games.

[0123] See also Figure 8 , Figure 8 This is a flow chart of the image processing method provided in the embodiment of the present application. Figure 1 ,in, Figure 8 The execution subject of each step is the image processing device; Figure 8 The steps shown are explained.

[0124] Step 101: When a soft box is placed on an object to be captured, in response to an image capture request, a target light source among M light sources is turned on.

[0125] In the embodiment of the present application, since the softbox is used to provide a shooting environment that is shielded from light (external illumination), the softbox is placed on the object to be captured. When the softbox is placed on the object to be captured and an image of the object is captured by an image processing device, a processor in the image processing device receives an image capture request. In response to the image capture request, the processor activates a target light source among the M light sources, thereby facilitating the target light source to control the image capture device to focus.

[0126] It should be noted that the target light source is any one or more of the M light sources, used to provide illumination for the focus of the image acquisition device; M>1, and M is an integer.

[0127] Step 102: When the target light source is in the on state, control the image acquisition device to focus.

[0128] In the embodiment of the present application, the target light source is turned on, so that the target light source is in the on state. When the target light source is in the on state, the processor in the image processing device controls the image acquisition device to focus, so that the image acquisition device is in the focused state. When the image acquisition device is in the focused state, the processor in the image processing device traverses M light sources by iterating i, and performs the following processing (i.e., steps 103 and 104) for each traversed light source, where i is an integer variable and 1≤i≤M. Each step is described below.

[0129] It should be noted that traversal is achieved by numbering the M light sources from 1 to M respectively.

[0130] Step 103: When the light source in the on state is turned off, turn on the i-th light source.

[0131] In the embodiment of the present application, the process of traversing M light sources is the process of switching the M light sources. Thus, before turning on the i-th light source, the processor in the image processing device first turns off the light source that is in the on state; and when the light source that is in the on state turns off, the processor turns on the i-th light source, so that the i-th light source is in the on state and the other light sources except the i-th light source are in the off state. The i-th light source is the light source currently traversed.

[0132] Step 104: When the i-th light source is in the on state, the image acquisition device is controlled to acquire an image of the object to be acquired to obtain a target image.

[0133] In the embodiment of the present application, when the i-th light source is in the on state, the processor in the image processing device controls the image acquisition device to acquire an image of the object to be acquired, and the obtained image acquisition result is the target image.

[0134] It should be noted that the target image refers to the imaging information of the object to be captured under any light source; in addition, when the i-th light source is turned on, the image capture device is in focus.

[0135] Step 105: When the iteration ends, the M target images obtained in iteration i are determined as the image acquisition results.

[0136] In an embodiment of the present application, when the processor in the image processing device traverses M light sources, it is determined that the iteration is completed; since the light source traversed in each iteration corresponds to a target image, M target images can be obtained for the M light sources; therefore, at the end of the iteration, M target images can be obtained; here, the M target images are referred to as image acquisition results.

[0137] It can be understood that when the softbox is placed on the object to be captured, it automatically controls the switching of M light sources, as well as the focus and image capture of the image capture device in response to the image capture request; on the one hand, it improves the intelligence of image capture and can improve image capture efficiency; on the other hand, it reduces the jitter of the image processing device and can improve the quality of image capture.

[0138] In an embodiment of the present application, when the softbox is placed on the object to be captured, and before the target light source among the M light sources is turned on in response to an image capture request, the image processing method further includes: when the softbox is placed on the object to be captured, the processor in the image processing device obtains an image capture request in response to triggering the image capture switch; or, when the softbox is placed on the object to be captured, the processor in the image processing device receives the image capture request sent by the image capture triggering device.

[0139] It should be noted that the image acquisition request is used to request image acquisition of the object to be acquired in multiple light source directions. It can be obtained through a physical button (called an image acquisition switch) or by receiving a message (called) sent by other devices (called an image acquisition trigger device), etc. The embodiments of the present application do not limit this.

[0140] In an embodiment of the present application, at the end of the iteration, the image processing method further includes: a processor in the image processing device adjusts the image acquisition device from a focus state to a focus-off state, and turns off the light source that is in the on state.

[0141] It should be noted that after the processor in the image processing device obtains the image acquisition result, it indicates that the image acquisition of the object to be acquired has been completed; therefore, at this time, the processor in the image processing device turns off the focus of the image acquisition device, that is, adjusts the image acquisition device from the focus state to the focus off state, and turns off the light source that is in the on state; in this way, the resource consumption of image acquisition can be reduced.

[0142] See also Figure 9 , Figure 9 This is a flow chart of the image processing method provided in the embodiment of the present application. Figure 2 ,in, Figure 9 The execution subject of each step is the image processing device; Figure 9 As shown, in the embodiment of the present application, step 105 also includes steps 106 to 108; that is, when the iteration is completed, the processor in the image processing device determines the M target images obtained in iteration i as the image acquisition results, and the image processing method also includes steps 106 to 108. Each step is explained below.

[0143] In the embodiment of the present application, the image acquisition result includes M target images, and the processor in the image processing device performs the following processing on each target image in the image acquisition result (ie, step 106).

[0144] Step 106: Extract texture from the target image to obtain target texture.

[0145] It should be noted that after obtaining the image acquisition results, the processor in the image processing device can send the image acquisition results to other devices to execute texture map acquisition, or perform texture extraction on each target image in the image acquisition results, and refer to the extracted texture as the texture of the target image; here, the texture of the target image is referred to as the target texture.

[0146] Step 107: Obtain a target texture set corresponding to the image acquisition result from the target texture of each target image, where the target texture set includes M target textures.

[0147] It should be noted that a corresponding target texture can be extracted from each target image. Thus, for an image acquisition result including M target images, the processor in the image processing device can obtain M target textures; here, the M target textures are referred to as a target texture set.

[0148] Step 108: Render a virtual object corresponding to the object to be captured in the virtual scene based on the target texture set.

[0149] In an embodiment of the present application, a processor in an image processing device obtains a texture map for rendering an object to be collected based on a target texture set, and renders a virtual object corresponding to the object to be collected in a virtual scene based on the texture map; wherein the rendered virtual object is an object in the virtual scene corresponding to the object to be collected, thereby improving the rendering quality of the virtual object.

[0150] The following describes an exemplary application of an embodiment of the present application in a practical application scenario. This exemplary application describes the process of photographing a plane to be photographed (referred to as the object to be captured), and further describes the use of multiple captured images (referred to as M target images) to generate texture rendering materials (referred to as texture maps).

[0151] See also Figure 10 , Figure 10 : is a connection diagram of an exemplary material scanning device provided in an embodiment of the present application; Figure 10As shown, in the exemplary material scanning device 10-1, the deep polish soft box 10-11 is taken as the main body. In the direction away from the soft light processing, the deep polish soft box 10-11 is connected to the top flash bracket 10-12 (called the bracket), and the top flash bracket 10-12 is connected to the camera connector 10-13 (called the acquisition device connector), and the camera connector 10-13 is used to connect the camera 10-14; the top flash bracket 10-12 can also be connected to the circuit board connector 10-15 (called the device connector), and the circuit board connector 10-15 is used to connect the circuit board 10-16; in addition, in the direction of the soft light processing, the deep polish soft box 10-11 is connected to the lens light 10-17 (called the first light source) and multiple (for example, 8) light strips 10-18 (called the second light source).

[0152] based on Figure 10 , see Figure 11 , Figure 11 is an exploded view of an exemplary material scanning device provided in an embodiment of the present application; Figure 11 As shown, the material scanning device 11-1 includes a deep polish soft box 11-11, a top flash bracket 11-12, a camera connector 11-13, a camera 11-14, a circuit board connector 11-15, a circuit board 11-16, a lens light 11-17 and 8 light strips 11-18.

[0153] The following describes each structure of the planar material scanning device 11-1.

[0154] The deep-throw softbox 11-11 is used for soft light processing and provides an internal light-proof shooting environment; it is also used as a support structure for other structures, that is, for attaching lens lights 11-17 and light strips 11-18, connecting cameras 11-14 and circuit boards 11-16; for example, a 90 cm deep-throw softbox with a Bowens mount.

[0155] A camera-mounted flash bracket 11-12 has one end for connecting to the end of the deep-throw softbox 11-11 facing away from the soft-light treatment, and the other end for connecting to the camera connector 11-13 and the circuit board connector 11-15; for example, a camera-mounted flash bracket with a Bowens mount.

[0156] The camera connector 11-13 is used to fix the camera 11-14.

[0157] Cameras 11-14 are used to capture images.

[0158] The circuit board connectors 11-15 are optional structures used to fix the circuit boards 11-16 (referred to as processors, memories and switch devices) to provide installation space for the expansion structure.

[0159] Circuit boards 11-16, used to implement extended functions

[0160] The lens lights 11-17 provide a ring-shaped light source emitted by the lens, such as a polarized lens light.

[0161] The light strips 11-18 are used as light sources in different directions to provide lights in different directions.

[0162] The connection between the various structures is described below.

[0163] 1) Connection between the camera and the camera connector.

[0164] It should be noted that the camera connector includes a bottom hole (called the third screw hole). Place the camera at the camera carrying position of the camera connector and insert the 3 / 4 camera screw into the bottom hole. Then rotate the 3 / 4 camera screw to fix the camera on the camera connector, thereby completing the connection between the camera and the camera connector.

[0165] See also Figure 12 , Figure 12 is a schematic diagram of an exemplary connection between a camera and a camera connector provided in an embodiment of the present application; Figure 12 As shown, the camera 12-1 is placed at the camera carrying position of the camera connector 12-2, and the connecting hole in the camera 12-1 is aligned with the bottom hole of the camera connector, the camera screw 12-3 is passed through the bottom hole and the connecting hole, and the camera screw 12-3 is rotated to fix the camera on the camera connector.

[0166] 2) Connection between the camera connector and the top flash bracket.

[0167] It should be noted that the camera connector also includes 6 screw holes (called at least one second screw hole position), and the top flash bracket includes 6 holes (called at least one first screw hole position) corresponding to the 6 screw holes one by one; after the 6 screw holes are aligned with the corresponding 6 holes, 6 screws (for example, butterfly screws with a thread diameter of 5 mm and a thread length of 8 mm) are respectively passed through the screw holes and the corresponding holes, and the screws are rotated to connect the camera connector and the top flash bracket, thereby completing the connection between the camera connector and the top flash bracket.

[0168] See also Figure 13 , Figure 13 : is a schematic diagram of an exemplary connection between a camera connector and a top flash bracket provided in an embodiment of the present application; Figure 13As shown, a camera connector 13-2 is placed on the top flash bracket 13-1, and the six screw holes of the camera connector 13-2 are aligned one by one with the six holes of the top flash bracket. By rotating each screw located in the connecting screw hole and the corresponding hole (screw 13-31 and screw 13-32 are shown as an example), the camera connector and the top flash bracket are fixed.

[0169] 3) Connection between the circuit board connector and the top flash bracket.

[0170] It should be noted that the side end of the circuit board connector includes three holes (called at least one fifth screw hole), and the side end of the top flash bracket includes three holes (called at least one fourth screw hole) corresponding to the three holes of the circuit board connector; after the three holes of the circuit board connector are aligned with the three holes on the top flash bracket, three screws (for example, two butterfly screws with a thread diameter of 3 mm and a thread length of 14 mm, and one butterfly screw with a thread diameter of 5 mm and a thread length of 25 mm) and the corresponding holes are used to fix the circuit board connector and the top flash bracket to achieve the connection between the circuit board connector and the top flash bracket.

[0171] See also Figure 14 , Figure 14 : is a schematic diagram of an exemplary connection between a circuit board connector and a top flash bracket provided in an embodiment of the present application; Figure 14 As shown, the side end of the circuit board connector 14 - 1 and the side end of the top flash bracket 14 - 2 are fixed through their respective three holes, and the fixation is achieved by three screws 14 - 3 .

[0172] 4) Connection between the top flash bracket and the deep throw softbox.

[0173] It should be noted that the connection between the on-camera flash bracket and the deep cast soft box can be achieved through a bayonet (such as the Baorong bayonet. In this case, the on-camera flash bracket and the deep cast soft box can be fixed by rotating, thereby achieving the connection between the on-camera flash bracket and the deep cast soft box).

[0174] See also Figure 15 , Figure 15 : is a schematic diagram of an exemplary connection between a top flash bracket and a deep throw softbox provided in an embodiment of the present application; Figure 15 As shown, the image 15-1 shows the bayonet 15-11 of the deep-throw softbox. Figure 15-2 Shown is the bayonet 15 - 21 of the on-camera flash bracket. The bayonet 15 - 11 and the bayonet 15 - 21 are fixed by rotation to achieve the connection between the on-camera flash bracket and the deep throw soft box.

[0175] 5) Connection between lens light and deep throw softbox.

[0176] It should be noted that the lens light and the deep throw softbox can be connected by pasting.

[0177] See also Figure 16 , Figure 16 : is a schematic diagram of an exemplary connection between a lens light and a deep-throw softbox provided in an embodiment of the present application; Figure 16 As shown, the lens light 16 - 1 is attached to the deep-throw softbox 16 - 2 by means of double-sided adhesive Velcro.

[0178] 6) Connection between light strip and deep throw softbox.

[0179] It should be noted that the light strip and the deep cast softbox can be connected by pasting.

[0180] See also Figure 17 , Figure 17 This is a schematic diagram of an exemplary connection between a light bar and a deep-throw softbox provided in an embodiment of the present application; Figure 17 As shown, the light strip 17 - 1 is attached to the deep-cast soft box 17 - 2 by means of double-sided adhesive Velcro.

[0181] Based on the connections between the structures, see Figure 18 , Figure 18 is a structural diagram of an exemplary material scanning device provided in an embodiment of the present application; Figure 18 As shown, Image 18-1 presents a front view of the overall assembly structure of the material scanning device, Image 18-2 presents a side view of the overall assembly structure of the material scanning device, and Image 18-3 presents a bottom view of the overall assembly structure of the material scanning device.

[0182] based on Figure 18 , see Figure 19 , Figure 19 is an exploded view of another exemplary material scanning device provided in an embodiment of the present application; Figure 19 As shown, Image 19-1 is an exploded view of Image 18-1, Image 19-2 is an exploded view of Image 18-2, and Image 19-3 is an exploded view of Image 18-3.

[0183] The origins of various structures in the material scanning device 11 - 1 are described below.

[0184] The on-camera flash bracket is obtained by punching holes in the initially obtained flash bracket based on the holes on the camera connector and the circuit board connector, thereby obtaining the on-camera flash bracket.

[0185] For example, see Figure 20 , Figure 20is a schematic diagram of an exemplary top-mounted flashlight bracket provided in an embodiment of the present application; Figure 20 As shown, the on-camera flash bracket is shown from angles 20 - 1 , 20 - 2 , and 20 - 3 .

[0186] The camera connector can be obtained through 3D printing.

[0187] For example, see Figure 21 , Figure 21 is a schematic diagram of the dimensions of an exemplary camera connector provided in an embodiment of the present application; Figure 21 As shown, the size information of the camera connecting part is shown from angles 21-1, 21-2 and 21-3.

[0188] See also Figure 22 , Figure 22 is a schematic diagram of an exemplary camera connector provided in an embodiment of the present application; Figure 22 As shown, a line drawing of the camera attachment 22-3 is shown from angles 22-1 and 22-2.

[0189] See also Figure 23 , Figure 23 is a schematic diagram of another exemplary camera connector provided in an embodiment of the present application; Figure 23 As shown, the camera connecting part 23 - 3 obtained by three-dimensional printing is shown from angles 23 - 1 and 23 - 2 .

[0190] Circuit board connectors can be obtained through three-dimensional printing.

[0191] For example, see Figure 24 , Figure 24 is a schematic diagram of the dimensions of an exemplary circuit board connector provided in an embodiment of the present application; Figure 24 As shown, the dimension information of the circuit board connector is shown from angles 24 - 1 , 24 - 2 and 24 - 3 .

[0192] See also Figure 25 , Figure 25 is a schematic diagram of an exemplary circuit board connector provided in an embodiment of the present application; Figure 25 As shown, a line drawing of the camera connecting member 25 - 1 and a camera connecting member 25 - 2 obtained by three-dimensional printing are shown.

[0193] The lens light adopts a polarized lens light and can be obtained through three-dimensional printing.

[0194] For example, see Figure 26 , Figure 26 is a schematic diagram of the dimensions of an exemplary lens light provided in an embodiment of the present application; Figure 26 As shown, the size information of the lens light is shown from angles 26 - 1 and 26 - 2 .

[0195] See also Figure 27 , Figure 27 is a schematic diagram of an exemplary lens light provided in an embodiment of the present application; Figure 27 As shown, a line drawing of the lens light 27-1 and a lens light 27-2 obtained by three-dimensional printing are shown.

[0196] Light strips, for example, use black frame light strips with specifications of 28 cm * 2 cm * 1 cm.

[0197] The camera can be any camera.

[0198] For example, see Figure 28 , Figure 28 is an exemplary camera schematic diagram provided in an embodiment of the present application; Figure 28 As shown, camera 28 - 1 is shown.

[0199] For example, see Figure 29 , Figure 29 is a schematic diagram of an exemplary material scanning device provided in an embodiment of the present application; Figure 29 As shown, the material scanning device 29 - 3 is shown at angle 29 - 1 and angle 29 - 2 .

[0200] The following describes the control process of the plane material scanning device.

[0201] join Figure 30 , Figure 30 This is an exemplary control diagram provided in the embodiment of the present application; Figure 30 As shown, through a one-touch trigger operation 30-1, the trigger logic controller 30-2 (which can be implemented as a chip, called a processor) controls the opening of 9 light sources 30-4 (1 lens light and 8 light strips) and the focus and shooting of the camera 30-5 through a relay 30-3 (called a switching device).

[0202] It should be noted that the logic controller controls the on and off of the negative pole through the relay to achieve the control of the 9 light sources. Figure 31 , Figure 31 is an exemplary control diagram of focusing and shooting provided in an embodiment of the present application; Figure 31 As shown, the logic controller controls the focus switch 31-1 through the relay to control the on / off connection with the ground line to achieve the focus control of the camera; the logic controller controls the shutter switch 31-2 through the relay to control the on / off connection with the ground line to achieve the shooting control of the camera.

[0203] For example, see Figure 32 , Figure 32 is a schematic diagram of an exemplary logic controller provided in an embodiment of the present application; Figure 32 As shown, a logic controller 32 - 1 is shown.

[0204] For example, see Figure 33 , Figure 33 is a schematic diagram of an exemplary relay provided in an embodiment of the present application; Figure 33 As shown, relay 33 - 1 is shown.

[0205] For example, see Figure 34 , Figure 34 is a schematic diagram of an exemplary connection line provided in an embodiment of the present application; Figure 34 As shown, a connecting line 34-1 (called acquisition control line) is shown, which converts the camera's control interface into a 3.5 mm three-pole contact: ground, shutter and focus.

[0206] join Figure 35 , Figure 35 This is an exemplary image acquisition flow chart provided in the embodiment of the present application; Figure 35 As shown, the exemplary image acquisition process includes steps 201 to 213, and each step is described below.

[0207] Step 201: Start image acquisition.

[0208] Step 202: Receive a one-key trigger operation.

[0209] Step 203: In response to a one-button trigger operation, light No. 1 is turned on.

[0210] It should be noted that the 9 light sources are numbered from 0 to 8; light No. 1 is turned on first for camera focusing; here, any numbered light can be turned on when the camera is focusing.

[0211] Step 204: Focus the camera with light No. 1 turned on.

[0212] It should be noted that when focusing is completed, the focus state is saved, that is, the focus is locked.

[0213] Step 205: When the camera is in focus, initialize the iteration variable x to 0.

[0214] It should be noted that the variable x is set to 0 and the traversal process of all light sources is started.

[0215] Step 206: Turn off all lights.

[0216] It should be noted that when all lights are turned off, the environment is completely dark.

[0217] Step 207: Turn on the xth light.

[0218] Step 208: Capture images.

[0219] Step 209: Determine whether all lights have been traversed. If yes, go to step 211; if not, go to step 210.

[0220] Step 210: Increment the iteration variable x. Then, execute step 206.

[0221] Step 211: Turn off the camera focus function.

[0222] Step 212: Turn off all lights.

[0223] Step 213: End image acquisition.

[0224] It should be noted that image acquisition is terminated by turning off the focus lock state and all light sources.

[0225] It can be understood that, from the hardware equipment aspect, the embodiment of the present application is based on a camera, a softbox, a top flash bracket and lights to form a set of hardware structures for material scanning, which reduces the weight of the material scanning equipment; in addition, the hardware structure includes a lens ring light (cross-polarized with the lens) and light sources in eight directions to provide sufficient and balanced lighting for the subject; and each structure in the hardware structure is detachable, which enhances the flexibility and portability of the material scanning equipment. From the aspect of automated shooting, the embodiment of the present application integrates single-chip microcomputers, relays, camera control lines, etc., and is equipped with a precisely adapted controller to realize a one-button shooting process of the device lights and the camera, thereby improving the shooting speed. By minimizing the touch of the shooting equipment throughout the entire process, the camera shake is effectively reduced, thereby reducing the defective rate of image acquisition, and also improving the image quality.

[0226] The following continues to describe the exemplary structure of the image processing device 455 provided in the embodiment of the present application implemented as a software module. In some embodiments, such as Figure 3 As shown, the software modules stored in the image processing device 455 of the memory 450 may include:

[0227] a request response module 4551 for turning on a target light source among M light sources in response to an image acquisition request when the softbox is placed on the object to be captured, where M>1 and M is an integer;

[0228] The device focusing module 4552 is used to control the image acquisition device to focus when the target light source is turned on;

[0229] The image acquisition module 4553 is configured to, when the image acquisition device is in a focused state, traverse the M light sources by iteration i, and perform the following processing on each traversed light source, where i is an integer variable and 1≤i≤M: when the light source in the turned-on state is turned off, turn on the i-th light source; and when the i-th light source is in the turned-on state, control the image acquisition device to capture an image of the object to be captured to obtain a target image;

[0230] The result acquisition module 4554 is configured to determine the M target images obtained in iteration i as image acquisition results when the iteration ends.

[0231] In an embodiment of the present application, the request response module 4551 is also used to obtain the image acquisition request in response to triggering the image acquisition switch when the softbox is placed on the object to be captured; or, when the softbox is placed on the object to be captured, receive the image acquisition request sent by the image acquisition trigger device.

[0232] In the embodiment of the present application, the image processing device 455 further includes a state adjustment module 4555 for adjusting the image acquisition device from the focus state to the focus-off state, and turning off the light source in the on state.

[0233] In an embodiment of the present application, the image processing device 455 also includes an object rendering module 4556, which is used to perform the following processing on each of the target images in the image acquisition results: texture extraction is performed on the target image to obtain a target texture; a target texture set corresponding to the image acquisition result is obtained from the target texture of each target image, and the target texture set includes M target textures; based on the target texture set, a virtual object corresponding to the object to be acquired is rendered in a virtual scene.

[0234] In an embodiment of the present application, the M light sources correspond to M different light source directions, and the light source direction is any one of the following: the image acquisition direction from the image acquisition device to the object to be acquired, one of the directions parallel to the object to be acquired, and one of the directions higher than a specified height of the plane where the object to be acquired is located.

[0235] The present invention provides a computer program product comprising computer-executable instructions or a computer program stored in a computer-readable storage medium. A processor of an image processing device reads the computer-executable instructions or the computer program from the computer-readable storage medium and executes the computer-executable instructions or the computer program, causing the image processing device to perform the image processing method described above in the present invention.

[0236] The embodiment of the present application provides a computer-readable storage medium in which computer-executable instructions or computer programs are stored. When the computer-executable instructions or computer programs are executed by a processor, the processor will execute the image processing method provided by the embodiment of the present application, for example, Figure 8 The image processing method is shown.

[0237] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or may be various devices including one or any combination of the above memories.

[0238] In some embodiments, computer-executable instructions may be in the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0239] As an example, computer-executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file that stores other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinating files (e.g., files storing one or more modules, subroutines, or code portions).

[0240] As an example, computer-executable instructions may be deployed to be executed on one electronic device (in which case, this one electronic device is the image processing device), or on multiple electronic devices located at one location (in which case, the multiple electronic devices located at one location are the image processing devices), or on multiple electronic devices distributed at multiple locations and interconnected through a communication network (in which case, the multiple electronic devices distributed at multiple locations and interconnected through a communication network are the image processing devices).

[0241] It is understood that in the embodiments of this application, when data such as target information obtained through image acquisition is involved and is applied to specific products or technologies, user permission or consent is required, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. In addition, the collection and processing of relevant data in this application should be strictly in accordance with the requirements of the relevant national laws and regulations when applied in examples, and the informed consent or separate consent of the personal information subject should be obtained. Subsequent data use and processing should be carried out within the scope of authorization of the laws and regulations and the personal information subject.

[0242] In summary, when constructing an image processing device, the embodiments of the present application utilize a softbox as a supporting structure to secure the memory, M light sources, processor, and image acquisition device used to capture images of the object to be captured. This allows the constructed image processing device to weigh less than a specified weight, thereby improving the portability of the image acquisition device. Furthermore, when the image acquisition device is used to scan materials, the applicability of image capture can be improved. Furthermore, the M light sources correspond to M different light source directions, which can enhance the lighting effect. Furthermore, by automatically controlling the image acquisition device and the M light sources in response to an image capture request to capture an image of the object to be captured, jitter to the image acquisition device can be reduced, thereby improving image capture quality.

[0243] The above description is merely an embodiment of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent replacements, and improvements made within the spirit and scope of the present application are included in the scope of protection of the present application.

Claims

1. An image processing device, characterized in that The image processing device includes: a memory, a soft box, a processor, an image acquisition device and M light sources, where M>1 and M is an integer; The memory is used to store computer executable instructions or computer programs; The first end of the soft box is used to fix the memory, the processor and the image acquisition device, and the second end of the soft box is used to fix the M light sources. The first end of the soft box refers to the end away from the soft light surface, and the second end of the soft box refers to the end where the soft light surface is located; The processor is configured to control the image acquisition device and the M light sources to capture an image of the object to be captured when the softbox is placed on the object to be captured and, in response to an image capture request, execute the computer-executable instructions or computer program stored in the memory.

2. The image processing device according to claim 1, wherein The first end of the softbox fixes the memory, the processor and the image acquisition device via a bracket; The first end of the softbox is used to fix the first end of the bracket, the side end of the bracket is used to fix the memory and the processor, and the second end of the bracket is used to fix the image acquisition device. The first end of the bracket is opposite to the second end of the bracket, and the side end of the bracket is located between the first end of the bracket and the second end of the bracket.

3. The image processing device according to claim 2, wherein The second end of the bracket fixes the image acquisition device via an acquisition device connector; The second end of the bracket is used to fix the first end of the acquisition device connector, the second end of the acquisition device connector is used to fix the image acquisition device, and the first end of the acquisition device connector is opposite to the second end of the acquisition device connector.

4. The image processing device according to claim 3, wherein The second end of the bracket includes at least one first screw hole, and the first end of the acquisition device connecting member includes at least one second screw hole corresponding to the at least one first screw hole, and the first end of the acquisition device connecting member is fixed to the second end of the bracket through the at least one first screw hole and the at least one second screw hole; The image acquisition device includes at least one device screw hole, and the second end of the acquisition device connecting piece includes at least one third screw hole corresponding to the at least one device screw hole. The image acquisition device is fixed to the second end of the acquisition device connecting piece through at least one device screw hole and at least one third screw hole.

5. The image processing device according to any one of claims 2 to 4, characterized in that The side ends of the bracket fix the memory and the processor via device connectors; The side end of the bracket is used to fix the side end of the device connector, the bearing end of the device connector is used to bear the memory and the processor, and the side end of the device connector is adjacent to the bearing end of the device connector.

6. The image processing device according to any one of claims 1 to 4, characterized in that The M light sources include N first light sources in the first dimension direction and MN second light sources in the second dimension direction, where the first dimension direction refers to the image acquisition direction from the image acquisition device to the object to be acquired, and the second dimension direction refers to each direction at a specified height above the plane where the object to be acquired is located, and N is an integer.

7. The image processing device according to claim 6, wherein N first light sources are fixed at the most concave position of the soft light surface of the soft box, and MN second light sources are fixed at edge positions deviating from the most concave position.

8. The image processing device according to any one of claims 1 to 4, characterized in that The image processing device also includes a switch device, the image acquisition device is connected to the switch device via an acquisition control line, the acquisition control line includes a focus switch, and the processor controls the focus switch through the switch device to control the focus of the image acquisition device.

9. The image processing device according to claim 8, wherein The acquisition control line further includes an image acquisition switch. The processor controls the image acquisition switch through the switch device. The image acquisition switch is controlled to control the image acquisition device to acquire an image of the object to be acquired.

10. The image processing device according to claim 8, wherein The M light sources are connected to the switch device, and the processor controls the turning on and off of the M light sources through the switch device.

11. An image processing method, characterized in that: Applied to the image processing device according to any one of claims 1 to 10, the method comprising: When the softbox is placed on the object to be captured, in response to an image capture request, a target light source among M light sources is turned on, where M>1 and M is an integer; When the target light source is in an on state, controlling the image acquisition device to focus; When the image acquisition device is in a focusing state, the M light sources are traversed by iteration i, and the following processing is performed on each traversed light source, where i is an integer variable and 1≤i≤M: When the light source in the on state is turned off, turning on the i-th light source; When the i-th light source is in the on state, controlling the image acquisition device to acquire an image of the object to be acquired to obtain a target image; When the iteration ends, the M target images obtained in iteration i are determined as image acquisition results.

12. The method according to claim 11, characterized in that When the softbox is placed on the object to be captured, and before turning on the target light source among the M light sources in response to the image capture request, the method further includes: When the softbox is placed on the object to be captured, in response to triggering an image capture switch, obtaining the image capture request; Alternatively, when the softbox is placed on the object to be captured, the image capture request sent by an image capture triggering device is received.

13. The method according to claim 11, characterized in that When the iteration ends, the method further includes: The image acquisition device is adjusted from the focus state to the focus off state, and the light source in the on state is turned off.

14. The method according to claim 11, characterized in that When the iteration ends, after determining the M target images obtained in iteration i as image acquisition results, the method further includes: Perform the following processing on each target image in the image acquisition result: Performing texture extraction on the target image to obtain a target texture; Obtaining a target texture set corresponding to the image acquisition result from the target texture of each target image, wherein the target texture set includes M target textures; Based on the target texture set, a virtual object corresponding to the object to be captured is rendered in a virtual scene.

15. The method according to claim 11, characterized in that The M light sources correspond to M different light source directions, and the light source direction is any one of the following: the image acquisition direction from the image acquisition device to the object to be acquired, one of the directions parallel to the object to be acquired, and one of the directions higher than the specified height of the plane where the object to be acquired is located.

16. An image processing device, characterized in that: The image processing device comprises: a request response module, configured to, when the softbox is placed on the object to be captured, turn on a target light source among the M light sources in response to an image capture request, where M>1 and M is an integer; A device focusing module, configured to control the image acquisition device to focus when the target light source is turned on; an image acquisition module, configured to, when the image acquisition device is in a focused state, traverse the M light sources by iteration i, and perform the following processing on each traversed light source, where i is an integer variable and 1≤i≤M: when the light source in the turned-on state is turned off, turn on the i-th light source; and when the i-th light source is in the turned-on state, control the image acquisition device to capture an image of the object to be captured, thereby obtaining a target image; The result acquisition module is configured to determine the M target images obtained in iteration i as image acquisition results when the iteration ends.

17. A computer-readable storage medium storing computer-executable instructions or a computer program, characterized in that: When the computer executable instructions or computer program are executed by a processor, the image processing method according to any one of claims 11 to 15 is implemented.

18. A computer program product comprising computer executable instructions or a computer program, characterized in that: When the computer executable instructions or computer program are executed by a processor, the image processing method according to any one of claims 11 to 15 is implemented.

Images