Three-dimensional face image capturing device

Abstract

A face image capturing device for capturing a three-dimensional face image of a user may include: a body including a holder and a head connected to an upper portion of the holder; a first arm rotatably connected to one side of the holder and having a longitudinal direction; a second arm rotatably connected to the other side of the holder and having a longitudinal direction; a front camera disposed on the head and disposed so as to face an imaging position; a lower camera disposed on the holder and disposed so as to face the imaging position; one or more first side cameras disposed on the first arm; one or more second side cameras disposed on the second arm; a projector disposed on the head and configured to irradiate a set structured light pattern toward the imaging position; and a processor for adjusting the orientation of the projector and the camera based on the images captured by the plurality of cameras.

Description

Technical Field

[0001] The present disclosure relates to a three-dimensional face image capturing device. Background Art

[0002] Typically, a device for capturing a three-dimensional image of a subject is handheld by a photographer. This handheld image capture device is configured to capture images of the subject at various angles by changing the shooting position of the subject. During the process of the handheld image capture device capturing the image of the subject, slight movements of the subject or movements of the photographer or the image capture device itself may cause the quality of the captured image to deteriorate. Furthermore, when generating a three-dimensional image by capturing images of the subject at various angles in the conventional manner, the time difference in the process of capturing a single image may cause errors in the image or the three-dimensional image generation process may consume a lot of time.

[0003] Therefore, there is a real need for an image capture device that can capture a three-dimensional image of a subject more quickly and accurately. In this regard, Korean Patent Publication No. 10-2016-0148885 discloses an invention related to three-dimensional (3D) modeling and a three-dimensional image creation method using a two-dimensional (2D) image.

[0004] The above-mentioned background technology is mastered or understood by the inventor in the process of deriving the disclosure content of this application, and cannot be said to be a public known technology disclosed to the general public before this application. Summary of the invention

[0005] Technical issues

[0006] An object of an embodiment of the present disclosure is to provide an image capturing device that can capture an accurate three-dimensional facial image of a user.

[0007] Still another object of an embodiment of the present disclosure is to provide an image capturing device that can change its form according to a usage state for convenient storage.

[0008] Another object of an embodiment of the present disclosure is to provide an image capturing device that can generate a three-dimensional face image by combining face images at various angles captured simultaneously by multiple cameras.

[0009] Technical Solution

[0010] A facial image capture device of one embodiment can capture a three-dimensional facial image of a user. In one embodiment, the facial image capture device may include: a body, including a bracket and a head, the head being connected to the upper portion of the bracket; a first arm being connected to one side of the bracket in a rotatable manner and having a length direction; a second arm being connected to the other side of the bracket in a rotatable manner and having a length direction; a front camera, arranged on the head and arranged in a manner facing a shooting position; one or more first side cameras, arranged on the first arm; one or more second side cameras, arranged on the second arm; a projector, arranged on the head, for irradiating a set structured light pattern toward the shooting position; and a processor, adjusting the orientation of the projector and the camera based on the images captured by the plurality of cameras. In one embodiment, the first arm and the second arm can be respectively rotated relative to the body in a manner that changes between a first state in which the arm is unfolded relative to the body and a second state in which the arm is folded relative to the body. In one embodiment, the first side camera and the second side camera can be oriented to the shooting position in the first state.

[0011] In one embodiment, the first side camera may include: a 1-1 side camera, which is disposed at the end of the first arm in the length direction; and a 1-2 side camera, which is located between the main body and the 1-1 side camera. In one embodiment, the second side camera may include: a 2-1 side camera, which is disposed at the end of the second arm in the length direction; and a 2-2 side camera, which is disposed between the main body and the 2-1 side camera. In the first state, the 1-1 side camera and the 2-1 side camera are used to photograph the left side and right side of the user's face, respectively, and the 1-2 side camera and the 2-2 side camera are used to photograph the left side and right side of the user's teeth, respectively.

[0012] In one embodiment, the first arm may include a first supporting surface for configuring the first side camera, and the second arm may include a second supporting surface for configuring the second side camera, and the first supporting surface and the second supporting surface are formed as curved surfaces so as to surround the shooting position into an arc with the bracket in between.

[0013] In one embodiment, the head may be formed with a mirror facing the shooting position, and may include a mirror surface for configuring the front camera and the projector. In one embodiment, the front camera, the first side camera, and the second side camera may simultaneously capture a single image of the user at various angles at the shooting position in the first state. In one embodiment, the processor may operate in a manner of generating a three-dimensional image of the user based on a single image of the user captured simultaneously by a plurality of the cameras.

[0014] In one embodiment, the image capture device may further include a pair of hinge modules, so that the first arm and the second arm are respectively connected to the body in a rotatable manner. In one embodiment, each of the hinge modules may include: a fixed body fixed to the body; a hinge body connected in a manner that can rotate relative to the fixed body with the rotation axis as the center, for fixing the arm; a guide component connected to the fixed body and surrounding at least a portion of the circumference of the hinge body with the rotation axis as the center; and a stopper connected to the hinge body and used to limit the rotation of the hinge body relative to the fixed body by selectively fastening to the guide component.

[0015] In one embodiment, the guide member may be in an arc shape extending in a peripheral direction with the rotation axis as the center. In one embodiment, the guide member may include one or more insertion holes arranged in a spaced relationship in the peripheral direction and extending in a direction perpendicular to the rotation axis. In one embodiment, the stopper may include a plunger pin that can be inserted into the insertion hole and move in a fastening direction perpendicular to the rotation axis, and when the plunger pin is inserted into the insertion hole, the rotation of the rotating body relative to the fixed body can be restricted.

[0016] In one embodiment, the stopper may further include: a support member connected to the hinge body in a manner of being located outside the guide member with the rotation axis as a reference, and installed in a manner such that the plunger pin can partially move along the fastening direction; and an elastic member connected to the plunger pin, applying pressure to the plunger pin toward the guide member. In one embodiment, when overlapping with the insertion hole, the plunger pin can be inserted into the insertion hole by the pressure applied by the elastic member.

[0017] In one embodiment, the guide member may include: a first insertion hole overlapping the plunger pin in the first state; and a second insertion hole overlapping the plunger pin in the second state.

[0018] In one embodiment, the facial image capture device may further include a calibration plate, which is detachably connected to the body, and is aligned and arranged at the shooting position when connected to the body, and the calibration plate includes a pattern portion, and the pattern portion is formed with a pattern corresponding to the pattern light irradiated by the projector. In one embodiment, the processor captures an image of the pattern portion irradiated with the pattern light through the front camera, the first side camera, and the second side camera, and can perform a calibration operation by adjusting the orientation of the projector and the camera so that the captured image of the pattern portion matches the set reference image.

[0019] In one embodiment, the hinge module may further include: a rotary motor for rotating the hinge body around the rotary shaft; and an auxiliary motor for moving the plunger pin along the tightening direction. In one embodiment, the processor may control the activation of the rotary motor and the auxiliary motor in a manner corresponding to the calibration action.

[0020] A facial image capturing device for capturing a three-dimensional facial image of a user according to an embodiment may include: a body, including a bracket and a head, the head being connected to an upper portion of the bracket; a first arm being rotatably connected to one side of the bracket and having a length direction; a second arm being rotatably connected to the other side of the bracket and having a length direction; a front camera, disposed on the head and disposed toward a shooting position; one or more first side cameras, disposed on the first arm; one or more second side cameras, disposed on the second arm; a projector, disposed on the head and configured to irradiate a set structured light pattern toward the shooting position; and A pair of hinge modules are rotatably connected to the main body so that the states of the first arm and the second arm can be changed between a first state in which the first arm is unfolded relative to the main body and a second state in which the first arm is folded relative to the main body, respectively. The first side camera and the second side camera are oriented to the shooting position in the first state. Each of the hinge modules may include: a fixed body fixed to the main body; a hinge body connected in a manner in which the hinge body can be rotated relative to the fixed body with a rotation axis as a center, for fixing the arm; and a guide component connected to the fixed body and surrounding at least a portion of the hinge body with the rotation axis as a center.

[0021] In one embodiment, each of the hinge modules may further include a stopper connected to the hinge body, and configured to limit the rotation of the hinge body relative to the fixed body by being selectively fastened to the guide component.

[0022] In one embodiment, the guide component may be in the shape of an arc extending along a circumferential direction with the rotation axis as the center, and may include one or more insertion holes spaced apart along the circumferential direction and passing through a direction perpendicular to the rotation axis. The stopper may include a plunger pin that can be inserted into the insertion hole and moved along a fastening direction perpendicular to the rotation axis. When the plunger pin is inserted into the insertion hole, the rotation of the rotating body relative to the fixed body can be restricted.

[0023] In one embodiment, the stopping portion may further include: a supporting component connected to the hinge body in a manner that the rotating axis is located outside the guide component as a reference, so that the plunger pin is installed in a manner that can partially move along the fastening direction; and an elastic component connected to the plunger pin, applying pressure to the plunger pin toward the guide component, and when overlapping with the insertion hole, the plunger pin can be inserted into the insertion hole by the pressure applied by the elastic component.

[0024] In one embodiment, the guide member may include: a first insertion hole overlapping the plunger pin in the first state; and a second insertion hole overlapping the plunger pin in the second state.

[0025] Beneficial Effects

[0026] The facial image capturing device of an embodiment may adjust the orientation angle of the camera with respect to the shooting position based on the pattern image irradiated onto the calibration plate.

[0027] The facial image capturing device of an embodiment can accurately generate a three-dimensional facial image of the user by using facial images of the user at various angles captured simultaneously by multiple cameras.

[0028] The facial image capturing device of an embodiment can change the form according to the use state by rotating the arm relative to the body.

[0029] The effects of the three-dimensional face image capture device based on multiple embodiments are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by ordinary technicians through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The accompanying drawings in this specification illustrate preferred embodiments of the present disclosure and are used to further understand the technical concept of the present disclosure together with the detailed description of the present invention. The present disclosure should not be construed as being limited to the matters shown in these drawings.

[0031] Figure 1 A usage status diagram of a facial image capture device according to an embodiment.

[0032] Figure 2aFIG. 1 is a perspective view showing a first state of a facial image capturing device according to an embodiment.

[0033] Figure 2b FIG. 1 is a perspective view showing a second state of a facial image capturing device according to an embodiment.

[0034] Figure 2c FIG. 1 is a rear view showing a second state of the facial image capturing device according to an embodiment.

[0035] Figure 3a and Figure 3b FIG. 1 is a diagram illustrating a process of changing the state of a facial image capturing device through a hinge module according to an embodiment.

[0036] Figure 4a FIG. 1 is a diagram showing a state where a hinge module according to an embodiment connects a body and an arm.

[0037] Figure 4b FIG. 1 is a diagram showing a hinge module according to an embodiment.

[0038] Figure 4c FIG. 1 is a diagram showing a guide member according to an embodiment.

[0039] Figure 4d FIG. 1 is a diagram showing a plunger pin according to an embodiment.

[0040] Figure 5 A three-dimensional view of a facial image capturing device showing a state in which a calibration component is connected to a main body according to an embodiment.

[0041] Description of Reference Numerals

[0042] 1: Image capture device

[0043] 100: Ontology

[0044] 102: Head

[0045] 110: First Arm

[0046] 120: Second Arm

[0047] 131: Front camera

[0048] 132: Lower camera

[0049] 140: The first side camera

[0050] 150: Second side camera

[0051] 160: Hinge module

[0052] 170: Projector

[0053] 180: Calibration board DETAILED DESCRIPTION

[0054] The various embodiments described in this specification are illustrative for the purpose of clearly illustrating the technical ideas of the present disclosure, and are not intended to limit the present disclosure to specific implementations. The technical ideas of the present disclosure include various modifications, equivalents, alternatives, and embodiments selectively combined from all or part of the various embodiments described in this specification. Furthermore, the scope of rights of the technical ideas of the present disclosure are not limited to the various embodiments proposed below or their specific descriptions.

[0055] Unless otherwise defined, the meanings of various terms used in this specification, including technical terms or scientific terms, are the same as those generally understood by ordinary technicians in the technical field to which the present disclosure belongs.

[0056] In this specification, the expressions "including", "may include", "have", "may have", "have", "may have", etc., mean the existence of the features (e.g., functions, actions or structural elements) indicated, and do not exclude the existence of other additional features. That is, such expressions should be understood as open-ended terms that include the possibility of a second embodiment.

[0057] In this specification, unless the context clearly specifies that it is singular, the expression in the singular includes the expression in the plural. Also, unless the context clearly specifies that it is plural, the expression in the plural includes the expression in the singular. Throughout the specification, when it is indicated that a certain part includes a certain structural element, unless there is a special record to the contrary, it means that other structural elements are not excluded, but other structural elements may also be included.

[0058] Furthermore, in the specification, the terms such as "module" or "unit" used mean software or hardware structural elements, and the "module" or "unit" performs a certain function. However, "module" or "unit" does not mean to be limited to software or hardware. "Module" or "unit" can exist in an addressable storage medium, and can also be constructed in a way that one or more processors are regenerated. Therefore, as an example, a "module" or "unit" may include at least one of structural elements such as software structural elements, object-pointing software structural elements, class structural elements and task structural elements, programs, functions, attributes, procedures, subroutines, segments of program codes, drivers, firmware, microcodes, loops, data, databases, data structures, tables, arrays or variables. The functions provided by the structural elements and "modules" or "units" can be combined with fewer structural elements and "modules" or "units", or can be further divided into additional structural elements and "modules" or "units".

[0059] According to one embodiment of the present disclosure, a "module" or "unit" may be embodied by a processor and a memory. "Processor" should be interpreted broadly to include a general-purpose processor, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a controller, a microcontroller, a state machine, etc. In some environments, "processor" may also refer to an application-specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), etc. For example, "processor" may also refer to a combination of a digital signal processor and a microprocessor, a combination of multiple microprocessors, a combination of more than one microprocessor combined with a digital signal processor core, a combination of any other such structures, and other processing devices. Furthermore, " "Memory" should be interpreted broadly to include any electronic component that can store electronic information. "Memory" can refer to various types of processor-readable media such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, magnetic or optical data storage devices, caches, etc. If the processor reads information from the memory and / or records information in the memory, it is said that the memory and the processor are in an electronic communication state. The memory integrated in the processor is in an electronic communication state between the processor.

[0060] Unless different meanings are expressed in the context, expressions such as "first", "second", "firstly", and "nextly" used in this specification are used to distinguish one object from other objects of the same kind, and do not limit the order or importance of the corresponding objects.

[0061] The expressions "A, B and C", "A, B or C", "A, B and / or C" or "at least one of A, B and C", "at least one of A, B or C", "at least one of A, B and / or C", "at least one selected from A, B and C", "at least one selected from A, B or C", "at least one selected from A, B and / or C" etc. used in this specification may mean all possible combinations of the listed items or the listed multiple items. For example, "at least one selected from A and B" may mean all of the following cases: (1) A; (2) at least one of A; (3) B; (4) at least one of B; (5) at least one of A and at least one of B; (6) at least one of A and B; (7) at least one of B and A; (8) A and B.

[0062] The expression "based on..." used in this specification is used to describe one or more factors that affect the determination, judgment behavior or action described in the sentence or article that includes the expression. The expression does not exclude additional factors that affect the corresponding determination, judgment behavior or action.

[0063] The expressions “connected” or “coupled” between a certain structural element (e.g., the first structural element) and other structural elements (e.g., the second structural element) used in this specification not only mean the situation where the above-mentioned certain structural element is directly connected or coupled to the above-mentioned other structural elements, but also mean the situation where other new structural elements (e.g., the third structural element) are connected or coupled as a medium.

[0064] The expression "configured to" or the like used in this specification may mean "set to" or "having" or "having" or "changing to" or "manufactured to" or "capable of executing" or the like, depending on the context. The expression is not limited to the meaning of "specially designed in hardware". For example, a processor configured to execute a specific action may mean a generic-purpose processor that can execute the specific action by running software.

[0065] Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings. In the drawings and descriptions of the drawings, the same reference numerals may be assigned to the same or substantially equivalent structural elements. Furthermore, in the following description of various embodiments, repeated descriptions of the same or corresponding structural elements may be omitted, which does not mean that the corresponding structural elements are not included in the embodiment.

[0066] Figure 1 A usage status diagram of a facial image capture device according to an embodiment.

[0067] Reference Figure 1, a facial image capture device 1 of an embodiment can be used to capture a three-dimensional facial image of a user U (e.g., a person being photographed, a photographed object). For example, the facial image capture device 1 can capture a three-dimensional facial image that is highly consistent with the actual image of the teeth of the user U. In one embodiment, if the face of the user U is accurately located at the shooting position, the facial image capture device 1 can act in a manner of capturing the facial image of the user U. In one embodiment, the shooting position can be a position where the focus of multiple cameras described later is focused with the facial image capture device 1 as a reference, for example, a position set in a manner of capturing the facial image of the user U. In the following, for ease of description, the shooting position is described as being located at the front of the facial image capture device 1. In one embodiment, the facial image capture device 1 can capture multiple images of the face of the user U located at the shooting position, which are captured by multiple cameras at multiple angles, and can generate a three-dimensional facial image of the user U based on the captured multiple images. In one embodiment, the facial image capture device 1 can capture multiple images of the face of the user U at the same time. In this case, since the action of capturing a plurality of facial images is performed simultaneously, the degradation of the quality of the three-dimensional facial image caused by the movement of the user U and the difference in shooting time can be reduced or prevented.

[0068] Figure 2a FIG. 1 is a perspective view showing a first state of a facial image capturing device according to an embodiment. Figure 2b FIG. 1 is a perspective view showing a second state of a facial image capturing device according to an embodiment. Figure 2c FIG. 1 is a rear view showing a second state of the facial image capturing device according to an embodiment. Figure 3a and Figure 3b FIG. 1 is a diagram illustrating a process of changing the state of a facial image capturing device through a hinge module according to an embodiment.

[0069] Reference Figure 2a to Figure 2c In one embodiment, the face image capture device 1 may be configured to change in accordance with the state of use. For example, the face image capture device 1 may be configured to change in accordance with the state of use. Figure 2a The first state shown in the unfolded configuration for use is similar to the Figure 2b In one embodiment, the facial image capture device 1 can be used in other configurations between the first and second configurations.

[0070] The facial image capturing device 1 of one embodiment may include: a body 100, a first arm 110, a second arm 120, a front camera 131, a lower camera 132, a first side camera 140, a second side camera 150, a projector 170 and a processor.

[0071] In one embodiment, the body 100 may include: a bracket 101 ; and a head 102 connected to the upper portion of the bracket 101 .

[0072] In one embodiment, the support 101 may include: a panel-shaped base portion 1011 disposed on a support surface (e.g., the ground); and a support portion 1012 extending upward from the base portion 1011. In one embodiment, the support portion 1012 may include a pair of connecting portions 1013 formed on both sides of the upper end and connecting the first arm 110 and the second arm 120. For example, the connecting portion 1013 may be formed in a manner of protruding toward both sides at the upper end of the support portion 1012. In one embodiment, components of the facial image capture device 1 (e.g., a processor, a battery, etc.) may be disposed inside the support 101. In one embodiment, an input button for receiving an input signal from a user U, an external device, or a connector portion 1014 connected to a terminal for connecting to a power source may be formed on the outer surface of the support 101. Although not shown in the figure, a display for displaying the working state of the facial image capture device 1 or an image captured by the facial image capture device 1 may also be disposed on the outer surface of the support 101. In one embodiment, a lower camera 132 may be disposed on the support 101. For example, the lower camera 132 may be disposed on the base portion 1011 and may be configured to be oriented to face the upper front side toward the shooting position.

[0073] In one embodiment, the head 102 may be connected to the upper portion of the bracket 101. In one embodiment, the head 102 may include a plane mirror 1021 facing the front of the facial image capture device 1, for example, facing the shooting position. In one embodiment, a mirror may be formed on the mirror 1021. In one embodiment, the mirror 1021 may be formed in a manner that the focus of the mirror is focused toward the shooting position. For example, the mirror 1021 may be formed in a manner that the face image of the user U can be directly reflected to the user U in a state where the face of the user U is aligned with the shooting position. In this case, the user U at the shooting position can recognize whether his face is accurately aligned to the shooting position through his face image reflected by the mirror 1021. In one embodiment, a front camera 131 may be configured at the center of the mirror 1021. The front camera 131 may be configured in a manner that faces the shooting position. In one embodiment, a projector 170 may be configured on the mirror 1021.

[0074] In one embodiment, the first arm 110 and the second arm 120 may be connected to the bracket 101 in a rotatable manner. In one embodiment, the first arm 110 may be connected to one side (e.g., the left side) of the bracket 101, for example, it may be connected to the first connecting portion 1013a formed on the upper side of the support portion 1012. The second arm 120 may be connected to the other side (e.g., the right side) of the bracket 101, for example, it may be connected to the second connecting portion 1013b formed on the upper side of the support portion 1012. In one embodiment, the first arm 110 and the second arm 120 may be formed in a symmetrical form with the main body 100 in between. In one embodiment, the first arm 110 may be connected in a manner of rotating relative to the main body 100 with the first rotation axis A1, A as the center. The second arm 120 may be connected in a manner of rotating relative to the main body 100 with the second rotation axis A2, A as the center. In one embodiment, based on the first state shown in FIG2a , the first arm 110 may have a length direction away from the main body 100 toward the left front side. Figure 2a Taking the first state shown as a reference, the second arm 120 may have a length direction away from the main body 100 toward the right front. In one embodiment, taking the first state as a reference, the first arm 110 may include a first support surface 111 facing the shooting position. The first side camera 140 may be arranged on the first support surface 111. In one embodiment, taking the first state as a reference, the second arm 120 may include a second support surface 121 facing the shooting position. The second side camera 150 may be arranged on the second support surface 121. In one embodiment, the first support surface 111 and the second support surface 121 may be formed as curved surfaces. In the first state, the first support surface 111 of the first arm 110 and the second support surface 121 of the second arm 120 can surround the shooting position in an arc shape. In one embodiment, the first arm 110 and the second arm 120 may include one or more lighting arranged on the first support surface 111 and the second support surface 121. In one embodiment, one or more lighting may be arranged around each of the first side camera 140 and the second side camera 150 arranged on the first arm 110 and the second arm 120, respectively.

[0075] In one embodiment, the first arm 110 and the second arm 120 can rotate relative to the body 100 according to the use state of the facial image capturing device 1. Figure 2aIn the first state shown, the first arm 110 and the second arm 120 are rotated relative to the body 100 in a manner of being unfolded relative to the body 100, for example, the support surface is rotated relative to the body 100 in a manner of facing the front, and in the second state shown in FIG. 2 b , the first arm 110 and the second arm 120 are rotated relative to the body 100 in a manner of being folded relative to the body 100, for example, the support surface is rotated relative to the body 100 in a manner of facing the rear. In one embodiment, in the first state of the facial image capture device 1, the first arm 110 and the second arm 120 may be actually located at the same height.

[0076] In one embodiment, at least one first side camera 140 may be arranged on the first arm 110, and at least one second side camera 150 may be arranged on the second arm 120. For example, at least one first side camera 140 may be arranged on the first support surface 111, and at least one second side camera 150 may be arranged on the second support surface 121. In one embodiment, the first side camera 140 and the second side camera 150 may change the direction of the focus according to the rotation of the first arm 110 and the second arm 120 relative to the body 100. In one embodiment, as shown in FIG. Figure 2a With the first state shown as a reference, the first side camera 140 and the second side camera 150 can be arranged on the first arm 110 and the second arm 120 in such a manner that the focus is directed to the photographing position.

[0077] In one embodiment, the front camera 131 , the lower camera 132 , the first side camera 140 , and the second side camera 150 may respectively capture facial images of the user U at the shooting position. The multiple cameras may capture multi-angle images for each shooting position.

[0078] In one embodiment, the front camera 131 may be disposed on the front of the head 102. For example, the front camera 131 may be disposed at the center of the mirror 1021, and may capture a front image of the face of the user U at the shooting position.

[0079] In one embodiment, the lower camera 132 may be disposed on the bracket 101 and may be tilted upward toward the shooting position. For example, the lower camera 132 may capture a lower image of the face of the user U at the shooting position in a tilted direction.

[0080] In one embodiment, the first side camera 140 may be disposed on the first arm 110. The first side camera 140 may capture a first side (e.g., left) image of the face of the user U at the shooting position. A plurality of first side cameras 140 may be disposed. In one embodiment, a plurality of first side cameras 140 may be disposed on the first support surface 111 of the first arm 110 and spaced apart along the length direction of the first arm 110. In one embodiment, the first side camera 140 may include: a 1-1 side camera 141 disposed at an end in the length direction of the first arm 110; and a 1-2 side camera 142 disposed at a middle position of the first arm 110 in a manner of being located between the body 100 and the 1-1 side camera 141.

[0081] In one embodiment, the 1-1st side camera 141 may capture a first side (e.g., left) image of the face of the user U at the shooting position. In one embodiment, the 1-2nd side camera 142 may capture a first side (e.g., left) image of the face of the user U at an angle between the shooting angles of the front camera 131 and the 1-1st side camera 141. For example, the 1-2nd side camera 142 may capture a left dental image of the user U at the shooting position.

[0082] In one embodiment, the second side camera 150 may be disposed on the second arm 120. The second side camera 150 may capture an image of the second side (e.g., right side) of the face of the user U at the shooting position. A plurality of second side cameras 150 may be provided. In one embodiment, a plurality of second side cameras 150 may be spaced apart and disposed along the length direction of the second arm 120 on the second support surface 121 of the second arm 120. In one embodiment, the second side camera 150 may include: a 2-1 side camera 151 disposed at an end in the length direction of the second arm 120; and a 2-2 side camera 152 disposed at a middle position of the second arm 120 in a manner of being located between the body 100 and the 2-1 side camera 151.

[0083] In one embodiment, the 2-1st side camera 151 may capture an image of the second side (e.g., right side) of the face of the user U at the photographing position. In one embodiment, the 2-2nd side camera 152 may capture an image of the second side (e.g., right side) of the face of the user U at an angle between the photographing angles of the front camera 131 and the 2-1st side camera 151. For example, the 2-2nd side camera 152 may capture an image of the right side teeth of the user U at the photographing position.

[0084] In one embodiment, Figure 2aTaking the first state shown as a reference, the 1-1st side camera 141, the 1-2nd side camera 142, the 2-1st side camera 151, and the 2-2nd side camera 152 may be actually located at the same height relative to the ground. For example, in the first state, the plurality of side cameras may capture a single image related to the face of the user U located at the shooting position at various angles while being located at the same height relative to the ground.

[0085] In one embodiment, the projector 170 may irradiate a light pattern. In one embodiment, the projector 170 may irradiate a pre-set structured light pattern toward the shooting position, for example, toward the face of the user U located at the shooting position. The structured light pattern irradiated by the projector 170 may be changed according to the working mode of the face image capture device 1. For example, the structured light pattern may form a pattern of lattice lines. In one embodiment, the structured light pattern irradiated by the projector 170 may be used to guide the directional position to which the focus of multiple cameras is directed. In one embodiment, the projector 170 may be configured on the head 102. For example, the projector 170 may be configured on the mirror 1021 in a manner of being located vertically below the front camera 131. In this case, in a state where the shooting position is aligned in a manner such that the face of the user U is accurately reflected on the mirror 1021, the projector 170 may irradiate the light pattern in an inclined direction from the lower part of the face of the user U toward the upper part.

[0086] In one embodiment, a processor (not shown) can control the operation of the facial image capture device 1. In one embodiment, the processor can control the operation of multiple cameras and lighting. In one embodiment, the processor can simultaneously execute the action of multiple cameras capturing the image of the user U at the shooting position according to the user U operation signal or the set control signal. In one embodiment, the processor can generate a three-dimensional facial image of the user U by integrating the single images captured by multiple cameras. In one embodiment, the processor can simultaneously control the image capture action of multiple cameras in a manner that allows the front camera 131, the lower camera 132, the first side camera 140, and the second side camera 150 to simultaneously capture the single images of the user U at various angles at the shooting position. In one embodiment, the processor can act in a manner that generates a three-dimensional facial image of the user U based on the single images at various angles captured by the multiple cameras. The action of generating the three-dimensional facial image of the user U can be executed by a set algorithm. In other embodiments, the processor can generate a three-dimensional facial image integrating multiple single images through an artificial intelligence neural network. Examples of artificial intelligence neural networks can be embodied by learning models such as deep neural networks (DNN), recurrent neural networks (RNN), bidirectional recurrent deep neural networks (BRDNN) and generative adversarial networks (GAN), but are not limited to these.

[0087] In one embodiment, the processor may enable the multiple cameras to capture images in the first state of the facial image capture device 1, but the present invention is not limited thereto. The action of capturing images through the multiple cameras may also be performed in a state of the facial image capture device 1 between the first state and the second state (e.g., a state in which the arms 110 and 120 are rotated relative to the body 100 at an angle between the first state and the second state).

[0088] In one embodiment, the processor may adjust the projectors 170 and their respective orientations (eg, the direction of focus) based on the images captured by the cameras. For example, the processor may perform calibration such as adjusting the orientation of the cameras based on light patterns that appear in the images captured by the cameras.

[0089] Reference Figure 3a and Figure 3bIn one embodiment, the body 100 and the arms 110 and 120 may be connected to the hinge module 160. In one embodiment, the first arm 110 and the second arm 120 may be rotatably connected to the body 100 through a pair of hinge modules 160, and the second arm 120 may be rotatably connected to the body 100 through a second hinge module 160. Each hinge module 160 allows the first arm 110 and the second arm 120 to rotate relative to the body 100 in a manner that the face image capture device 1 changes between the first state and the second state, and can fix the rotation angle of the first arm 110 and the second arm 120 relative to the body 100 in a manner that maintains the shape of the face image capture device 1. In the following, for the sake of convenience, the description is based on one hinge module 160 and one arm.

[0090] Figure 4a FIG. 1 is a diagram showing a state where a hinge module according to an embodiment connects a body and an arm. Figure 4b FIG. 1 is a diagram showing a hinge module according to an embodiment. Figure 4c FIG. 1 is a diagram showing a guide member according to an embodiment. Figure 4d FIG. 1 is a diagram showing a plunger pin according to an embodiment.

[0091] Reference Figure 4a to Figure 4b The hinge module 160 can connect the body 100 and the arm in a manner of rotating around the rotation axis A. In one embodiment, the hinge module 160 may include a fixing body 161 , a hinge body 162 , a guide member 163 and a stopper 164 .

[0092] In one embodiment, the fixed body 161 can be fixed to the body 100. For example, an opening is formed in the connection portion 1013 of the body 100, and the fixed body 161 is inserted and fixed inside the body 100 (e.g., the support portion 1012) through the opening. The fixed body 161 can be in the form of a cylinder with a circular cross section with the rotation axis A as the center. A through hole 1611 can be formed through the fixed body 161 to allow a connection line (e.g., a flexible circuit substrate, a wire, etc.) between the body 100 and the arm 110 to pass through.

[0093] In one embodiment, the hinge body 162 can be connected in a manner that it can rotate relative to the fixed body 161 with the rotation axis A as the center. The hinge body 162 can be in an arc shape formed with the rotation axis A as the center, for example, a cross-sectional shape of a circle, a semicircle, or at least a part of a circle. In one embodiment, the arm 110 can be fixed to the hinge body 162. According to the rotation movement of the hinge body 162 relative to the fixed body 161, the arm 110 can be formed to rotate relative to the body 100.

[0094] In one embodiment, the hinge body 162 can be articulated with the fixed body 161 with the rotation axis A as the center. In another embodiment, the hinge module 160 may include a rotation motor for rotating the hinge body 162 with respect to the fixed body 161 with the rotation axis A as the center.

[0095] In one embodiment, the guide member 163 may be connected to the fixed body 161. The guide member 163 may be in a form that surrounds at least a portion of the hinge body 162 with the rotation axis A as the center. For example, the guide member 163 may be in a form that surrounds the circular cross section formed by the hinge body 162. For example, the guide member 163 may have a cross-sectional form that constitutes a portion of a circle with a radius greater than the rotation body with the rotation axis A as the reference. For example, the guide member 163 may be in an annular form or a form that constitutes a portion of an annular form. In one embodiment, the guide member 163 may be in an arc shape that extends in a peripheral direction with the rotation axis A as the center. The guide member 163 may include one or more insertion holes that are spaced apart and arranged in the peripheral direction of the arc and penetrate in a direction perpendicular to the rotation axis A. In one embodiment, since the guide member 163 is connected to the fixed body 161, as the hinge body 162 rotates relative to the fixed body 161, the hinge body 162 may be relatively rotated with the rotation axis A as the center.

[0096] In one embodiment, the stopper 164 may be connected to the hinge body 162. The stopper 164 may be selectively fastened to the guide member 163. By selectively fastening the stopper 164 to the guide member 163, the rotation of the hinge body 162 relative to the fixed body 161 may be selectively restricted. For example, when the stopper 164 is fastened to the guide member 163, the rotation of the rotating body relative to the fixed body 161 is restricted, so that the rotation angle of the arm 110 relative to the body 100 can be maintained. On the contrary, if the stopper 164 is released from the guide member 163, the rotation of the rotating body relative to the fixed body 161 is allowed, so that the arm can be rotated relative to the body 100. In one embodiment, the stopper 164 may include a support member 1642, a plunger pin 1641, and an elastic member 1643.

[0097] In one embodiment, the support member 1642 may be located outside the radius of the guide member 163 with the rotation axis A as a reference. The support member 1642 may be connected to the hinge body 162. As the hinge body 162 rotates, the support member 1642 may relatively rotate the fixed body 161 and the guide member 163 with the rotation axis A as the center. The plunger pin 1641 may be movably provided on the support member 1642.

[0098] In one embodiment, the plunger pin 1641 is provided in a manner of penetrating the support member 1642, and is installed in a manner of being partially movable relative to the support member 1642 along the fastening direction perpendicular to the rotation axis A. The plunger pin 1641 may be selectively inserted into the insertion holes 1631, 1632 formed in the guide member 163 as it moves along the fastening direction. For example, the stopper 164 may be selectively fastened to the guide member 163 by the plunger pin 1641. In one embodiment, the plunger pin 1641 may overlap with the arc formed by the guide member 163 when viewed along the fastening direction. According to the rotation of the arm relative to the body 100, for example, according to the rotation action of the hinge body 162 relative to the fixed body 161, the overlapping position of the plunger pin 1641 and the guide member 163 may change along the circumferential direction of the arc. In one embodiment, the plunger pin 1641 may overlap with one or more insertion holes 1631, 1632 formed in the guide member 163 according to the state of the facial image capture device 1. For example, the guide member 163 may include: a first insertion hole 1631, which overlaps with the plunger pin 1641 in the first state; and a second insertion hole 1632, which overlaps with the plunger pin 1641 in the second state. However, this is an example, and in another embodiment, a plurality of insertion holes 1631, 1632 located between the first insertion hole and the second insertion hole may be formed in the guide member 163. For example, a third insertion hole may be formed between the first insertion hole 1631 and the second insertion hole 1632 to overlap with the plunger pin 1641 along the tightening direction when the facial image capture device 1 is in a third state (not shown) between the first state and the second state.

[0099] In one embodiment, when the plunger pin 1641 overlaps with the insertion holes 1631 and 1632 formed in the guide member 163 along the fastening direction, the hinge body 162 can be restricted from rotating relative to the fixed body 161 by being inserted into the insertion holes 1631 and 1632. When the plunger pin 1641 is disengaged from the insertion holes 1631 and 1632, the hinge body 162 can be allowed to rotate relative to the fixed body 161.

[0100] In one embodiment, an elastic member 1643 (not shown) may be connected to the plunger pin 1641. The plunger pin 1641 may be pressed toward the guide member 163 by the elastic member 1643. The elastic member 1643 is compressed when the plunger pin 1641 is pulled in the opposite direction of the guide member 163 by an external force (e.g., a pulling action by the user U, a pulling action by the auxiliary motor), and when the external force is released, the plunger pin 1641 is pressed toward the guide member 163 by the elastic force due to the compression. Therefore, when the external force is released, the plunger pin 1641 may maintain a state of contacting the outer surface of the guide member 163 by the elastic member 1643. In one embodiment, if the plunger pin 1641 does not overlap with the insertion holes 1631 and 1632, the plunger pin 1641 moves toward the surrounding direction of the guide member 163 in a state of contacting the outer surface of the guide member 163 as the hinge body 162 rotates relative to the fixed body 161. If the plunger pin 1641 overlaps with one of the insertion holes 1631 and 1632, the plunger pin 1641 will be automatically inserted into the insertion holes 1631 and 1632 due to the pressure of the elastic member 1643, thereby limiting the rotation of the hinge body 162 relative to the fixed body 161. In order to rotate the hinge body 162 relative to the fixed body 161, an external force may be required to pull the plunger pin 1641 out of the insertion holes 1631 and 1632. In one embodiment, the plunger pin 1641 may be connected to an auxiliary motor for moving the plunger pin 1641 along the tightening direction. If the plunger pin 1641 is connected to the auxiliary motor, the elastic member may be omitted.

[0101] Figure 5 A three-dimensional view of a facial image capturing device showing a state in which a calibration component is connected to a main body according to an embodiment.

[0102] Reference Figure 5 A facial image capture device 1 of one embodiment may include a main body 100, a first arm 110, a second arm 120, a front camera 131, a lower camera 132, a 1-1st side camera 141, a 1-2nd side camera 142, a 2-1st side camera 151, a 2-2nd side camera 152, a projector 170, a processor and a calibration plate 180.

[0103] In one embodiment, the calibration plate 180 can be connected to the body 100 in a detachable manner. In one embodiment, the calibration plate 180 may include a pattern portion 181 that is aligned and configured at a set shooting position when connected to the body 100. In one embodiment, the pattern portion 181 is formed in a plate shape and can be configured in a state where the surface faces the front camera 131 when connected to the body 100. In one embodiment, a pattern (e.g., pattern texture) corresponding to the pattern light irradiated by the projector 170 can be formed on the surface of the pattern portion 181.

[0104] In one embodiment, the processor may correct the image capturing action of the face image capturing device 1 through the calibration plate 180. For example, the processor may perform the following actions, that is, when the calibration plate 180 is connected to the body 100, the pattern light is irradiated to the pattern portion 181 through the projector 170, and the image of the pattern portion 181 is captured by multiple cameras. For example, the front camera 131, the lower camera 132, the first side camera 140, and the second side camera 150 may capture the image of the pattern portion 181 irradiated with the pattern light at their respective positions and provide it to the processor. In one embodiment, the processor may determine whether the image of the pattern portion 181 captured by each camera 131, 132, 140, 150 matches the set reference image, that is, whether the image irradiated with the pattern light matches the set reference image. In particular, when the arm of the facial image capture device 1 is folded and then unfolded (i.e., changed from the second state to the first state), the setting position of the device 1 is changed, etc., an indication that calibration is required will be displayed visually to the user, or the user may be notified by voice, so that the user can perform calibration on the facial image capture device 1.

[0105] In one embodiment, if the image captured by each camera 131, 132, 140, 150 does not match the set reference image, the processor may identify that the orientation adjustment of the corresponding camera is required. In one embodiment, the processor may perform a calibration operation to correct the geometric relationship between the camera and the projector in a software manner so that the image of the pattern portion 181 captured by the camera 131, 132, 140, 150 matches the set reference image. As an example, the software calibration operation for the camera 131, 132, 140, 150 or the projector 170 may be performed by adjusting the focus angle of at least one of the camera 131, 132, 140, 150 and the projector 170.

[0106] In other embodiments, the processor may perform hardware calibration by adjusting the rotation angle of the arm relative to the body 100 so that the image of the pattern portion 181 captured by the cameras 131, 132, 140, 150 matches the set reference image. As an example, the processor may control the activation of the rotary motor and the auxiliary motor in such a manner that the arms 110, 120 rotate relative to the body 100 according to the calibration action. For example, if it is determined that the orientation of the first side camera 140 or the second side camera 150 needs to be adjusted by adjusting the rotation angle of the arms 110, 120 relative to the body 100, the processor may release the stopper 164 through the auxiliary motor, and then precisely rotate the arms 110, 120 relative to the body 100 through the rotary motor.

[0107] As described above, a person skilled in the art of the present disclosure can understand that the present disclosure can be implemented through other specific embodiments without changing the technical ideas or essential features of the present disclosure. Therefore, the above embodiments are illustrative in all aspects and should not be understood as limiting. The scope of the present disclosure is reflected by the attached invention claims, rather than detailed descriptions, and all changes or variant implementations derived from the meaning, scope, and equivalent concepts of the invention claims should be interpreted as included in the scope of the present disclosure.

[0108] The features and advantages described in this specification are not exhaustive, and many additional features and advantages can be clearly understood by those skilled in the art through the drawings, the specification and the scope of protection of the invention. Moreover, the language used in this specification is mainly selected for the purpose of readability and teaching, and may not be selected for the purpose of describing or limiting the subject matter of the present disclosure.

[0109] The above description of the various embodiments of the present disclosure is provided for the purpose of illustration. This is not intended to limit the present disclosure to the exact embodiments disclosed or to make it exhaustive. It will be appreciated by those skilled in the art that various modifications and variations may be implemented based on the above disclosure.

[0110] Therefore, the scope of the present disclosure is not limited to the detailed description, but to any claims of the application based thereon. Therefore, the disclosure of the multiple embodiments of the present disclosure is illustrative and does not limit the scope of the present disclosure recorded in the attached invention claims.

Claims

1. A facial image capturing device for capturing a three-dimensional facial image of a user, comprising: The body comprises a bracket and a head, wherein the head is connected to the upper part of the bracket; The first arm is connected to one side of the bracket in a rotatable manner and has a length direction; The second arm is connected to the other side of the bracket in a rotatable manner and has a length direction; a front camera, arranged on the head and arranged to face the shooting position; One or more first side cameras, disposed on the first arm; One or more second side cameras, disposed on the second arm; A projector, disposed on the head, for irradiating the set structured light pattern toward the shooting position; as well as The processor calibrates the projector and the camera based on the images captured by the plurality of cameras. The first arm and the second arm are respectively rotatable relative to the body in such a manner that the states thereof change between a first state in which the first arm is unfolded relative to the body and a second state in which the second arm is folded relative to the body. The first side camera and the second side camera are oriented to the shooting position in the first state.

2. The facial image capturing device according to claim 1, characterized in that: The first side camera includes: A 1-1 side camera is disposed at an end portion in the length direction of the first arm; and The 1-2 side camera is located between the main body and the 1-1 side camera. The second side camera includes: The 2-1st side camera is arranged at the end of the length direction of the second arm; and The 2-2 side camera is arranged between the main body and the 2-1 side camera. In the first state, the 1-1 side camera and the 2-1 side camera are used to photograph the left and right sides of the user's face, respectively, and the 1-2 side camera and the 2-2 side camera are used to photograph the left and right sides of the user's teeth, respectively.

3. The facial image capturing device according to claim 2, characterized in that: The first arm comprises a first supporting surface for configuring the first side camera, The second arm comprises a second supporting surface for arranging the second side camera. The first supporting surface and the second supporting surface are formed as curved surfaces so as to surround the shooting position in an arc shape with the bracket in between in the first state.

4. The facial image capturing device according to claim 2, characterized in that: The head is provided with a mirror facing the shooting position and includes a mirror surface for configuring the front camera and the projector. The front camera, the first side camera, and the second side camera simultaneously capture single images of the user at various angles at the shooting position in the first state. The processor operates in a manner to generate a three-dimensional image of the user based on a single image of the user captured simultaneously by the plurality of cameras.

5. The facial image capturing device according to claim 1, characterized in that: The invention also includes a pair of hinge modules, so that the first arm and the second arm are respectively connected to the body in a rotatable manner. Each of the above hinge modules comprises: A fixed main body, fixed to the above-mentioned main body; A hinge body connected in a manner that allows the hinge body to rotate relative to the fixed body about a rotation axis, and used to fix the arm; a guide member connected to the fixed body and surrounding at least a portion of the hinge body with the rotation axis as the center; and The stopper is connected to the hinge body and is used to limit the rotation of the hinge body relative to the fixed body by selectively fastening to the guide component.

6. The facial image capturing device according to claim 5, characterized in that: The guide member is in an arc shape extending in a peripheral direction with the rotation axis as a center, and includes one or more insertion holes arranged at intervals in the peripheral direction and penetrating in a direction perpendicular to the rotation axis. The stopper includes a plunger pin that can be inserted into the insertion hole and move along a fastening direction perpendicular to the rotation axis, and restricts rotation of the rotating body relative to the fixed body when the plunger pin is inserted into the insertion hole.

7. The facial image capturing device according to claim 6, characterized in that: The above-mentioned stopper also includes: a supporting member connected to the hinge body so as to be located outside the guide member with the rotation axis as a reference and installed so as to allow the plunger pin to partially move along the tightening direction; and an elastic member connected to the plunger pin and applying pressure to the plunger pin toward the guide member, When the plunger pin overlaps the insertion hole, the plunger pin is pressed by the elastic member to be inserted into the insertion hole.

8. The facial image capturing device according to claim 7, characterized in that: The above-mentioned guide component comprises: a first insertion hole overlapping the plunger pin in the first state; and The second insertion hole overlaps with the plunger pin in the second state.

9. The facial image capturing device according to claim 1, characterized in that: The device further comprises a calibration plate connected to the main body in a detachable manner, and when connected to the main body, the calibration plate is aligned and arranged at the shooting position, wherein the calibration plate comprises a pattern portion, and the pattern portion is formed with a pattern corresponding to the pattern light irradiated by the projector. The processor captures the image of the pattern portion irradiated with the pattern light through the front camera, the first side camera and the second side camera, and performs a calibration operation by adjusting the orientation of the projector and the camera so that the captured image of the pattern portion matches the set reference image.

10. The facial image capturing device according to claim 9, characterized in that: The hinge module further comprises: a rotary motor for rotating the hinge body around the rotary shaft; and an auxiliary motor, used to move the plunger pin along the tightening direction, The processor controls activation of the rotary motor and the auxiliary motor in a manner corresponding to the calibration operation.

11. A facial image capturing device for capturing a three-dimensional facial image of a user, characterized in that: include: The body comprises a bracket and a head, wherein the head is connected to the upper part of the bracket; The first arm is connected to one side of the bracket in a rotatable manner and has a length direction; The second arm is connected to the other side of the bracket in a rotatable manner and has a length direction; a front camera, arranged on the head and arranged to face the shooting position; One or more first side cameras, disposed on the first arm; One or more second side cameras, disposed on the second arm; a projector, disposed on the head, for irradiating the set structured light pattern toward the shooting position; and A pair of hinge modules are rotatably connected to the body so that the states of the first arm and the second arm change between a first state in which the first arm is unfolded relative to the body and a second state in which the second arm is folded relative to the body, respectively, and the first side camera and the second side camera are oriented to the shooting position in the first state. Each of the above hinge modules comprises: A fixed main body, fixed to the above-mentioned main body; a hinge body connected to the fixed body so as to be rotatable about a rotation axis as a center, and used to fix the arm; and The guide member is connected to the fixed body and surrounds at least a portion of the hinge body around the rotation axis.

12. The facial image capturing device according to claim 11, characterized in that: Each of the hinge modules further includes a stopper connected to the hinge body and configured to limit the rotation of the hinge body relative to the fixed body by selectively fastening to the guide component.

13. The facial image capturing device according to claim 12, characterized in that: The guide member is in an arc shape extending in a peripheral direction with the rotation axis as a center, and includes one or more insertion holes arranged at intervals in the peripheral direction and penetrating in a direction perpendicular to the rotation axis. The stopper includes a plunger pin that can be inserted into the insertion hole and move along a fastening direction perpendicular to the rotation axis, and restricts rotation of the rotating body relative to the fixed body when the plunger pin is inserted into the insertion hole.

14. The facial image capturing device according to claim 13, characterized in that: The above-mentioned stopper also includes: a supporting member connected to the hinge body so as to be located outside the guide member with the rotation axis as a reference and installed so as to allow the plunger pin to partially move along the tightening direction; and an elastic member connected to the plunger pin and applying pressure to the plunger pin toward the guide member, When the plunger pin overlaps the insertion hole, the plunger pin is pressed by the elastic member to be inserted into the insertion hole.

15. The facial image capturing device according to claim 14, characterized in that: The above-mentioned guide component comprises: a first insertion hole overlapping the plunger pin in the first state; and The second insertion hole overlaps with the plunger pin in the second state.

Images