Extensible angle-adjustable lip motion image shooting function module

Abstract

The application discloses a stretchable angle-adjustable lip motion image shooting function module, which comprises a rotation adjusting knob, angle adjusting knobs, back-shaped double straight transmission bars, a camera fixing groove, a module fixing screw, a transmission bar control box and a power supply control box. Two angle adjusting knobs are fixed at the bottom of two back-shaped double straight transmission bars, and the two back-shaped double straight transmission bars are arranged in the transmission bar control box in an overlapping mode. The outer side of the transmission bar control box is provided with the rotation adjusting knob. The bottom of each of the two angle adjusting knobs is fixed with the module fixing screw and the camera fixing groove. The outer edge of the module fixing screw is provided with screw threads, and the module fixing screw is detachably connected to the power supply control box. The camera fixing groove is provided with a resistance groove. The application can ensure that the wearer can adjust the angle of the lip motion image shooting function module twice according to the needs of the wearer, so that the camera can contain the shooting unit of the shooting object to the greatest extent.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of lip movement image detection in articulatory movement research, in particular to a stretchable angle adjustment type lip movement image shooting function module. BACKGROUND

[0002] The articulatory system of speech includes aspects such as voicing and voicing. Among them, voicing refers to the process of modulating the sound produced by the glottis by the mutual cooperation between the tongue, palate, lips, teeth and other organs in the oral cavity. With the continuous development of computer graphics processing technology and audio signal processing technology, researchers in the field of phonetics hope to collect and process multi-modal data during voicing in a way, so as to further explore and analyze the individual movement of each voicing organ (horizontal and vertical directions), the matching between voicing organs and phonemes, and the correlation between voicing organs.

[0003] Generally, the multi-modal data that needs to be collected and processed includes audio information, ultrasonic imaging information and facial movement information. The audio information refers to the audio signal information (including single words, phrases and sentences) obtained by the sampling person during the sound production process using a condenser microphone; the ultrasonic imaging information refers to the tongue movement ultrasonic imaging information obtained by the sampling person through an ultrasonic scanning probe during the sound production process; the facial movement information refers to the corresponding facial expression information (mainly including lip movement) of the sampling person during the sound production process. After analysis, the characteristic parameters that researchers can obtain from the audio signal include F0, F1, F2 and F3. Among them, F0 can reflect the tone and speed of voicing, F1 can reflect the opening degree of the lips during voicing, F2 can reflect the front and back movement position of the tongue (mid-sagittal plane direction) during voicing, and F3 can reflect the features such as roundness of the lips, curling of the tongue and pharyngealization of the sound producer during voicing. On this basis, capturing real-time movement images of lip movement (including upper lip lines and lower lip lines) will provide effective and scientific basis for researchers to further study the correlation between organs and the running mechanism during voicing.

[0004] A common method for obtaining multi-modal data is to place a condenser microphone and a camera capable of capturing lip movement on a table in front of the sound producer. Then, the sound producer holds the ultrasonic imaging scanning probe against the mandible to start data collection. Although this collection method can reduce errors to some extent, the resulting poor comfort, low flexibility and large equipment footprint make it difficult for users to cooperate with experimental data collection activities for a long time. At the same time, the observation plane of the lip movement and the imaging reference plane (perpendicular to the scanning direction) always have heterotopic phenomenon (i.e., no same coordinate origin), which causes difficulties in matching the corresponding aspects. Therefore, a stretchable angle adjustment type lip movement image shooting function module is proposed. SUMMARY

[0005] In view of the above technical deficiencies, the present application aims to provide a stretchable angle-adjustable lip movement image shooting function module. During the process of a speaker pronouncing, the wearer can adjust the angle of the lip movement image shooting function module twice according to his / her own needs, so that the camera can maximize the inclusion of the shooting unit of the shooting object.

[0006] To solve the above technical problems, the present application adopts the following technical solutions:

[0007] The stretchable angle-adjustable lip movement image shooting function module comprises a rotation adjustment knob, an angle adjustment knob, a double straight line transmission bar, a camera fixing groove, a module fixing screw, a transmission bar control box, and a power supply control box. Two angle adjustment knobs are fixed at the bottom ends of two double straight line transmission bars, and the two double straight line transmission bars are arranged in an overlapping manner in the transmission bar control box. A rotation adjustment knob is installed on the outside of the transmission bar control box. The bottom ends of the two angle adjustment knobs are respectively fixed with a module fixing screw and a camera fixing groove. The outer edge of the module fixing screw has a screw thread, which can be detachably connected to the power supply control box. The camera fixing groove is provided with a resistance groove.

[0008] Preferably, the angle adjustment knob comprises an angle adjustment gear, an angle adjustment button connecting piece, an angle adjustment knob shell, an angle adjustment knob shaft hole, a lock, an angle adjustment knob limiting block, a blocking piece, a pull-back spring fixing column, and a pull-back spring. The angle adjustment limiting block is fixed in the angle adjustment knob shell. The bottom end of the lock is fixed with the blocking piece and the pull-back spring fixing column. The lock is connected with the pull-back spring through the pull-back spring fixing column. The lock, the blocking piece, the pull-back spring fixing column, and the pull-back spring together constitute an adjustment structure arranged in the middle of the angle adjustment limiting block. The angle adjustment gear is provided with an angle adjustment knob shaft hole, and the angle adjustment button connecting piece with the angle adjustment knob shaft hole is embedded on the outside of the angle adjustment knob shell. The angle adjustment button connecting piece is connected with the angle adjustment gear through a shaft rod.

[0009] Preferably, the transmission bar control box comprises a transmission bar control box side shell, a transmission bar control box bottom shell, a transmission gear shaft hole, a transmission gear, a transmission gear limiting block, a transmission bar control box top shell, a transmission bar control shaft hole, a transmission bar control box control groove, an elastic lock piece and a lock piece control shaft; the transmission bar control box side shell, the transmission bar control box bottom shell and the transmission bar control box top shell jointly form the shell of the transmission bar control box; the center of the transmission bar control box bottom shell is fixed with a structure composed of the transmission gear shaft hole, the transmission gear and the transmission gear limiting block; two of the meandering double straight transmission bars are arranged in an overlapping manner in the interior of the transmission bar control box side shell and pass through the structure composed of the transmission gear shaft hole, the transmission gear and the transmission gear limiting block; the transmission bar control box top shell is provided with the transmission bar control shaft hole and the transmission bar control box control groove; the transmission bar control box control groove is provided with a circular wave pattern structure; the rotation adjusting knob required by the transmission bar control box has the elastic lock piece and the lock piece control shaft structure; the elastic lock piece has an elastic structure which is located at the center of the rotation adjusting knob through the lock piece control shaft.

[0010] Preferably, the power supply control box comprises a power supply control box shell, a module fixing hole, an external power supply outlet hole and an external power supply installation cabin; the left upper side of the power supply control box shell is provided with the module fixing hole, the upper right side of the power supply control box shell is provided with the external power supply outlet hole, and the lower right side of the power supply control box shell is provided with the external power supply installation cabin; the module fixing hole is provided with screw threads.

[0011] The application has the advantages that the wearable can be provided with the stretchable angle-adjustable lip motion image shooting function module. In the process of speaking, the wearable can adjust the angle of the lip motion image shooting function module twice according to the needs, so that the camera can contain the shooting unit of the shooting object to the greatest extent. The length and angle are adjusted to ensure that the horizontal distance between the camera and the face remains relatively unchanged, thereby reducing the ectopic error caused by the distance change. In addition, the installation of the module on the multi-modal data acquisition helmet can keep the imaging plane of the lip motion parallel to the tongue motion reference plane (perpendicular to the imaging plane), thereby ensuring that the image acquisition function of the multi-modal data has the same reference plane, and ensuring the rationality of image matching. BRIEF DESCRIPTION OF DRAWINGS

[0012] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description only show some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor based on these drawings.

[0013] Figure 1 Structure schematic diagram of the stretchable angle-adjustable lip motion image shooting function module in a split state according to the present application;

[0014] Figure 2 Structure schematic diagram of the stretchable angle-adjustable lip motion image shooting function module in a split state according to the present application;

[0015] Figure 3 Structure schematic diagram of the stretchable angle-adjustable lip motion image shooting function module in a split state according to the present application;

[0016] Figure 4 Structure schematic diagram of the stretchable angle-adjustable lip motion image shooting function module in a split state according to the present application;

[0017] Figure 5 Structure schematic diagram of the stretchable angle-adjustable lip motion image shooting function module in a split state according to the present application;

[0018] Figure 6 Structure schematic diagram of the stretchable angle-adjustable lip motion image shooting function module in a split state according to the present application;

[0019] Figure 7 Structure schematic diagram of the stretchable angle-adjustable lip motion image shooting function module in a split state according to the present application;

[0020] Legend of reference signs:

[0021] Rotary adjustment knob 1, angle adjustment knob 2, back-shaped double straight transmission bar 3, camera fixing groove 4, module fixing screw 5, transmission bar control box 6, power supply control box 7, angle adjustment gear 8, angle adjustment knob connecting piece 9, angle adjustment knob shell 10, angle adjustment knob shaft hole 11, lock 12, angle adjustment limiting block 13, blocking piece 14, back-pulling spring fixing column 15, back-pulling spring 16, transmission bar control and side shell 17, transmission bar control box bottom shell 18, transmission gear shaft hole 19, transmission gear 20, transmission gear limiting block 21, transmission bar control box top shell 22, transmission bar control box control shaft hole 23, transmission control box control groove 24, elastic lock piece 25, lock piece control shaft 26, power supply control box shell 27, module fixing hole 28, external power supply outlet hole 29, external power supply installation cabin 30. DETAILED DESCRIPTION

[0022] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0023] like Figures 1-7 As shown, the extendable angle-adjustable lip motion image capturing module includes a rotary adjustment knob 1, an angle adjustment knob 2, a loop-shaped double linear transmission bar 3, a camera mounting slot 4, a module mounting screw 5, a transmission bar control box 6, and a power supply control box 7. Two angle adjustment knobs 2 are respectively fixed to the bottom ends of two loop-shaped double linear transmission bars 3, and the two loop-shaped double linear transmission bars 3 are arranged in an overlapping manner within the transmission bar control box 6. The rotary adjustment knob 1 is installed on the outer side of the transmission bar control box 6. The bottom ends of the two angle adjustment knobs 2 are respectively fixed with module mounting screws 5 and camera mounting slots 4. The outer edge of the module mounting screws 5 has screw threads and is detachably connected to the power supply control box 7. Meanwhile, the camera mounting slot 4 has a resistance groove, allowing for camera replacement and removal.

[0024] Furthermore, the angle adjustment knob 2 includes an angle adjustment gear 8, an angle adjustment button connector 9, an angle adjustment knob housing 10, an angle adjustment knob shaft hole 11, a latch 12, an angle adjustment knob limiting block 13, a blocking plate 14, a pull-back spring fixing post 15, and a pull-back spring 16; the angle adjustment limiting block 13 is fixed in the angle adjustment knob housing 10; the bottom end of the latch 12 is fixed with the blocking plate 14 and the pull-back spring fixing post 15; the latch 12 is connected to the pull-back spring 16 through the pull-back spring fixing post 15 to ensure that the latch 12 will not deviate from the pull-back spring 16 during operation.

[0025] The adjustment structure, consisting of the latch 12, the blocking plate 14, the pull-back spring fixing post 15, and the return spring 16, is located in the middle of the angle adjustment limit block 13; the angle adjustment gear 8 has an angle adjustment knob shaft hole 11, and the angle adjustment knob housing is externally fitted with an angle adjustment button connector 9 having an angle adjustment knob shaft hole 11; the angle adjustment button connector 9 is connected to the angle adjustment gear 8 via a shaft.

[0026] Further, the transmission bar control box 6 comprises a transmission bar control box side shell 17, a transmission bar control box bottom shell 18, a transmission gear shaft hole 19, a transmission gear 20, a transmission gear limiting block 21, a transmission bar control box top shell 22, a transmission bar control shaft hole 23, a transmission bar control box control groove 24, an elastic lock piece 25, and a lock piece control shaft 26. The transmission bar control box side shell 17, the transmission bar control box bottom shell 18, and the transmission bar control box top shell 22 together form the shell of the transmission bar control box. The transmission bar control box bottom shell 18 is fixed with a structure composed of the transmission gear shaft hole 19, the transmission gear 20, and the transmission gear limiting block 21 in the center. Two of the meandering double straight transmission bars 3 are arranged in an overlapping manner inside the transmission bar control box side shell 17 and pass through the structure composed of the transmission gear shaft hole 19, the transmission gear 20, and the transmission gear limiting block 21. The transmission bar control box top shell 22 is provided with the transmission bar control shaft hole 23 and the transmission bar control box control groove 24. The transmission bar control box control groove 24 is a circular wave structure. In addition, the rotary adjustment knob 1 required by the transmission bar control box has an elastic lock piece 25 and a lock piece control shaft 26 structure. The elastic lock piece has an elastic structure and is located in the center of the rotary adjustment knob 1 through the lock piece control shaft 26.

[0027] Further, the power supply control box 7 comprises a power supply control box shell 27, a module fixing hole 28, an external power supply outlet hole 29, and an external power supply installation cabin 30. The left side of the power supply control box shell 27 has the module fixing hole 28 on the top, the right side of the power supply control box shell 27 has the external power supply outlet hole 29 on the top, and the right side of the power supply control box shell 27 has the external power supply installation cabin 30 on the bottom. The module fixing hole 28 has a screw texture.

[0028] In use, the user places the extendable angle-adjustable lip movement image shooting function module at the upper frontal functional interface of the ultrasonic imaging helmet, and installs the shooting module on the power supply control box with the module fixing hole 28 through the module fixing screw 5 with a screw texture. The power supply control box 7 is used to provide external power supply for the shooting module. The angle of the lip movement shooting imaging is adjusted through the angle adjustment knob 2. The length of the meandering double straight transmission bar 3 in the shooting module is controlled through the transmission bar control box 6. The camera required for shooting is fixed and detached through the camera fixing groove 4.

[0029] The power supply control box 7 is located at the upper frontal functional interface of the ultrasonic imaging helmet. The wearer can fix the shooting module above the power supply control box 7 through the module fixing screw 5. The wearer can place the external power supply box in the power supply installation cabin 30 and pass the power supply line out through the external power supply outlet hole 29 for power supply.

[0030] The angle adjustment knob 2 can help the wearer to adjust the shooting angle of the camera according to his own needs when the lips move. The lip movement image shooting function module has two angle adjustment knobs 2, which can be rotated twice by the wearer, so that the camera fixed in the camera fixing groove 4 can face the wearer's lips to collect movement information. When the wearer adjusts the angle, the angle adjustment gear 8 makes the lock 12 move to the right along the track left by the two angle adjustment knob limiting blocks 13, and the retractable spring 16 connected to the retractable spring fixing column 15 is retracted. At this time, the lock 12 is subjected to a rightward pushing force. When the angle adjustment is completed, the retractable spring 16 will make the lock 12 move to the left to restore its original state, and when the blocking piece 14 is blocked by the angle adjustment limiting block 13, the movement is stopped, and finally the lock 12 is locked, thereby completing the angle adjustment;

[0031] The transmission bar control box 6 can help the wearer to adjust the position of the back-to-back straight transmission bar 3 according to his own needs, so as to adjust the distance between the lip movement camera and the face. When the wearer rotates the rotating button 1, the lock piece control shaft 26 passing through the transmission bar control box control shaft hole 23 will rotate (clockwise or counterclockwise), at this time, the elastic lock piece 25 fixed on both sides of the lock piece control shaft 26 will be deformed and rotate in the transmission bar control box control groove 24 with wave pattern. The rotation of the lock piece control shaft 26 will drive the transmission gear 20 connected through the transmission gear shaft hole 19, thereby driving the back-to-back straight transmission bar 3 at both ends to extend or shorten. Limited by the transmission gear limiting block 21, the two back-to-back straight transmission bars 3 can always maintain a horizontal movement state;

[0032] The power supply control box 7 is used to fix the main support of the stretchable angle adjustment type lip movement image shooting function module. When the module needs external power supply, this structure can provide external power support for the camera. When installing, the wearer fixes it in the module fixing hole 28 through the module fixing screw 5 at the bottom of the shooting module main support. When external power is needed, the user installs the external battery box in the external power supply installation cabin 30, and the power cord is passed out through the external power supply outlet hole 29.

[0033] The camera installed in the camera fixing cabin 4 can be adjusted in shooting angle by rotating the angle adjustment knob 2. The main support of the shooting module has two angle adjustment knobs 2, each of which can complete 0-180° angle adjustment. The wearer can adjust the angle twice, so that the camera fixed in the camera fixing groove 4 can face the wearer's lips to collect movement information;

[0034] The relative position of the two back-shaped transmission bars installed in the transmission bar control box 6 can be adjusted by operating the rotation adjustment knob 1. When the wearer operates the rotation adjustment knob 1 counterclockwise, the transmission gear 20 connected with the lock piece control shaft 26 will drive the two back-shaped double straight transmission bars 3 to move in different directions respectively, thereby extending the shooting length of the main support. When the wearer operates the rotation adjustment knob 1 clockwise, the transmission gear 20 connected with the lock piece control shaft 26 will drive the two back-shaped double straight transmission bars 3 to move in different directions respectively, thereby shortening the shooting length of the main support. When the wearer stops operating the rotation adjustment knob 1, the elastic lock structure at the end of the lock piece 25 connected with the lock piece control shaft 26 will be clamped in the concave groove of the wavy groove of the transmission bar control box control groove 24, so that the two back-shaped transmission bars 3 maintain the existing relative position, thereby completing the length adjustment.

[0035] The design of the present application can provide the wearer with an extendable angle-adjustable lip movement image shooting function module. During the process of the speaker's pronunciation, the present application can ensure that the wearer can adjust the lip movement image shooting function module twice according to their own needs, so that the camera can maximize the inclusion of the shooting unit of the shooting object. By adjusting the length and angle, the horizontal distance between the camera and the face is kept relatively unchanged, thereby reducing the ectopic error caused by the change of distance. In addition, installing this module on a multi-modal data acquisition helmet can make the imaging plane of the lip movement always in parallel with the tongue movement reference plane (perpendicular to the imaging plane), ensuring that the image acquisition function of the multi-modal data has the same reference plane, thereby ensuring the rationality of image matching.

[0036] Obviously, those skilled in the art can make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application also intends to include these modifications and variations.

Claims

1. An extendable angle-adjustable lip-motion image shooting function module, characterized in that, The utility model relates to a kind of angle-adjusting device, including rotation adjusting knob, angle-adjusting knob, backshaped double straight transmission bar, camera fixing groove, module fixed screw, transmission bar control box, power supply control box;Two angle-adjusting knobs are respectively fixed in the bottom of two backshaped double straight transmission bars, and two backshaped double straight transmission bars are set in transmission bar control box in the form of overlap;The outside of transmission bar control box is equipped with rotation adjusting knob;The bottom of two angle-adjusting knobs is respectively fixed with module fixed screw and camera fixing groove;The outer edge of module fixed screw has screw thread, and it is detachably connected to power supply control box;Camera fixing groove is provided with resistance groove; The angle-adjusting knob includes angle-adjusting gear, angle-adjusting button connecting piece, angle-adjusting knob shell, angle-adjusting knob shaft hole, lock, angle-adjusting knob limiting block, blocking piece, back-pulling spring fixing column and back-pulling spring;The angle-adjusting knob limiting block is fixed in the angle-adjusting knob shell;The bottom of the lock is fixed with the blocking piece and the back-pulling spring fixing column;The lock is connected with the back-pulling spring through the back-pulling spring fixing column;The adjusting structure composed of the lock, the blocking piece, the back-pulling spring fixing column and the back-pulling spring is set in the middle of the angle-adjusting knob limiting block;The angle-adjusting knob shaft hole is arranged on the angle-adjusting gear, and the angle-adjusting button connecting piece with the angle-adjusting knob shaft hole is embedded on the angle-adjusting knob shell;The angle-adjusting button connecting piece is connected with the angle-adjusting gear through a shaft rod; The transmission bar control box includes transmission bar control box side shell, transmission bar control box bottom shell, transmission gear shaft hole, transmission gear, transmission gear limiting block, transmission bar control box top shell, transmission bar control shaft hole, transmission bar control box control groove, elastic lock piece and lock piece control shaft;The transmission bar control box side shell, the transmission bar control box bottom shell and the transmission bar control box top shell together form the shell of the transmission bar control box;The center of the transmission bar control box bottom shell is fixed with the structure composed of the transmission gear shaft hole, the transmission gear and the transmission gear limiting block;Two backshaped double straight transmission bars are set in the inside of the transmission bar control box side shell in the form of overlap, and pass through the structure composed of the gear shaft hole, the transmission gear and the transmission gear limiting block;The transmission bar control shaft hole and the transmission bar control box control groove are arranged above the transmission bar control box top shell;The transmission bar control box control groove is provided with a circular wave pattern structure;The rotation adjusting knob required by the transmission bar control box has the structure of the elastic lock piece and the lock piece control shaft;The elastic lock piece has an elastic structure, which is located in the center of the rotation adjusting knob through the lock piece control shaft; When the wearer adjusts the angle, the angle-adjusting gear makes the lock move right along the track left by the two angle-adjusting knob limiting blocks, and the back-pulling spring connected with the back-pulling spring fixing column contracts;At this time, the lock receives a rightward thrust;After the angle adjustment is completed, the back-pulling spring restores to its original state, which makes the lock move left, and the blocking piece stops moving when it is hindered by the angle-adjusting limiting block, finally locking the lock, thereby completing the angle adjustment. The transmission bar control box can help the wearer to adjust the position of the meander-shaped double straight transmission bar according to the needs of the wearer, so as to adjust the distance between the lip movement camera and the face; the wearer rotates the rotation adjusting knob, the lock piece control shaft penetrating through the transmission bar control box control shaft hole rotates, the elastic lock piece fixed on both sides of the lock piece control shaft is deformed and rotates in the transmission bar control box control groove with wave lines; the rotation of the lock piece control shaft drives the transmission gear connected through the transmission gear shaft hole, so as to drive the meander-shaped double straight transmission bar at both ends to perform the elongation or shortening movement; limited by the transmission gear limiting block, the two meander-shaped double straight transmission bars can always maintain the horizontal movement state.

2. The stretchable angle-adjustable lip-motion image capturing function module according to claim 1, wherein The power supply control box includes a power supply control box shell, a module fixing hole, an external power supply outlet hole and an external power supply installation cabin. The left upper side of the power supply control box shell is provided with the module fixing hole, the upper right side of the power supply control box shell is provided with the external power supply outlet hole, and the lower right side of the power supply control box shell is provided with the external power supply installation cabin. The module fixing hole is provided with screw threads.

Images