Voice recognition system and display device using the same

Abstract

Disclosed are a speech recognition system and a display device using the same. The disclosed speech recognition system includes a panel structure, a vibration sensor, and a speech recognition device. The panel structure vibrates in response to propagation of sound waves generated by a user, and the vibration sensor is disposed in contact with the panel structure to detect the vibration of the panel structure. The speech recognition device recognizes the user's speech by receiving a signal output from the vibration sensor.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application is based upon and claims the benefit of priority from Korean Patent Application No. 10-2020-0002146 filed on January 7, 2020, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference. Technical Field

[0003] The present disclosure relates to a voice recognition system and a display device using the same. Background Art

[0004] In devices used for voice recognition, when the microphone is located inside or outside the device, a sound hole is required to transmit the user's voice well. In addition, multiple microphones are required to increase the voice recognition range, and the relative positions of the multiple microphones need to be appropriately adjusted. Summary of the Invention

[0005] Provided are a speech recognition system and a display device using the system.

[0006] Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the embodiments presented herein.

[0007] According to one aspect of the present disclosure, a speech recognition system is provided, including: a plate structure that vibrates based on the propagation of sound waves from a user; a vibration sensor that is arranged to contact the plate structure to detect the vibration of the plate structure; and a speech recognition device configured to recognize the user's speech based on a signal output from the vibration sensor.

[0008] The vibration sensor may be arranged to have directivity in the direction of the user.

[0009] The surface of the vibration sensor facing in the direction of the user may be arranged parallel to the plate structure.

[0010] The vibration sensor may include a displacement sensor.

[0011] The vibration sensor may include: a support plate, a portion of which is fixed to the plate structure; and at least one sensing element disposed on the support plate.

[0012] The vibration sensor may further include a weight block disposed on the support plate.

[0013] The vibration sensor may include: a plurality of support plates each having a portion fixed to a plate structure; and a plurality of sensing elements having different resonant frequencies, each of the plurality of sensing elements being disposed on the plurality of support plates.

[0014] The speech recognition system may further include a housing supporting the plate structure.

[0015] The voice recognition system may further include a vibration-damping member disposed between the plate structure and the housing.

[0016] According to another aspect of the present disclosure, a speech recognition system is provided, including: a plate structure that vibrates based on the propagation of sound waves from a user; a plurality of vibration sensors that are arranged to be in contact with the plate structure; a signal processor configured to process signals output from the plurality of vibration sensors; and a speech recognition device configured to recognize the user's speech based on the signals processed by the signal processor.

[0017] The plurality of vibration sensors may have directivity in a first direction, which is a direction of the user, and may be disposed at positions determined based on a value of displacement corresponding to the panel structure.

[0018] The plurality of vibration sensors may include a first vibration sensor having directivity in a first direction; and a second vibration sensor having directivity in a second direction different from the first direction.

[0019] The speech recognition system may further include a housing supporting the plate structure.

[0020] The voice recognition system may further include a vibration-damping member disposed between the plate structure and the housing.

[0021] According to another aspect of the present disclosure, a display device is provided, including: a display panel that vibrates based on the propagation of sound waves from a user; a housing that supports the display panel; at least one vibration sensor disposed in the housing and in contact with the display panel to detect vibration of the display panel; and a voice recognition device configured to recognize the user's voice based on a signal output from the at least one vibration sensor.

[0022] The display apparatus may further include a vibration reducing member disposed between the display panel and the housing.

[0023] At least one vibration sensor may be attached to the rear surface of the display panel.

[0024] The at least one vibration sensor may be arranged to have directivity in a first direction, the first direction being the direction of the user.

[0025] The at least one vibration sensor may include: a first vibration sensor having directivity in a first direction; and a second vibration sensor having directivity in a second direction different from the first direction.

[0026] The display device may further include a signal processor configured to process signals output from the first vibration sensor and the second vibration sensor and output the processed signals to the voice recognition device.

[0027] According to another aspect of the present disclosure, a speech recognition device is provided, comprising: a board structure; and a vibration sensor, arranged on the board structure, for detecting vibration of the board structure, wherein the vibration sensor comprises: a substrate having a cavity and a supporting portion; and a sensing element, arranged on the supporting portion of the substrate.

[0028] A substrate may be attached to the rear surface of the board structure.

[0029] The support portion may be arranged parallel to the plate structure. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The above and other aspects, features and advantages of some embodiments of the present disclosure will become more apparent from the following description in conjunction with the accompanying drawings, in which:

[0031] Figure 1 is a schematic diagram of a speech recognition system according to an example embodiment;

[0032] Figure 2 yes Figure 1 A perspective view of the vibration sensor shown;

[0033] Figure 3 It is along Figure 2 A cross-sectional view taken along line AA′;

[0034] Figure 4 It is along Figure 2 A cross-sectional view taken along line BB′;

[0035] Figure 5 is Figures 2 to 4 A perspective view of an equivalent model made of isotropic material of a sensing element disposed on a support plate;

[0036] Figure 6 yes Figure 1 A perspective view of another example vibration sensor that may be employed in a speech recognition system is shown;

[0037] Figures 7 to 10 Shown Figure 1 Other example vibration sensors that may be employed in the illustrated speech recognition system;

[0038] Figure 11 is a schematic diagram of a speech recognition system according to another example embodiment;

[0039] Figure 12 is a schematic diagram of a speech recognition system according to another example embodiment; and

[0040] 13A to 13F A speech recognition system according to other example embodiments is shown. DETAILED DESCRIPTION

[0041] With reference now to embodiment in detail, examples of embodiments are shown in the accompanying drawings, wherein similar reference numerals throughout the drawings represent similar elements. In this regard, embodiments may have different forms and should not be construed as being limited to the description set forth herein. Therefore, the embodiments are described below only by reference to the accompanying drawings to explain various aspects. As used herein, the term "and / or" includes any and all combinations of one or more of the relevant listed items. Statements such as "at least one of..." modify the entire element list when following an element list, rather than modifying the individual elements in the list.

[0042] Hereinafter, the present disclosure will be described in detail by illustrating embodiments of the present disclosure with reference to the accompanying drawings. In the accompanying drawings, like reference numerals represent like elements, and the sizes of the elements may be exaggerated for the sake of clarity and ease of description. The embodiments described herein are merely examples and may be modified in various ways.

[0043] In the following description, when an element is referred to as being "on" another element, it can be "directly" on the other element or "indirectly" if intervening elements are present. The singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. When used herein, the terms "include," "comprising," "having," and / or "containing" indicate the presence of the elements described, but do not preclude the presence or addition of one or more other elements.

[0044] The definite article "the" or other referential words can refer to both singular and plural forms. Unless the context clearly indicates otherwise, the operations included in the method can be performed in a suitable order and are not limited to the order described herein.

[0045] Terms such as “unit” or “module” used herein refer to an entity for processing at least one function or operation and can be implemented by hardware, software, or a combination of hardware and software.

[0046] The connecting lines or connecting members between elements shown in the drawings represent examples of functional connections and / or physical or circuit connections and may represent various alternative or additional functional connections, physical connections or circuit connections in actual devices.

[0047] Unless defined by the claims, all examples or exemplary terms are only used to describe the technical features in detail, and do not limit the scope of the present disclosure.

[0048] Figure 1 is a schematic diagram of a speech recognition system 100 according to an example embodiment.

[0049] refer to Figure 1 , the voice recognition system 100 includes a board structure 110, a vibration sensor 130, and a voice recognition device 150. The board structure 110 may vibrate due to the voice generated by the user S, and the vibration sensor 130 may be attached to the board structure 110 to detect the vibration of the board structure 110. The voice recognition device 150 may recognize the voice of the user S by receiving a signal 160 output from the vibration sensor 130.

[0050] exist Figure 1 In the voice recognition system 100 shown in , when a sound wave is generated and propagated from a user S, the plate structure 110 vibrates based on the sound wave. For example, the plate structure 110 vibrates slightly in synchronization with the sound wave. Due to the vibration, a dynamic change that is highly correlated with the voice signal of the user S occurs at a portion of the plate structure 110 that is attached to the vibration sensor 130. According to an example embodiment, the dynamic change can be one or more of displacement, velocity, acceleration, strain, or optical displacement. The vibration sensor 130 can then obtain the vibration that causes the dynamic change, and the voice recognition device 150 can recognize the voice of the user S by receiving the output signal 160 obtained from the vibration sensor 130.

[0051] The panel structure 110 may vibrate due to sound waves generated from the user S. Here, the user S may be located in front of the panel structure 110, for example Figure 1 The plate structure 110 may include a front surface 110 a facing the user S and a rear surface 110 b opposite to the front surface 110 a.

[0052] The plate structure 110 may be in the form of a thin plate capable of generating vibrations. The plate structure 110 may include, for example, a display panel, a smart window, or a smart mirror. However, these items are merely examples. For example, when a display panel is used as the plate structure 110, the speech recognition system 100 according to the present embodiment may be a display device.

[0053] According to an example embodiment, the voice recognition system 100 may include a housing 120 disposed outside the board structure 110 to support the board structure 110. Here, the housing 120 may be disposed, for example, to cover the rear surface 110b of the board structure 110. However, this configuration is merely an example. In some cases, the housing 120 may not be provided.

[0054] The vibration sensor 130 is used to detect the vibration of the panel structure 110 caused by the voice of the user S, and can be arranged to be in contact with the panel structure 110. When the user S is located in front of the panel structure 110, the vibration sensor 130 can be attached to, for example, the rear surface 110b of the panel structure 110. In this case, the vibration sensor 130 can be attached to, for example, the portion of the panel structure 110 where the vibration occurs most. For example, the vibration sensor 130 can be attached to the portion of the panel structure 110 where the vibration has the greatest impact on the position and / or speed of the displacement of the panel structure 110. However, the present disclosure is not limited thereto, and therefore, in some cases, the vibration sensor 130 can be attached to a portion of the panel structure 110 other than the rear surface 110b.

[0055] The vibration sensor 130 may include, for example, a displacement sensor for detecting displacement due to vibration of the plate structure 110. In this case, the vibration sensor 130 may be disposed in parallel with the plate structure 110 to have a direction in front of the plate structure 110 corresponding to the user direction (e.g., Figure 1 That is, the vibration sensor 130 may be arranged so that the plane of the vibration sensor 130 faces the direction of the user. According to an example embodiment, the vibration sensor 130 may be arranged so that the plane of the vibration sensor 130 is perpendicular to the direction of the user.

[0056] Figure 2 yes Figure 1 A perspective view of vibration sensor 130 is shown. Figure 3 It is along Figure 2 A cross-sectional view taken along line AA', and Figure 4 It is along Figure 2 A cross-sectional view taken along line BB'. Figures 2 to 4 The vibration sensor 130 shown in FIG. 1 may be a displacement sensor for detecting displacement due to vibration of the plate structure 110 caused by the user S's voice.

[0057] refer to Figures 2 to 4 The vibration sensor 130 may include a substrate 131 and a sensing element 140 disposed on the substrate 131. Here, the substrate 131 may be attached to the rear surface 110b of the plate structure 110. An adhesive layer 135 may be further disposed between the substrate 131 and the plate structure 110 for attaching the vibration sensor 130 to the plate structure 110.

[0058] The substrate 131 may have a cavity 131a passing through the substrate 131 and a support plate 132 extending into the cavity 131a. Here, the support plate 132 is disposed parallel to the plate structure 110. The substrate 131 may use, for example, a silicon substrate, but is not limited thereto and may use substrates of various materials.

[0059] The support plate 132 may have a cantilever structure, one end of which is fixed to a portion of the base plate 131 attached to the plate structure 110, and the other end of which may be moved in a direction of the user (eg, Figure 2 The z-axis direction in the image can be freely moved.

[0060] The sensing element 140 may be disposed on the surface of the support plate 132. Here, the sensing element 140 may include a resonator having a specific resonant frequency. For example, the sensing element 140 may include a piezoelectric device for generating electrical energy due to deformation of a piezoelectric body. In this case, the sensing element 140 includes a first electrode 141 disposed on the support plate 132, a piezoelectric layer 143 disposed on the first electrode 141, and a second electrode 142 disposed on the piezoelectric layer 143. Here, the first electrode 141 and the second electrode 142 may be, for example, a (+) electrode and a (-) electrode, respectively. Alternatively, the first electrode 141 and the second electrode 142 may be a (-) electrode and a (+) electrode, respectively. The first electrode 141 and the second electrode 142 may be electrically connected to a first terminal 141a and a second terminal 142a disposed on the substrate 131, respectively.

[0061] exist Figures 2 to 4 In the vibration sensor 130 shown, the displacement generated by the vibration of the plate structure 110 caused by the voice of the user S can be transmitted to one end of the support plate 132 fixed to the plate structure 110, and the other end of the support plate 132 can vibrate due to inertial force to amplify the displacement.

[0062] In the current embodiment, the vibration sensor 130 may be disposed in parallel with the plate structure 110 (eg, xy plane) to have directivity in the user direction (eg, z-axis direction).

[0063] Figure 5 According to an example embodiment, Figures 2 to 4 A perspective view of an equivalent model 145 of an isotropic material of the sensing element 140 disposed on the support plate 132. Figure 5 In, l x 、l y and l z They respectively represent the length (dimension in the x-axis direction), width (dimension in the y-axis direction), and thickness (dimension in the z-axis direction) of the equivalent model 145 .

[0064] Equation 1 represents the ratio of the stiffness in the y-axis direction to the stiffness in the z-axis direction, and Equation 2 represents the ratio of the stiffness in the x-axis direction to the stiffness in the z-axis direction. In Equations 1 and 2, E represents Young's modulus.

[0065]

[0066]

[0067] As an example of the dimensions of a typical small sensor, assume that the thickness of the equivalent model 145 is l z , width l y and length l x 2 μm, 100 μm, and 1000 μm, respectively. According to Equations 1 and 2, the stiffness in the y-axis direction is about 2,500 times that in the z-axis direction, and the stiffness in the x-axis direction is about 25,000 times that in the z-axis direction.

[0068] As described above, since the stiffness in the x-axis direction and the stiffness in the y-axis direction are much greater than the stiffness in the z-axis direction, the equivalent model 145 is shown to have directivity in the z-axis direction.

[0069] Therefore, when the plate structure 110 vibrates, the vibration sensor 130, which is arranged parallel to the plate structure 110, can obtain a signal mainly from the z-axis direction corresponding to the user direction (for example, a sound signal generated from a speaker installed in the housing) compared to a signal from the x-axis or y-axis.

[0070] Figure 6 yes Figure 1 A perspective view of another example vibration sensor 230 that may be employed in the speech recognition system 100 is shown.

[0071] refer to Figure 6 The vibration sensor 230 includes a plurality of sensing elements 241, 242, and 243 provided on a substrate 231. A cavity 231a passes through the substrate 231, and a plurality of support plates 232a, 232b, and 232c extend from the substrate 231 into the cavity 231a. Here, the plurality of support plates 232a, 232b, and 232c may be provided in parallel with the plate structure 110 (see FIG. Figure 1 )parallel.

[0072] Each of the plurality of support plates 232a, 232b, and 232c may have a cantilever structure, one end of which is fixed to the base plate 231 attached to the plate structure 110, and the other end of which may be moved in a direction of the user (eg, Figure 6 The z-axis direction in the image can be freely moved.

[0073] The plurality of sensing elements 241, 242 and 243 are respectively provided on the plurality of support plates 232a, 232b and 232c. As described above, each of the plurality of sensing elements 241, 242 and 243 may include, for example, a piezoelectric device for generating electric energy due to deformation of a piezoelectric body.

[0074] The plurality of sensing elements 241, 242, and 243 may be configured to have different resonant frequencies. To this end, the plurality of sensing elements 241, 242, and 243 may be configured to have different sizes. For example, the plurality of sensing elements 241, 242, and 243 may have at least one of different lengths, different widths, and different thicknesses. Figure 6 An example is shown in which a plurality of support plates 232 a , 232 b , and 232 c having different lengths are provided on a substrate 231 , and a plurality of sensing elements 241 , 242 , and 243 having different lengths are provided on the support plates 232 a , 232 b , and 232 c .

[0075] Despite Figure 6 Three sensing elements 241 , 242 , and 243 having three different resonant frequencies are shown, but three is only an example, and the number of sensing elements 241 , 242 , and 243 may be variously changed.

[0076] As described above, since the vibration sensor 230 includes the plurality of sensing elements 241 , 242 , and 243 having different resonance frequencies, a voice signal of a wide frequency band can be recognized.

[0077] Figures 7 to 10 Shown Figure 1 Other example vibration sensors 371 , 372 , 373 , and 374 that may be employed in speech recognition system 100 are shown.

[0078] Figure 7 The vibration sensor 371 shown includes a support plate 332a and a sensing element 340a disposed on the support plate 332a. Here, the support plate 332a may have a cantilever structure including a fixed end. Specifically, the support plate 332a may have a structure in which one end of the structure is fixed to a plate structure 110 (see FIG. Figure 1 ) substrate 131, and its other end can move freely in the direction of the user. Sensing element 340a can be arranged near the fixed portion of support plate 332a. A weight block (mass) 380a capable of increasing inertial force can also be arranged on the other end of support plate 332a to increase the sensitivity of vibration sensor 371.

[0079] Figure 8 The vibration sensor 372 shown includes a support plate 332b and a plurality of sensing elements 340b disposed on the support plate 332b. Here, the support plate 332b may have a bridge structure with two fixed ends. Specifically, the support plate 332b may have a structure in which both ends are fixed to the base plate 131 attached to the plate structure 110, and the middle portion thereof is free to move in the direction of the user. The plurality of sensing elements 340b may be disposed near the fixed portion of the support plate 332b. Figure 8 An example is shown in which two sensing elements 340b are provided on the support plate 332b. However, the number of sensing elements 340b is not limited thereto, and a single sensing element 340b may be provided on the support plate 332b. A weight block 380b may also be provided in the middle portion of the support plate 332b to increase the sensitivity of the vibration sensor 372.

[0080] Figure 9 The vibration sensor 373 includes a support plate 332c and a plurality of sensing elements 340c disposed on the support plate 332c. Here, the support plate 332c may have a polygonal structure including four fixed ends. The plurality of sensing elements 340c may be disposed near the fixed portion of the support plate 332c. Figure 9 An example is shown in which four sensing elements 340c are provided on the support plate 332c. However, the number of sensing elements 340c is not limited thereto, and various numbers of sensing elements 340c may be provided on the support plate 332c. A weight block 380c may also be provided in the middle portion of the support plate 332c to increase the sensitivity of the vibration sensor 373.

[0081] Figure 9 The vibration sensor 373 is shown as an example including a polygonal support plate 332c having four fixed ends. However, four is only an example, and the vibration sensor 373 may include various polygonal support plates having three fixed ends or five or more fixed ends.

[0082] Figure 10 The vibration sensor 374 includes a support plate 332d and a sensing element 340d disposed on the support plate 332d. Here, the support plate 332d may have a circular structure with a fixed circumference. The sensing element 340d may be disposed along a fixed portion of the support plate 332d. Figure 10 An example is shown in which a single sensing element 340d is provided on the support plate 332d. However, the number of sensing elements 340d is not limited thereto, and a plurality of sensing elements 340d may be provided on the support plate 332d. A weight block 380d may also be provided in the middle portion of the support plate 332d to increase the sensitivity of the vibration sensor 374. Furthermore, at least one through hole 332′ may be provided in the support plate 332d for adjusting the rigidity of the support plate 332d.

[0083] exist Figure 1In the voice recognition system 100 shown in , the vibration sensor 130, 230, 371, 372, 373 or 374 can detect the vibration of the plate structure 110 generated due to the voice of the user S, and the voice recognition device 150 can recognize the voice of the user S by receiving the signal 160 output from the vibration sensor 130, 230, 371, 372, 373 or 374.

[0084] In the voice recognition system 100 according to the present embodiment, since the vibration sensor 130, 230, 371, 372, 373, or 374 can be arranged in contact with the panel structure 110 to detect vibrations of the panel structure 110 caused by the voice of the user S, a sound hole or the like for effectively transmitting the voice of the user S is not required. Furthermore, since the vibration sensor 130, 230, 371, 372, 373, or 374 can be attached to the rear surface 110b of the panel structure 110, which is not visible to the user S, the design of the front surface 110a of the panel structure 110 is not limited by the vibration sensor 130, 230, 371, 372, 373, or 374. Furthermore, since the vibration sensor 130, 230, 371, 372, 373, or 374 can be arranged parallel to the panel structure 110 to have directivity in the direction of the user, it is possible to primarily obtain only voice signals from the direction of the user.

[0085] The above description describes a case where the vibration sensor includes a displacement sensor for detecting displacement due to vibration of the plate structure 110. However, the displacement sensor is merely an example, and the vibration sensor may include other types of sensors.

[0086] For example, the vibration sensor may include an inertial sensor for detecting an inertial force generated by the vibration of the plate structure 110 caused by the voice of the user S, a strain sensor for detecting a strain generated by the vibration of the plate structure 110 caused by the voice of the user S, or an optical sensor for detecting an optical displacement generated by the vibration of the plate structure 110 caused by the voice of the user S. Here, the inertial sensor, the strain sensor, and the optical sensor are generally well known, and thus a detailed description thereof will not be provided here.

[0087] Figure 11 is a schematic diagram of a speech recognition system 400 according to another example embodiment. Figure 11 Shown in Figure 1 The speech recognition device 150 is shown.

[0088] refer to Figure 11 The speech recognition system 400 includes a plate structure 110, a vibration sensor 430, a speech recognition device 150 (see Figure 1 ), housing 420 and vibration-damping member 490.

[0089] Descriptions of the board structure 110 and the voice recognition device 150 are provided above and thus will not be repeated here. The vibration sensor 430 may correspond to one of the above-described vibration sensors 130, 230, 371, 372, 373, and 374, and a detailed description thereof will not be provided here.

[0090] The housing 420 is provided to support the plate structure 110. For example, the housing 420 may be provided to cover the rear surface of the plate structure 110. A vibration reduction member 490 capable of suppressing the transmission of vibration of the housing 420 to the plate structure 110 may be provided between the plate structure 110 and the housing 420. Here, the vibration reduction member 490 may include, for example, an elastic material.

[0091] For example, when the speakers SP1 and SP2 are installed in the housing 420, the housing 420 vibrates due to the sounds generated from the speakers SP1 and SP2, and the vibration may be transferred to the board structure 110. In the voice recognition system 400 according to the exemplary embodiment, since the vibration reduction member 490 is provided between the board structure 110 and the housing 420, the vibration of the housing 420 generated due to the sounds generated from the speakers SP1 and SP2 may be prevented from being transferred to the board structure 110 by the vibration reduction member 490, and thus the vibration sensor 430 may react well to the voice of the user S.

[0092] Figure 12 is a schematic diagram of a speech recognition system 500 according to another example embodiment.

[0093] refer to Figure 12 , the speech recognition system 500 includes a board structure 110, a plurality of vibration sensors 531, 532, and 533 attached to the board structure 110, a signal processor 570, and a speech recognition device 550. The board structure 110 may be supported by the housing 420, and a vibration damping member 490 may be provided between the board structure 110 and the housing 420 to suppress the transmission of vibration of the housing 420 to the board structure 110. The description of the board structure 110, the housing 420, and the vibration damping member 490 is provided above, and thus will not be repeated here.

[0094] The user S may be located in front of the board structure 110 (eg, Figure 12 The plate structure 110 may include a front surface 110a facing the user S and a rear surface 110b opposite the front surface 110a. The plurality of vibration sensors 531, 532, and 533 are attached to the plate structure 110. For example, the plurality of vibration sensors 531, 532, and 533 may be attached to the rear surface 110b of the plate structure 110, but are not limited thereto.

[0095] The plurality of vibration sensors 531, 532, and 533 may include a first vibration sensor 531, a second vibration sensor 532, and a third vibration sensor 533. Here, the first vibration sensor 531, the second vibration sensor 532, and the third vibration sensor 533 may have different directivities depending on the direction in which the first vibration sensor 531, the second vibration sensor 532, and the third vibration sensor 533 are attached to the plate structure 110. Each of the first vibration sensor 531, the second vibration sensor 532, and the third vibration sensor 533 may have the same configuration as one of the vibration sensors 130, 230, 371, 372, 373, and 374 described above.

[0096] The first vibration sensor 531 may be used to detect the vibration of the plate structure 110 caused by the voice of the user S, and may be attached in parallel with the plate structure 110 as described above. Specifically, the first vibration sensor 531 may be arranged to be parallel to the plate structure 110. Figure 12 The first vibration sensor 531 is parallel to the xy plane in the panel structure 110 to have directivity along the user direction (ie, the z-axis direction).

[0097] The second vibration sensor 532 may be used to detect vibration of the panel structure 110 due to a sound source other than the user S (e.g., speakers SP1 and SP2 installed in the housing 420), and may be attached, for example, perpendicularly to the panel structure 110. Specifically, the second vibration sensor 532 may be provided in parallel with the panel structure 110. Figure 12 The second vibration sensor 532 is parallel to the xz plane in the panel structure 110 to have directivity along the y-axis direction. Therefore, the second vibration sensor 532 can mainly detect the vibration of the panel structure 110 in the y-axis direction.

[0098] The third vibration sensor 533 may be used to detect vibration of the panel structure 110 due to a sound source other than the user S (e.g., speakers SP1 and SP2 installed in the housing 420), and may be attached, for example, perpendicularly to the panel structure 110. Specifically, the third vibration sensor 533 may be provided in parallel with the panel structure 110. Figure 12 The third vibration sensor 533 is parallel to the yz plane in the panel structure 110 to have directivity along the x-axis direction. Therefore, the third vibration sensor 533 can mainly detect the vibration of the panel structure 110 in the x-axis direction.

[0099] The first output signal 561 output from the first vibration sensor 531, the second output signal 562 output from the second vibration sensor 532, and the third output signal 563 output from the third vibration sensor 533 are input to the signal processor 570. The signal processor 570 can combine the first output signal 561, the second output signal 562, and the third output signal 563 and process the combined signal, and then the voice recognition device 550 can recognize the voice of the user S by receiving the processed signal.

[0100] In an example embodiment, the signal processor 570 can effectively reduce signals other than the user's voice by distinguishing and removing signals generated due to vibrations in directions different from the z-axis direction corresponding to the user's direction (e.g., the x-axis direction and the y-axis direction).

[0101] 13A to 13F A speech recognition system according to other example embodiments is shown. 13A to 13F Vibration sensors 631, 632, 633, 634, 635, and 636 are shown variously disposed on the rear surface 110b of the plate structure 110. The vibration sensors 631, 632, 633, 634, 635, and 636 described below may correspond to one of the vibration sensors 130, 230, 371, 372, 373, and 374 described above.

[0102] 13A to 13F An example is shown in which the vibration sensors 631 , 632 , 633 , 634 , 635 , and 636 are provided at a portion of the plate structure 110 where the maximum displacement occurs due to the voice of the user S. Figure 13A The case where a single vibration sensor 631 is provided on the plate structure 110 is shown, and 13B to 13F The case where a plurality of vibration sensors 632, 633, 634, 635, and 636 are provided on the board structure 110 is shown. When a plurality of vibration sensors 632, 633, 634, 635, or 636 are provided on the board structure 110, output signals detected by the plurality of vibration sensors 632, 633, 634, 635, or 636 may be processed by a signal processor and then input into the speech recognition device.

[0103] refer to Figure 13A , when a large displacement is generated in the middle portion of the plate structure 110 due to the voice of the user S, the vibration sensor 631 may be provided in the middle portion of the plate structure 110. Figure 13B , when a large displacement is generated in the left and right parts of the plate structure 110 due to the voice of the user S, the vibration sensors 632 may be provided in the left and right parts.

[0104] refer to Figure 13C, when a large displacement is generated in the upper and lower parts of the plate structure 110 due to the voice of the user S, the vibration sensor 633 may be provided in the upper and lower parts. Figure 13D , when a large displacement is generated in the left, center, and right parts of the plate structure 110 due to the voice of the user S, the vibration sensors 634 may be provided in the left, center, and right parts.

[0105] The vibration sensors 635 may be provided at four portions of the plate structure 110 (eg Figure 13E Alternatively, the vibration sensors 636 may be provided at six portions of the plate structure 110 (eg Figure 13F shown).

[0106] As described above, according to example embodiments, since the vibration sensor can be positioned in contact with the panel structure to detect vibrations of the panel structure caused by the user's voice, a sound hole or the like for effectively transmitting the user's voice may be unnecessary. Furthermore, since the vibration sensor can be attached to the rear surface of the panel structure, which is invisible to the user, the design of the front surface of the panel structure is not restricted by the vibration sensor. Furthermore, since the vibration sensor can be positioned parallel to the panel structure to have directivity in the direction of the user, it is possible to primarily obtain voice signals originating from the user's direction.

[0107] The elements of the speech recognition system described herein can be implemented using hardware components and software components. For example, the hardware components may include a microphone, an amplifier, a bandpass filter, an audio digital converter, a non-transitory computer memory, and a processing device. The processing device can be implemented using one or more general or special-purpose computers (e.g., a processor, a controller, and an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of responding and executing instructions in a defined manner). The processing device can run an operating system (OS) and one or more software applications running on the OS. The processing device can also access, store, manipulate, process, and create data in response to the execution of the software. For the purpose of simplicity, the processing device is described in the singular; however, those skilled in the art will recognize that the processing device can include multiple processing elements and multiple types of processing elements. For example, the processing device can include multiple processors or a processor and a controller. In addition, different processing configurations are also possible, such as parallel processors.

[0108] Software may include a computer program, a piece of code, instructions, or some combination thereof to independently or collectively instruct or configure a processing device to operate as desired. Software and data may be embodied permanently or temporarily in any type of machine, component, physical or virtual device, computer storage medium or device, or in a propagating signal wave capable of providing instructions or data to or being interpreted by a processing device. Software may also be distributed across a network of coupled computer systems so that the software is stored and executed in a distributed manner. Software and data may be stored by one or more non-transitory computer-readable recording media. A non-transitory computer-readable recording medium may include any data storage device capable of storing data that can subsequently be read by a computer system or processing device.

[0109] Example embodiments include non-transitory computer-readable media that include program instructions to implement various operations embodied by a computer. The media may also include data files, data structures, tables, etc., alone or in combination with program instructions. The media and program instructions may be media and program instructions specifically designed and constructed for the purposes of the example embodiments, or they may be media and program instructions that are well known and available to those skilled in the art of computer software. Examples of non-transitory computer-readable media include: magnetic media, such as hard disks, floppy disks, and magnetic tapes; optical media, such as CD-ROM disks; magneto-optical media, such as optical floppy disks; and hardware devices specifically configured to store and execute program instructions, such as read-only storage devices (ROM) and random access memories (RAM). Examples of program instructions include both machine code (e.g., machine code generated by a compiler) and files containing higher-level code that can be executed by a computer using an interpreter. The described hardware devices may be configured to function as one or more software modules to perform the operations of the example embodiments described above, or vice versa.

[0110] It should be understood that the embodiments described herein should be considered in a descriptive sense only and not for purposes of limitation. The description of features or aspects in each embodiment should generally be considered applicable to other similar features or aspects in other embodiments. Although one or more embodiments have been described with reference to the accompanying drawings, it should be understood by those skilled in the art that various changes in form and details may be made without departing from the spirit and scope of the appended claims.

Claims

1. A speech recognition system comprising: a plate structure that vibrates based on propagation of sound waves from a user; a vibration sensor disposed in contact with the plate structure to detect vibration of the plate structure; as well as a voice recognition device configured to recognize the user's voice based on the signal output from the vibration sensor, Wherein, the vibration sensor comprises: a plurality of support plates, each having a portion secured to the plate structure, and A plurality of sensing elements having different resonant frequencies, each of the plurality of sensing elements being disposed on a corresponding support plate of the plurality of support plates.

2. The speech recognition system according to claim 1, wherein The vibration sensor is provided to have directivity in the direction of the user.

3. The speech recognition system according to claim 2, wherein: A surface of the vibration sensor facing in the direction of the user is arranged parallel to the plate structure.

4. The speech recognition system according to claim 1, wherein: The vibration sensor includes a displacement sensor.

5. The speech recognition system according to claim 1, wherein: The vibration sensor further includes a weight block disposed on the support plate. The speech recognition system according to claim 1 , further comprising a housing supporting the panel structure. 7 . The voice recognition system according to claim 6 , further comprising a vibration-damping member provided between the plate structure and the housing.

8. A speech recognition system comprising: a plate structure that vibrates based on propagation of sound waves from a user; a plurality of vibration sensors disposed in contact with the plate structure; a signal processor configured to process signals output from the plurality of vibration sensors; as well as a speech recognition device configured to recognize the user's speech based on the signal processed by the signal processor, Wherein, each of the plurality of vibration sensors comprises: a plurality of support plates, each having a portion secured to the plate structure, and A plurality of sensing elements having different resonant frequencies, each of the plurality of sensing elements being disposed on a corresponding support plate of the plurality of support plates.

9. The speech recognition system according to claim 8, wherein: The plurality of vibration sensors have directivity in a first direction that is a direction of the user and are provided at positions determined based on a value of displacement corresponding to the plate structure.

10. The speech recognition system according to claim 8, wherein: The plurality of vibration sensors include: a first vibration sensor having directivity along a first direction, and The second vibration sensor has directivity in a second direction different from the first direction.

11. The speech recognition system according to claim 8, further comprising a housing supporting the panel structure. 12 . The voice recognition system according to claim 11 , further comprising a vibration-damping member disposed between the plate structure and the housing.

13. A display device comprising: a display panel that vibrates based on propagation of sound waves from a user; a housing supporting the display panel; at least one vibration sensor disposed in the housing and in contact with the display panel to detect vibration of the display panel; as well as a voice recognition device configured to recognize the user's voice based on a signal output from the at least one vibration sensor, Wherein, the at least one vibration sensor comprises: a plurality of support plates, each having a portion fixed to the display panel, and A plurality of sensing elements having different resonant frequencies, each of the plurality of sensing elements being disposed on a corresponding support plate of the plurality of support plates. 14 . The display apparatus according to claim 13 , further comprising a vibration-reducing member disposed between the display panel and the housing.

15. The display device according to claim 13, wherein The at least one vibration sensor is attached to the rear surface of the display panel.

16. The display device according to claim 13, wherein The at least one vibration sensor is arranged to have directivity along a first direction, the first direction being the direction of the user.

17. The display device according to claim 13, wherein The at least one vibration sensor comprises: a first vibration sensor having directivity along a first direction, and The second vibration sensor has directivity in a second direction different from the first direction.

18. The display device according to claim 17, further comprising: A signal processor is configured to process the signals output from the first vibration sensor and the second vibration sensor, and output the processed signals to the voice recognition device.

19. A speech recognition device, comprising: Plate structure; as well as a vibration sensor, disposed on the plate structure, for detecting vibration of the plate structure, Wherein, the vibration sensor comprises: a base plate having a cavity and a plurality of supports, each of the plurality of supports having a portion fixed to the plate structure; and a plurality of sensing elements having different resonant frequencies, each of the plurality of sensing elements being disposed on a corresponding support portion of the plurality of support portions, The plurality of support portions extend into the cavity, and the plurality of support portions are parallel to the plate structure.

20. The speech recognition device according to claim 19, wherein: The substrate is attached to the rear surface of the board structure.

Images