Silent Communication System and Method Using an Adhesive Optical Sensor

Abstract

An adhering optical sensor, a silent communication system, and a silent communication method are disclosed. 【Solution means】There are a plurality of the optical fiber layers, and they can be arranged to form layers in the vertical direction with respect to each other. The support member can include an optical fiber arranged in the vertical direction. The support member can connect a plurality of optical fiber layers arranged to form layers in the vertical direction in the vertical direction. The light source is connected to one side of the optical fiber included in the optical fiber layer and one side of the optical fiber included in the support member, and can supply light to the optical fiber. The optical receiver is connected to the other side of the optical fiber included in the optical fiber layer and the other side of the optical fiber arranged in the support member, and can detect the light that has passed through the optical fiber.

Description

Technical Field

[0001] The technology described below relates to a silent communication system.

Background Art

[0002] Silent-Speech Interface technology is one of the technologies that enables users to communicate without actually making a sound. The Silent-Speech Interface is one of the technologies that enables users such as those with hearing and speech communication disabilities, those who have difficulty in accurate vocalization due to laryngectomy or vocal nodules, and military / police / fire protection / security personnel who must converse while wearing a mask to communicate without sound. Among the Silent-Speech Interfaces, the silent-type speech recognition technology that enables communication only by lip movement without actual voice has strong characteristics against ambient noise and communication security.

Prior Art Documents

Patent Documents

[0003]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Conventional silent speech interface technologies include technologies that capture and utilize the air emitted from the mouth, technologies that capture and utilize the movements of a person's face, and the like. However, these conventional technologies have problems such as the need for sounds above a certain level (e.g., 35 dB(A)) or the influence of the shooting angle and the presence or absence of light on performance. In particular, there is a problem that it is difficult to use in daily life or wartime / operational situations where recognizable pronunciation is very limited.

[0005] The technology described below aims to disclose a silent communication system that enables language communication using only the minute movements of a person's skin without actual sound.

Means for Solving the Problem

[0006] The technology described below discloses an adherent optical sensor, a silent communication system, and a silent communication method.

[0007] As one embodiment of the technology described below, the adherent optical sensor can include an optical fiber layer, a support member, and a photoreceiver. The optical fiber layer can include optical fibers horizontally arranged in a lattice structure. There can be a plurality of the optical fiber layers, which can be arranged to form layers in the vertical direction with respect to each other. The support member can include optical fibers arranged in the vertical direction. The support member can connect the plurality of vertically arranged optical fiber layers in the vertical direction. The light source is connected to one side of the optical fibers included in the optical fiber layer and one side of the optical fibers included in the support member, and can supply light to the optical fibers. The photoreceiver is connected to the other side of the optical fibers included in the optical fiber layer and the other side of the optical fibers arranged in the support member, and can sense the light that has passed through the optical fibers.

[0008] As one of the embodiments of the technology described below, a silent communication system can include a sensor unit that acquires optical sensing data using an adherent optical sensor, a data processing unit that includes an inference module that generates sound data based on the optical sensing data, and a speaker unit that outputs sound based on the sound data.

[0009] As one of the embodiments of the technology described below, a silent communication method can include a step in which a sensor unit acquires optical sensing data, a step in which an inference module included in a data processing unit generates sound data based on the optical sensing data, and a step in which a speaker unit outputs sound corresponding to the sound data.

Advantages of the Invention

[0010] When using the technology described below, the movement of a user's skin can be sensed.

[0011] When using the technology described below, people can communicate with each other based on the result of sensing the movement of a user's skin.

[0012] When using the technology described below, communication between each other is possible without sound in wartime and combat situations. Also, it is resistant to loud ambient noise and can solve problems such as communication security.

[0013] When using the technology described below, it can be applied not only to silent speech interfaces but also to the measurement of muscle and joint movements, which can be useful for the diagnosis and rehabilitation treatment of musculoskeletal diseases.

Brief Description of the Drawings

[0014] [Figure 1] It is a perspective view showing an example of an adherent optical sensor including two optical fiber layers according to one embodiment. [Diagram 2] It is a top view showing an example of an adherent optical sensor including two optical fiber layers according to one embodiment. [Figure 3]FIG. showing a power communication unit included in an adhesive optical sensor including two optical fiber layers according to an embodiment. [Figure 4] FIG. showing a state where an adhesive optical sensor according to an embodiment is attached to the tongue. [Figure 5] FIG. showing an example of a silent communication system according to an embodiment. [Figure 6] FIG. showing an example of realizing a silent communication system according to an embodiment. [Figure 7] FIG. showing an example of a silent communication system performing a silent communication method according to an embodiment.

DETAILED DESCRIPTION OF THE INVENTION

[0015] The technology described below can be modified in various ways and can have various embodiments. Specific embodiments of the technology described below can be illustrated in the drawings of the specification. However, this is for the purpose of explaining the technology described below and does not limit the technology described below to specific embodiments. Therefore, all modifications, equivalents, or alternatives included in the spirit and technical scope of the technology described below should be understood to be included in the technology described below.

[0016] Terms such as "first", "second", "A", "B", etc. can be used to describe various components. However, these terms are only used to distinguish one component from another and do not attempt to limit the component. For example, without departing from the scope of the claims of the technology described below, the first component can be named the second component, and similarly, the second component can also be named the first component. The term "and / or" includes a combination of a plurality of related listed items or any of the plurality of related listed items.

[0017] In the terms used hereinafter, the singular forms shall be construed to include the plural forms as well, unless the context clearly dictates otherwise. Terms such as "comprising" shall mean the presence of the recited features, numbers, steps, operations, components, parts, or combinations thereof, and shall not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0018] Before providing a detailed description of the drawings, it should be made clear that the classification of the components in this specification is merely based on the main functions that each component undertakes. That is to say, two or more components described hereinafter may be grouped into one component, or one component may be further divided into two or more components according to more refined functions. And each of the components described hereinafter can, in addition to its main function, further perform part or all of the functions of other components. Needless to say, part of the functions that each component undertakes can also be solely performed by other components.

[0019] Also, when performing a method or an operation method, each process constituting the method can be performed in an order different from the specified order, unless the context clearly specifies a particular order. That is, each process may be performed in the same order as the specified order, may be performed substantially simultaneously, or may be performed in the reverse order.

[0020] As one of the embodiments, the adherent optical sensor may be a sensor used in a silent communication system. Alternatively, the adherent optical sensor may be a sensor used for measuring human muscle movement or the like.

[0021] The adherent optical sensor can be attached to the human body. For example, the adherent optical sensor can be attached to the upper or lower end of the tongue, the palate, the bottom of the mouth, the lips, the cheeks, the vocal cords of the neck, the arms, the legs, and the like.

[0022] The attached optical sensor can detect minute changes or movements in human skin. The attached optical sensor can measure minute changes or movements in the skin that occur during silent speech.

[0023] The attached optical sensor can include an optical fiber. The optical fiber included in the attached optical sensor can change in response to minute changes or movements in the skin. The optical fiber included in the attached optical sensor can be stretched or compressed in response to minute changes or movements in the skin. As the optical fiber changes, the path, intensity, or phase of the light passing through the interior of the optical fiber can change. Based on such changes, changes or movements in the skin can be detected.

[0024] The attached optical sensor can include a plasmonic strain material instead of an optical fiber. Therefore, the attached optical sensor can enable very sensitive strain rate detection by detecting changes in local surface plasmon resonance (LSPR).

[0025] The attached optical sensor can include optical fibers arranged horizontally in a grid structure. When forces are applied to the attached optical sensor in the X-axis and Y-axis directions, changes may occur in the optical fibers included in the optical fiber layer. Therefore, the optical fibers included in the optical fiber layer can detect the forces applied in the X-axis and Y-axis directions.

[0026] The attached optical sensor can include optical fibers arranged vertically. When a force is applied to the attached optical sensor in the Z-axis direction, changes may occur in the vertically arranged optical fibers. For example, when the attached optical sensor adheres to the tongue, if pressure in the Z-axis direction is generated on the attached optical sensor by the tongue or teeth, etc., changes may occur in the optical fibers included in the support member. Therefore, the attached optical sensor can measure pressure.

[0027] The attached optical sensor can measure not only two-dimensional fine changes or movements of the skin but also three-dimensional fine changes or movements of the skin via a horizontally arranged optical fiber and a vertically arranged optical fiber.

[0028] As one of the embodiments, the attached optical sensor can include an optical fiber layer, a light source, a light receiver, and a support member. Further, the attached optical sensor can further include a power supply communication unit and an adhesive patch unit.

[0029] The optical fiber layer can include optical fibers. The optical fiber layer can include horizontally arranged optical fibers. The optical fiber layer can include optical fibers in a lattice structure. The optical fiber layer can include horizontally arranged optical fibers in a lattice structure.

[0030] There can be a plurality of optical fiber layers. The plurality of optical fiber layers can be arranged in layers in the vertical direction with respect to each other. The plurality of optical fiber layers can have the same or different shapes, forms, and structures from each other.

[0031] The support member can include optical fibers. The support member can include vertically arranged optical fibers.

[0032] The support member can connect a plurality of optical fiber layers. The support member can connect a plurality of optical fiber layers in the vertical direction. The support member can connect a plurality of optical fiber layers arranged in layers in the vertical direction in the vertical direction.

[0033] The light source can be connected to one side of the optical fiber. The light source can be connected to one side of the optical fiber included in the optical fiber layer. The light source can be connected to one side of the optical fiber included in the support member. The light source can supply light to the optical fiber. The light source can be connected to one side of the optical fiber included in the optical fiber layer and one side of the optical fiber included in the support member to supply light to the optical fiber.

[0034] The optical receiver can be connected to the other side of the optical fiber. The optical receiver can be connected to the other side of the optical fiber included in the optical fiber layer. The optical receiver can be connected to the other side of the optical fiber included in the support member. The optical receiver can sense the light that has passed through the optical fiber. The optical receiver can be connected to the other side of the optical fiber included in the optical fiber layer and the other side of the optical fiber included in the support member, and can sense the light that has passed through the optical fiber. The optical receiver can sense at least one of the path, intensity, and phase of the light passing through the interior of the optical fiber.

[0035] The plurality of optical fiber layers can have the same or different shapes, forms, and structures from each other. For example, the plurality of optical fiber layers can have the same square shape as each other. Or, some of the plurality of optical fiber layers can have a circular shape, and the remaining part can have a square shape.

[0036] The light source and the optical receiver can exist for each layer formed by the plurality of optical fiber layers. For example, when three optical fiber layers exist as three layers in the attached type optical sensor, the light source and the optical receiver exist for each layer, so that a total of three light sources and three optical receivers can exist in the attached type optical sensor.

[0037] A part of the optical fiber included in the support member can be connected to the light source included in the upper optical fiber layer and the optical receiver included in the lower optical fiber layer. The remaining part of the optical fiber can be connected to the light source included in the lower optical fiber layer and the optical receiver included in the upper optical fiber layer.

[0038] The power supply communication unit can supply power to the light source and the optical receiver.

[0039] The power communication unit can transmit and receive optical sensing data. The power communication unit can transmit and receive optical sensing data. For this purpose, the power communication unit can use NFMI (Near-filed magnetic induction) technology. By using NFMI technology, it is possible to enable efficient short-distance wireless charging and data transmission to a short-distance power source and a wireless receiver. Also, it can be fabricated into a flexible and very small ultra-small strain chip and be made patch-type for attachment to the skin for use. Also, by using the NFMI strain chip, it can operate with very low power and is resistant to radio frequency (RF) interference, enabling secure short-distance communication from eavesdropping.

[0040] The adhesive patch portion can enable the attached optical sensor to adhere to the skin. The adhesive patch portion is harmless to the human body and can adhere for several hours and can have resistance to waste substances such as saliva and sweat.

[0041] The adhesive patch portion can contain an adhesive substance that reacts with saliva to generate adhesive force. The adhesive patch portion can contain an adhesive substance that dissolves and disappears after a period of time has passed after adhesion. As an example, the adhesive substance can contain raw materials such as ethyl cellulose, PVP, glycerin, or silicone.

[0042] Figures 1 to 3 show an example of an attached optical sensor 100 including two optical fiber layers according to an embodiment. For the convenience of the following description, each is named the first optical fiber layer 110, the first light source 111, the first light receiver 112, the second optical fiber layer 120, the second light source 121, and the second light receiver 122.

[0043] Figure 1 is a perspective view of the attached optical sensor 100 according to the embodiment. Figure 2 is a top view of the attached optical sensor 100 according to the embodiment. Figure 3 is a diagram showing the power communication unit 140 included in the attached optical sensor 100 according to the embodiment.

[0044] The wearable optical sensor 100 may include a first optical fiber layer 110, a first light source 111, a first optical receiver 112, a second optical fiber layer 120, a second light source 121, a second optical receiver 122, and a support member 130. The wearable optical sensor 100 may further include a power communication unit 140 and an adhesive patch unit 150.

[0045] The first optical fiber layer 110 and the second optical fiber layer 120 may include optical fibers arranged horizontally in a lattice structure. The support member 130 may include optical fibers arranged vertically. The first optical fiber layer 110 and the second optical fiber layer 120 may be arranged in layers vertically. The first optical fiber layer 110 may be located on the upper side, and the second optical fiber layer 120 may be located on the lower side. The support member 130 may vertically connect the first optical fiber layer 110 and the second optical fiber layer 120 arranged in layers vertically.

[0046] An optical source 111, 121 and an optical receiver 112, 122 may be present in each of the first optical fiber layer 110 and the second optical fiber layer 120.

[0047] The first light source 111 can be located on two adjacent sides of the first optical fiber layer 110. The first optical receiver 112 can be located on two adjacent sides of the first optical fiber layer 110. The first optical receiver 112 can be located on two adjacent sides of the first optical fiber layer 110 opposite to the first light source 111.

[0048] The first light source 111 may be connected to one side of the optical fiber included in the first optical fiber layer 110. The first light source 111 may supply light to the inside of the optical fiber included in the first optical fiber layer 110. The first optical receiver 112 may be connected to the other side of the optical fiber included in the first optical fiber layer 110. The first optical receiver 112 may sense light passing through the optical fiber included in the first optical fiber layer 110.

[0049] The second light source 121 can be located on two adjacent sides of the second optical fiber layer 120. The second optical receiver 122 can be located on two adjacent sides of the second optical fiber layer 120. The second optical receiver 122 can be located on two adjacent sides opposite to the second light source 121 in the second optical fiber layer 120.

[0050] The second light source 121 can be connected to one side of the optical fibers included in the second optical fiber layer 120. The second light source 121 can supply light into the optical fibers included in the second optical fiber layer 120. The second optical receiver 122 can be connected to the other side of the optical fibers included in the second optical fiber layer 120. The second optical receiver 122 can sense the light that has passed through the optical fibers included in the second optical fiber layer 120.

[0051] A part of the optical fibers included in the support member 130 can be connected between the first light source 111 and the second optical receiver 122. The first light source 111 can be connected to one side of a part of the optical fibers included in the support member 130. The second optical receiver 122 can be connected to the other side of a part of the optical fibers included in the support member 130.

[0052] The remainder of the optical fibers included in the support member 130 can be connected between the second light source 121 and the first optical receiver 112. The second light source 121 can be connected to one side of the remainder of the optical fibers included in the support member 130. The first optical receiver 112 can be connected to the other side of the remainder of the optical fibers included in the support member 130.

[0053] The power supply communication unit 140 can be located between the first optical fiber layer 110 and the second optical fiber layer 120.

[0054] The power communication unit 140 can include a battery 141 that supplies power, a data collector 142 that collects optical sensing data from a photoreceiver, a power receiver 143 that receives power from an NFMI microchip through short-range wireless communication, and a data transmitter 144 that includes an NFMI antenna that transmits optical sensing data. At this time, the NFMI microchip has a unique ID and can transmit data together with the NFMI ID during data transmission. The power communication unit 140 can receive power supply through NFMI technology.

[0055] The adhesive patch portion 150 can be located below the second optical fiber layer 120. The adhesive patch portion 150 enables the attachment-type optical sensor 100 to adhere to a person's skin.

[0056] FIG. 4 shows a state in which the attachment-type optical sensor 100 according to an embodiment is attached to the tongue. As shown in FIG. 4, the attachment-type optical sensor 100 can be located at the upper end of the tongue. Therefore, the attachment-type optical sensor 100 can detect the movement of the tongue and acquire optical sensing data. This is only an example, and the attachment-type optical sensor 100 does not necessarily have to be attached to the tongue. The attachment-type optical sensor 100 can be attached anywhere as long as it can be attached to a person's skin. In addition, the attachment-type optical sensor 100 can be used not only for a silent speech interface but also for measuring movements of muscles and joints, and thus can be used for diagnosing or rehabilitating musculoskeletal diseases.

[0057] FIG. 5 shows an example of a silent communication system 200 according to an embodiment.

[0058] The silent communication system 200 can include a sensor unit 210, a speaker unit 220, a microphone unit 230, a relay unit 240, a data processing unit 250, and a communication unit 260. The sensor unit 210, the speaker unit 220, the microphone unit 230, the relay unit 240, the data processing unit 250, and the communication unit 260 included in the silent communication system 200 can each be realized as separate devices, or can also be realized by one device or multiple devices. For example, a speaker, a microphone, and a repeater may be included in one earphone. Or, the sensor unit 210, the microphone unit 230, and the relay unit 240 may be included in one sensor.

[0059] The sensor unit 210 can acquire optical sensing data using an adhesive optical sensor. The sensor unit 210 can acquire optical sensing data using the adhesive optical sensor such as that shown in FIG. 1 described above.

[0060] The speaker unit 220 can output sound. The speaker unit 220 can output sound to the user. The speaker unit 220 can be physically realized in various ways. As an example, the speaker unit 220 can be realized in the form of earphones, earbuds, and headsets, etc.

[0061] The speaker unit 220 can output sound corresponding to the sound data received from the relay unit 240. The sound data received by the speaker unit 220 can be data related to the sound inferred from the optical sensing data.

[0062] The microphone unit 230 can acquire sound. The microphone unit 230 can acquire sound with respect to the user's voice. The microphone unit 230 can be physically realized in various ways.

[0063] The microphone unit 230 can acquire sound data corresponding to the voice spoken by the user to whom the sensor unit 210 is attached. The sound data acquired by the microphone unit 230 can become learning data necessary for constructing an analysis model.

[0064] The relay unit 40 can transmit and receive data to and from the sensor unit 210, the speaker unit 220, the microphone unit 230, and the data processing unit 250. The relay unit 240 can communicate with the sensor unit 210, the speaker unit 220, the microphone unit 230, and the data processing unit 250 wirelessly and / or via wire. For example, the relay unit 240 can receive optical sensing data from the sensor unit 210. The relay unit 240 can transmit sound data to the speaker unit 220. The relay unit 240 can receive sound data from the microphone unit 230. The relay unit 240 can transmit and receive optical sensing data and sound data to and from the data processing unit 250.

[0065] The relay unit 240 may include a chip for wireless communication and / or wireless power transmission. As an example, the relay unit 240 may include an NFMI microchip.

[0066] The relay unit 240 may be located close to the sensor unit 210. Because the relay unit 240 is located close to the sensor unit 210, the relay unit 240 can perform wireless communication and / or wireless power transmission with the sensor unit 210. For example, because the relay unit 240 is located close to the sensor unit 210, the relay unit 240 can perform NFMI-based wireless communication and wireless power transmission with the sensor unit 210. Wireless power supply or data transmission can be performed between the relay unit 240 and the power communication unit 140 via an NFMI chip attached to each other. The NFMI chip allows for efficient power supply and wireless transmission without complex wiring. Power can be wirelessly supplied from the relay unit 240 to the optical sensor via the NFMI chip. The power communication unit 140 can wirelessly transmit optical sensing data to the relay unit via the NFMI chip.

[0067] The data processing unit 250 can perform data processing, calculations, etc. required for the operation of the silent communication system 200. The data processing unit 250 can perform calculations required for the silent communication method. The data processing unit can be a device including a processor that processes certain calculations, an AP (Application Processor), and a chip with an embedded program. For example, the calculation device 930 can include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or an NPU (Neural Processing Unit), etc.

[0068] The data processing unit 250 can be physically realized in various forms. For example, the data processing unit 250 can have the form of a PC, a notebook computer, a smart device, a server, or a chip set dedicated to data processing.

[0069] The data processing unit 250 may include an inference module 252 and a learning module 251 .

[0070] The inference module 252 can generate sound data based on the light sensing data. The inference module 252 can generate sound data corresponding to the light sensing data based on the light sensing data.

[0071] The inference module 252 can generate sound data based on the light sensing data using an analytical model. The inference module 252 can input the light sensing data to the trained analytical model and then generate sound data based on the output value of the analytical model. The analytical model used by the inference module 252 can be a model trained by the learning module 251.

[0072] The sound data generated by the inference module 252 may be transmitted to the speaker unit 220. The sound data generated by the inference module 252 may be transmitted to the speaker unit 220 via the relay unit 240. The speaker unit 220 may output sound to the user based on the transmitted sound data.

[0073] The learning module 251 can train an analytical model based on the training data.

[0074] The learning module 251 can construct learning data for training an analysis model based on the optical sensing data acquired by the sensor unit 210 and the sound data acquired by the microphone unit 230. As an example, the learning module 251 can construct learning data for training an analysis model by pairing the optical sensing data acquired by the sensor unit 210 and the sound data of the user acquired by the microphone unit 230.

[0075] The learning module 251 can store the constructed learning data in a database. The database may record the user's light sensing data and the user's sound data. The database may also record the characteristics of the user's individual speech voice and light sensing data.

[0076] The learning module 251 can preprocess the training data and then train the analytical model. For example, the learning module 251 can convert the training data into a form suitable for training the analytical model by performing preprocessing such as noise removal, normalization, and dimensionality reduction (PCA, t-SNE) on the training data.

[0077] The analytical model may be a model that generates, from the light sensing data, sound data corresponding to the light sensing data.

[0078] The analytical model may be a machine learning (ML)-based model. A machine learning-based model may learn through data to understand a specific object or condition, or may find and classify patterns in data. Machine learning-based models may be of various types. For example, machine learning-based models may include decision trees, random forests (RF), k-nearest neighbors (KNN), naive Bayes, support vector machines (SVM), and artificial neural networks (ANN). The ANN may be a deep neural network (DNN), which may include convolutional neural networks (CNN), recurrent neural networks (RNN), restricted Boltzmann machines (RBM), deep belief networks (DBN), generative adversarial networks (GAN), and relation networks (RL).

[0079] The analysis model may be a model that performs an attention mechanism. The analysis model may generate sound data by focusing more on data necessary for generating sound data from optical sensing data. For example, the analysis model may generate sound data by focusing more on data affected by movements of the tongue, lips, vocal cords, etc. in the optical sensing data.

[0080] The analytical model can include an encoder-decoder structure. The encoder can compress the optical sensing data and extract only the parts necessary to generate sound data. The decoder can generate sound data based on the information extracted by the encoder.

[0081] The communication unit 260 can transmit or receive data via wired or wireless communication. The communication unit 260 can transmit or receive optical sensing data. The inference module 252 can generate sound data based on the optical sensing data received by the communication unit 260. The communication unit 260 can also transmit or receive sound data. By the communication unit 260 receiving optical sensing data and sound data of a third party other than the user, the user and the third party can conduct silent communication.

[0082] FIG. 6 shows an example of implementing a silent communication system according to an embodiment.

[0083] The sensor unit 210 can include at least one attached optical sensor. The attached optical sensor can be attached to a person's nasal groove, jaw, and the neck area near the vocal cords. The earphone can include a relay unit 240 and a speaker unit 220. The relay unit 240 can receive optical sensing data from at least one attached optical sensor. After collecting the optical sensing data received from at least one attached optical sensor, the relay unit 240 can transmit this to the data processing unit 250. The data processing unit 250 can generate sound data based on the received optical sensing data. The data processing unit 250 can be implemented in the form of a smartphone. The communication unit 260 can transmit optical sensing data and sound data to other data processing units, or receive optical sensing data and sound data from other data processing units. The speaker unit 220 can output sound based on the sound data. Thereby, a person can hear sound through skin movement even without direct sound. Also, by hearing sound based on the optical sensing data of a third party, a conversation can be conducted with the third party via communication.

[0084] FIG. 7 shows an example 300 of a silent communication system performing a silent communication method according to an embodiment.

[0085] The sensor unit can acquire optical sensing data (310). For example, when the silent speech of the speaker starts, the sensor unit can acquire optical sensing data corresponding to minute changes or movements of the skin via an adhesive optical sensor attached to the vicinity of the vocal cords in the neck. The sensor unit can transmit the acquired optical sensing data to the relay unit (320). The relay unit can be realized in the form of earphones or as part of earphones. The relay unit can transmit the received optical sensing data to the data processing unit (330). The data processing unit may be a smartphone. The data processing unit can generate audio data based on the received optical sensing data (340). The data processing unit can transmit the generated audio data to the relay unit (350). The relay unit can transmit the audio data to the speaker unit (360). The speaker unit may be realized in the form of earphones or as part of earphones. The speaker unit can output a sound corresponding to the audio data (370).

Claims

1. An adhesive optical sensor including an optical fiber layer, a support member, a light source, and a light receiver, wherein the optical fiber layer includes optical fibers horizontally arranged in a lattice structure, there are a plurality of the optical fiber layers, which are arranged in layers in the vertical direction with respect to each other, the support member includes the optical fibers arranged in the vertical direction, the support member vertically connects the plurality of optical fiber layers arranged in layers in the vertical direction, the light source is connected to one side of the optical fibers included in the optical fiber layer and one side of the optical fibers included in the support member to supply light to the optical fibers, the light receiver is connected to the other side of the optical fibers included in the optical fiber layer and the other side of the optical fibers arranged in the support member to sense the light that has passed through the optical fibers, an adhesive optical sensor.

2. The adhesive optical sensor according to claim 1, wherein the light source and the light receiver exist for each layer formed by the plurality of optical fiber layers.

3. The adhesive optical sensor according to claim 2, wherein a part of the optical fibers included in the support member is connected to the light source included in the upper optical fiber layer and the light receiver included in the lower optical fiber layer, and the rest of the optical fibers are connected to the light source included in the lower optical fiber layer and the light receiver included in the upper optical fiber layer.

4. The adhesive optical sensor according to claim 1, wherein the light receiver senses at least one of the path, intensity, and phase of the light passing through the interior of the optical fiber.

5. The adhesive optical sensor according to claim 1, wherein the plurality of optical fiber layers have the same or different shapes, forms, and structures with respect to each other.

6. The adhesive optical sensor further includes a power supply communication unit, wherein the power supply communication unit includes a battery that supplies power to the adhesive optical sensor, a data collector that collects optical sensing data from the light receiver, and a data transmitter that transmits the optical sensing data, the adhesive optical sensor according to claim 1.

7. The adhesive optical sensor further includes an adhesive patch portion, wherein the adhesive patch portion includes an adhesive substance that allows the adhesive optical sensor to adhere to human skin, the adhesive optical sensor according to claim 1.

8. A sensor unit that acquires optical sensing data using an adhesive optical sensor, and a data processing unit including an inference module that generates sound data based on the optical sensing data a speaker unit that outputs sound based on the sound data, The silent communication system, wherein the adhesive optical sensor is the adhesive optical sensor of claim 1 .

9. The silent communication system according to claim 8 , further comprising a relay unit capable of transmitting and receiving data to and from the sensor unit, the data processing unit, and the speaker unit.

10. the inference module generates sound data based on the light sensing data using an analytical model; The silent communication system according to claim 8 , wherein the analytical model is a trained model that is trained based on training data.

11. 11. The silent communication system of claim 10, wherein the analytical model comprises an artificial neural network (ANN)-based model capable of performing an attention mechanism to further focus data necessary to generate sound data from the optical sensing data.

12. The silent communication system of claim 10, wherein the analytical model includes an encoder-decoder structure.

13. The silent communication system according to claim 8 , further comprising a communication unit capable of transmitting or receiving at least one of optical sensing data and sound data.

14. The silent communication system further includes a microphone unit for capturing a sound corresponding to a user's voice; the data processing unit further includes a learning module; The silent communication system of claim 8, wherein the learning module constructs learning data necessary to train an analytical model used by the inference module based on the optical sensing data acquired by the sensor unit and the sound corresponding to the user's voice acquired by the microphone unit.

15. 9. A method for performing a silent communication method in a silent communication system according to claim 8, comprising: A step in which a sensor unit acquires light sensing data; generating sound data based on the optical sensing data by an inference module included in the data processing unit; and a step of outputting a sound corresponding to the sound data by the speaker unit.

16. The silent communication system further includes a relay unit; The silent communication method according to claim 15, further comprising a step in which the relay unit transmits or receives data to and from the sensor unit, the data processing unit, and the speaker unit.

17. The inference module generates sound data based on the optical sensing data using an analysis model, The analysis model is a learning model learned based on learning data, and relates to the silent communication method according to claim 15.

18. The silent communication system further includes a communication unit, The silent communication method according to claim 15 is characterized in that the method further includes a step in which the communication unit transmits or receives at least one of optical sensing data and sound data.

19. The silent communication system further includes a microphone unit, The data processing unit further includes a learning module, The silent communication method includes a step in which the microphone unit acquires sound for the user's voice, and a step in which the learning module included in the data processing unit constructs learning data necessary for learning an analysis model used by the inference module based on the optical sensing data acquired by the sensor unit and the sound for the user's voice acquired by the microphone unit. The silent communication method according to claim 15.

Images