Voice interaction system and method, and intelligent device

Abstract

The present disclosure provides a voice interaction system and method, and an intelligent device. The voice interaction system includes: a voice interaction unit for collecting and recognizing a user's target voice command; a photoelectric induction unit connected to the voice interaction unit for receiving and recognizing the user's target limb command and controlling the on / off of the voice interaction unit according to the target limb command; and a command control unit connected to the voice interaction unit for determining whether the voice interaction unit is in an on state. If so, according to the target voice command received and recognized by the voice interaction unit, it controls the intelligent device to perform an action corresponding to the target voice command. The voice interaction system, method, and intelligent device provided by the present disclosure can realize turning on the intelligent voice speaker through limb induction and interacting with the entire intelligent device.

Description

Technical Field

[0001] The present disclosure relates to the technical field of intelligent devices, and in particular, to a voice interaction system and method, and an intelligent device. Background Art

[0002] The Internet of Things has become an important driving force for the new round of global scientific and technological revolution and industrial transformation. There are an endless variety of smart speakers on the market now. For example, "Xiaodu" launched by Baidu and Siri on Apple phones belong to intelligent voice technologies. Their core is very simple - to enable machines to have human-like capabilities in the voice dialogue link and penetrate into people's daily living spaces. The microphone, as an important component of the intelligent voice speaker, determines the voice interaction ability. In the related art, for an intelligent voice speaker to achieve interaction, the microphone needs to give an indication to tell consumers that voice recognition starts. Summary of the Invention

[0003] Embodiments of the present disclosure provide a voice interaction system and method, and an intelligent device, which can realize turning on the intelligent voice speaker through body sensing and interacting with the entire intelligent device.

[0004] The technical solutions provided by the embodiments of the present disclosure are as follows:

[0005] Embodiments of the present disclosure provide a voice interaction system, including:

[0006] A voice interaction unit, configured to collect and recognize a user's target voice command;

[0007] An optoelectronic sensing unit, connected to the voice interaction unit, configured to receive and recognize a user's target body command, and control the on / off of the voice interaction unit according to the target body command;

[0008] A command control unit, connected to the voice interaction unit, configured to determine whether the voice interaction unit is in an on state; if so, control the intelligent device to execute an action corresponding to the target voice command according to the target voice command received and recognized by the voice interaction unit.

[0009] Exemplarily, when the voice interaction unit is in an on state, the command control unit is further configured to determine whether the voice interaction unit receives a voice command within a predetermined time; if not, send a shutdown command of the voice interaction unit to the voice interaction unit.

[0010] Exemplarily, the voice interaction unit is further configured to: when receiving the shutdown command of the voice interaction unit, send the shutdown command of the optoelectronic sensing unit to the optoelectronic sensing unit.

[0011] Exemplarily, the instruction control unit is further configured to receive and identify the image data collected by the image acquisition unit; and when the image data includes a target gesture, send an activation instruction of the voice interaction unit to the voice interaction unit;

[0012] The voice interaction unit is further configured to, when receiving the activation instruction of the voice interaction unit, send an activation instruction of the photoelectric induction unit to the photoelectric induction unit.

[0013] Exemplarily, communication between the voice interaction unit and the instruction control unit is performed through serial port instructions,

[0014] Communication between the voice interaction unit and the instruction control unit is performed through serial port instructions.

[0015] Exemplarily, the photoelectric induction unit includes a photoelectric switch, and the photoelectric switch includes:

[0016] A housing, the interior of the housing is hollow, the housing includes a front end and a rear end, the front end is provided with an indication mark, and the rear end is open;

[0017] A photoelectric sensor disposed inside the housing;

[0018] A circuit board disposed inside the housing, and the circuit board is connected to the photoelectric sensor;

[0019] A rear cover snap-fitted to the rear end of the housing;

[0020] A signal transmission wire harness, one end of the signal transmission wire harness is connected to the circuit board, and the other end extends out of the rear cover.

[0021] Exemplarily, the rear end of the housing is connected to the rear cover by a buckle.

[0022] Exemplarily, a first through hole and a second through hole are provided on the front end;

[0023] The photoelectric sensor is provided with a receiving electrode and a transmitting electrode, the receiving electrode is located at the first through hole, and the transmitting electrode is located at the second through hole.

[0024] Exemplarily, the indication mark includes an engraved hollowed-out mark.

[0025] Exemplarily, the photoelectric switch further includes: a light source disposed inside the housing.

[0026] Exemplarily, the voice interaction unit includes a microphone module, and the microphone module includes:

[0027] An upper cover, the interior of the upper cover is hollow, the upper cover includes a front end and a rear end, at least two sound receiving holes are provided on the front end, and the rear end is open;

[0028] At least two sound pickup microphones disposed inside the upper cover, each of the sound pickup microphones corresponding to one of the sound pickup holes, and a sealing ring being disposed at each of the sound pickup holes;

[0029] A printed circuit board disposed inside the upper cover, the printed circuit board being connected to the sound pickup microphones;

[0030] A bottom cover disposed at the rear end of the upper cover.

[0031] Exemplarily, the microphone module further includes:

[0032] A signal transmission wire harness connected to the printed circuit board, and a wire pressing plate disposed on the printed circuit board for pressing the signal transmission wire harness.

[0033] Exemplarily, the bottom cover and the wire pressing plate are fixed to the upper cover by snap fasteners and encapsulated with a sealant.

[0034] An embodiment of the present disclosure further provides a voice interaction method, including:

[0035] Determining whether the voice interaction unit is in an on state;

[0036] If so, controlling the intelligent device to perform an action corresponding to the target voice command according to the target voice command of the user received and recognized by the voice interaction unit;

[0037] If not, controlling the voice interaction unit to be turned on according to the target limb command of the user received and recognized by the photoelectric induction unit, and controlling the intelligent device to perform an action corresponding to the target voice command according to the target voice command of the user received and recognized by the voice interaction unit.

[0038] Exemplarily, the method further includes:

[0039] When the voice interaction unit is in an on state, determining whether the voice interaction unit receives a voice command within a predetermined time; if not, controlling the voice interaction unit to be turned off.

[0040] Exemplarily, the method further includes:

[0041] When the voice interaction unit is in an on state, determining whether the voice interaction unit receives a voice command within a predetermined time; if not, controlling the photoelectric induction unit to be turned off.

[0042] Exemplarily, the method further includes:

[0043] Receiving and recognizing the image data collected by the image acquisition unit;

[0044] When the image data includes a target gesture, control the optoelectronic sensing unit and the voice interaction unit to turn on.

[0045] An embodiment of the present disclosure also provides an intelligent device, on which the voice interaction system provided by the embodiment of the present disclosure is provided.

[0046] The beneficial effects brought by the embodiments of the present disclosure are as follows:

[0047] The voice interaction system, method, and intelligent device provided by the embodiments of the present disclosure combine the intelligent voice interaction unit with the optoelectronic sensing unit, and can realize controlling the switch of the voice interaction unit through body movements, so as to realize interaction with the whole machine, and solve the technical problems of how the optoelectronic sensing unit controls the opening of the voice interaction unit and how the instruction control unit switches the voice interaction unit and the optoelectronic sensing unit. Description of the Drawings

[0048] Figure 1 The block diagram of the voice interaction system provided by the embodiment of the present disclosure is shown;

[0049] Figure 2 The logic block diagram of the voice interaction system provided by the embodiment of the present disclosure is shown;

[0050] Figure 3 It is a schematic diagram of the communication method between the instruction control unit, the voice interaction unit, and the optoelectronic sensing unit;

[0051] Figure 4 It is a schematic structural diagram of an optoelectronic switch in the embodiment of the present disclosure;

[0052] Figure 5 The schematic diagram of the front-end structure of the housing of the optoelectronic switch in the embodiment of the present disclosure is shown;

[0053] Figure 6 The exploded view of the structure of the microphone module in the embodiment of the present disclosure is shown. Detailed Embodiments

[0054] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure clearer, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the described embodiments of the present disclosure without creative efforts shall fall within the scope of protection of the present disclosure.

[0055] Unless otherwise defined, the technical terms or scientific terms used in this disclosure shall have the ordinary meanings as understood by those of ordinary skill in the field to which this disclosure pertains. The terms "first", "second" and similar words used in this disclosure do not denote any order, quantity or importance, but are only used to distinguish different components. Similarly, words such as "a", "an" or "the" do not denote a quantity limitation, but mean that there is at least one. Words such as "comprising" or "including" mean that the elements or items appearing before this word cover the elements or items listed after this word and their equivalents, without excluding other elements or items. Words such as "connected" or "coupled" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Upper", "lower", "left", "right", etc. are only used to indicate relative positional relationships, and when the absolute position of the object being described changes, the relative positional relationship may also change accordingly.

[0056] The voice interaction system provided by the embodiments of this disclosure can be applied to various intelligent devices, such as intelligent refrigerators, intelligent washing machines, intelligent TVs, etc.

[0057] Figure 1 The following shows the structural block diagram of the voice interaction system provided by the embodiments of this disclosure, Figure 2 The following shows the logical block diagram of the voice interaction system provided by the embodiments of this disclosure.

[0058] Please refer to Figure 1 and Figure 2 , the voice interaction system of the intelligent device provided by the embodiments of this disclosure includes:

[0059] A voice interaction unit 100, configured to collect and recognize a user's target voice command;

[0060] An optoelectronic induction unit 200, the optoelectronic induction unit 200 is connected to the voice interaction unit 100, and is configured to receive and recognize a user's target limb command, and control the on / off of the voice interaction unit 100 according to the target limb command;

[0061] An instruction control unit 300, the instruction control unit 300 is connected to the voice interaction unit 100, and is configured to determine whether the voice interaction unit 100 is in an on state; if so, control the intelligent device to execute an action corresponding to the target voice command according to the target voice command received and recognized by the voice interaction unit 100.

[0062] In the above solution, the photoelectric induction unit 200, the voice interaction unit 100, and the instruction control unit 300 are connected to form a voice interaction system, which can be applied to intelligent devices. Combining the voice interaction unit 100 with the photoelectric induction unit 200 can achieve controlling the switch of the voice interaction unit 100 through body movements, realizing interaction with the whole machine, and solving the technical problems of how the photoelectric induction unit 200 controls the opening of the voice interaction unit 100 and how the instruction control unit 300 switches the voice interaction unit 100 and the photoelectric induction unit 200.

[0063] In some embodiments, when the voice interaction unit 100 is in an on state, the instruction control unit 300 is further configured to determine whether the voice interaction unit 100 receives a voice instruction within a predetermined time; if not, send a close instruction of the voice interaction unit 100 to the voice interaction unit 100.

[0064] In some embodiments, the voice interaction unit 100 is further configured to: when receiving the close instruction of the voice interaction unit 100, send a close instruction of the photoelectric induction unit 200 to the photoelectric induction unit 200.

[0065] In some embodiments, the voice interaction system further includes an image acquisition unit 400. The instruction control unit 300 is connected to the image acquisition unit 400. The instruction control unit 300 is further configured to receive and recognize the image data acquired by the image acquisition unit 400; and when the image data includes a target gesture, send an on instruction of the voice interaction unit 100 to the voice interaction unit 100; the voice interaction unit 100 is further configured to send an on instruction of the photoelectric induction unit 200 to the photoelectric induction unit 200 when receiving the on instruction of the voice interaction unit 100.

[0066] The following provides a more detailed description of the voice interaction system provided by the embodiments of the present disclosure:

[0067] In the voice interaction system provided by the embodiments of the present disclosure, the voice interaction unit 100 may include a microphone module (MIC), etc. According to different usage environments and different requirements for sound quality, different models of silicon microphones can be selected for the voice interaction unit, and at the same time, microphone modules with different numbers of silicon microphones can be designed. Taking the microphone module as an example, the way it acquires and recognizes the target voice instruction of the user can be that the microphone module is turned on, starts recording the user's voice, and sends the recorded audio to the instruction control unit 300.

[0068] The photoelectric induction unit 200 may include distance induction switch devices such as photoelectric switches, laser sensor switches, electromagnetic induction sensor switches, and capacitive induction sensor switches. Taking the photoelectric switch as an example, the photoelectric switch is based on infrared sensing technology. The principle is to utilize the physical properties of infrared rays. The intensity of the infrared signal reflected is different when the distance to the obstacle is different, and thus the distance to the obstacle is detected. Combining the infrared sensor with the switch circuit forms an induction distance type switch. The method of using the photoelectric switch to receive and identify the target limb instruction of the user can be that the user performs a certain limb movement within the induction distance of the photoelectric switch. For example, limb movements such as approaching the photoelectric switch or waving the hand, etc. The photoelectric switch receives the reflected light signal and identifies the limb movement instruction according to the light signal.

[0069] The instruction control unit 300 may be a computer, MCU, etc. For example, the instruction control unit 300 may be the PC side of an intelligent device.

[0070] In the voice interaction system of the embodiments of the present disclosure, communication between the voice interaction unit 100 and the instruction control unit 300 is carried out through serial port instructions, and communication between the voice interaction unit 100 and the instruction control unit 300 is carried out through serial port instructions.

[0071] The specific structures of the voice interaction unit 100, the photoelectric induction unit 200, and the instruction control unit 300 will be further described later. First, the voice interaction implementation process of the voice interaction system will be explained in more detail below.

[0072] As Figure 2 shown, the voice interaction method of the voice interaction system of the intelligent device provided in the embodiments of the present disclosure may include the following processes:

[0073] 1) The user independently turns on the voice interaction unit 100. The instruction control unit 300 receives the target voice instruction sent by the voice interaction unit 100, and controls the intelligent device to execute an action corresponding to the target voice instruction according to the voice interaction unit 100 receiving and identifying the target voice instruction of the user, so as to realize voice interaction. In the logic block diagram, this process is from serial number B to serial number C.

[0074] 2) When the voice interaction unit 100 is in the on state, the instruction control unit 300 determines whether the voice interaction unit 100 receives a voice instruction within a predetermined time; if not, sends a shutdown instruction of the voice interaction unit 100 to the voice interaction unit 100;

[0075] Specifically, for example, according to the algorithm, when the instruction control unit 300 detects that the voice interaction unit 100 has not input voice within a certain period of time, the instruction control unit 300 will send a shutdown instruction to the voice interaction unit 100 (sequence number ②). The voice interaction unit 100 stops recording and will no longer send voice instructions to the instruction control unit 300 (sequence number ③). At the same time, the voice interaction unit 100 sends a shutdown command to the photoelectric induction unit 200 (sequence number ④), and the photoelectric induction unit 200 shuts down.

[0076] It should be noted that after the user's voice instruction is completed and there is no voice instruction for a period of time, the instruction control unit 300 will send a shutdown instruction to the voice interaction unit 100. At this time, the voice interaction unit 100 can be in a standby state. In this way, not only can power be saved, but also the privacy can be protected. At this time, the user's voice will not be recorded and saved by the voice interaction unit 100.

[0077] 3) When the voice interaction unit 100 is in the shutdown state, when the photoelectric induction unit 200 senses the user's target limb instruction, it sends an instruction to the voice interaction unit 100 to control the voice interaction unit 100 to turn on. The instruction control unit 300 receives the target voice instruction sent by the voice interaction unit 100, and according to the voice interaction unit 100 receiving and recognizing the user's target voice instruction, controls the intelligent device to perform an action corresponding to the target voice instruction to achieve voice interaction;

[0078] For example, when the user approaches the photoelectric induction unit 200 (that is, the distance between the user and the photoelectric induction unit 200 is less than a predetermined distance) or the user makes a target limb movement (such as waving) in front of the sensor of the photoelectric induction unit 200, the photoelectric induction unit 200 sends an activation instruction to the voice interaction unit 100. The voice interaction unit 100 starts recording and sends the recording data to the instruction control unit 300. The instruction control unit 300 recognizes the text according to the recorded audio and makes corresponding actions according to the user's voice, which is sequence number A → sequence number B → sequence number C in the logic block diagram.

[0079] 4) The instruction control unit 300 can autonomously send an activation instruction to the voice interaction unit 100 (sequence number Y). The voice interaction unit 100 is activated and sends the audio data including the target voice instruction received to the instruction control unit 300 (sequence number Z). The voice interaction unit 100 sends an activation command to the photoelectric induction unit 200, and the photoelectric induction unit 200 is activated.

[0080] For example, taking a smart device as a smart refrigerator, the voice interaction system further includes an image acquisition unit 400. When the user is at a distance from the photoelectric induction unit 200 that is far beyond the threshold, or the induction is affected and the sensitivity is interfered, at this time, it may not be possible to turn on the photoelectric induction unit 200 and the voice interaction unit 100 through body movements. Then, the instruction control unit 300 can, according to the image acquired by the image acquisition unit 400. For example, when the acquired image includes a target gesture, the instruction control unit 300 determines that the user has the intention to turn on the voice interaction unit 100, and thus sends an activation instruction (sequence number V) to the voice interaction unit 100. At the same time, the voice interaction unit 100 sends an activation instruction to the photoelectric induction unit 200 to turn on the voice interaction unit 100 and the photoelectric induction unit 200.

[0081] Figure 3 It is a schematic diagram of the communication method among the instruction control unit 300, the voice interaction unit, and the photoelectric induction unit 200. Taking the instruction control unit 300 as the host (PC side) of the smart device, the voice interaction unit 100 includes a microphone module (MIC), and the photoelectric induction unit 200 includes a photoelectric switch LED lamp as a specific embodiment. The specific working process is described as follows:

[0082] 1) As Figure 3 Connected, the photoelectric induction unit 200 is connected to the voice interaction unit 100, and the voice interaction unit 100 is connected to the instruction control unit 300; the MIC is in the default MUTE ON state. At this time, the MIC remains in the standby state and does not output voice instructions. At the same time, the MIC sends the corresponding MUTE ON state to the photoelectric induction unit 200, and the photoelectric switch remains closed (MUTE ON state), and the LED lamp goes out;

[0083] 2) After the PC side sends a MUTE ON instruction to the MIC through UART (Universal Asynchronous Receiver / Transmitter), the MIC is turned off. At the same time, the MIC sends the current state to the photoelectric induction unit 200 through the serial port, the photoelectric switch is turned off (MUTE ON state), and the LED lamp is turned off;

[0084] 3) After the PC side sends a MUTE OFF instruction to the MIC through UART, the MIC is turned on. At the same time, the MIC sends the current state to the photoelectric induction unit 200 through the serial port, the photoelectric switch is turned on (MUTE OFF state), and the LED lamp is turned on; the photoelectric switch can only receive the user's body instructions in the MUTE ON state (LED off), and cannot receive the user's body instructions in the MUTE OFF state (LED on).

[0085] Specifically, the control instructions in the voice interaction system are shown in Table 1:

[0086] Table 1: PC-MIC-Photoelectric Switch Control Instructions

[0087]

[0088] The above is an explanation of the logical design of the voice interaction system of the intelligent device provided in the embodiments of the present disclosure. The following will further elaborate on the structure of each unit in the voice interaction system of the intelligent device provided in the embodiments of the present disclosure.

[0089] In some embodiments, as Figure 4 and Figure 5 shown, the photoelectric induction unit 200 includes a photoelectric switch, and the photoelectric switch includes: a housing 210, a photoelectric sensor 220, a circuit board 230, a rear cover 240, and a first signal transmission wire harness (not shown in the figure). The interior of the housing 210 is hollow. The housing 210 includes a front end and a rear end. The front end is provided with an indication mark 211, and the rear end is open. The photoelectric sensor 220 is disposed within the housing 210. The circuit board 230 is disposed within the housing 210, and the circuit board 230 is connected to the photoelectric sensor 220. The rear cover 240 is snapped onto the rear end of the housing 210. One end of the first signal transmission wire harness is connected to the circuit board 230, and the other end extends out of the rear cover 240. The photoelectric switch further includes a light source disposed within the housing 210. For example, the light source may include an LED lamp.

[0090] In some embodiments, as Figure 4 shown, the rear end of the housing 210 and the rear cover 240 are connected by a snap connection. For example, the rear end of the housing 210 may be provided with a snap groove, and the rear cover 240 is provided with a snap 241. By snapping the snap 241 on the rear cover 240 into the snap groove of the housing 210, after covering the housing 210 with the rear cover 240, it can be prevented from falling off.

[0091] In addition, in some embodiments, as Figure 5 shown, the front end is provided with a first through hole 213 and a second through hole 214. The photoelectric sensor 220 is provided with a receiving electrode and a transmitting electrode. The receiving electrode is located at the first through hole 213, and the transmitting electrode is located at the second through hole 214, so as to expose the receiving electrode and the transmitting electrode of the photoelectric sensor 220.

[0092] In the above solution, the sizes of the first through hole 213 and the second through hole 214 are based on exposing the receiving electrode and the transmitting electrode. For example, the diameters of the first through hole 213 and the second through hole 214 may be 2.8 mm.

[0093] In addition, in some embodiments of the present disclosure, the indication identifier includes an engraved hollow identifier. In this way, the front surface of the housing 210 has an engraved hollow identifier, which can clearly display a mark on the surface of the optoelectronic switch housing 210. For example, the mark is text, such as "Wave Hand To Speak", to remind the user that they can wave their hand to turn on the optoelectronic switch and wake up the microphone for recording.

[0094] The relief design depth of the engraved hollow identifier on the front surface of the housing 210 can be about 0.3 mm. Compared with the engraved hollow mark, the font of the engraved hollow identifier is clearer. The engraved font is thicker. If the housing 210 is formed by an injection molding process and painted on the surface, the light transmittance of the housing 210 is not good. The thicker the font, the darker the display and the worse the contrast effect. If the engraved hollow form is adopted, the font is thinned, the display is brighter, and the contrast effect is better, solving the technical problem that the mark on the housing 210 is not clearly displayed when the optoelectronic switch works.

[0095] In addition, it should be noted that the surface of the housing 210 can be painted. For example, the Pantone 656C color number is selected, and the painting thickness can be 0.7 - 0.12 μm to ensure that the light of the LED is evenly transmitted and the characters of the engraved hollow identifier are clearly displayed.

[0096] In addition, in the embodiments of the present disclosure, the optoelectronic sensor 220 in the optoelectronic switch can be an infrared sensor. The infrared sensor can determine the range of the energized current and the sensing distance of the infrared sensor by the size of the peripheral resistor. For example, according to the actual use environment, the sensing distance of the optoelectronic switch can be about 80 mm, but it is not limited thereto.

[0097] The emitter of the infrared sensor emits infrared light. When the user makes a limb movement (such as approaching the optoelectronic switch or waving, etc.) within the sensing distance, the emitted infrared light will be reflected back under the reflection of the blocking obstacle. At this time, the receiver of the infrared sensor will receive the optical signal and convert the optical signal into an electrical signal. The optoelectronic switch controls the LED light to turn on according to the electrical signal of the infrared sensor, and at the same time wakes up the microphone module according to the UART instruction.

[0098] In addition, in a specific exemplary embodiment, the circuit board 230 in the optoelectronic switch includes a first surface and a second surface arranged opposite to each other. An LED light is arranged on the first surface to provide a light source for the optoelectronic switch. After the LED light is turned on, the light can pass through the housing 210 to display the engraved hollow identifier on the front end of the housing 210.

[0099] The infrared sensor and the peripheral resistor are also arranged on the first surface.

[0100] An optoelectronic induction main chip and a first signal transmission wire harness are arranged on the second surface. The optoelectronic induction main chip receives the signal sent by the infrared sensor, processes the signal, and sends an activation instruction to the microphone module. One end of the first signal transmission wire harness is connected to the circuit board 230, and the other end passes through a through hole formed in the center of the rear cover 240 and is connected to the first signal transmission wire harness of the microphone module. The optoelectronic switch receives and sends instructions through the signal transmission wire harness.

[0101] In addition, in some embodiments, the voice interaction unit includes a microphone module. The figure shows an exploded view of the structure of an embodiment of the microphone module.

[0102] As Figure 6 shown, the microphone module includes: an upper cover 110, at least two sound-receiving microphones (not shown in the figure), a printed circuit board 120, a sealing ring 130, and a bottom cover 140. The inside of the upper cover 110 is hollow. The upper cover 110 includes a front end and a rear end. At least two sound-receiving holes are provided at the front end, and the rear end is open. At least two sound-receiving microphones are arranged inside the upper cover 110, each sound-receiving microphone is arranged corresponding to one of the sound-receiving holes, and a sealing ring 130 is arranged at each sound-receiving hole. The printed circuit board 120 is arranged inside the upper cover 110, and the printed circuit board 120 is connected to the sound-receiving microphones. The bottom cover 140 is arranged at the rear end of the upper cover 110.

[0103] In some embodiments, the microphone module further includes: a second signal transmission wire harness connected to the printed circuit board 120, and a wire pressing plate 150 arranged on the printed circuit board 120 for pressing the second signal transmission wire harness. The bottom cover 140 and the wire pressing plate are fixed to the upper cover 110 by buckles and are encapsulated with sealant.

[0104] As an exemplary embodiment, the upper cover 110 of the microphone module is screen-printed with a black mark (LOGO) for easy user identification. There are two sound-receiving holes on the upper and lower surfaces of the upper cover 110, corresponding to the positions of the sealing rings 130, which is more conducive to sound collection.

[0105] As an exemplary embodiment, the printed circuit board 120 includes a front side and a back side. Taking the number of microphones as two as an example, the two microphones are arranged at both ends of the front side. Taking the number of microphones in this microphone module as two as an example, after ambient noise sampling, the sound waveform is analyzed and phase-operated, and then superimposed on the sampling waveform of the main microphone to form phase cancellation, so that one of the microphones can stably maintain clear recording, and the other microphone actively eliminates physical noise. After algorithm processing, the recorded sound is clearer, solving the technical problem of poor recording effect of microphones in noisy environments. The dual microphones can improve the signal-to-noise ratio and keep the recorded sound pure when dealing with changing and complex sound environments, and the later algorithm processing is more accurate.

[0106] A main voice signal chip is also arranged on the front side of the printed circuit board 120. The main voice signal chip can perform noise reduction and algorithm optimization processing according to the sound data input by the two microphones. At the same time, a serial port interface is included in the main voice signal chip for sending and receiving instructions from the optoelectronic switch and the PC side.

[0107] A reset key is arranged on the back side of the printed circuit board 120 for subsequent software upgrade operations.

[0108] A connection line jack is also arranged on the back side of the printed circuit board 120 for connecting to the second signal transmission harness to maintain signal data transmission between the optoelectronic switch and the PC side.

[0109] The bottom cover 140 and the wire pressing cover can be connected to the upper cover 110 by a snap-fastening method and are encapsulated with sealant to prevent damage by external forces.

[0110] The embodiment of the present disclosure also provides a voice interaction method, including:

[0111] Judging whether the voice interaction unit 100 is in an on state;

[0112] If so, controlling the intelligent device to perform an action corresponding to the target voice command according to the target voice command of the user received and recognized by the voice interaction unit 100;

[0113] If not, controlling the voice interaction unit 100 to turn on according to the target limb command of the user received and recognized by the optoelectronic induction unit 200, and controlling the intelligent device to perform an action corresponding to the target voice command according to the target voice command of the user received and recognized by the voice interaction unit 100.

[0114] In some exemplary embodiments, the method further includes:

[0115] When the voice interaction unit 100 is in the on state, determine whether the voice interaction unit 100 receives a voice command within a predetermined time; if not, control the voice interaction unit 100 to turn off.

[0116] In some exemplary embodiments, the method further includes:

[0117] When the voice interaction unit 100 is in the on state, determine whether the voice interaction unit 100 receives a voice command within a predetermined time; if not, control the photoelectric induction unit 200 to turn off.

[0118] In some exemplary embodiments, the method further includes:

[0119] Receive and recognize the image data collected by the image acquisition unit 400 in the intelligent device;

[0120] When the image data includes a target gesture, control the photoelectric induction unit 200 and the voice interaction unit 100 to turn on.

[0121] For the specific voice interaction process of this voice interaction method, it is the same as the specific voice interaction process of the voice interaction system provided by the present disclosure, and will not be elaborated here.

[0122] The embodiments of the present disclosure further provide an intelligent device, on which the voice interaction system provided by the embodiments of the present disclosure is provided.

[0123] The intelligent device provided by the embodiments of the present disclosure may include an intelligent refrigerator, an intelligent washing machine, an intelligent TV, etc. The application scenarios are not limited to household appliances, but can also be applied to application scenarios such as clothing store shopping guides and self-service convenience stores.

[0124] The following points need to be explained:

[0125] (1) The drawings of the embodiments of the present disclosure only relate to the structures involved in the embodiments of the present disclosure, and other structures can refer to the general design.

[0126] (2) For clarity, in the drawings used to describe the embodiments of the present disclosure, the thickness of the layers or regions is enlarged or reduced, that is, these drawings are not drawn according to the actual scale. It can be understood that when an element such as a layer, film, region or substrate is referred to as being "on" or "under" another element, the element can be "directly" on or under the other element or there can be an intermediate element.

[0127] (3) Without conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other to obtain new embodiments.

[0128] The above are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. The protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims

1. A voice interaction system, characterized in that, including: a voice interaction unit for collecting and recognizing a user's target voice command; a photoelectric induction unit connected to the voice interaction unit for receiving and recognizing a user's target limb command and controlling the on / off of the voice interaction unit according to the target limb command; a command control unit connected to the voice interaction unit for determining whether the voice interaction unit is in an on state; if so, controlling the intelligent device to perform an action corresponding to the target voice command according to the target voice command received and recognized by the voice interaction unit; wherein, the photoelectric induction unit includes a photoelectric switch that recognizes a limb movement command according to the received reflected light signal; the voice interaction unit includes a microphone module, and the microphone module includes: an upper cover with a hollow interior, the upper cover including a front end and a rear end, the front end being provided with at least two sound collection holes and the rear end being open; at least two sound collection microphones disposed inside the upper cover, each sound collection microphone corresponding to one of the sound collection holes and a sealing ring being disposed at each sound collection hole; a voice signal main chip configured to perform noise reduction and algorithm optimization processing on the sound data recorded by at least two microphones, such that at least two of the sound collection microphones are configured to, after ambient noise sampling, have their sound waveforms analyzed and phase-operated and superimposed on the sampling waveform of the main microphone to form phase cancellation, so that one of the sound collection microphones maintains clear recording and the other sound collection microphone actively cancels physical noise.

2. The voice interaction system according to claim 1, wherein the command control unit is further configured to, when the voice interaction unit is in an on state, determine whether the voice interaction unit receives a voice command within a predetermined time; if not, send a turn-off command for the voice interaction unit to the voice interaction unit.

3. The voice interaction system according to claim 2, wherein the voice interaction unit is further configured to: when receiving the turn-off command for the voice interaction unit, send a turn-off command for the photoelectric induction unit to the photoelectric induction unit.

4. The voice interaction system according to claim 1, wherein the voice interaction system further includes an image acquisition unit, the command control unit being connected to the image acquisition unit for receiving and recognizing the image data acquired by the image acquisition unit, and when the image data includes a target gesture, sending an on command for the voice interaction unit to the voice interaction unit; the voice interaction unit is further configured to, when receiving the on command for the voice interaction unit, send an on command for the photoelectric induction unit to the photoelectric induction unit.

5. The voice interaction system according to claim 1, wherein communication between the voice interaction unit and the command control unit is performed through serial port commands, communication between the voice interaction unit and the command control unit is performed through serial port commands.

6. The voice interaction system according to claim 1, wherein the photoelectric switch includes: A housing, the interior of which is hollow, the housing includes a front end and a rear end, an indication mark is provided at the front end, and the rear end is open; A photoelectric sensor disposed within the housing; A circuit board disposed within the housing, the circuit board being connected to the photoelectric sensor; A rear cover snap-fitted to the rear end of the housing; A signal transmission wire harness, one end of the signal transmission wire harness is connected to the circuit board, and the other end extends out of the rear cover.

7. The voice interaction system according to claim 6, wherein The rear end of the housing is connected to the rear cover by a buckle.

8. The voice interaction system according to claim 6, wherein A first through hole and a second through hole are provided on the front end; a receiving pole and a transmitting pole are provided on the photoelectric sensor, the receiving pole is located at the first through hole, and the transmitting pole is located at the second through hole.

9. The voice interaction system according to claim 6, wherein The indication mark includes an intaglio hollowed-out mark.

10. The voice interaction system according to claim 6, wherein The photoelectric switch further includes: a light source disposed within the housing.

11. The voice interaction system according to claim 1, wherein The microphone module further includes: A printed circuit board disposed inside the upper cover, the printed circuit board being connected to the sound pickup microphone; A bottom cover disposed at the rear end of the upper cover.

12. The voice interaction system according to claim 11, wherein The microphone module further includes: A signal transmission wire harness connected to the printed circuit board, and a wire pressing plate disposed on the printed circuit board for pressing the signal transmission wire harness.

13. The voice interaction system according to claim 12, wherein The bottom cover and the wire pressing plate are fixed to the upper cover by a buckle and encapsulated with a sealant.

14. A voice interaction method, characterized in that, Applied to the voice interaction system according to any one of claims 1 to 13, the method includes: Determine whether the voice interaction unit is in an on state; If so, control the intelligent device to execute an action corresponding to the target voice command according to the target voice command of the user received and recognized by the voice interaction unit; If not, control the voice interaction unit to turn on according to the target limb command of the user received and recognized by the photoelectric induction unit, and control the intelligent device to execute an action corresponding to the target voice command according to the target voice command of the user received and recognized by the voice interaction unit.

15. The voice interaction method according to claim 14, wherein The method further includes: When the voice interaction unit is in an on state, determine whether the voice interaction unit receives a voice command within a predetermined time; if not, control the voice interaction unit to turn off.

16. The voice interaction method according to claim 15, wherein The method further includes: Receive and recognize the image data collected by the image acquisition unit; When the image data includes a target gesture, control the photoelectric induction unit and the voice interaction unit to turn on.

17. An intelligent device, characterized in that, The voice interaction system according to any one of claims 1 to 12 is provided on the intelligent device.

Images