Voice reply method, earphone box, earphone system, storage medium and product

Abstract

The embodiment of the disclosure provides a voice reply method, an earphone box, an earphone system, a storage medium and a product, and relates to the technical field of computers, and the method comprises the following steps: acquiring inquiry voice information in the case that an earphone is in an earphone box; controlling a camera arranged on the earphone to collect a first image; obtaining first reply voice information of the inquiry voice information, the first reply voice information being information related to the first image, the first image and the inquiry voice information being processed by a dialogue model which is pre-trained to obtain the first reply voice information; and playing the first reply voice information. First, the embodiment of the disclosure can realize intelligent dialogue by using the earphone box in the case that the earphone is in the earphone box, thereby improving the efficiency of the intelligent dialogue in the case that the earphone is in the earphone box.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to a voice response method, an earphone case, an earphone system, a storage medium, and a product. Background Technology

[0002] Intelligent dialogue is an interaction between users and smart devices that uses a question-and-answer format. It is widely used in scenarios such as voice assistants and intelligent customer service.

[0003] Currently, intelligent dialogue is mainly implemented through terminal devices. For example, users input voice or text information through the interface of a terminal device, and the terminal device outputs corresponding response information. This method suffers from low dialogue efficiency. Summary of the Invention

[0004] This disclosure provides a voice response method, apparatus, device, computer-readable storage medium, and product to address the technical problem of low efficiency in existing technologies that use terminal devices to achieve intelligent dialogue.

[0005] In a first aspect, embodiments of this disclosure provide a voice response method applied to an earphone case. The voice response method includes: acquiring inquiry voice information when the earphone is in the earphone case; controlling a camera mounted on the earphone to capture a first image; obtaining first response voice information related to the inquiry voice information, wherein the first response voice information is information related to the first image, and the first image and the inquiry voice information are processed by a pre-trained dialogue model to obtain the first response voice information; and playing the first response voice information.

[0006] Secondly, embodiments of this disclosure provide an earphone case, the earphone case comprising:

[0007] The acquisition unit is used to acquire query voice information when the earphone is in the earphone case;

[0008] The control unit is used to control the camera mounted on the earpiece to capture the first image;

[0009] The processing unit is used to obtain the first response voice information of the query voice information. The first response voice information is information related to the first image. The first image and the query voice information are processed by a pre-trained dialogue model to obtain the first response voice information.

[0010] The playback unit is used to play the first response voice message.

[0011] Thirdly, embodiments of this disclosure provide an earphone system, including earphones and an earphone case, wherein the earphones carry a camera, and the earphone case is used for:

[0012] Collect inquiry voice information when the earphones are in the earphone case;

[0013] Control the camera set on the headphones to capture the first image;

[0014] The first response voice information is obtained from the query voice information. The first response voice information is related to the first image. The first image and the query voice information are processed by a pre-trained dialogue model to obtain the first response voice information.

[0015] Play the first reply voice message.

[0016] Fourthly, embodiments of this disclosure provide an electronic device, including: a processor and a memory;

[0017] The memory stores instructions that the computer executes;

[0018] The processor executes computer execution instructions stored in memory, causing at least one processor to perform the first aspect above and various possible voice response methods of the first aspect.

[0019] Fifthly, embodiments of this disclosure provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the first aspect and various possible voice response methods described above.

[0020] In a sixth aspect, embodiments of this disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the first aspect as described above and various possible voice response methods of the first aspect.

[0021] The voice response method, earphone case, earphone system, storage medium, and product provided in this embodiment are applied to an earphone case. The voice response method includes: acquiring inquiry voice information when the earphone is in the earphone case; controlling a camera set on the earphone to capture a first image; obtaining first response voice information related to the inquiry voice information, wherein the first response voice information is related to the first image, and the first image and the inquiry voice information are processed by a pre-trained dialogue model to obtain the first response voice information; and playing the first response voice information. Firstly, this disclosure can realize intelligent dialogue using the earphone case when the earphone is in the earphone case, thereby improving the efficiency of intelligent dialogue in the scenario where the earphone is in the earphone case. Attached Figure Description

[0022] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0023] Figure 1 This is an example diagram illustrating an application scenario of a voice response method provided in an embodiment of this disclosure;

[0024] Figure 2 A flowchart of a voice response method provided in an embodiment of this disclosure;

[0025] Figure 3 A flowchart of another voice response method provided in this disclosure embodiment;

[0026] Figure 4 This is a schematic diagram of the structure of an earphone device provided in an embodiment of the present disclosure;

[0027] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0028] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0029] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, the target user should be informed of the type, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and the authorization of the target user should be obtained.

[0030] It is understood that the above notification and target user authorization process is merely illustrative and does not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0031] In related technologies, if a user needs to inquire about information about an object in their surroundings while wearing headphones, they need to use headphones with a camera to take a picture of the object, obtain an image, and then use a relevant recognition application on the mobile terminal to scan the image. The headphones then output the relevant information about the object. This requires the user to wear headphones to complete the intelligent dialogue. If the user does not wear headphones, the intelligent dialogue achieved through the mobile terminal in related technologies suffers from low efficiency.

[0032] To address the technical problem, this disclosure provides a voice response method. This method involves: acquiring inquiry voice information when the earphone is in an earphone case; controlling a camera mounted on the earphone to capture a first image; obtaining a first response voice information related to the first image; processing the first image and the inquiry voice information using a pre-trained dialogue model to obtain the first response voice information; and playing the first response voice information. This method enables intelligent dialogue with the user when the earphone is in an earphone case, based on the first image captured by the earphone, thus improving the efficiency of intelligent dialogue in earphone-in-earphone-case scenarios.

[0033] It should be noted that the voice response method provided in this disclosure can be applied to any type of headphone box equipped with intelligent dialogue function.

[0034] The voice response method provided in the embodiments of this disclosure will be described in detail below with reference to the accompanying drawings.

[0035] Figure 1 This diagram illustrates an application scenario of a voice response method provided in an embodiment of this disclosure. Figure 1 As shown, the earphone case 10 is provided with a through hole 11, and the earphone 12 carries a camera. When the earphone 12 is placed in the earphone 10, the camera on the earphone 12 can capture images of the scene outside the earphone case through the through hole. The earphone case 10 can then engage in intelligent dialogue with the user based on the images captured by the earphone 12.

[0036] Figure 1 This is merely an exemplary application scenario and can be used in any configuration of the headphone case. This disclosure does not limit the type of headphone case.

[0037] Figure 2 A flowchart of a voice response method provided in this disclosure embodiment, which is applied to an earphone case, may include the following steps:

[0038] S201. Obtain inquiry voice information when the earphone is in the earphone case.

[0039] In this embodiment of the disclosure, reference is made to Figure 1 The headphone case can detect whether the headphones are inside. If the headphones are inside, the headphone case can receive the user's voice inquiry information.

[0040] It's understandable that the earphone case is equipped with a microphone to collect users' voice inquiries.

[0041] In addition, the earphone case has the usual functions of an earphone case, such as storing the earphones and charging them.

[0042] Furthermore, a microphone, speaker, processor, and display screen are incorporated into the headphone case. The headphone case can then function as an electronic device that communicates with other electronic devices.

[0043] S202, Control the camera set on the earphone to capture the first image.

[0044] In this embodiment of the disclosure, the earphone is equipped with a camera that can capture images of the surrounding scene.

[0045] Furthermore, when the user is wearing headphones, the camera can be turned on to capture one or more frames of images of the user's surrounding scene. In addition, the headphones can also capture the user's inquiry voice information. Then, the images and inquiry voice information are input into a pre-trained dialogue model for processing to obtain response voice information, which is played through the headphones.

[0046] In one embodiment, a pre-trained dialogue model can be deployed on the headset side. The headset can directly input images and query voice information into the dialogue model for processing, and then play the response voice information.

[0047] In another embodiment, the dialogue model is deployed on a terminal device (such as a mobile phone). The headset can send images and query voice information to the terminal device, which then inputs the images and query voice information into the dialogue model for processing to obtain response voice information. The terminal device then sends the response voice information to the headset for playback.

[0048] In another embodiment, the dialogue model can be deployed in the cloud, and the headset can connect to the network to send images and query voice information to the dialogue model in the cloud for processing, and then play the response voice information.

[0049] It is understood that, when the earphones are not in the charging case and the user is wearing them, the earphones can independently achieve intelligent dialogue. Furthermore, the earphones can detect whether they are being worn; if worn, the earphones can directly transmit captured images to the terminal device for processing or storage.

[0050] Furthermore, in this disclosure, a camera may be installed on one of the earphones to capture the first image, or cameras may be installed on both earphones to capture the first image respectively.

[0051] In this disclosure, if the earphones are in the earphone case, the camera on the earphone case is controlled by the earphone case, and the earphone case can control the camera on the earphones to capture a first image.

[0052] S203, Receive the first response voice message after the inquiry.

[0053] The first response voice information is information related to the first image. The first image and the query voice information are processed by a pre-trained dialogue model to obtain the first response voice information.

[0054] The dialogue model is an LLM (Large Language Model), a pre-trained multimodal language model that processes the first image and the natural language query speech information to obtain the first response speech information. This first response speech information is related to the first image. For example, if the query speech information is "XX, what's next to the car?", where "XX" is the wake word, and the first image includes "car, tree next to the car", then the first response speech information could be "There's a tree next to the car". If the query speech information is "What kind of tree is this?", then the first response speech information could be "It's a willow tree".

[0055] In this embodiment of the disclosure, the input to the dialogue model can be a voice query message in speech format, or the voice query message can be converted into a text query message using STT (Speech To Text) technology. The text query message is then input into the dialogue model, and the dialogue model can also output a first response text message. The headset device uses TTS (Text To Speech) technology to convert the first response text message from text format to speech format to obtain the first response voice message.

[0056] In one embodiment, obtaining the first response voice information of the inquiry voice information includes: receiving a first image transmitted through an earpiece; inputting the first image and the inquiry voice information into a pre-trained dialogue model for processing to obtain the first response voice information of the inquiry voice information.

[0057] It is understandable that the earphones transmit the first image captured by the camera to the earphone box, which is equipped with a dialogue model. The earphone box can directly input the first image and the query voice information into the dialogue model for processing to obtain the first response voice information.

[0058] Alternatively, a dialogue application can be installed in the earphone case, and a dialogue model can be deployed on a cloud server. The earphone case can upload the first image and inquiry voice information to the dialogue model on the cloud server for processing to obtain the first response voice information. The earphone case can connect directly to the internet via Wi-Fi (mobile hotspot) or eSIM (Embedded Subscriber Identity Module) to upload the first image and inquiry voice information to the dialogue model on the cloud server for processing.

[0059] In one embodiment, obtaining the first response voice information of the inquiry voice information includes: receiving a first image transmitted by an earpiece; sending the first image and the inquiry voice information to a terminal device, wherein the terminal device processes the first image and the inquiry voice information through a pre-trained dialogue model to obtain the first response voice information of the inquiry voice information; and receiving the first response voice information sent by the terminal device.

[0060] It is understandable that if the dialogue model is deployed on the terminal device side, the earphone box sends the first image and the query voice information to the terminal device, and the terminal device processes the first image and the query voice information through the dialogue model to obtain the first response voice information.

[0061] In another embodiment, obtaining the first response voice information of the inquiry voice information includes: transmitting the inquiry voice information to the headset; receiving the first response voice information transmitted by the headset, wherein the headset is used to process the first image and the inquiry voice information through a pre-trained dialogue model to obtain the first response voice information of the inquiry voice information.

[0062] It is understandable that the dialogue model is deployed on the earphone side. After the earphone box collects the inquiry voice information, it sends the inquiry voice information to the earphone. The earphone inputs the inquiry voice information and the first image collected into the dialogue model for processing to obtain the first response voice information. Then, the earphone transmits the first response voice information to the earphone box for playback.

[0063] In summary, this disclosure can employ various methods to process the first image and the query voice information using a dialogue model to obtain the first response voice information.

[0064] S204. Play the first reply voice message.

[0065] In this embodiment of the disclosure, the method further includes: receiving at least one second image transmitted by the earphone, wherein the at least one second image is an image stored in the earphone, and the at least one second image is captured by the earphone outside the earphone case; storing at least one second image in the earphone case; and controlling the deletion of at least one second image stored in the earphone.

[0066] It's understandable that both the earphones and the charging case have storage units. The charging case's storage capacity is greater than that of the earphones. Therefore, when the earphones are worn, the second image captured is first stored in the earphones' storage unit. When the earphones are in the charging case, the second image stored in the earphones' storage unit can be transferred to the charging case's storage unit. Then, the second image stored in the earphones is deleted, freeing up the earphones' storage unit. Furthermore, the charging case can transmit the second image to a terminal device for storage via Wi-Fi, Bluetooth, or Type-C.

[0067] Furthermore, the text information corresponding to the first reply voice message is displayed on the display screen of the earphone case.

[0068] It is understood that, in this embodiment of the disclosure, a display screen can be deployed on the earphone box, which can display the text information of the voice information during intelligent dialogue, so that users can receive the response content of the inquiry voice information more accurately.

[0069] Furthermore, the display screen enables human-computer interaction, allowing users to view images stored in the headphone case.

[0070] In this embodiment of the disclosure, when the earphones are not in the charging case, the user can engage in intelligent conversations through the earphones while wearing them. When the earphones are in the charging case, the user can engage in intelligent conversations through the charging case, thereby improving the efficiency of intelligent conversations.

[0071] In summary, when the earbuds are placed in the charging case, the earbuds' cameras are exposed. The connection between the earbuds and the terminal device is closed, and the earbuds transmit the first image they capture to the charging case. When the user speaks a question into the charging case, the charging case controls the camera on the earbuds to capture the first image and transmits it to the dialogue model. The charging case also captures the user's question voice and sends it to the dialogue model. After processing the first image and the question voice, the dialogue model obtains the first response voice message and then communicates it to the user through the charging case, enabling intelligent dialogue when the earbuds are in the charging case.

[0072] Figure 3 A flowchart of a voice response method provided in this disclosure, applied to an earphone case, specifically includes the following steps:

[0073] S301, obtain inquiry voice information.

[0074] In this embodiment of the disclosure, the microphone configured on the earphone box can collect the user's inquiry voice information.

[0075] S302, confirm if the earphones are in the earphone case.

[0076] If yes, execute steps S201 to S204; otherwise, execute S303.

[0077] It's understandable that the earphone case can detect whether the earphones are inside; if the earphones are inside, it can perform [actions]. Figure 2 The content shown is used to respond to users' inquiries via voice messages.

[0078] S303, confirm the second response voice message to the inquiry voice message.

[0079] In this process, the query voice information is processed by the dialogue model to obtain the second response voice information.

[0080] It is understandable that when the earphones are not in the earphone case, the earphone case can independently process the query voice information, that is, the dialogue model only processes the query voice information.

[0081] For example, if the question is "What category does a butterfly belong to?", the second response could be "Butterflies belong to the insect class".

[0082] S304, playing the second reply voice message.

[0083] In this embodiment of the disclosure, the second response voice information can be played through the speaker on the headphone case.

[0084] S305 displays the text information corresponding to the second reply voice message on the display screen of the earphone case.

[0085] It is understandable that a display screen could be deployed on the earphone case to show the text information of the voice messages during intelligent dialogue, making it easier for users to receive the response to the voice messages they ask for more accurately.

[0086] In summary, the voice response method disclosed herein enables intelligent dialogue between the user and the earphones when the user is wearing earphones, or between the earphones and the user alone via the earphone case. When the user is not wearing earphones, if the earphones are in the earphone case, intelligent dialogue can be achieved through the interaction between the earphones and the earphones, improving the efficiency of intelligent dialogue and enhancing the user experience.

[0087] Figure 4 This is a schematic diagram of the structure of an earphone case provided in an embodiment of the present disclosure. The earphone case 40 may include the following units:

[0088] The acquisition unit 401 is used to acquire query voice information when the earphone is in the earphone case;

[0089] Control unit 402 is used to control the camera set on the earphone to capture the first image;

[0090] The processing unit 403 is used to obtain the first response voice information of the query voice information. The first response voice information is information related to the first image. The first image and the query voice information are processed by a pre-trained dialogue model to obtain the first response voice information.

[0091] Playback unit 404 is used to play the first reply voice message.

[0092] In one optional embodiment, the processing unit 403 is specifically configured to: receive a first image transmitted by the earpiece; input the first image and the query voice information into a pre-trained dialogue model for processing to obtain a first response voice information to the query voice information.

[0093] In one optional embodiment, the processing unit 403 is specifically configured to: receive a first image transmitted by the earphone;

[0094] Send a first image and query voice information to the terminal device. The terminal device processes the first image and query voice information using a pre-trained dialogue model to obtain the first response voice information of the query voice information.

[0095] Receive the first reply voice message sent by the terminal device.

[0096] In one optional embodiment, the processing unit 403 is specifically configured to: transmit query voice information to the headset;

[0097] The system receives the first response voice information transmitted through the headset. The headset is used to process the first image and the query voice information through a pre-trained dialogue model to obtain the first response voice information of the query voice information.

[0098] In an optional embodiment, the processing unit 403 is further configured to: determine the second response voice information of the inquiry voice information when the earphone is not in the earphone case, wherein the inquiry voice information is processed by the dialogue model to obtain the second response voice information;

[0099] Playback unit 404 is also used to play the second reply voice message.

[0100] In an optional embodiment, it further includes:

[0101] A receiving unit (not shown) is used to receive at least one second image transmitted by the earphone, the at least one second image being an image stored in the earphone, and the at least one second image being captured by the earphone outside the earphone case;

[0102] The control unit 402 is also configured to store at least one second image in the headphone case and to control the deletion of at least one second image stored in the headphones.

[0103] In one optional embodiment, a display unit (not shown) is further included for displaying text information corresponding to the first response voice information on the display screen of the earphone case.

[0104] The specific implementation process of the earphone box provided in this embodiment can be referred to the embodiment of the voice response method, and will not be repeated here.

[0105] Furthermore, this disclosure also provides an earphone system, including earphones and an earphone case. The earphones carry a camera, and the earphone case is used for: acquiring inquiry voice information when the earphones are in the earphone case; controlling the camera set on the earphones to acquire a first image; obtaining first response voice information of the inquiry voice information, the first response voice information being information related to the first image, the first image and the inquiry voice information being processed by a pre-trained dialogue model to obtain the first response voice information; and playing the first response voice information.

[0106] The specific implementation process of the headphone system provided in this disclosure can be referred to the voice response method embodiment, and will not be repeated here.

[0107] To implement the above embodiments, this disclosure also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the voice response method as described in any of the above embodiments.

[0108] To implement the above embodiments, this disclosure also provides a computer program product, including a computer program that, when executed by a processor, implements the voice response method as described in any of the above embodiments.

[0109] To implement the above embodiments, this disclosure also provides an electronic device, including: a processor and a memory;

[0110] The memory stores instructions that the computer executes;

[0111] The processor executes computer execution instructions stored in memory, causing the processor to perform the voice response method as described in any of the above embodiments.

[0112] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. The electronic device 50 can be a terminal device or a server. The terminal device can include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), portable Android devices (PADs), portable media players (PMPs), and in-vehicle terminals (such as in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 5 The electronic device described is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0113] like Figure 5As shown, the electronic device 50 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 51, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 52 or a program loaded from storage device 58 into random access memory (RAM) 53. The RAM 53 also stores various programs and data required for the operation of the electronic device 50. The processing unit 51, ROM 52, and RAM 53 are interconnected via a bus 54. An input / output (I / O) interface 55 is also connected to the bus 54.

[0114] Typically, the following devices can be connected to I / O interface 55: input devices 56 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 57 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 58 including, for example, magnetic tapes, hard disks, etc.; and communication devices 59. Communication device 59 allows electronic device 50 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 5 An electronic device 50 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0115] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 59, or installed from a storage device 58, or installed from a ROM 52. When the computer program is executed by the processing device 51, it performs the functions defined in the methods of embodiments of this disclosure.

[0116] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0117] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0118] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above embodiments.

[0119] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the target user's computer, partially on the target user's computer, as a standalone software package, partially on the target user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the target user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0120] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0121] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0122] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0123] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0124] In a first aspect, according to one or more embodiments of this disclosure, a voice response method is provided, applied to an earphone case, the voice response method comprising:

[0125] Obtain the inquiry voice information;

[0126] With the earphones in the earphone case, control the camera set on the earphones to capture the first image;

[0127] The first response voice information is obtained from the query voice information. The first response voice information is related to the first image. The first image and the query voice information are processed by a pre-trained dialogue model to obtain the first response voice information.

[0128] Play the first reply voice message.

[0129] According to one or more embodiments of this disclosure, a first response voice message to the inquiry voice message is obtained, including:

[0130] Receive the first image transmitted through the headphones;

[0131] The first image and the query voice information are input into a pre-trained dialogue model for processing to obtain the first response voice information to the query voice information.

[0132] According to one or more embodiments of this disclosure, a first response voice message to the inquiry voice message is obtained, including:

[0133] Receive the first image transmitted through the headphones;

[0134] Send a first image and query voice information to the terminal device. The terminal device processes the first image and query voice information using a pre-trained dialogue model to obtain the first response voice information of the query voice information.

[0135] Receive the first reply voice message sent by the terminal device.

[0136] According to one or more embodiments of this disclosure, a first response voice message to the inquiry voice message is obtained, including:

[0137] Transmit inquiry voice information to the headset;

[0138] The system receives the first response voice information transmitted through the headset. The headset is used to process the first image and the query voice information through a pre-trained dialogue model to obtain the first response voice information of the query voice information.

[0139] According to one or more embodiments of this disclosure, it further includes:

[0140] When the earphones are not in the earphone case, the second response voice information of the inquiry voice information is determined, and the inquiry voice information is processed by the dialogue model to obtain the second response voice information;

[0141] Play the second reply voice message.

[0142] According to one or more embodiments of this disclosure, it further includes:

[0143] Receive at least one second image transmitted by the earphone, the at least one second image being an image stored in the earphone, and the at least one second image being captured by the earphone outside the earphone case;

[0144] Store at least one second image in the headphone case, and control the deletion of at least one second image stored in the headphones.

[0145] According to one or more embodiments of this disclosure, it further includes: displaying text information corresponding to the first response voice information on the display screen of the earphone case.

[0146] Secondly, according to one or more embodiments of this disclosure, an earphone case is provided, the earphone case comprising:

[0147] The acquisition unit is used to acquire query voice information when the earphone is in the earphone case;

[0148] The control unit is used to control the camera mounted on the earpiece to capture the first image;

[0149] The processing unit is used to obtain the first response voice information of the query voice information. The first response voice information is information related to the first image. The first image and the query voice information are processed by a pre-trained dialogue model to obtain the first response voice information.

[0150] The playback unit is used to play the first response voice message.

[0151] Thirdly, according to one or more embodiments of this disclosure, an earphone system is provided, including earphones and an earphone case, the earphones carrying a camera, and the earphone case being used for:

[0152] Collect inquiry voice information when the earphones are in the earphone case;

[0153] Control the camera set on the headphones to capture the first image;

[0154] The first response voice information is obtained from the query voice information. The first response voice information is related to the first image. The first image and the query voice information are processed by a pre-trained dialogue model to obtain the first response voice information.

[0155] Play the first reply voice message.

[0156] Fourthly, according to one or more embodiments of the present disclosure, an electronic device is provided, comprising: at least one processor and a memory;

[0157] The memory stores instructions that the computer executes;

[0158] At least one processor executes computer execution instructions stored in memory, causing at least one processor to perform the voice response method as described in the first aspect above and various possible designs of the first aspect.

[0159] Fifthly, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, which stores computer-executable instructions that, when executed by a processor, implement the voice response method as described in the first aspect and various possible designs of the first aspect.

[0160] In a sixth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the voice response method as described in the first aspect above and various possible designs of the first aspect.

[0161] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0162] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0163] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A voice response method, characterized in that, Applied to an earphone case, the voice response method includes: Obtain the inquiry voice information; With the earphones in the earphone case, the camera mounted on the earphones is controlled to capture a first image; The first response voice information is obtained from the query voice information. The first response voice information is information related to the first image. The first image and the query voice information are processed by a pre-trained dialogue model to obtain the first response voice information. Play the first reply voice message.

2. The voice response method according to claim 1, characterized in that, The first response voice information obtained from the inquiry voice information includes: Receive the first image transmitted by the earphone; The first image and the query voice information are input into a pre-trained dialogue model for processing to obtain the first response voice information to the query voice information.

3. The voice response method according to claim 1, characterized in that, The first response voice information obtained from the inquiry voice information includes: Receive the first image transmitted by the earphone; The terminal device sends the first image and the query voice information to the terminal device, which processes the first image and the query voice information through a pre-trained dialogue model to obtain the first response voice information of the query voice information. Receive the first reply voice message sent by the terminal device.

4. The voice response method according to claim 1, characterized in that, The first response voice information obtained from the inquiry voice information includes: The inquiry voice information is transmitted to the headset; The headset receives the first response voice information transmitted by the headset. The headset is used to process the first image and the query voice information through a pre-trained dialogue model to obtain the first response voice information of the query voice information.

5. The voice response method according to any one of claims 1 to 4, characterized in that, Also includes: In the absence of the earphones in the earphone case, a second response voice message to the inquiry voice message is determined, and the inquiry voice message is processed by the dialogue model to obtain the second response voice message; Play the second reply voice message.

6. The voice response method according to any one of claims 1 to 4, characterized in that, Also includes: Receive at least one second image transmitted by the earphone, the at least one second image being an image stored in the earphone, and the at least one second image being captured by the earphone outside the earphone case; The at least one second image is stored in the earphone case, and the at least one second image stored in the earphone is deleted.

7. The voice response method according to claim 1, characterized in that, Also includes: The text information corresponding to the first reply voice message is displayed on the screen of the earphone box.

8. An earphone case, characterized in that, The earphone case includes: The acquisition unit is used to acquire inquiry voice information when the earphone is in the earphone case; A control unit is used to control the camera mounted on the earphones to capture a first image; The processing unit is configured to obtain first response voice information of the inquiry voice information, wherein the first response voice information is information related to the first image, and the first image and the inquiry voice information are processed by a pre-trained dialogue model to obtain the first response voice information. The playback unit is used to play the first reply voice information.

9. A headphone system, characterized in that, Includes earphones and an earphone case, the earphones carrying a camera, and the earphone case being used for: When the earphones are in the earphone case, query voice information is collected; The camera mounted on the headphones is controlled to capture a first image; The first response voice information is obtained from the query voice information. The first response voice information is information related to the first image. The first image and the query voice information are processed by a pre-trained dialogue model to obtain the first response voice information. Play the first reply voice message.

10. An electronic device, characterized in that, include: Processor and memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the voice response method as described in any one of claims 1 to 7.

11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, implement the voice response method as described in any one of claims 1 to 7.

12. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the voice response method as described in any one of claims 1 to 7.

Images