Control methods, apparatus and device, and earphone

Abstract

Provided in the embodiments of the present disclosure are control methods, apparatus and device, and an earphone. A method comprises: a control device receiving a user instruction and at least one first image which are sent by earphones, the first image being acquired by cameras in the earphones; on the basis of the user instruction and the at least one first image, determining target acquisition configuration information of the cameras, the cameras being arranged in the earphones, and the target acquisition configuration information being used for instructing to control a camera in a left earphone and / or a camera in a right earphone to acquire images; and sending to the earphones the target acquisition configuration information. Another method comprises: earphones acquiring a user instruction and target acquisition configuration information; acquiring wearing information of the earphones, the wearing information being used for indicating the wearing state of a left earphone and the wearing state of a right earphone, and the wearing state being a worn state or an unworn state; and, on the basis of the user instruction, the target acquisition configuration information and the wearing information, controlling a camera to acquire at least one environment image.

Description

Control methods, devices and headphones

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202411525577.4, filed on October 29, 2024, entitled "Control Method, Apparatus and Headphones", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This disclosure relates to the field of computer and network communication technology, and in particular to a control method, device, and headphones. Background Technology

[0004] With the improvement of terminal device hardware performance and the continuous advancement of artificial intelligence technology, it is possible to collect personal data through cameras in electronic devices, enabling more accurate human-computer interaction with users. Summary of the Invention

[0005] This disclosure provides a control method, an apparatus, and headphones.

[0006] In a first aspect, embodiments of this disclosure provide a control method applied to a control device, the method comprising:

[0007] Receive user commands and at least one first image sent by the headset, wherein the first image is captured by the camera in the headset;

[0008] Based on the user instruction and the at least one first image, target acquisition configuration information of the camera is determined, wherein the camera is installed in the earphone, and the target acquisition configuration information is used to instruct the camera in the left earphone and / or the camera in the right earphone to acquire images.

[0009] The target acquisition configuration information is sent to the headset so that the headset controls the camera to acquire at least one environmental image according to the target acquisition configuration information.

[0010] Secondly, embodiments of this disclosure provide a control method applied to headphones, wherein the headphones are equipped with a camera, the method comprising:

[0011] Obtain user commands and target acquisition configuration information;

[0012] The wearing information of the earphones is obtained, and the wearing information is used to indicate the wearing status of the left earphone and the wearing status of the right earphone, wherein the wearing status is either worn or not worn.

[0013] Based on the user instructions, the target acquisition configuration information, and the wearing information, the camera is controlled to acquire at least one environmental image.

[0014] Thirdly, embodiments of this disclosure provide a control device, including:

[0015] A receiving module is used to receive user commands and at least one first image sent by the headset, wherein the first image is captured by a camera in the headset.

[0016] A determining module is configured to determine target acquisition configuration information of a camera based on the user instruction and the at least one first image, wherein the camera is disposed in an earphone, and the target acquisition configuration information is used to instruct the camera in the left earphone and / or the camera in the right earphone to acquire images;

[0017] The sending module is used to send the target acquisition configuration information to the headset, so that the headset controls the camera to acquire at least one environmental image according to the target acquisition configuration information.

[0018] Fourthly, embodiments of this disclosure provide a control device, including:

[0019] The first acquisition module is used to acquire user commands and target acquisition configuration information;

[0020] The second acquisition module is used to acquire the wearing information of the earphones. The wearing information is used to indicate the wearing status of the left earphone and the wearing status of the right earphone. The wearing status is either a worn status or a non-worn status.

[0021] The control module is used to control the camera to acquire at least one environmental image according to the user instructions, the target acquisition configuration information, and the wearing information.

[0022] Fifthly, embodiments of this disclosure provide a control device, including: a processor and a memory;

[0023] The memory stores computer-executed instructions;

[0024] The processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the control method described in the first aspect and various possible designs of the first aspect.

[0025] Sixthly, embodiments of this disclosure provide an earphone, including: a processor and a memory;

[0026] The memory stores computer-executed instructions;

[0027] The processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the control method described in the various possible designs of the first and second aspects above.

[0028] In a seventh aspect, embodiments of this disclosure provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the control method described in any of the first or second aspects above.

[0029] Eighthly, embodiments of this disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the control method described in any of the first aspects or any of the second aspects above.

[0030] The control method, device, and earphone provided in this embodiment allow the control device to determine target acquisition configuration information based on user instructions and at least one first image captured by the earphone, and then send the target acquisition configuration information to the earphone. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0032] Figure 1A is a schematic diagram of an application scenario provided by an embodiment of this disclosure;

[0033] Figure 1B is a schematic diagram of another application scenario provided by the embodiments of this disclosure;

[0034] Figure 2 is a flowchart illustrating a control method provided in an embodiment of this disclosure;

[0035] Figure 3 is a flowchart illustrating another control method provided in an embodiment of this disclosure;

[0036] Figure 4 is a flowchart illustrating another control method provided in an embodiment of this disclosure;

[0037] Figure 5 is a schematic diagram of the control process provided in an embodiment of this disclosure;

[0038] Figure 6 is a schematic diagram of a control device provided in an embodiment of this disclosure;

[0039] Figure 7 is a schematic diagram of another control device provided in an embodiment of this disclosure;

[0040] Figure 8 is a schematic diagram of another control device provided in an embodiment of this disclosure;

[0041] Figure 9 is a schematic diagram of another control device provided in an embodiment of this disclosure;

[0042] Figure 10 is a schematic diagram of the structure of the control device provided in an embodiment of this disclosure;

[0043] Figure 11 is a schematic diagram of the structure of the earphone provided in an embodiment of this disclosure. Detailed Implementation

[0044] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0045] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with relevant laws, regulations and standards, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0046] With the improvement of terminal device hardware performance and the continuous advancement of artificial intelligence technology, it is possible to collect personal data through cameras in electronic devices, enabling more accurate human-computer interaction with users.

[0047] In practical applications, keeping the camera in an electronic device operational consumes a significant amount of power, and wearable devices (such as headphones) have limited space to accommodate batteries. If a camera is installed on a wearable device, the power requirements for the camera will be even higher. Therefore, it is crucial to consider how to rationally configure camera usage strategies to reduce power consumption while still meeting user needs.

[0048] This disclosure provides a control method, device, and headphones to overcome the problem of high energy consumption during the use of wearable devices.

[0049] The control method, device, and earphones provided in this embodiment allow the control device to determine target acquisition configuration information based on user instructions and at least one first image captured by the earphones, and then send the target acquisition configuration information to the earphones. Since the target acquisition configuration information is used to instruct the camera in the left earphone and / or the camera in the right earphone to capture images, the earphones can control at least one camera in the earphones to capture at least one environmental image based on the target acquisition control information. This avoids the possibility of both cameras simultaneously capturing at least one environmental image each time the earphones capture images, thus reducing the energy consumption of the wearable device during use while meeting user needs.

[0050] For ease of understanding, the application scenarios applicable to the embodiments of this disclosure will be described below with reference to Figures 1A and 1B.

[0051] Figure 1A is a schematic diagram of an application scenario provided by an embodiment of this disclosure. Referring to Figure 1A, it includes an earphone 101 and a terminal device 102. The earphone 101 can be a headset, and the earphone 101 has a camera installed. The terminal device 102 can be a mobile phone, tablet computer, etc. A wireless connection can be established between the earphone 101 and the terminal device 102, such as a Bluetooth connection or a Wi-Fi connection. After wearing the earphone 101, the user can control the earphone 101 to acquire at least one environmental image through the terminal device 102 or user commands. User commands can be gestures, voice commands, or touch controls on the earphone 101. The terminal device 102 can acquire at least one environmental image and process it.

[0052] Figure 1B is a schematic diagram of another application scenario provided by an embodiment of this disclosure. Referring to Figure 1B, it includes an earphone 101 and a server 103. The earphone 101 and the server 103 can establish a connection via a wireless network, local area network, or other means. After wearing the earphone 101, the user can control the earphone 101 to capture images via user commands. The server 103 can acquire at least one environmental image and process at least one environmental image.

[0053] In practical applications, wearable devices (such as headphones) have limited space to accommodate batteries. If a camera is installed on the wearable device, the power requirements for the camera will be even higher. Therefore, it is important to consider how to rationally configure camera usage strategies to reduce power consumption while still meeting user needs.

[0054] In this embodiment, a control device is provided. The control device can determine target acquisition configuration information based on user instructions and at least one first image captured by the earpieces, and send the target acquisition configuration information to the earpieces. Since the target acquisition configuration information is used to instruct the camera in the left earpiece and / or the camera in the right earpiece to capture images, the earpieces can control at least one camera in the earpieces to capture at least one environmental image based on the target acquisition configuration information. This avoids the possibility of both cameras simultaneously capturing at least one environmental image each time the earpieces capture images, reducing the energy consumption of the wearable device during use while meeting user needs.

[0055] The method disclosed herein will now be described through specific embodiments. It should be noted that the following embodiments may exist independently or in combination with each other; identical or similar content will not be repeated in different embodiments.

[0056] Figure 2 is a flowchart illustrating a control method provided in an embodiment of this disclosure. Referring to Figure 2, the method may include:

[0057] S201, The control device receives user instructions and at least one first image sent by the headset.

[0058] The first image was captured by the camera in the headphones.

[0059] The control device can be a terminal device or a server. The terminal device can be a mobile phone, tablet computer, computer, etc.

[0060] After receiving a user instruction, if the earphone determines that the user instruction instructs the camera to capture an image, it captures at least one first image and sends the user instruction and at least one first image to the control device.

[0061] An artificial intelligence model can be used to determine whether a user command instructs the camera to capture an image. This AI model can be integrated into the control device. After the earphones receive the user command, they send it to the control device. The control device then uses the AI ​​model to determine whether the user command instructs the camera to capture an image.

[0062] Optionally, an artificial intelligence model can be incorporated into the headphones to analyze the semantics or text corresponding to user commands. This allows the headphones to process user commands using the AI ​​model to determine whether the command instructs the camera to capture an image.

[0063] When the earphone captures the first image, it can first determine whether historical capture configuration information is stored in the earphone. If so, it controls the camera in the earphone to capture at least one first image according to the historical capture configuration information. If not, it obtains preset capture configuration information and controls the camera in the earphone to capture at least one first image according to the preset capture configuration information.

[0064] The preset image capture configuration information is used to instruct the cameras in the left and right earbuds to capture images. This preset configuration information can be set in advance and stored in the earbuds' preset storage space.

[0065] For example, after wearing the earphones, a user inputs the voice command, "Doubao, Doubao, help me see the color of the water in front of me." The earphones capture the user's voice and generate a user command. An artificial intelligence model then determines that the user command instructs the camera to capture an image. At this point, the earphones determine that they have stored historical capture configuration information. This historical configuration information is used to instruct the camera in the left earphone to capture an image. Therefore, the camera in the left earphone captures at least one first image. The earphones then send the user command and at least one first image to the control device.

[0066] For example, if the headphones are being used for the first time, it can be determined that no historical data acquisition configuration information is stored in the headphones. In this case, the headphones can control the camera in the headphones to acquire at least one first image based on the preset data acquisition configuration information.

[0067] S202. The control device determines the target acquisition configuration information of the camera based on the user instruction and at least one first image.

[0068] The camera is located in the earphone, and the target acquisition configuration information is used to instruct the camera in the left earphone and / or the camera in the right earphone to acquire images.

[0069] The target acquisition configuration information of the camera can be determined in the following way based on user instructions and at least one first image: obtain historical acquisition configuration information, which is the acquisition configuration information corresponding to the acquisition of at least one first image; determine the target acquisition configuration information based on user instructions, at least one first image and historical acquisition configuration information.

[0070] After determining the target acquisition configuration information, the control device stores the target acquisition configuration information.

[0071] If the control device can determine the response voice corresponding to the user command based on at least one first image, then the historical acquisition configuration information can be determined as the target acquisition configuration information. If the control device cannot determine the response voice corresponding to the user command based on at least one first image, then it needs to determine the target acquisition configuration information based on at least one first image and the user command, so that the control device can determine the response voice corresponding to the user command based on at least one environmental image acquired using the target acquisition configuration information.

[0072] For example, as illustrated above, the user command is determined to be "Doubao, Doubao, help me see the color of the water in front of me." Assume the historical acquisition configuration information obtained by the control device is used to instruct the camera in the left earpiece to capture an image. In this case, the control device determines that the image acquired based on the historical acquisition configuration information can yield the corresponding voice response to the user command. Therefore, the control device determines the target acquisition configuration information to be the historical acquisition configuration information.

[0073] For example, as illustrated above, the user command is determined to be "Doubao, Doubao, help me see how tall the tree in the distance is." Assume the historical acquisition configuration information acquired by the control device is used to instruct the camera in the left earbud to capture images and the camera in the right earbud to capture images. In this case, the control device determines that the images acquired based on the historical acquisition configuration information cannot produce the corresponding voice response to the user command. Therefore, based on the user command, at least one first image, and the historical acquisition configuration information, the target acquisition configuration information is determined to instruct the camera in the left earbud to capture images and the camera in the right earbud to capture images. The control device stores the target acquisition configuration information.

[0074] S203. The control device sends target acquisition configuration information to the headset, so that the headset controls the camera to acquire at least one environmental image according to the target acquisition configuration information.

[0075] The control device sends target acquisition configuration information to the headset, so that the headset controls the camera to acquire at least one environmental image according to the target acquisition configuration information.

[0076] S204. The headset acquires user commands and target acquisition configuration information.

[0077] After receiving a user command, the headset can determine whether the user command instructs the camera to capture an image. If so, it retrieves the target capture configuration information.

[0078] S205, The earphone obtains the earphone wearing information.

[0079] Wearing information indicates the wearing status of the left earphone and the right earphone, which can be either worn or not.

[0080] The headphones are equipped with sensors that can obtain information about how the headphones are worn.

[0081] For example, as illustrated above, the user command is determined to be "Doubao, Doubao, help me see the color of the water in front of me." The target acquisition configuration information obtained by the earphones is used to instruct the camera in the left earphone to capture images and the camera in the right earphone to capture images. The earphone wearing information is used to indicate that the left earphone is being worn and the right earphone is not being worn.

[0082] S206. The earphone controls the camera to capture at least one environmental image based on user instructions, target acquisition configuration information, and wearing information.

[0083] The camera can be controlled to capture at least one environmental image based on user instructions, target acquisition configuration information, and wearing information in the following manner: when the user instruction instructs the camera to capture an image, it is determined whether the target acquisition configuration information matches the wearing information; in response to the target acquisition configuration information matching the wearing information, the camera is controlled to capture at least one environmental image based on the target acquisition configuration information; in response to the target acquisition configuration information not matching the wearing information, a prompt message is generated to indicate that the target acquisition configuration information does not match the wearing information.

[0084] For example, as illustrated above, the target acquisition configuration information is used to instruct the camera in the left earbud to capture images and the camera in the right earbud to capture images. The earbud wearing information is used to indicate that the left earbud is being worn and the right earbud is not. Therefore, it can be determined that the target acquisition configuration information and the wearing information do not match. At this point, the earbuds generate a prompt message to indicate this mismatch. The prompt message can take the form of voice, light effects, vibration, etc.

[0085] The control method provided in this embodiment involves a control device receiving a user instruction and at least one first image from an earphone. The control device determines target acquisition configuration information for a camera based on the user instruction and the first image. The control device then sends the target acquisition configuration information to the earphone. The earphone acquires the user instruction and the target acquisition configuration information. The earphone acquires its wearing information. Based on the user instruction, the target acquisition configuration information, and the wearing information, the earphone controls the camera to acquire at least one environmental image. In this process, the target acquisition configuration information is used to instruct the camera in the left earphone and / or the camera in the right earphone to acquire images. The earphone can control at least one camera in the earphone to acquire at least one environmental image based on the target acquisition control information. This avoids the possibility of both cameras simultaneously acquiring at least one environmental image each time the earphone acquires an image, reducing the earphone's energy consumption during use while meeting user needs.

[0086] Based on any of the above embodiments, the detailed process of controlling the control device will be described below with reference to Figure 3.

[0087] Figure 3 is a flowchart illustrating another control method provided in an embodiment of this disclosure. Referring to Figure 3, the method includes:

[0088] S301, Receive user instructions and at least one first image sent by the headset.

[0089] The execution entity in the embodiment shown in Figure 3 can be a control device, or a chip, chip module, or control unit disposed within the control device. The control unit can be implemented through software or a combination of software and hardware. The control device can be a server or a terminal device. If the control device is a terminal device, it can be a terminal device that establishes a connection with the headset. The connection method between the terminal device and the headset can be Bluetooth, wireless network, or other methods.

[0090] It should be noted that the execution process of S301 can be found in S201, and will not be repeated here.

[0091] S302. Obtain historical data collection configuration information.

[0092] The historical acquisition configuration information is the acquisition configuration information corresponding to the acquisition of the at least one first image.

[0093] For example, suppose the user command received by the earpiece is "Doubao, Doubao, help me search for similar styles of this dress." The earpiece determines that the user command instructs the camera to capture an image. The earpiece then retrieves historical capture configuration information and captures at least one first image based on this information. After receiving the user command and at least one first image from the earpiece, the control device determines that the historical capture configuration information is used to instruct the camera in the left earpiece to capture an image, or the camera in the right earpiece to capture an image.

[0094] S303. Determine whether the user instruction is an associated instruction of a historical user instruction.

[0095] Historical user commands are user commands corresponding to historically collected configuration information.

[0096] The historical data collection configuration information is determined based on historical user instructions.

[0097] Artificial intelligence models can be used to determine whether a user command is a related command to a historical user command. These AI models are integrated into the control device.

[0098] For example, historical configuration information is determined based on the user instruction "Doubao, Doubao, help me see the color of the water in front of me." Therefore, the historical user instruction is "Doubao, Doubao, help me see the color of the water in front of me." The control device, based on the historical user instruction and the current user instruction, uses an artificial intelligence model to determine whether the current user instruction is a related instruction to the historical user instruction.

[0099] In response to a user instruction that is an associated instruction of a historical user instruction, execute S304.

[0100] In response to a user instruction that is not an associated instruction of a previous user instruction, execute S307.

[0101] S304. According to the user's instructions, process at least one first image to obtain the target region.

[0102] The target region includes at least one target object.

[0103] At least one first image can be processed using an artificial intelligence model to obtain the target region. The artificial intelligence model can be a multimodal large language model (MLLM).

[0104] Before processing at least one first image using an artificial intelligence model, the model can be trained to accurately determine the target region in various scenarios.

[0105] The following describes the training process of the artificial intelligence model. The camera's hotspot is defined around the ear. Paired image acquisition is performed by calculating the overlap between the camera's effective range and the user's everyday field of vision to obtain the training dataset. Then, based on the image results output by the segmentation model, points of interest (POIs) in the images are labeled to determine the target region.

[0106] The training dataset may include at least one image captured by a single earphone, and at least one POI label in each image; or at least one image captured by a dual earphone, and at least one POI label in each image. The training dataset can be collected through video collection or natural language description.

[0107] Video collection specifically involves gathering a large amount of high-quality video data, covering various scenes and actions. These videos can come from publicly available datasets, camera-captured videos, or obtained through other means. Natural language description collection specifically involves collecting or generating corresponding natural language descriptions for each video segment. These descriptions should be detailed and accurate, capable of describing the scene, actions, or events in the video.

[0108] For example, firstly, a frame from a video is segmented into multiple sub-images labeled with Points of Interest (POIs) using a segmentation model. Each POI can be represented numerically. For instance, two potted plants in the image are segmented and assigned numerical labels 15 and 20 respectively. This data is then used as a pre-training dataset. A suitable AI model architecture (e.g., the CLIP model based on the Transformer architecture) is determined, capable of handling both video and natural language. Supervised learning is then performed on the model using the dataset, allowing it to learn the relationship between videos and corresponding semantic descriptions. This enables comparative learning between video frames and natural language descriptions, resulting in strong cross-modal understanding capabilities. The model automatically learns the association between video and text from the data. Once trained, the model can effectively identify multiple target regions of the user.

[0109] For example, based on the user's instruction "Doubao Doubao, help me search for similar styles of this dress", an artificial intelligence model processes at least one first image to obtain the target area as the area A1 in front of the user.

[0110] S305, Get the candidate area.

[0111] The candidate area is determined based on historical user commands.

[0112] When the candidate region is a historical user command, the target region is determined by an artificial intelligence model.

[0113] For example, when the user command is the historical user command "Doubao Doubao, help me see the color of the water in front of me", the target area is determined by the artificial intelligence model to be area A1 in front of the user. Therefore, area A1 is determined as the candidate area.

[0114] S306. Determine the target data acquisition configuration information based on the candidate area, the target area, and the historical data acquisition configuration information.

[0115] The target acquisition configuration information can be determined based on the candidate area, the target area, and historical acquisition configuration information in the following ways: determine whether the candidate area matches the target area; in response to the candidate area matching the target area, determine the historical acquisition configuration information as the target acquisition configuration information; in response to the candidate area not matching the target area, determine the target acquisition configuration information based on the target area.

[0116] For example, as illustrated above, the target area is determined to be area A1, and the candidate area is also area A1. Therefore, it can be determined that the candidate area matches the target area, and the historical acquisition configuration information is then determined as the target acquisition configuration information. The target acquisition configuration information is used to instruct the camera in the left earphone to acquire images, or the camera in the right earphone to acquire images.

[0117] The target acquisition configuration information can be determined based on the target area in the following ways: determine the area type of the target area; in response to the area type of the target area being far-field type, determine the target acquisition configuration information to instruct the camera in the left earphone or the camera in the right earphone to acquire images; in response to the area type of the target area being near-field type, determine the target acquisition configuration information to instruct the camera in the left earphone and the camera in the right earphone to acquire images.

[0118] The region type of the target region can be determined based on the initial distance between the target region and the user. If the initial distance between the target region and the user is less than or equal to a preset distance, the region type is determined to be near-field. If the initial distance between the target region and the user is greater than the preset distance, the region type is determined to be far-field.

[0119] The first distance can be the distance between the center of the target area and the user. This first distance can be determined based on a preset algorithm.

[0120] For example, suppose the user's instruction is "Doubao, Doubao, help me see how high the table to my left is." Using an artificial intelligence model, at least one first image is processed to obtain the target area as the user's left front region A2. Based on the example above, the candidate region is determined to be region A1. Therefore, it can be determined that the candidate region and the target region do not match. At this point, the first distance between the target region and the user is determined to be 0.5 meters. Since this first distance is less than the preset distance of 1 meter, the region type of the target region can be determined to be near-field. Based on the near-field type, the target acquisition configuration information is determined to instruct the cameras in the left and right earpieces to acquire images.

[0121] After S306, execute S309.

[0122] S307. According to the user's instructions, process at least one first image to obtain the target region.

[0123] The target region includes at least one target object.

[0124] It should be noted that the execution process of S307 can be found in S304, and will not be repeated here.

[0125] S308. Determine the target acquisition configuration information based on the target area.

[0126] For example, suppose the user command is "Doubao, Doubao, help me see how tall the tree in the distance is." Based on the example above, the historical user command is determined to be "Doubao, Doubao, help me see the color of the water in front of me." Therefore, it can be determined that the user command is not a related command to the historical user command. At this time, the control device directly processes at least one first image according to the user command to obtain the target area as region B1 in the distance in front of the user. The control device determines that the region type of the target area is far-field type, and can then determine that the target acquisition configuration information is used to instruct the camera in the left earphone, or the camera in the right earphone, to acquire the image.

[0127] S309. Send target acquisition configuration information to the headset so that the headset controls the camera to acquire at least one environmental image according to the target acquisition configuration information.

[0128] After the headset controls the camera to capture at least one environmental image based on the target acquisition configuration information, the control device can receive at least one environmental image sent by the headset; process the at least one environmental image according to the user's instructions to obtain the corresponding reply voice; and send the reply voice to the headset.

[0129] For example, as illustrated above, if the user command is "Doubao, Doubao, help me see the color of the water in front of me," the target acquisition configuration information is used to instruct either the camera in the left earbud to capture an image, or the camera in the right earbud to capture an image. After the earbuds control the cameras to capture at least one environmental image according to the target acquisition configuration information, they send that image to the control device. The control device, based on the user command, processes the at least one environmental image using an artificial intelligence model to obtain the corresponding voice response: "The water in front of you is orange." The control device then sends the voice response back to the earbuds.

[0130] Optionally, when the target acquisition configuration information is determined to instruct the camera in the left earbud to capture images, or the camera in the right earbud to capture images, the control device can also determine the recommended earbud to use based on the battery levels of the left and right earbuds and the image quality captured by the left and right earbuds. This can improve the earbud's usage time and shooting effect.

[0131] The control method provided in this disclosure receives a user command and at least one first image sent by an earpiece. It acquires historical acquisition configuration information. It determines whether the user command is an associated command of a historical user command. In response to the user command being an associated command of a historical user command, it determines target acquisition configuration information based on the user command, at least one first image, and historical acquisition configuration information. In response to the user command not being an associated command of a historical user command, it determines target acquisition configuration information based on at least one first image. The target acquisition configuration information is sent to the earpiece, causing the earpiece to control the camera to acquire at least one environmental image according to the target acquisition configuration information. In the above process, before the earpiece acquires at least one environmental image, the control device can determine the target acquisition configuration information based on the user command, at least one first image, and historical acquisition configuration information. The earpiece can control at least one camera in the earpiece to acquire at least one environmental image according to the target acquisition control information. This avoids the possibility of both cameras simultaneously acquiring at least one environmental image each time the earpiece acquires an image, reducing the energy consumption of the earpiece during use while meeting user needs, thereby increasing the earpiece's usage time. Furthermore, it can determine the target acquisition configuration information based on changes in the target area when the user wears the earpiece, improving the flexibility of earpiece use.

[0132] Based on any of the above embodiments, the detailed process of controlling the headphones will be described below with reference to Figure 4.

[0133] Figure 4 is a flowchart illustrating another control method provided in an embodiment of this disclosure. Referring to Figure 4, the method includes:

[0134] S401. Obtain user instructions and target acquisition configuration information.

[0135] The execution entity shown in Figure 4 can be an earphone, or a chip, chip module, or control device disposed in the earphone. The control device can be implemented by software or by a combination of software and hardware.

[0136] S402, Obtain headphone wearing information.

[0137] It should be noted that the execution process of S401 to S402 can be found in S204 to S205. It will not be repeated here.

[0138] S403. When the user instructs the camera to capture images, determine whether the target capture configuration information matches the wearing information.

[0139] The following methods can be used to determine whether the target acquisition configuration information matches the wearing information: If the target acquisition configuration information is used to indicate that the camera in the left earphone and the camera in the right earphone capture images, and the wearing information is used to indicate that the earphone is being worn but not in a wearing state, then the target acquisition configuration information does not match the wearing information; if the target acquisition configuration information is used to indicate that the camera in the left earphone or the camera in the right earphone capture images, and the wearing information is used to indicate that the left earphone and / or the right earphone is being worn but not in a wearing state, then the target acquisition configuration information matches the wearing information.

[0140] After determining the target acquisition information, the control device receives the target acquisition configuration information sent by the control device; obtains the historical acquisition configuration information; updates the historical acquisition configuration information to the target acquisition configuration information; and stores the target acquisition configuration information.

[0141] S404. In response to the matching of target acquisition configuration information and wearing information, control the camera to acquire at least one environmental image according to the target acquisition configuration information.

[0142] The camera can be controlled to capture at least one environmental image based on the target acquisition configuration information in the following ways: If the target acquisition configuration information is used to instruct the camera in the left earphone or the camera in the right earphone to capture an image, then the battery levels of the left earphone and the right earphone are obtained, and the camera in the left earphone or the camera in the right earphone is controlled to capture at least one environmental image based on the battery levels of the left earphone and the right earphone; If the target acquisition configuration information is used to instruct the camera in both the left earphone and the right earphone to capture an image, then the camera in both the left earphone and the right earphone is controlled to capture at least one environmental image.

[0143] When controlling the camera in the left earbud, or the camera in the right earbud, to capture at least one environmental image, the camera in the earbud with the highest battery level can also be controlled to capture at least one environmental image. This increases the earbud's battery life and improves the user experience.

[0144] The camera can be controlled to capture at least one environmental image based on the target acquisition configuration information in the following manner: if the target acquisition configuration information is used to instruct the camera in the left earphone to capture an image, or the camera in the right earphone to capture an image, then the environmental image captured by the left earphone and the environmental image captured by the right earphone are acquired, and based on the image quality of the environmental image captured by the left earphone and the image quality of the environmental image captured by the right earphone, the left earphone is controlled to capture at least one environmental image, or the right earphone is controlled to capture at least one environmental image.

[0145] Image quality includes image sharpness and the area of ​​the image that is obscured.

[0146] When controlling the camera in the left earbud or the camera in the right earbud to capture at least one environmental image, the camera in the earbud with the best image quality can be controlled to capture at least one environmental image. This improves the quality of the captured images, allowing the artificial model in the control device to more accurately obtain the corresponding voice response to the user's commands.

[0147] The preset algorithm in the headphones can be used to process at least one environmental image to obtain the image quality of the left and right earphones.

[0148] It should be noted that when controlling the camera to capture at least one environmental image, the control of either earphone to capture at least one environmental image can be determined based on the earphone battery level and / or image quality. This disclosure does not impose any limitations.

[0149] For example, suppose the user command received by the earphones is "Doubao, Doubao, help me see what model of car that is in the distance is." The target acquisition configuration information received by the earphones is used to instruct the camera in the left earphone, or the camera in the right earphone, to capture an image. The wearing information received by the earphones indicates that the left earphone is being worn and the right earphone is not being worn. Therefore, the earphones can determine that the target acquisition configuration information matches the wearing information. At this time, it can be determined that the battery level of the left earphone is 60% and the battery level of the right earphone is 80%. Then, the camera in the right earphone can be controlled to capture an image.

[0150] For example, as illustrated above, the target acquisition configuration information is determined to match the wearing information. At this point, environmental images captured by the left earphone and the right earphone can be acquired, and the quality of the environmental image captured by the left earphone is determined to be optimal. Therefore, the camera in the left earphone is controlled to acquire images.

[0151] S405. In response to a mismatch between the target acquisition configuration information and the wearing information, a prompt message is generated.

[0152] The prompt message indicates that the target's data acquisition configuration information does not match the wearer's information.

[0153] S406. Send at least one environmental image to the control device.

[0154] The control method provided in this disclosure acquires user instructions and target acquisition configuration information. It acquires earphone wearing information. When the user instruction instructs the camera to acquire an image, it determines whether the target acquisition configuration information matches the wearing information. In response to a match between the target acquisition configuration information and the wearing information, it controls the camera to acquire at least one environmental image based on the target acquisition configuration information. In response to a mismatch between the target acquisition configuration information and the wearing information, it generates a prompt message. It then sends at least one environmental image to a control device. In this process, the earphone can control at least one camera in the earphone to acquire at least one environmental image based on the target acquisition control information. This avoids the possibility of both cameras simultaneously acquiring at least one environmental image each time the earphone acquires an image, reducing energy consumption during earphone use while meeting user needs, thereby increasing the earphone's usage time. Furthermore, when it is determined that single-ear image acquisition is possible, the earphone can determine whether to control the left or right earphone to acquire an image based on factors such as earphone battery level and image quality, improving the flexibility of earphone use.

[0155] Based on any of the above embodiments, the control process will be illustrated below with reference to Figure 5.

[0156] Figure 5 is a schematic diagram of the control process provided in an embodiment of this disclosure. Referring to Figure 5, it includes an earphone 501 and a control device 502. The earphone 501 is equipped with a camera. The control device 502 can be a terminal device or a server, and it contains an artificial intelligence model. The terminal device can be a mobile phone, tablet computer, computer, etc. After the user wears the earphone 501, the earphone 501 can receive the user's command, "Doubao, Doubao, help me check the temperature of the water in front of me." The earphone 501 determines that the user command instructs the camera to capture an image, and then uses historical acquisition configuration information to instruct the camera in the left earphone or right earphone to capture images. The earphone 501 controls the camera in the left earphone to capture at least one first image. The earphone 501 sends the user command and at least one first image to the control device 502.

[0157] Control device 502 determines that the historical user instruction corresponding to the historical acquisition configuration information is "Doubao, Doubao, help me determine the color of the water in front of me". Based on the historical user instruction and the user instruction, control device 502 uses an artificial intelligence model to determine that the user instruction is an associated instruction of the historical user instruction. Control device 502 processes at least one first image using the artificial intelligence model to obtain the target area as the area C1 in front of the user. Control device 502 obtains the candidate area as the area C1 in front of the user. If control device 502 determines that the candidate area matches the target area using the artificial intelligence model, then the historical acquisition configuration information is determined as the target acquisition configuration information. Control device 502 sends the target acquisition configuration information to headset 501.

[0158] After receiving the target acquisition configuration information, earphone 501 retrieves historical acquisition configuration information and determines that the historical acquisition configuration information is the target acquisition configuration information. Therefore, the earphone does not need to update the stored historical acquisition configuration information. Earphone 501 retrieves wearing information, which indicates that the left and right earphones are being worn. Therefore, earphone 501 determines that the target acquisition configuration information matches the wearing information. Earphone 501 detects that the battery level of the left earphone is 60% and the battery level of the right earphone is 55%. It can then control the camera in the left earphone to capture at least one environmental image. Earphone 501 sends at least one environmental image to the control device 502.

[0159] Control device 502 processes at least one environmental image based on user commands using an artificial intelligence model, obtaining a corresponding voice response: "The water in front of you has a calorie content of 81.33 kcal." Control device 502 then sends the voice response to headset 501. Upon receiving the voice response, headset 501 plays it through its speaker.

[0160] The control process provided in this embodiment includes a control device receiving a user instruction and at least one first image from the earphones. The control device determines target acquisition configuration information for the camera based on the user instruction and the at least one first image. The control device sends the target acquisition configuration information to the earphones. The earphones acquire the user instruction and the target acquisition configuration information. The earphones acquire wearing information. Based on the user instruction, the target acquisition configuration information, and the wearing information, the earphones control the camera to acquire at least one environmental image. In this process, the target acquisition configuration information is used to instruct the camera in the left earphone and / or the camera in the right earphone to acquire images. The earphones can control at least one camera in the earphones to acquire at least one environmental image based on the target acquisition control information. This avoids the possibility of both cameras simultaneously acquiring at least one environmental image each time the earphones acquire images, reducing the energy consumption of the earphones during use while meeting user needs. Furthermore, the control device can determine the target acquisition configuration information based on changes in the target area when the user wears the earphones. Therefore, the earphones can determine whether to control the left or right earphone to acquire images based on factors such as earphone battery level and image quality, improving the flexibility of earphone use.

[0161] Figure 6 is a schematic diagram of a control device provided in an embodiment of this disclosure. For ease of explanation, only the parts relevant to the embodiment of this disclosure are shown. Referring to Figure 6, the control device 600 is disposed in a control equipment, and the control device 600 may include:

[0162] The receiving module 601 is used to receive user instructions and at least one first image sent by the headset, wherein the first image is captured by the camera in the headset;

[0163] The determining module 602 is configured to determine the target acquisition configuration information of the camera based on the user instruction and the at least one first image, wherein the camera is installed in the earphone, and the target acquisition configuration information is used to instruct the camera in the left earphone and / or the camera in the right earphone to acquire images.

[0164] The sending module 603 is used to send the target acquisition configuration information to the headset, so that the headset controls the camera to acquire at least one environmental image according to the target acquisition configuration information.

[0165] According to one or more embodiments of this disclosure, the determining module 602 is specifically used for:

[0166] Obtain historical acquisition configuration information, which is the acquisition configuration information corresponding to the acquisition of the at least one first image;

[0167] The target acquisition configuration information is determined based on the user instruction, the at least one first image, and the historical acquisition configuration information.

[0168] According to one or more embodiments of this disclosure, the determining module 602 is specifically used for:

[0169] Determine whether the user instruction is an associated instruction of the historical user instruction, wherein the historical user instruction is the user instruction corresponding to the historical collection configuration information;

[0170] In response to the user instruction being an associated instruction of the historical user instruction, the target acquisition configuration information is determined based on the user instruction, the at least one first image, and the historical acquisition configuration information;

[0171] In response to the user instruction not being an associated instruction of the historical user instruction, the target acquisition configuration information is determined based on the at least one first image.

[0172] According to one or more embodiments of this disclosure, the determining module 602 is specifically used for;

[0173] According to the user instruction, the at least one first image is processed to obtain a target region, wherein the target region includes at least one target object;

[0174] Obtain a candidate region, which is determined based on the historical user instructions;

[0175] The target acquisition configuration information is determined based on the candidate area, the target area, and the historical acquisition configuration information.

[0176] According to one or more embodiments of this disclosure, the determining module 602 is specifically used for:

[0177] Determine whether the candidate region matches the target region;

[0178] In response to a match between the candidate region and the target region, the historical data collection configuration information is determined as the target data collection configuration information;

[0179] In response to a mismatch between the candidate region and the target region, the target acquisition configuration information is determined based on the target region.

[0180] According to one or more embodiments of this disclosure, the determining module 602 is specifically used for:

[0181] Determine the region type of the target region;

[0182] In response to the target area being of far-field type, the target acquisition configuration information is determined to instruct the camera in the left earphone, or the camera in the right earphone, to acquire images;

[0183] In response to the target area being of the near-field type, the target acquisition configuration information is determined to instruct the camera in the left earphone and the camera in the right earphone to acquire images.

[0184] According to one or more embodiments of this disclosure, the determining module 602 is specifically used for:

[0185] According to the user instruction, the at least one first image is processed to obtain a target region, wherein the target region includes at least one target object;

[0186] Based on the target area, determine the target acquisition configuration information.

[0187] The control device provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0188] Figure 7 is a schematic diagram of another control device provided in an embodiment of this disclosure. For ease of explanation, only the parts relevant to the embodiment of this disclosure are shown. Based on the embodiment shown in Figure 6, and referring to Figure 7, the control device 600 further includes a processing module 604.

[0189] The processing module 604 is used for:

[0190] Receive at least one environmental image transmitted by the headset;

[0191] Based on the user instruction, the at least one environmental image is processed to obtain the response voice corresponding to the user instruction;

[0192] The reply voice is sent to the headset.

[0193] The control device provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0194] Figure 8 is a schematic diagram of another control device provided in an embodiment of this disclosure. For ease of explanation, only the parts relevant to the embodiment of this disclosure are shown. Referring to Figure 8, the control device 800 is disposed in the earphone, and the control device 800 may include:

[0195] The first acquisition module 801 is used to acquire user commands and target acquisition configuration information;

[0196] The second acquisition module 802 is used to acquire the wearing information of the earphones. The wearing information is used to indicate the wearing status of the left earphone and the wearing status of the right earphone. The wearing status is either a worn status or a non-worn status.

[0197] The control module 803 is used to control the camera to acquire at least one environmental image according to the user instruction, the target acquisition configuration information and the wearing information.

[0198] According to one or more embodiments of this disclosure, the control module 803 is specifically used for:

[0199] When the user instruction instructs the camera to capture an image, it is determined whether the target acquisition configuration information matches the wearing information;

[0200] In response to the target acquisition configuration information matching the wearing information, the camera is controlled to acquire at least one environmental image according to the target acquisition configuration information;

[0201] In response to a mismatch between the target acquisition configuration information and the wearing information, a prompt message is generated, which indicates that the target acquisition configuration information and the wearing information do not match.

[0202] According to one or more embodiments of this disclosure, the control module 803 is specifically used for:

[0203] If the target acquisition configuration information is used to instruct the camera in the left earphone to capture images, or the camera in the right earphone to capture images, then the battery level of the left earphone and the battery level of the right earphone are obtained, and the camera in the left earphone or the camera in the right earphone is controlled to capture the at least one environmental image based on the battery level of the left earphone and the battery level of the right earphone.

[0204] If the target acquisition configuration information is used to instruct the camera in the left earphone and the camera in the right earphone to acquire images, then the camera in the left earphone and the camera in the right earphone are controlled to acquire at least one environmental image.

[0205] According to one or more embodiments of this disclosure, the control module 803 is specifically used for:

[0206] If the target acquisition configuration information is used to instruct the camera in the left earphone to capture images, or the camera in the right earphone to capture images, then the environmental images captured by the left earphone and the environmental images captured by the right earphone are acquired, and based on the image quality of the environmental images captured by the left earphone and the environmental images captured by the right earphone, the left earphone is controlled to capture at least one environmental image, or the right earphone is controlled to capture at least one environmental image.

[0207] According to one or more embodiments of this disclosure, the image quality includes image sharpness and the area of ​​image obscuration.

[0208] The control device provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0209] Figure 9 is a schematic diagram of another control device provided in an embodiment of this disclosure. For ease of explanation, only the parts relevant to the embodiment of this disclosure are shown. Based on the embodiment shown in Figure 8, referring to Figure 9, the control device 800 further includes a storage module 804 and a transmission module 805.

[0210] The storage module 804 is used for:

[0211] Receive target acquisition configuration information sent by the control device;

[0212] Retrieve historical data collection configuration information;

[0213] Update the historical acquisition configuration information to the target acquisition configuration information and store the target acquisition configuration information.

[0214] The sending module 805 is used for:

[0215] Send the at least one environmental image to the control device.

[0216] The control device provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0217] Figure 10 is a schematic diagram of the structure of a control device provided in an embodiment of this disclosure. Referring to Figure 10, it shows a schematic diagram of the structure of a control device 1000 suitable for implementing an embodiment of this disclosure. The control device 1000 can be a terminal device or a server. The terminal device can include, but is not limited to, mobile terminals such as mobile phones, laptops, digital radio receivers, personal digital assistants (PDAs), tablet computers, portable media players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The control device shown in Figure 10 is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of this disclosure.

[0218] As shown in Figure 10, the control device 1000 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 1001, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 1002 or a program loaded from storage device 1008 into random access memory (RAM) 1003. The RAM 1003 also stores various programs and data required for the operation of the control device 1000. The processing unit 1001, ROM 1002, and RAM 1003 are interconnected via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0219] Typically, the following devices can be connected to the I / O interface 1005: input devices 1006 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 1007 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1008 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. Communication device 1009 allows the control device 1000 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 10 shows a control device 1000 with various devices, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0220] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1009, or installed from storage device 1008, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of embodiments of this disclosure.

[0221] Figure 11 is a schematic diagram of the structure of an earphone provided in an embodiment of this disclosure. Referring to Figure 11, it shows a schematic diagram of the structure of a control device 1100 suitable for implementing an embodiment of this disclosure. The control device shown in Figure 11 is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this disclosure.

[0222] As shown in Figure 11, the control device 1100 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 1101, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 1102 or a program loaded from storage device 1108 into random access memory (RAM) 1103. The RAM 1103 also stores various programs and data required for the operation of the control device 1100. The processing unit 1101, ROM 1102, and RAM 1103 are interconnected via a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0223] Typically, the following devices can be connected to I / O interface 1105: input devices 1106 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 1107 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1108 including, for example, magnetic tapes, hard disks, etc.; and communication devices 11011. Communication device 11011 allows control device 1100 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 11 shows control device 1100 with various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or included alternatively.

[0224] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 1109, or installed from storage device 1108, or installed from ROM 1102. When the computer program is executed by processing device 1101, it performs the functions defined in the methods of embodiments of this disclosure.

[0225] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in connection with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0226] The aforementioned computer-readable medium may be included in the aforementioned control device or headphones; or it may exist independently and not assembled into the control device or headphones.

[0227] The aforementioned computer-readable medium carries one or more programs that, when executed by the control device or headphones, cause the control device or headphones to perform the methods shown in the above embodiments.

[0228] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0229] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0230] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0231] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0232] In a first aspect, according to one or more embodiments of the present disclosure, a control method is provided, applied to a control device, the method comprising:

[0233] Receive user commands and at least one first image sent by the headset, wherein the first image is captured by the camera in the headset;

[0234] Based on the user instruction and the at least one first image, target acquisition configuration information of the camera is determined, wherein the camera is installed in the earphone, and the target acquisition configuration information is used to instruct the camera in the left earphone and / or the camera in the right earphone to acquire images.

[0235] The target acquisition configuration information is sent to the headset so that the headset controls the camera to acquire at least one environmental image according to the target acquisition configuration information.

[0236] According to one or more embodiments of this disclosure, determining the target acquisition configuration information of the camera based on the user instruction and the at least one first image includes:

[0237] Obtain historical acquisition configuration information, which is the acquisition configuration information corresponding to the acquisition of the at least one first image;

[0238] The target acquisition configuration information is determined based on the user instruction, the at least one first image, and the historical acquisition configuration information.

[0239] According to one or more embodiments of this disclosure, determining the target acquisition configuration information based on the user instruction, the at least one first image, and the historical acquisition configuration information includes:

[0240] Determine whether the user instruction is an associated instruction of the historical user instruction, wherein the historical user instruction is the user instruction corresponding to the historical collection configuration information;

[0241] In response to the user instruction being an associated instruction of the historical user instruction, the target acquisition configuration information is determined based on the user instruction, the at least one first image, and the historical acquisition configuration information;

[0242] In response to the user instruction not being an associated instruction of the historical user instruction, the target acquisition configuration information is determined based on the at least one first image.

[0243] According to one or more embodiments of this disclosure, the target acquisition configuration information is determined based on the user instruction, the at least one first image, and the historical acquisition configuration information, including:

[0244] According to the user instruction, the at least one first image is processed to obtain a target region, wherein the target region includes at least one target object;

[0245] Obtain a candidate region, which is determined based on the historical user instructions;

[0246] The target acquisition configuration information is determined based on the candidate area, the target area, and the historical acquisition configuration information.

[0247] According to one or more embodiments of this disclosure, determining the target data acquisition configuration information based on the candidate region, the target region, and the historical data acquisition configuration information includes:

[0248] Determine whether the candidate region matches the target region;

[0249] In response to a match between the candidate region and the target region, the historical data collection configuration information is determined as the target data collection configuration information;

[0250] In response to a mismatch between the candidate region and the target region, the target acquisition configuration information is determined based on the target region.

[0251] According to one or more embodiments of this disclosure, determining the target acquisition configuration information based on the target area includes:

[0252] Determine the region type of the target region;

[0253] In response to the target area being of far-field type, the target acquisition configuration information is determined to instruct the camera in the left earphone, or the camera in the right earphone, to acquire images;

[0254] In response to the target area being of the near-field type, the target acquisition configuration information is determined to instruct the camera in the left earphone and the camera in the right earphone to acquire images.

[0255] According to one or more embodiments of this disclosure, determining the target acquisition configuration information based on the at least one first image includes:

[0256] According to the user instruction, the at least one first image is processed to obtain a target region, wherein the target region includes at least one target object;

[0257] Based on the target area, determine the target acquisition configuration information.

[0258] According to one or more embodiments of this disclosure, the method further includes:

[0259] Receive at least one environmental image transmitted by the headset;

[0260] Based on the user instruction, the at least one environmental image is processed to obtain the response voice corresponding to the user instruction;

[0261] The reply voice is sent to the headset.

[0262] Secondly, according to one or more embodiments of this disclosure, a control method is provided for use in headphones, wherein a camera is provided in the headphones, the method comprising:

[0263] Obtain user commands and target acquisition configuration information;

[0264] The wearing information of the earphones is obtained, which is used to indicate the wearing status of the left earphone and the wearing status of the right earphone, wherein the wearing status is either worn or not worn.

[0265] Based on the user instructions, the target acquisition configuration information, and the wearing information, the camera is controlled to acquire at least one environmental image.

[0266] According to one or more embodiments of this disclosure, controlling the camera to acquire at least one first image based on the user instruction, the target acquisition configuration information, and the wearing information includes:

[0267] When the user instruction instructs the camera to capture an image, it is determined whether the target acquisition configuration information matches the wearing information;

[0268] In response to the target acquisition configuration information matching the wearing information, the camera is controlled to acquire at least one environmental image according to the target acquisition configuration information;

[0269] In response to a mismatch between the target acquisition configuration information and the wearing information, a prompt message is generated, which indicates that the target acquisition configuration information and the wearing information do not match.

[0270] According to one or more embodiments of this disclosure, controlling the camera to acquire at least one environmental image based on the target acquisition configuration information includes:

[0271] If the target acquisition configuration information is used to instruct the camera in the left earphone to capture images, or the camera in the right earphone to capture images, then the battery level of the left earphone and the battery level of the right earphone are obtained, and the camera in the left earphone or the camera in the right earphone is controlled to capture the at least one environmental image based on the battery level of the left earphone and the battery level of the right earphone.

[0272] If the target acquisition configuration information is used to instruct the camera in the left earphone and the camera in the right earphone to acquire images, then the camera in the left earphone and the camera in the right earphone are controlled to acquire at least one environmental image.

[0273] According to one or more embodiments of this disclosure, controlling the camera to acquire at least one environmental image based on the target acquisition configuration information includes:

[0274] If the target acquisition configuration information is used to instruct the camera in the left earphone to capture images, or the camera in the right earphone to capture images, then the environmental images captured by the left earphone and the environmental images captured by the right earphone are acquired, and based on the image quality of the environmental images captured by the left earphone and the environmental images captured by the right earphone, the left earphone is controlled to capture at least one environmental image, or the right earphone is controlled to capture at least one environmental image.

[0275] According to one or more embodiments of this disclosure, the image quality includes image sharpness and the area of ​​image obscuration.

[0276] According to one or more embodiments of this disclosure, the method further includes:

[0277] Receive target acquisition configuration information sent by the control device;

[0278] Retrieve historical data collection configuration information;

[0279] Update the historical acquisition configuration information to the target acquisition configuration information and store the target acquisition configuration information.

[0280] According to one or more embodiments of this disclosure, the method further includes:

[0281] Send the at least one environmental image to the control device.

[0282] Thirdly, according to one or more embodiments of this disclosure, a control device is provided, comprising:

[0283] A receiving module is used to receive user commands and at least one first image sent by the headset, wherein the first image is captured by a camera in the headset.

[0284] A determining module is configured to determine target acquisition configuration information of a camera based on the user instruction and the at least one first image, wherein the camera is disposed in an earphone, and the target acquisition configuration information is used to instruct the camera in the left earphone and / or the camera in the right earphone to acquire images;

[0285] The sending module is used to send the target acquisition configuration information to the headset, so that the headset controls the camera to acquire at least one environmental image according to the target acquisition configuration information.

[0286] According to one or more embodiments of this disclosure, the determining module is specifically used for:

[0287] Obtain historical acquisition configuration information, which is the acquisition configuration information corresponding to the acquisition of the at least one first image;

[0288] The target acquisition configuration information is determined based on the user instruction, the at least one first image, and the historical acquisition configuration information.

[0289] According to one or more embodiments of this disclosure, the determining module is specifically used for:

[0290] Determine whether the user instruction is an associated instruction of the historical user instruction, wherein the historical user instruction is the user instruction corresponding to the historical collection configuration information;

[0291] In response to the user instruction being an associated instruction of the historical user instruction, the target acquisition configuration information is determined based on the user instruction, the at least one first image, and the historical acquisition configuration information;

[0292] In response to the user instruction not being an associated instruction of the historical user instruction, the target acquisition configuration information is determined based on the at least one first image.

[0293] According to one or more embodiments of this disclosure, the determining module is specifically used for;

[0294] According to the user instruction, the at least one first image is processed to obtain a target region, wherein the target region includes at least one target object;

[0295] Obtain a candidate region, which is determined based on the historical user instructions;

[0296] The target acquisition configuration information is determined based on the candidate area, the target area, and the historical acquisition configuration information.

[0297] According to one or more embodiments of this disclosure, the determining module is specifically used for:

[0298] Determine whether the candidate region matches the target region;

[0299] In response to a match between the candidate region and the target region, the historical data collection configuration information is determined as the target data collection configuration information;

[0300] In response to a mismatch between the candidate region and the target region, the target acquisition configuration information is determined based on the target region.

[0301] According to one or more embodiments of this disclosure, the determining module is specifically used for:

[0302] Determine the region type of the target region;

[0303] In response to the target area being of far-field type, the target acquisition configuration information is determined to instruct the camera in the left earphone, or the camera in the right earphone, to acquire images;

[0304] In response to the target area being of the near-field type, the target acquisition configuration information is determined to instruct the camera in the left earphone and the camera in the right earphone to acquire images.

[0305] According to one or more embodiments of this disclosure, the determining module is specifically used for:

[0306] According to the user instruction, the at least one first image is processed to obtain a target region, wherein the target region includes at least one target object;

[0307] Based on the target area, determine the target acquisition configuration information.

[0308] According to one or more embodiments of this disclosure, the apparatus further includes a processing module.

[0309] The processing module is used for:

[0310] Receive at least one environmental image transmitted by the headset;

[0311] Based on the user instruction, the at least one environmental image is processed to obtain the response voice corresponding to the user instruction;

[0312] The reply voice is sent to the headset.

[0313] Fourthly, according to one or more embodiments of this disclosure, a control device is provided, comprising:

[0314] The first acquisition module is used to acquire user commands and target acquisition configuration information;

[0315] The second acquisition module is used to acquire the wearing information of the earphones. The wearing information is used to indicate the wearing status of the left earphone and the wearing status of the right earphone. The wearing status is either a worn status or a non-worn status.

[0316] The control module is used to control the camera to acquire at least one environmental image according to the user instructions, the target acquisition configuration information, and the wearing information.

[0317] According to one or more embodiments of this disclosure, the control module is specifically used for:

[0318] When the user instruction instructs the camera to capture an image, it is determined whether the target acquisition configuration information matches the wearing information;

[0319] In response to the target acquisition configuration information matching the wearing information, the camera is controlled to acquire at least one environmental image according to the target acquisition configuration information;

[0320] In response to a mismatch between the target acquisition configuration information and the wearing information, a prompt message is generated, which indicates that the target acquisition configuration information and the wearing information do not match.

[0321] According to one or more embodiments of this disclosure, the control module is specifically used for:

[0322] If the target acquisition configuration information is used to instruct the camera in the left earphone to capture images, or the camera in the right earphone to capture images, then the battery level of the left earphone and the battery level of the right earphone are obtained, and the camera in the left earphone or the camera in the right earphone is controlled to capture the at least one environmental image based on the battery level of the left earphone and the battery level of the right earphone.

[0323] If the target acquisition configuration information is used to instruct the camera in the left earphone and the camera in the right earphone to acquire images, then the camera in the left earphone and the camera in the right earphone are controlled to acquire at least one environmental image.

[0324] According to one or more embodiments of this disclosure, the control module is specifically used for:

[0325] If the target acquisition configuration information is used to instruct the camera in the left earphone to capture images, or the camera in the right earphone to capture images, then the environmental images captured by the left earphone and the environmental images captured by the right earphone are acquired, and based on the image quality of the environmental images captured by the left earphone and the environmental images captured by the right earphone, the left earphone is controlled to capture at least one environmental image, or the right earphone is controlled to capture at least one environmental image.

[0326] According to one or more embodiments of this disclosure, the image quality includes image sharpness and the area of ​​image obscuration.

[0327] According to one or more embodiments of this disclosure, the apparatus further includes a storage module and a transmission module.

[0328] The storage module is used for:

[0329] Receive target acquisition configuration information sent by the control device;

[0330] Retrieve historical data collection configuration information;

[0331] Update the historical acquisition configuration information to the target acquisition configuration information and store the target acquisition configuration information.

[0332] The sending module is used for:

[0333] Send the at least one environmental image to the control device.

[0334] Fifthly, embodiments of this disclosure provide a control device, including: a processor and a memory;

[0335] The memory stores computer-executed instructions;

[0336] The processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the control method described in the first aspect and various possible designs of the first aspect.

[0337] Sixthly, embodiments of this disclosure provide an earphone, including: a processor and a memory;

[0338] The memory stores computer-executed instructions;

[0339] The processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the control method described in the various possible designs of the first and second aspects above.

[0340] In a seventh aspect, embodiments of this disclosure provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the control method described in any of the first or second aspects above.

[0341] Eighthly, embodiments of this disclosure provide a computer program product, including a computer program that, when executed by a processor, implements the control method described in any of the first aspects or any of the second aspects above.

[0342] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0343] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0344] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A control method applied to a control device, the method comprising: Receive user commands and at least one first image sent by the headset, wherein the first image is captured by the camera in the headset; Based on the user instruction and the at least one first image, target acquisition configuration information of the camera is determined, wherein the camera is installed in the earphone, and the target acquisition configuration information is used to instruct the camera in the left earphone and / or the camera in the right earphone to acquire images. The target acquisition configuration information is sent to the headset so that the headset controls the camera to acquire at least one environmental image according to the target acquisition configuration information.

2. The control method according to claim 1, wherein, Based on the user instruction and the at least one first image, determine the target acquisition configuration information of the camera, including: Obtain historical acquisition configuration information, which is the acquisition configuration information corresponding to the acquisition of the at least one first image; The target acquisition configuration information is determined based on the user instruction, the at least one first image, and the historical acquisition configuration information.

3. The control method according to claim 2, wherein, Based on the user instruction, the at least one first image, and the historical acquisition configuration information, the target acquisition configuration information is determined, including: Determine whether the user instruction is an associated instruction of the historical user instruction, wherein the historical user instruction is the user instruction corresponding to the historical collection configuration information; In response to the user instruction being an associated instruction of the historical user instruction, the target acquisition configuration information is determined based on the user instruction, the at least one first image, and the historical acquisition configuration information; In response to the user instruction not being an associated instruction of the historical user instruction, the target acquisition configuration information is determined based on the at least one first image.

4. The control method according to claim 3, wherein, The target acquisition configuration information is determined based on the user instruction, the at least one first image, and the historical acquisition configuration information, including: According to the user instruction, the at least one first image is processed to obtain a target region, wherein the target region includes at least one target object; Obtain a candidate region, which is determined based on the historical user instructions; The target acquisition configuration information is determined based on the candidate area, the target area, and the historical acquisition configuration information.

5. The control method according to claim 4, wherein, Based on the candidate area, the target area, and the historical data collection configuration information, the target data collection configuration information is determined, including: Determine whether the candidate region matches the target region; In response to a match between the candidate region and the target region, the historical data collection configuration information is determined as the target data collection configuration information; In response to a mismatch between the candidate region and the target region, the target acquisition configuration information is determined based on the target region.

6. The control method according to claim 5, wherein, Based on the target area, the target acquisition configuration information is determined, including: Determine the region type of the target region; In response to the target area being of far-field type, the target acquisition configuration information is determined to instruct the camera in the left earphone, or the camera in the right earphone, to acquire images; In response to the target area being of the near-field type, the target acquisition configuration information is determined to instruct the camera in the left earphone and the camera in the right earphone to acquire images.

7. The control method according to claim 3, wherein, Based on the at least one first image, the target acquisition configuration information is determined, including: According to the user instruction, the at least one first image is processed to obtain a target region, wherein the target region includes at least one target object; Based on the target area, determine the target acquisition configuration information.

8. The control method according to any one of claims 1-7, further comprising: Receive at least one environmental image transmitted by the headset; Based on the user instruction, the at least one environmental image is processed to obtain the response voice corresponding to the user instruction; The reply voice is sent to the headset.

9. A control method applied to headphones, wherein the headphones are equipped with a camera, the method comprising: Obtain user commands and target acquisition configuration information; The wearing information of the earphones is obtained, and the wearing information is used to indicate the wearing status of the left earphone and the wearing status of the right earphone, wherein the wearing status is either worn or not worn. Based on the user instructions, the target acquisition configuration information, and the wearing information, the camera is controlled to acquire at least one environmental image.

10. The control method according to claim 9, wherein, Based on the user instructions, the target acquisition configuration information, and the wearing information, control the camera to acquire at least one first image, including: When the user instruction instructs the camera to capture an image, it is determined whether the target acquisition configuration information matches the wearing information; In response to the target acquisition configuration information matching the wearing information, the camera is controlled to acquire at least one environmental image according to the target acquisition configuration information; In response to a mismatch between the target acquisition configuration information and the wearing information, a prompt message is generated, which indicates that the target acquisition configuration information and the wearing information do not match.

11. The control method according to claim 10, wherein, Based on the target acquisition configuration information, control the camera to acquire at least one environmental image, including: If the target acquisition configuration information is used to instruct the camera in the left earphone to capture images, or the camera in the right earphone to capture images, then the battery level of the left earphone and the battery level of the right earphone are obtained, and the camera in the left earphone or the camera in the right earphone is controlled to capture the at least one environmental image based on the battery level of the left earphone and the battery level of the right earphone. If the target acquisition configuration information is used to instruct the camera in the left earphone and the camera in the right earphone to acquire images, then the camera in the left earphone and the camera in the right earphone are controlled to acquire at least one environmental image.

12. The control method according to claim 10, wherein, Based on the target acquisition configuration information, control the camera to acquire at least one environmental image, including: If the target acquisition configuration information is used to instruct the camera in the left earphone to capture images, or the camera in the right earphone to capture images, then the environmental images captured by the left earphone and the environmental images captured by the right earphone are acquired, and based on the image quality of the environmental images captured by the left earphone and the environmental images captured by the right earphone, the left earphone is controlled to capture at least one environmental image, or the right earphone is controlled to capture at least one environmental image.

13. The control method according to claim 12, wherein, The image quality includes image sharpness and the area of ​​the image that is obscured.

14. The control method according to any one of claims 9-13, further comprising: Receive target acquisition configuration information sent by the control device; Retrieve historical data collection configuration information; Update the historical acquisition configuration information to the target acquisition configuration information and store the target acquisition configuration information.

15. The control method according to any one of claims 9-14, further comprising: Send the at least one environmental image to the control device.

16. A control device, comprising: A receiving module is used to receive user commands and at least one first image sent by the headset, wherein the first image is captured by a camera in the headset. A determining module is configured to determine target acquisition configuration information of a camera based on the user instruction and the at least one first image, wherein the camera is disposed in an earphone, and the target acquisition configuration information is used to instruct the camera in the left earphone and / or the camera in the right earphone to acquire images; The sending module is used to send the target acquisition configuration information to the headset, so that the headset controls the camera to acquire at least one environmental image according to the target acquisition configuration information.

17. A control device, comprising: The first acquisition module is used to acquire user commands and target acquisition configuration information; The second acquisition module is used to acquire the wearing information of the earphones. The wearing information is used to indicate the wearing status of the left earphone and the wearing status of the right earphone. The wearing status is either a worn status or a non-worn status. The control module is used to control the camera to acquire at least one environmental image according to the user instructions, the target acquisition configuration information, and the wearing information.

18. A control device, comprising: Processor and memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the control method as described in any one of claims 1 to 8.

19. An earphone, comprising: Processor and memory; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory, causing the processor to perform the control method as described in any one of claims 9 to 15.

20. A computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the control method as described in any one of claims 1 to 8, or any one of claims 9 to 15.

21. A computer program product comprising a computer program that, when executed by a processor, implements the control method as described in any one of claims 1 to 8, or claims 9 to 15.

Images