Control method and device for earphones with camera, earphones and storage medium

Abstract

The embodiments of this application relate to a control method and apparatus for earphones with a camera, earphones, and a storage medium, and belong to the technical field of information processing. The method includes controlling the camera to collect at least one frame of ambient imagery while the earphones are being worn, transmitting at least one frame of ambient imagery to a terminal device so that an image analysis device deployed in the terminal device analyzes the ambient imagery to obtain a detection result of a first wearing posture of the earphones, and receiving the detection result of the first wearing posture transmitted by the terminal device, and in response that the first wearing posture does not satisfy the target shooting request, issuing a first notification to the user to remind the user to adjust the wearing posture of the earphones. This application can solve the problem of poor image quality of camera capture due to the wearing posture of the earphones with a camera.

Description

TECHNICAL FIELD

[0001] This application claims the priority of the Chinese patent application filed with the China National Intellectual Property Administration on September 19, 2024, with the application number 202411311106.3 and the application title "Control Method and Apparatus for Camera-equipped Earphone, Earphone and Storage Medium", the entire content of which is incorporated into this application by reference.

[0002] The present application relates to the technical field of information processing, specifically to the technical field of earphone control, and particularly relates to a control method and apparatus for a camera-equipped earphone, an earphone and a storage medium. BACKGROUND ART

[0003] As people's demand for electronic products increases, multi-functional electronic products are gaining more and more popularity. For example, a camera is added to a wearable device to collect environmental photos according to user demands. However, the shooting angle of the camera directly affects the picture quality, which may fail to meet user demands. Therefore, it is very important to enable users to collect images that meet requirements in a timely and efficient manner after wearing the wearable device.

[0004] The foregoing description provides general background information and does not necessarily constitute prior art. SUMMARY OF THE INVENTION

[0005] The present application provides a control method and apparatus for a camera-equipped earphone, an earphone and a storage medium, which are used to solve the problem that the image quality captured by the camera is poor due to the wearing posture of the camera-equipped earphone.

[0006] According to a first aspect, the embodiments of the present application provide a control method for a camera-equipped earphone applied to the earphone side, and the method includes: controlling the camera to collect at least one frame of environmental image when the earphone is in a worn state; The environmental image of at least one frame is transmitted to a terminal device, and the image analysis unit deployed on the terminal device analyzes the environmental image to obtain a detection result for the first wearing posture of the earphones. The system includes receiving the detection result of a first wearing posture transmitted by the terminal device, and, in response that the first wearing posture does not meet the target shooting request, issuing a first notification to the user to remind them to adjust the wearing posture of the earphones.

[0007] In one possible implementation, the device further includes providing a second notification to the user in response to the first mounting posture satisfying the target imaging requirement.

[0008] In one possible implementation, transmitting at least one frame of the environmental image to a terminal device, and having an image analysis unit deployed on the terminal device analyze the environmental image to obtain a detection result for a first wearing posture of the earphones, includes transmitting at least one frame of the environmental image to a terminal device, having an image analysis unit deployed on the terminal device perform intent analysis processing on the environmental image to obtain a first intent analysis result of the user, and, based on the first intent analysis result, obtaining a detection result for a first wearing posture of the earphones.

[0009] One possible implementation further includes collecting the user's first voice, transmitting the first voice to a terminal device, and having an image analysis device deployed in the terminal device perform a comprehensive analysis based on the first voice and the environmental image to obtain a second intent analysis result of the user, and to obtain a detection result of the first wearing posture of the earphones based on the second intent analysis result.

[0010] According to a second aspect, an embodiment of the present application provides a method for controlling an earphone with a camera, wherein the earphone is equipped with a posture detector, the posture detector is used to detect the posture of the earphone and generate a second wearing posture, the method includes determining whether the current posture of the earphone satisfies a target shooting requirement based on the second wearing posture, and, in response to the current posture of the earphone not satisfying the target shooting requirement, giving a third notification to the user to remind the user to adjust the wearing posture of the earphone.

[0011] In one possible implementation, after the user adjusts their earphone wearing position in accordance with a third notification, the camera is controlled to collect at least one frame of the current ambient image, and the process further includes jumping to the step of transmitting the at least one frame of the ambient image to a terminal device.

[0012] In one possible implementation, the system further includes providing a second notification to the user in response to the current orientation of the earphones satisfying the target shooting requirement.

[0013] In one possible implementation, the earphone is provided with a micro-adjustment mechanism, which is used to automatically adjust the shooting angle of the camera in response to the first wearing position not meeting the target shooting requirement.

[0014] According to a third aspect, the embodiment of the present application further provides a method for controlling an earphone with a camera used in a terminal device, the method being: The system receives at least one frame of ambient image transmitted by the earphone, wherein the ambient image is collected by the earphone controlling the camera while the earphone is being worn. The environmental image is analyzed to obtain the detection result of the first wearing posture of the earphones, The system further includes transmitting the detection result of the first wearing posture to the earphone, and when the earphone responds that the first wearing posture does not meet the target shooting requirement, it provides the user with a first notification to remind the user to adjust the wearing posture of the earphone.

[0015] In one possible implementation, after receiving at least one frame of environmental image transmitted by the earphone, intent analysis processing is performed on the environmental image to obtain a first intent analysis result of the user, and further, a detection result of a first wearing posture of the earphone is obtained based on the first intent analysis result.

[0016] In one possible implementation, the system receives a first voice transmitted by the earphone, wherein the first voice is collected by the earphone; and further includes performing a comprehensive analysis based on the first voice and the environmental image to determine a second user intent analysis result, and obtaining a detection result of the first wearing posture of the earphone based on the second intent analysis result.

[0017] In one possible implementation, the earphone is equipped with a posture detector, which is used to detect the posture of the earphone and generate a second wearing posture, and the method further includes jumping to receiving at least one frame of an environmental image transmitted by the earphone after the user has adjusted the wearing posture of the earphone in accordance with a third notification. The environmental image of at least one frame is collected by the earphone controlling the camera after the user adjusts the earphone wearing position in accordance with the third notification, the third notification is given to the user in response to the earphone's current position not meeting the target shooting requirement, and the current position is determined by the earphone based on the second wearing position.

[0018] In one possible implementation, the earphones are connected to a terminal device, the earphones contain an image control side, and the terminal device contains an image analysis side.

[0019] In one possible implementation, the image analysis side is used to display the environmental image of at least one frame on a real-time display screen, and accordingly the method further includes providing a first notification to the user on the real-time display screen in response that the first mounting posture does not satisfy the target shooting requirement, or providing a second notification to the user on the real-time display screen in response that the first mounting posture satisfies the target shooting requirement.

[0020] According to a fourth aspect, the embodiments of this application further provide a method for controlling an earphone with a camera, the method being: With the aforementioned earphones attached, acquire at least one frame of ambient imagery, The environmental image is analyzed to obtain the detection result of the first wearing posture of the earphones, This includes providing a first notification to the user to remind them to adjust the earphone wearing position in response to the first wearing position not meeting the target shooting requirements.

[0021] According to a fifth aspect, the embodiment of the present application further provides a control device for an earphone with a camera used on the earphone side, the device being: A collection module for controlling the camera to collect at least one frame of environmental image while the aforementioned earphones are attached, A first transmission module for transmitting at least one frame of the environmental image to a terminal device so that an image analysis unit deployed in the terminal device can analyze the environmental image to obtain a detection result for the first wearing posture of the earphones, a first receiving module, configured to receive a detection result of a first wearing posture transmitted by the terminal device, and issue a first notification to the user to remind the user to adjust the wearing posture of the earphone in response to the fact that the first wearing posture does not meet the target shooting requirement.

[0022] According to a sixth aspect, the embodiments of the present application further provide a control apparatus for an earphone with a camera, which is used in a terminal device, and the apparatus comprises: a second receiving module, configured to receive at least one frame of environmental image transmitted by the earphone side, wherein the at least one frame of environmental image is collected by the earphone side by controlling the camera in a state where the earphone is worn. an analysis module, configured to analyze the environmental image to obtain a detection result of the first wearing posture of the earphone. a second transmitting module, configured to transmit the detection result of the first wearing posture to the earphone side, so that when the earphone side responds to the fact that the first wearing posture does not meet the target shooting requirement, the earphone side issues a first notification to the user to remind the user to adjust the wearing posture of the earphone.

[0023] According to a seventh aspect, the embodiments of the present application further provide an earphone, which comprises an earphone body, a camera, at least one processor, and a memory. The earphone body is configured to be worn by a user, and to establish a communication connection with the image processing side. The camera is mounted on the earphone body, and the camera is configured to collect at least one frame of environmental image. Computer-executable instructions are stored in the memory. The at least one processor executes the computer-executable instructions stored in the memory, to cause the at least one processor to execute the method for controlling an earphone with a camera described in the first aspect.

[0024] In one possible implementation, the earphone is further provided with an attitude detector, which is used to detect and generate the wearing posture of the earphone body.

[0025] In one possible implementation, the earphone is further provided with a micro-adjustment mechanism, which is used to rotate the camera and adjust the camera's shooting angle.

[0026] According to the eighth aspect, an embodiment of the present application further provides a computer-readable storage medium in which computer execution instructions are stored, and when a processor executes the computer execution instructions, a control method for a camera-equipped earphone as described in the first, second, or third aspect is realized.

[0027] This application provides a control method and apparatus for earphones with a camera, earphones, and a storage medium. The method involves first controlling the camera to collect at least one frame of ambient imagery, and then transmitting at least one frame of ambient imagery to a terminal device. The image analysis unit deployed in the terminal device analyzes the ambient imagery to determine the detection result of a first wearing posture of the earphones. Finally, upon receiving the first wearing posture transmitted by the terminal device, and detecting that the first wearing posture does not satisfy the target shooting requirement, the system issues a first notification to the user to remind them to adjust the wearing posture of the earphones. In this way, the ambient imagery collected by the earphones controlling the camera satisfies the target shooting requirement. This avoids the problem of poor image quality due to the wearing posture of the earphones with a camera, and improves the image quality of the collected ambient imagery. [Brief explanation of the drawing]

[0028] To more clearly illustrate the embodiments of this application or the technical concepts in the prior art, the following is a brief introduction to the drawings that may be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments described in this application, and a person skilled in the art can obtain other drawings based on these drawings without expending any creative effort. [Figure 1] This is one schematic diagram illustrating an application scenario of the control method for earphones with a camera according to an embodiment of this application. [Figure 2] This is the second schematic diagram illustrating an application scene of the control method for earphones with a camera according to an embodiment of this application. [Figure 3] This is one flowchart of a control method for a camera-equipped earphone according to an embodiment of this application. [Figure 4] This is the second flowchart of the control method for a camera-equipped earphone according to an embodiment of this application. [Figure 5] This is an interaction flowchart of a control method for earphones with a camera according to an embodiment of this application. [Figure 6] This is the third flowchart of the control method for a camera-equipped earphone according to an embodiment of this application. [Figure 7] This is one of the schematic diagrams of the structure of a control device for a camera-equipped earphone according to an embodiment of this application. [Figure 8] This is the second schematic diagram of the structure of a control device for a camera-equipped earphone according to an embodiment of this application. [Figure 9] This is a schematic diagram of the connection structure between the various hardware components of an earphone according to an embodiment of this application. [Modes for carrying out the invention]

[0029] To further clarify the purpose, technical proposal, and advantages of the embodiments of this application, the technical proposal of the embodiments of this application will be clearly and completely described below, with reference to the drawings of the embodiments. Clearly, the embodiments described are only a part of the embodiments of this application, not all of them. All other embodiments derived from the embodiments of this application without the creative effort of a person skilled in the art are all within the scope of protection of this application.

[0030] Furthermore, the user information (including, but not limited to, user device information and user personal information) and data (including, but not limited to, data for analysis, stored data, and displayed data) relating to this application are all information and data authorized by the user or fully permitted by the parties, and the processing of such related data, including collection, storage, use, processing, transmission, provision, disclosure, and application, is carried out in accordance with the relevant laws, regulations, and standards of the relevant country or region, with necessary confidentiality measures taken, without violating public order and morality, and with corresponding operational entries provided for the user to choose to permit or refuse.

[0031] Furthermore, the proposed technology relating to this application collects information about the user's surrounding environment (including, but not limited to, personal biometric characteristics such as images and voice, and the surrounding environment and personal belongings), employs artificial intelligence technology to make automated decisions, and makes decisions that have a significant impact on the individual's rights based on the automated decision results. This technology provides the user with corresponding permission selection operation entries to choose whether to agree to or reject the automated decision results. If the user chooses to reject, the camera can be automatically closed. If the user agrees, the user's surrounding environment information can be collected.

[0032] The inventors, while researching camera-equipped earphones that capture images of the surrounding environment, discovered that when the earphones are worn, the camera can be opened to collect images of the user's surroundings. These images can then be transmitted to an image processing device, such as a mobile phone, cloud, or server, where the user can view them or the image processing device can perform image recognition and analysis. The images can then be stored on the image processing device to provide feedback to the user after obtaining image-related information. The inventors further discovered that while there are certain requirements for image quality when the collected images are processed by the image processing device, problems such as incorrect earphone placement, image capture angle, the degree to which the image is obscured by the face or hair, and image clarity are likely to occur. When these problems arise, the image quality does not meet the expected requirements. As a result, users may be dissatisfied with the image quality when directly reviewing the collected images, or incorrect image information may be fed back to the user after image recognition and analysis by the image processing device, resulting in a poor user experience.

[0033] To solve the above technical problems, the embodiments of this application provide the following technical concept to solve the problems. First, when the user is wearing earphones, the camera is controlled to perform an image acquisition operation on the user's surrounding environment, and the acquired image information is transmitted to a terminal device connected to the earphones. The image is analyzed using an image analysis device installed in the terminal device to obtain a first wearing posture, and if the first wearing posture does not satisfy the target shooting requirement, a first notification is given to the user to remind them to adjust the wearing posture of the earphones. Note that if the earphones are also equipped with an image analysis device, the transmission and reception operations may not be necessary, and the detection result of whether or not the wearing posture of the earphones satisfies the shooting requirement can be obtained by directly analyzing the image acquired by the image analysis device installed in the earphones.

[0034] Figure 1 is one schematic diagram of an application scene of the control method for earphones with a camera according to an embodiment of this application, and as shown in Figure 1, the scene includes earphones 101 and terminal equipment 102 equipped with an image analysis side.

[0035] Here, the earphone 101 is equipped with an earphone control side, which may be a controller or a chip, and the earphone 101 is used for the user to wear, and the earphone 101 is equipped with a camera for collecting at least one frame of environmental images of the user's surroundings, and the earphone 101 transmits the environmental images collected by the camera to the terminal device 102.

[0036] The terminal device 102 may be a mobile phone, and the terminal device 102 is equipped with an image analysis side, which may be built-in software, such as a large-scale artificial intelligence model or other image analysis software. After receiving the environmental image, the image analysis side analyzes the environmental image to determine the wearing posture of the earphone 102 and returns the wearing posture to the earphone 101. The terminal device 102 returns specific posture data to the earphone 101 via the image analysis side, and the earphone control side of the earphone 101 can determine whether the posture data satisfies the target shooting request and send a corresponding notification to the user to remind them. Alternatively, the terminal device 102 may directly determine whether the shooting specifications are met based on the environmental image via the image analysis side and return a corresponding notification to the earphone. Or, the terminal device 102 may directly obtain image-related information based on the image environment via the image analysis side and return it to the earphone.

[0037] Figure 2 is a schematic diagram of an application scene of the control method for earphones with a camera according to an embodiment of this application. As shown in Figure 2, the difference between this scene and the scene shown in Figure 1 is that the terminal device 102 is a server, personal computer, tablet computer, or other computer-related equipment. In this embodiment, the terminal device 102 in Figure 2 is a personal computer.

[0038] The difference from the application scenes shown in Figures 1 and 2 is that the embodiment of this application further provides an application scene which includes only a camera-equipped earphone, and while the earphone is being worn, the camera acquires at least one frame of environmental imagery, and the environmental imagery is analyzed to obtain a first wearing posture detection result, and in response that the first wearing posture does not meet the target shooting requirement, a first notification is given to the user to remind them to adjust their wearing posture.

[0039] It should be noted that the earphone 101 in the above application scenario is merely one earphone style disclosed in this embodiment, and in addition to this Bluetooth® earphone style, it may also be other wireless Bluetooth® earphones, bone conduction earphones, or wired earphones. However, this embodiment is not particularly limited herein.

[0040] Figure 3 is one flowchart of a control method for a camera-equipped earphone according to an embodiment of this application. The implementing body of this embodiment may be the earphone control side of the earphone 101 in the embodiment shown in Figure 1 or Figure 2, or it may be a related control component of another computer, and the embodiment is not particularly limited thereto.

[0041] As shown in Figure 3, the control method for the camera-equipped earphone includes the following:

[0042] S301: Control the camera to collect at least one frame of ambient imagery while earphones are being worn.

[0043] In this embodiment, "earphones are worn" means that the user is wearing the earphones on their head. After activation, the earphone controls the camera to capture the environment in front of the user and collect at least one frame of environmental imagery. Here, "at least one frame of environmental imagery" refers to an image captured by the camera, which may be a video or a photograph.

[0044] S302: At least one frame of the environmental image is transmitted to the terminal device, and the image analysis unit deployed on the terminal device analyzes the environmental image to obtain a detection result for the first wearing posture of the earphones.

[0045] In this embodiment, to transmit at least one frame of the environmental image to the image analysis side, the image may be transmitted using a Bluetooth® connection, a wired earphone cable, or a wireless transmission communication method, such as Wi-Fi, and the embodiment is not particularly limited to these methods.

[0046] In this embodiment, analyzing environmental images may be an operation that performs image processing and identification using a large-scale artificial intelligence model, and the first mounting posture may be one that can reflect the camera's shooting angle or the proportion of effective pixels in the captured image.

[0047] In this embodiment, the detection results may include posture data of the first wearing posture, text, voice, or illustrations describing whether the first wearing posture satisfies the target shooting requirement, and descriptive information related to the environmental image.

[0048] S303: Upon receiving the detection result of the first wearing posture transmitted by the image analysis side, and in response that the first wearing posture does not meet the target shooting request, a first notification is sent to the user to remind them to adjust the wearing posture of the earphones.

[0049] In this embodiment, when it is detected that the first wearing posture does not meet the shooting requirements, the environmental image quality captured by the camera is obscured, indicating a problem with image quality such as an incorrect shooting angle or low clarity. At this time, the user is given a first notification to remind them to adjust the earphone wearing posture. In this embodiment, the first notification may be information that allows the user to sense that the earphone wearing posture needs to be adjusted. For example, the first notification may be voice information, a warning sound, or vibration. After the user adjusts the earphone wearing posture, the camera can be controlled to capture an environmental image that meets the requirements.

[0050] For example, if a user wants to photograph a glass full of water on a table, the camera's shooting angle should be a downward angle. However, if the camera's shooting angle determined after analysis by the image analysis system is an upward angle, it will be determined that the first wearing posture does not satisfy the target shooting requirement. In this case, the user can adjust their earphone wearing posture to make the camera's shooting angle a downward angle and control the camera to capture an image of the environment including the glass.

[0051] In summary, the camera-equipped earphone control method according to the embodiment of this application first controls the camera to collect at least one frame of environmental image, and then transmits at least one frame of environmental image to a terminal device. The image analysis side deployed in the terminal device analyzes the environmental image to determine a first wearing posture of the earphone, and finally receives the detection result of the first wearing posture transmitted by the device terminal. If it detects that the first wearing posture does not satisfy the target shooting requirement, it issues a first notification to the user to remind them to adjust the wearing posture of the earphone. In this way, the environmental image collected by the earphone controlling the camera satisfies the target shooting requirement. This avoids the problem of poor image quality of camera capture due to the wearing posture of the camera-equipped earphone and improves the image quality of the collected environmental image.

[0052] Based on the above embodiment, in one optional embodiment of the present application, the method for controlling an earphone with a camera further includes giving a second notification to the user in response that a first wearing posture satisfies a target shooting request.

[0053] In this embodiment, the first wearing posture satisfying the target shooting requirement means, through analysis, that the image quality of the ambient image meets expectations. For example, the ambient image is clear and the degree of occlusion is smaller than a preset value. The second notification may be information that reminds the user that the earphones have already been adjusted to the correct posture, and the second notification may be a voice, text, or vibration that is clearly distinguishable from the first notification. For example, the first notification may be five vibrations, each lasting one second, and the second notification may be one vibration lasting two seconds. The first notification may be a voice announcement played through the earphone speaker saying, "The earphone posture needs to be adjusted, please adjust it in a timely manner," and the second notification may be, "The earphone posture adjustment is complete, please maintain this posture."

[0054] Based on the above embodiments, one optional embodiment of the present application further provides a method for controlling an earphone with a camera, wherein step S302 includes the following:

[0055] Step A: At least one frame of the environmental image is sent to the terminal device, and the image analysis side deployed on the terminal device performs intent analysis processing on the environmental image to obtain a first intent analysis result of the user, and based on the first intent analysis result, a first earphone wearing posture detection result is obtained.

[0056] In this embodiment, intent analysis processing may be a process in which the image analysis side uses a pre-trained large-scale artificial intelligence model to obtain results that reflect the user's intent based on data related to the environmental image, such as the position of objects in the environmental image and the proportion of the environmental image occupied by the objects. For example, if the collected environmental image contains an apple, the first intent analysis result obtained after intent analysis processing is "Detect the heat of the apple in the image."

[0057] In this embodiment, if the first intent analysis result indicates that the environmental image does not meet the target capture request, the image analysis side may return incorrect information related to the environmental image after analyzing it according to the first intent analysis result. This information is not what the user expects, and in this case, a first notification is given to the user to remind them to adjust their earphone wearing position. Conversely, a second notification is given to the user to remind them to maintain their current wearing position in order to collect the environmental image that the user expects.

[0058] In summary, the control method for camera-equipped earphones according to the embodiment of this application further transmits environmental images to the image analysis side, which performs intent analysis processing on the environmental images to obtain a first intent analysis result of the user, and then determines whether the first wearing posture satisfies the target shooting request based on the first intent analysis result, and gives the user a first or second notification, thereby further improving the accuracy of posture detection and increasing the image quality of the environmental images collected by the camera.

[0059] Based on the above embodiments, in one optional embodiment of the present application, the method for controlling the camera-equipped earphone further includes the following:

[0060] Step B: Collect the user's first voice.

[0061] In this embodiment, collecting the user's first voice may be a process of controlling a pickup installed in the earphone to pick up the voice emitted by the user. The first voice may be information that expresses the user's needs, for example, the content of the first voice may be, "I want to know the number of calories in one glass of milk on the table."

[0062] Step C: The first voice is transmitted to the terminal device, and the image analysis unit deployed on the terminal device performs a comprehensive analysis based on the first voice and environmental image to obtain the second intent analysis result of the user, and based on the second intent analysis result, it obtains the detection result of the first wearing posture of the earphones.

[0063] In this embodiment, the artificial intelligence model deployed within the image analysis system can perform a comprehensive analysis based on the first voice and the environmental image. This comprehensive analysis may be a process that analyzes the keywords in the first voice, combines them with objects in the environmental image to perform identification and determination, determines the true intent of the environmental image collected by the user, and obtains a second intent analysis result. For example, if the keywords in the first voice are "milk" and "one glass," and there is one glass of milk in the center of the environmental image, the system can determine that the first wearing posture satisfies the target shooting request based on the second intent analysis result, and at this time, it provides the user with a second notification. Conversely, if the milk in the environmental image is located at the edge of the image or is not fully displayed and cannot be identified and detected by the artificial intelligence model, it provides the user with a first notification. In this embodiment, the detection result of the first wearing posture may be information related to the user's intent or the environmental image analyzed by the image analysis system, such as the specific calorie count of one glass of water.

[0064] In summary, the camera-equipped earphone control method according to the embodiment of this application further transmits a first voice to the image analysis side, which then performs a comprehensive analysis by combining the first voice and the environmental image to determine the user's second intent analysis result, and based on the second intent analysis result, determines whether the first wearing posture satisfies the target shooting request, and gives the user a first or second notification, thereby further improving the accuracy of posture detection and increasing the image quality of the environmental image collected by the camera.

[0065] In one optional embodiment of the present application, the earphone is provided with an attitude detector, which is used to detect the attitude of the earphone and generate a second wearing attitude, and the method for controlling the camera-equipped earphone further includes the following:

[0066] Step D: Based on the second wearing posture, determine whether the current posture of the earphones satisfies the target shooting requirement.

[0067] In this embodiment, the attitude detector may be a sensor, instrument, or device that detects the attitude information of the earphones. For example, the attitude detector may be an accelerometer, tilt angle sensor, magnetometer, inertial measurement unit (IMU), or gyroscope. The second wearing attitude is the wearing attitude of the earphones collected by the attitude detector.

[0068] Step E: In response to the earphone's current orientation not meeting the target shooting requirement, a third notification is sent to the user to remind them to adjust the earphone's wearing position.

[0069] In this embodiment, determining whether the current posture of the earphones satisfies the target requirement based on the second wearing posture may be interpreted as determining that the current wearing posture of the earphones satisfies the target shooting requirement when it is detected that the second wearing posture satisfies the target shooting requirement.

[0070] In some embodiments, a second wearing posture obtained by a posture detector is acquired before controlling the camera to collect at least one frame of environmental imagery, and it is determined based on the second wearing posture whether the current posture of the earphone satisfies the target shooting requirement.

[0071] In one optional embodiment of the present application, the method for controlling the camera-equipped earphone further includes:

[0072] Step F: After the user adjusts their earphone wearing position according to the third notification, the camera is controlled to collect at least one frame of the current environment image, and the image is sent to the image analysis side.

[0073] In this embodiment, after the user adjusts the earphone wearing position in accordance with the third notification, the process may return to step S302 to detect and adjust the earphone wearing position again until the earphone wearing position satisfies the target shooting request.

[0074] In summary, by detecting and adjusting the posture of the earphones multiple times, the environmental image finally collected by the earphone camera can satisfy the target shooting requirements, thereby improving the image quality of the environmental image collected by the camera.

[0075] In one optional embodiment of the present application, the method for controlling the camera-equipped earphone further includes:

[0076] Step G: When it is detected that the current position of the earphones satisfies the target shooting requirement, a second notification is sent to the user.

[0077] In this embodiment, the second notification is similar to the second notification in the above embodiment, so this embodiment will not be described here.

[0078] In summary, the control method for earphones with a camera according to the embodiment of this application further detects the posture of the earphones using a posture detector, generates a second wearing posture, and further determines whether the current posture of the earphones satisfies the target shooting requirement based on the second and / or first wearing postures. If it is detected that the current posture of the earphones does not satisfy the target shooting requirement, a third notification is given to the user to remind them to adjust the wearing posture of the earphones, and the image quality of the environmental image collected by the camera on the earphones is further improved.

[0079] Based on the above embodiment, in one optional embodiment of this application, the earphone is provided with a micro-adjustment mechanism, which is used to automatically adjust the camera's shooting angle when it detects that the first or second wearing position does not satisfy the target shooting requirement.

[0080] In this embodiment, the fine adjustment mechanism may consist of a drive motor and a rotating rod. When the drive motor is activated, it moves the rotating rod, which in turn rotates the camera, thereby achieving the objective of adjusting the camera's shooting angle.

[0081] In summary, the camera-equipped earphone control method according to the embodiment of this application further allows the camera's shooting angle to be adjusted by a micro-adjustment mechanism on the earphone when it detects that the first wearing posture does not meet the target shooting requirement. This reduces the user's manual adjustment actions and improves the efficiency and accuracy of adjusting the earphone's wearing posture, thereby improving the image quality of the environmental image captured by the camera.

[0082] Figure 4 is the second flowchart of a control method for earphones with a camera according to an embodiment of this application. The implementing body of this embodiment may be the terminal device 102 in the embodiment shown in Figure 1 or Figure 2, and the terminal device 102 is equipped with an image analysis side. Of course, the implementing body of this embodiment may be related equipment or a server of another computer equipped with an image analysis side, and the embodiment is not particularly limited thereto.

[0083] As shown in Figure 4, the control method for the camera-equipped earphone includes the following:

[0084] S401: Receives at least one frame of ambient image transmitted by the earphone, where the at least one frame of ambient image was collected by the earphone controlling the camera while the earphone was being worn.

[0085] S402: The image analysis unit analyzes the environmental image to obtain the detection result for the first wearing posture of the earphones.

[0086] S403: The detection result of the first wearing posture is transmitted to the earphone side, and when the earphone side responds that the first wearing posture does not meet the target shooting request, it sends a first notification to the user to remind the user to adjust the wearing posture of the earphone.

[0087] In this embodiment, the processing process on the image analysis side of the environmental image in steps S401 to S403 was described in steps S301 to S303 above, so this embodiment will not be described here.

[0088] In summary, the camera-equipped earphone control method according to the embodiment of this application first analyzes the environmental image to determine a first wearing position of the earphone, and finally transmits the first wearing position to the earphone. When the earphone control side detects that the first wearing position does not satisfy the target shooting requirement, it issues a first notification to the user to remind them to adjust the earphone wearing position. In this way, the environmental image collected by the earphone side controlling the camera satisfies the target shooting requirement. This avoids the problem of poor image quality from camera capture due to the wearing position of the camera-equipped earphone and improves the image quality of the collected environmental image.

[0089] In addition to transmitting and detecting the first wearing posture to the earphone side, the image analysis side can also directly detect it and remind the user to adjust the earphone posture. Based on the above embodiment, the method for controlling an earphone with a camera according to one optional embodiment of the present application further includes, after step S402, detecting that the first wearing posture does not satisfy the target shooting request, giving the user a first notification to remind the user to adjust the earphone wearing posture.

[0090] In this embodiment, the process of sending a first notification to the user to remind them to adjust their earphone wearing position is performed directly on the image analysis side, thus avoiding the user failing to perceive the first notification from the earphones. This ensures that the user perceives the first notification in a timely manner, adjusts their earphone wearing position, and ultimately achieves the objective of higher quality image capture of the environment.

[0091] In one optional embodiment of this application, the following is further included after step S401:

[0092] Step S404: The image analysis side performs intent analysis processing on the environmental image to obtain a first intent analysis result of the user, and based on the first intent analysis result, it obtains a detection result of a first wearing posture of the earphones.

[0093] In this embodiment, the process from performing intent analysis on the environmental image in step S404 to providing the first notification to the user was described in step A of the above embodiment, so this embodiment will not be described here.

[0094] Based on the above embodiments, one optional embodiment of the present application further includes:

[0095] Step S405: The first voice transmitted by the earphone is received, where the first voice is collected by the earphone.

[0096] Step S406: A comprehensive analysis is performed based on the first voice and environmental image to determine the second user intent analysis result, and the first earphone wearing posture detection result is obtained based on the second intent analysis result.

[0097] In this embodiment, the processing process for the first voice transmitted by the earphone is described in steps S405-S406 and steps B-C after receiving the first voice, so this embodiment will not be explained here.

[0098] Based on the above embodiments, one optional embodiment of the present application further includes: an earphone equipped with a posture sensor, the posture sensor used to detect the posture of the earphone and generate a second wearing posture, the method further includes:

[0099] S407: The earphone is equipped with a posture detector, which is used to detect the posture of the earphone and generate a second wearing posture, the method further includes jumping to receiving at least one frame of ambient image transmitted by the earphone after the user has adjusted the wearing posture of the earphone in accordance with a third notification, the at least one frame of ambient image being collected by the earphone controlling the camera after the user has adjusted the wearing posture of the earphone in accordance with the third notification, the third notification being given to the user in response that the current posture of the earphone does not meet the target shooting request, and the current posture being determined by the earphone based on the second wearing posture.

[0100] In this embodiment, the process used by the attitude detector to detect the attitude of the earphones and generate a second wearing attitude may be understood as detecting the earphone wearing angle by the sensor and calculating the corresponding second wearing attitude from the earphone wearing angle.

[0101] Specifically, in this embodiment, if the posture detector detects that the difference between the two earphone wearing angles is greater than a preset angle threshold, a third notification can be generated to inform the user to adjust the earphone wearing posture. When the earphones are worn for the first time, it is understood that the first angle α of the left earphone and the second angle β of the right earphone must satisfy the condition that both α and β are greater than the first angle threshold and less than the second angle threshold, and the absolute value of the difference between α and β is less than the second angle threshold. Here, the first angle threshold is, for example, -10°, and the second angle threshold is, for example, 10°. In the embodiment of this application, it is required that the user wearing the left and right earphones is facing forward when detection occurs. Here, the first angle is the angle between the horizontal plane and the first vector representing the direction of the left earphone when the left earphone is being worn. The second angle is the angle between the horizontal plane and the second vector representing the direction of the right earphone when the right earphone is being worn. Here, the posture detector installed on the earphones may be a sensor. It should be understood that the sensor includes an Inertial Measurement Unit (IMU), and the first measurement data includes first inertial measurement data. The first inertial measurement data includes triaxial attitude angles and acceleration. The number of sensors in the embodiments of this application may be one or more, and the sensors may be other sensors, such as pressure sensors, velocity sensors, angle sensors, etc., and are not limited to these in the embodiments of this application.

[0102] In this embodiment, after the user adjusts the earphone wearing position in accordance with the third notification, the system jumps to the image analysis side to receive at least one frame of the environmental image transmitted by the earphone side, and continues to execute the subsequent steps S402 to S403 until the image quality of the environmental image captured by the camera meets the expectations.

[0103] In one optional embodiment of this application, the earphone side is connected to a terminal device, the earphone side is equipped with an earphone control side, and the terminal device is equipped with an image analysis side.

[0104] In this embodiment, the image analysis side is located in the terminal device and can be used to display at least one frame of an image in real time. When the image is located in a server connected to the terminal device, the server is configured to analyze the user's shooting intention based on at least one frame of the environmental image and to determine whether the first wearing posture of the earphones satisfies the target requirement based on the intention analysis result of the user's shooting intention.

[0105] Furthermore, in one optional embodiment of the present application, the image analysis side is used to display at least one frame of the environmental image on a real-time display screen, and accordingly further includes the following:

[0106] Step S408: In response to the first mounting posture not meeting the target shooting requirement, a first notification is given to the user on the real-time display screen.

[0107] In this embodiment, when the first wearing posture does not satisfy the target shooting requirement, a first notification is displayed to the user on the real-time display screen to remind them to adjust the earphone wearing posture. In this embodiment, the first notification may be a text notification that reminds the user that the earphone wearing posture satisfies the target shooting requirement, an icon notification with a reminder function, or a screen position notification. For example, in order for the user to determine and adjust the earphone wearing posture themselves based on vertical and horizontal positions, an environment picture is displayed on the real-time display screen, showing the vertical and horizontal line positions.

[0108] Step S409: Alternatively, in response to the first mounting posture satisfying the target shooting requirement, a second notification is given to the user on the real-time display screen.

[0109] In this embodiment, when the first wearing posture satisfies the target shooting requirement, the user can directly see on the real-time display screen of the image analysis side that the environmental image meets the expected image quality requirement. The second notification may be a text notification that reminds the user that the earphone wearing posture satisfies the target shooting requirement, an icon notification with a reminder function, or a screen position notification.

[0110] In summary, the camera-equipped earphone control method according to the embodiment of this application displays at least one frame of the environmental image on a real-time display screen, allowing the user to directly obtain whether the earphone wearing posture satisfies a preset shooting requirement when viewing the captured environmental image on the image analysis side, and to easily obtain the first or second notification.

[0111] Figure 5 is an interaction flowchart of a control method for a camera-equipped earphone according to an embodiment of this application.

[0112] As shown in Figure 5, the control method for the camera-equipped earphone includes the following steps.

[0113] S501: When earphones are worn, the earphone controls the camera to collect at least one frame of ambient imagery.

[0114] S502: The earphone side transmits at least one frame of the ambient image to the image analysis side.

[0115] S503: The image analysis side analyzes the environmental image to determine the first wearing position of the earphones.

[0116] S504: The image analysis side transmits the first wearing posture to the earphone side.

[0117] S505: When the earphone unit detects that the first wearing posture does not meet the target shooting requirement, it issues a first notification to the user to remind them to adjust the earphone wearing posture.

[0118] In addition, this embodiment may include other steps to correspond to the specific steps of each possible embodiment in the embodiment of the method shown in Figures 3 and 4 above.

[0119] Figure 6 is the third flowchart of the control method for camera-equipped earphones according to an embodiment of this application. The difference from the above embodiment is that this embodiment does not have an interaction process, and both the process of collecting environmental images and the process of analyzing environmental images are performed locally on the earphones.

[0120] As shown in Figure 6, the control method for the camera-equipped earphone includes the following steps.

[0121] S601: With earphones attached, acquire at least one frame of ambient imagery.

[0122] S602: Analyzes environmental images to obtain the detection result for the first wearing posture of the earphones.

[0123] S603: In response to the first wearing posture not meeting the target shooting requirement, the first notification is sent to the user to remind them to adjust the earphone wearing posture.

[0124] In this embodiment, the earphone side is equipped with an image analysis unit, and the process of acquiring at least one frame of environmental image may involve the earphone side controlling the camera to collect environmental images of the user's surroundings. The earphone's local image analysis unit can also analyze the environmental image to obtain a result for detecting the first wearing posture of the earphone. The subsequent operation process is similar in principle to the embodiment of the above method, so this embodiment will not be described here.

[0125] In addition, this embodiment may include other steps to correspond to the specific steps of each possible embodiment in the embodiment of the method shown in Figures 3 and 4 above.

[0126] In one optional embodiment of the present application, the method for controlling the camera-equipped earphone further includes:

[0127] S604: When the earphones are worn, the detection result of the second wearing posture is obtained. S605: In response to the second wearing position not meeting the target shooting requirements, the first notification is sent to the user to remind them to adjust the wearing position of the earphones.

[0128] In this embodiment, the process of acquiring the second wearing posture may involve the earphone controlling its posture detector to detect the earphone's wearing posture. If it is possible to determine whether the target shooting requirement is met based solely on the second wearing posture, there is no need to perform image analysis, and the first notification can be given directly to the user, thus making the wearing detection process faster and more efficient. Of course, the accuracy of wearing detection can be improved and the image quality of the acquired environmental image can be increased by combining the results of image analysis with the second wearing posture to determine whether the target shooting requirement is met.

[0129] Figure 7 is one of the schematic diagrams of the structure of a control device for a camera-equipped earphone according to an embodiment of the present application. As shown in Figure 7, the control device for the camera-equipped earphone is used on the earphone side and includes a collection module 71, a first transmission module 72, and a first reception module 73.

[0130] The acquisition module 71 is used to control the camera to acquire at least one frame of environmental image while the earphones are being worn. The first transmission module 72 is used to transmit at least one frame of environmental image to a terminal device so that the image analysis unit deployed in the terminal device can analyze the environmental image and obtain a detection result for the first wearing posture of the earphones. The first receiving module 73 receives the detection result of a first wearing posture transmitted by the terminal device and, in response to the first wearing posture not meeting the target shooting request, is used to send a first notification to the user to remind them to adjust the wearing posture of the earphones.

[0131] In one optional embodiment of the present application, the first receiving module 73 is further used to provide a second notification to the user in response that the first mounting posture satisfies the target imaging request.

[0132] In one optional embodiment of this application, the first transmission module 72 is further used to transmit at least one frame of an environmental image to a terminal device so that an image analysis unit deployed in the terminal device can perform intent analysis processing on the environmental image to obtain a first intent analysis result of the user and, based on the first intent analysis result, obtain a detection result of a first wearing posture of the earphones.

[0133] In one optional embodiment of this application, the collection module 71 is further used to collect a first voice of the user. The first transmission module 72 is further used to transmit the first voice to a terminal device so that an image analysis unit deployed in the terminal device can perform a comprehensive analysis based on the first voice and environmental images to obtain a second intent analysis result of the user, and to obtain a detection result of a first wearing posture of the earphones based on the second intent analysis result.

[0134] In one optional embodiment of the present application, the earphone is provided with a posture sensor, which is used to detect the posture of the earphone and generate a second wearing posture, and the first receiving module 73 is further used to determine whether the current posture of the earphone satisfies a target shooting request based on the second wearing posture, and in response to the earphone's current posture not satisfying the target shooting request, to provide a third notification to the user to remind the user to adjust the wearing posture of the earphone.

[0135] In one optional embodiment of the present application, the first receiving module 73 is further used to control the camera to collect at least one frame of the current ambient image after the user has adjusted the earphone wearing position in accordance with the third notice, and to jump to the step of transmitting at least one frame of the ambient image to the image analysis side.

[0136] In one optional embodiment of the present application, the first receiving module 73 is further used to provide a second notification to the user in response that the current orientation of the earphone satisfies the target shooting request.

[0137] In one optional embodiment of this application, the earphone is provided with a micro-adjustment mechanism, which is used to automatically adjust the camera's shooting angle in response to a first wearing position not meeting the target shooting requirement.

[0138] The control device for the camera-equipped earphone according to this embodiment may also be used to implement the technical proposal of the embodiment of the above method, and since its implementation principle and technical effect are similar, this embodiment will not be described here.

[0139] Figure 8 is a schematic diagram of the structure of a control device for a camera-equipped earphone according to an embodiment of the present application. As shown in Figure 8, the control device for the camera-equipped earphone is used in a terminal device, and the terminal device is equipped with an image analysis side, and the device includes a second receiving module 81, an analysis module 82, and a second transmitting module 83.

[0140] The second receiving module 81 is used to receive at least one frame of environmental image transmitted by the earphone, where the at least one frame of environmental image is collected by the earphone controlling the camera while the earphone is being worn. The analysis module 82 is used to analyze the environmental image by the image analysis side to obtain the detection result of the first wearing posture of the earphones. The second transmission module 83 transmits the detection result of the first wearing posture to the earphone side, and when the earphone side responds that the first wearing posture does not meet the target shooting request, it is used to send a first notification to the user to remind the user to adjust the wearing posture of the earphone.

[0141] In one optional embodiment of this application, after the second receiving module 81 is used to receive at least one frame of environmental image transmitted by the earphone side, the analysis module 82 is further used to perform intent analysis processing on the environmental image by the image analysis side to obtain a first intent analysis result of the user, and to obtain a detection result of a first wearing posture of the earphone based on the first intent analysis result.

[0142] In one optional embodiment of this application, a second receiving module 81 is further used to receive a first voice transmitted by the earphone, where the first voice is collected by the earphone. An analysis module 82 is further used to perform a comprehensive analysis based on the first voice and environmental images to determine a second user intent analysis result, and to obtain a first earphone wearing posture detection result based on the second intent analysis result.

[0143] In one optional embodiment of the present application, the image analysis side is used to display at least one frame of the environmental image on a real-time display screen in real time. Accordingly, the analysis module 82 is further used to jump to receiving at least one frame of the environmental image transmitted by the earphone side after the user adjusts the earphone wearing position in accordance with the third notification.

[0144] The control device for the camera-equipped earphone according to this embodiment may also be used to implement the technical proposal of the embodiment of the above method, and since its implementation principle and technical effect are similar, this embodiment will not be described here.

[0145] Figure 9 is a schematic diagram of the connection structure between the hardware components of an earphone according to an embodiment of the present application, and as shown in Figure 9, the earphone includes an earphone body 901, a camera 902, at least one processor 903, and memory 904.

[0146] The earphone unit 901 is worn by the user and used to establish a communication connection with the image processing side.

[0147] The camera is attached to the earphone body 901, and the camera 902 is used to collect at least one frame of environmental imagery.

[0148] In this embodiment, the earphone body 901 may include the main earphone structure, such as a housing, pickup, speaker, etc.

[0149] Memory 904 is used to store computer execution instructions. At least one processor 903 is used to execute computer execution instructions stored in memory 904 to realize each step of the embodiment of the above method. Specifically, you can refer to the relevant descriptions in the embodiments of the above method.

[0150] Optionally, the memory 904 may be independent or integrated with the processor 901.

[0151] If the memory 902 is installed independently, the earphone further includes a bus 905 for connecting the memory 904 and the processor 903.

[0152] Optionally, the earphone is further provided with a posture detector 906, which is used to detect and generate the wearing posture of the earphone body 901.

[0153] In this embodiment, the posture detector may be connected to the processor 904 inside the earphone body 901 by an electrical connection method in order to transmit the wearing posture of the earphone body 901 to the processor 904.

[0154] Optionally, the earphone is further equipped with a fine-adjustment mechanism 907, which is used to rotate the camera 902 and adjust the shooting angle of the camera 902. The fine-adjustment mechanism 907 is further connected to the processor 903 by an electrical connection to receive control commands issued from the processor 903.

[0155] Embodiments of this application further provide a computer-readable storage medium in which computer execution instructions are stored, and when a processor executes a computer execution instruction, the above-described method for controlling earphones with a camera is realized.

[0156] Embodiments of this application further provide a computer program product that, when executed by a processor, includes a computer program that implements the above-described method for controlling earphones with a camera.

[0157] In some embodiments provided by this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the embodiments of the apparatus described above are merely illustrative, and the module division is merely a logical functional division; in actual implementation, there may be other methods of division, for example, multiple modules may be combined, or integrated into another system, or some features may be ignored or not performed. Also, the coupling or direct coupling or communication connection between elements shown or discussed may be an indirect coupling or communication connection via some interface, apparatus or module, and may be in electrical, mechanical, or other forms.

[0158] The modules, shown as separate components, may or may not be physically separated, and the components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Depending on the actual needs, some or all of these modules can be selected to realize the embodiments of this embodiment.

[0159] Furthermore, each functional module in each embodiment of the present invention may be integrated into a single processing unit, each module may exist physically independently, or two or more modules may be integrated into a single unit. The unit consisting of the above modules may be implemented in hardware form, or in the form of a hardware and software functional unit.

[0160] The integrated module, implemented in the form of the above-described software function module, may be stored in a single computer-readable storage medium. The above-described software function module is stored in a storage medium containing several instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) or processor to perform some steps of the methods of each embodiment of this application.

[0161] It should be understood that the above-mentioned processor may be a Central Processing Unit (CPU), or it may be another general-purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. The general-purpose processor may be a microprocessor, or it may be any ordinary processor, etc. The steps of the method disclosed in combination with the invention can be directly embodied so as to be performed and completed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0162] The memory may include high-speed RAM memory and may further include non-volatile storage NVM, such as at least one disk memory, which may be a U disk, mobile hard disk, read-only memory, magnetic disk, or optical disk.

[0163] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For convenience of representation, the bus in the drawings of this application is not limited to a single bus or a single type of bus.

[0164] The above-mentioned storage medium may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk. The storage medium may also be any available medium accessible by a general-purpose computer or a dedicated computer.

[0165] By coupling an exemplary storage medium to a processor, the processor is enabled to read information from and write information to the storage medium. Of course, the storage medium may be a component of the processor. The processor and storage medium may be located in an Application Specific Integrated Circuit (ASIC). Of course, the processor and storage medium may be located as discrete components in electronic equipment or main control equipment.

[0166] Those skilled in the art will understand that all or some of the steps to implement the embodiments of each of the above methods can be completed by hardware associated with program instructions. The aforementioned program may be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the embodiments including each of the above methods, and the storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0167] The above describes the proposed technical solution of this application, but does not limit it. While the application has been described in detail with reference to the embodiments described above, those skilled in the art can still modify the technical solution described in the embodiments described above, or replace some or all of its technical features with equivalents. However, these modifications or replacements should be understood not to cause the essence of the corresponding technical solution to deviate from the scope of the technical solution of each embodiment of this application.

Claims

1. A method for controlling earphones with a camera, used on the earphone side, the method is With the aforementioned earphones attached, the camera is controlled to collect at least one frame of ambient imagery. The environmental image of at least one frame is transmitted to a terminal device, and the image analysis side deployed on the terminal device analyzes the environmental image to obtain a detection result for the first wearing posture of the earphones. A method for controlling an earphone with a camera, characterized by receiving a detection result of a first wearing posture transmitted by the terminal device, and, in response that the first wearing posture does not satisfy the target shooting request, issuing a first notification to the user to remind the user to adjust the wearing posture of the earphone.

2. The method according to claim 1, further comprising providing a second notification to the user in response that the first mounting posture satisfies the target imaging requirement.

3. The above-mentioned method of transmitting the environmental image of at least one frame to a terminal device, and having the image analysis side deployed on the terminal device analyze the environmental image to obtain a detection result for the first wearing posture of the earphones, is: The method according to 1 or 2, characterized in that it includes transmitting the environmental image of at least one frame to a terminal device, and an image analysis side deployed on the terminal device performs intent analysis processing on the environmental image to obtain a first intent analysis result of the user, and to obtain a detection result of a first wearing posture of the earphones based on the first intent analysis result.

4. To collect the first voice of the aforementioned user, The method according to claim 3, further comprising transmitting the first voice to a terminal device, and having an image analysis device deployed in the terminal device perform a comprehensive analysis based on the first voice and the environmental image to obtain a second user intent analysis result, and to obtain a first earphone wearing posture detection result based on the second intent analysis result.

5. A method for controlling earphones with a camera, used on the earphone side, wherein the earphone is equipped with an attitude detector, the attitude detector is used to detect the attitude of the earphone and generate a second wearing attitude, and the method is Based on the second wearing posture, it is determined whether the current posture of the earphone satisfies the target shooting requirement, A method for controlling an earphone with a camera, characterized by including a third notification to the user to remind them to adjust the wearing position of the earphone in response to the current position of the earphone not meeting the target shooting requirement.

6. The method according to 5, further comprising controlling the camera to collect at least one frame of the current ambient image after the user adjusts the earphone wearing position in accordance with the third notification, and then jumping to the step of transmitting the at least one frame of the ambient image to a terminal device.

7. The method according to claim 5, further comprising providing a second notification to the user in response that the current orientation of the earphone satisfies the target shooting requirement.

8. The method according to 1 or 5, characterized in that the earphone is provided with a micro-adjustment mechanism, which is used to automatically adjust the shooting angle of the camera in response to the first or second wearing position not satisfying the target shooting requirement.

9. A method for controlling earphones with a camera, used in a terminal device, wherein the terminal device is equipped with an image analysis side, and the method is The system receives at least one frame of ambient image transmitted by the earphone, wherein the ambient image of at least one frame was collected by the earphone controlling the camera while the earphone was being worn. The aforementioned image analysis device analyzes the environmental image to obtain a detection result for the first wearing posture of the earphones, A method for controlling an earphone with a camera, characterized by transmitting the detection result of the first wearing posture to the earphone, and when the earphone responds that the first wearing posture does not satisfy the target shooting request, it provides a first notification to the user to remind the user to adjust the wearing posture of the earphone.

10. After receiving at least one frame of the environmental image transmitted by the earphone, The method according to claim 9, further comprising performing intent analysis processing on the environmental image by the image analysis side to obtain a first intent analysis result of the user, and obtaining a detection result of a first wearing posture of the earphones based on the first intent analysis result.

11. The first voice transmitted by the earphone is received, and here, the first voice is collected by the earphone. The method according to 9, further comprising: performing a comprehensive analysis based on the first voice and the environmental image to determine a second user intent analysis result; and obtaining a detection result of the first wearing posture of the earphones based on the second intent analysis result.

12. The earphone is equipped with a posture detector, which is used to detect the posture of the earphone and generate a second wearing posture, and the method further includes jumping to receiving at least one frame of an environmental image transmitted by the earphone after the user has adjusted the wearing posture of the earphone in accordance with a third notification. The method according to 11, characterized in that the environmental image of at least one frame is collected by the earphone controlling the camera after the user adjusts the wearing position of the earphone in accordance with a third notification, the third notification is given to the user in response that the current position of the earphone does not satisfy the target shooting request, and the current position is determined by the earphone based on the second wearing position.

13. The method according to any one of claims 9 to 12, characterized in that the earphone side is connected to a terminal device, an earphone control side is provided on the earphone side, and an image analysis side is provided on the terminal device.

14. The image analysis side is used to display the environmental image of at least one frame on a real-time display screen. Accordingly, the above method is In response to the fact that the first mounting posture does not satisfy the target shooting requirement, the first notification is given to the user on the real-time display screen, or The method according to 13, further comprising providing a second notification to the user on the real-time display screen in response to the first mounting posture satisfying the target shooting requirement.

15. A method for controlling earphones with a camera, With the aforementioned earphones attached, acquire at least one frame of ambient imagery, The environmental image is analyzed to obtain the detection result of the first wearing posture of the earphones, A method for controlling an earphone with a camera, characterized by including giving a first notification to the user to remind them to adjust the earphone's wearing position in response to the first wearing position not satisfying the target shooting requirement.

16. The detection result of a second wearing posture is obtained while the aforementioned earphones are being worn. The method according to 15, further comprising providing a first notification to the user to remind the user to adjust the earphone wearing position in response that the second wearing position does not satisfy the target shooting requirement.

17. A control device for earphones with a camera, used on the earphone side, the device is A collection module for controlling the camera to collect at least one frame of environmental image while the aforementioned earphones are attached, A first transmission module for transmitting at least one frame of the environmental image to a terminal device so that an image analysis unit deployed in the terminal device can analyze the environmental image to obtain a detection result for the first wearing posture of the earphones, A control device for earphones with a camera, comprising: a first receiving module for receiving a detection result of a first wearing posture transmitted by the terminal device, and for making a first notification to the user to remind the user to adjust the wearing posture of the earphones in response that the first wearing posture does not satisfy the target shooting request.

18. A control device for earphones with a camera, used in a terminal device, the terminal device is equipped with an image analysis side, and the method is: A second receiving module receives at least one frame of ambient image transmitted by the earphone, wherein the ambient image of at least one frame is collected by the earphone controlling the camera while the earphone is being worn. An analysis module for analyzing the environmental image by the image analysis side to obtain a detection result of the first wearing posture of the earphones, A control device for an earphone with a camera, comprising: a second transmitting module for transmitting the detection result of the first wearing posture to the earphone, and for the earphone to issue a first notification to the user to remind the user to adjust the wearing posture of the earphone when the earphone responds that the first wearing posture does not satisfy the target shooting request.

19. An earphone comprising an earphone body, a camera, at least one processor, and memory, The aforementioned earphone body is worn by the user and used to establish a communication connection with the image processing side. The camera is attached to the earphone body and is used to collect at least one frame of environmental image. The aforementioned memory stores computer execution instructions. The earphone is characterized in that the at least one processor executes computer execution instructions stored in the memory to cause the at least one processor to execute the control method for the earphone with a camera according to any one of claims 1 to 4.

20. The earphone according to claim 19, further provided with an attitude detector, the attitude detector being used to detect and generate the wearing posture of the earphone body.

21. The earphone according to claim 19, further provided with a fine adjustment mechanism, the fine adjustment mechanism being used to rotate the camera and adjust the shooting angle of the camera.

22. A computer-readable storage medium, wherein the computer-readable storage medium stores computer execution instructions, and when a processor executes the computer execution instructions, it realizes the control method for earphones with a camera described in any one of claims 1 to 8, 9 to 14, or 15 to 16.

Images