Method and apparatus for controlling earphone having camera, and earphone and storage medium

Abstract

The embodiments of the present application relate to the technical field of information processing. Provided are a method and apparatus for controlling an earphone having a camera, and an earphone and a storage medium. The method comprises: when an earphone is in a worn state, controlling a camera to acquire at least one environmental image frame; sending the at least one environmental image frame to a terminal device, such that an image analysis end deployed on the terminal device analyzes an environmental image to obtain a detection result of a first wearing orientation of the earphone; and receiving the detection result of the first wearing orientation sent by the terminal device, and in response to the first wearing orientation failing to meet a target capture requirement, providing a first prompt to a user to prompt the user to adjust a wearing orientation of the earphone. The present application can solve the problem of the low quality of images captured by the camera due to a wearing orientation of the earphone having the camera.

Description

Control method and device of earphone with camera, earphone and storage medium

[0001] The present application claims priority to the Chinese patent application No. 202411311106.3, filed on September 19, 2024, and entitled "Control method and device of earphone with camera, earphone and storage medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the technical field of information processing, specifically to the technical field of earphone control, and particularly to a control method and device of earphone with camera, earphone and storage medium. BACKGROUND

[0003] With the increasing demand for electronic products, multi-functional electronic products are increasingly favored by people, such as adding a camera to a wearable device to collect environmental photos according to user needs. However, the shooting angle of the camera directly affects the image quality, which may result in the user's needs not being met. Therefore, how to efficiently collect images that meet the requirements in a timely manner after the user wears the wearable device is crucial.

[0004] The foregoing narrative is intended to provide general background information and does not necessarily constitute the prior art.

[0005] SUMMARY

[0006] The present application provides a control method and device of earphone with camera, earphone and storage medium, which are used to solve the problem of low image quality caused by the wearing posture of the earphone with camera.

[0007] In a first aspect, the embodiments of the present application provide a control method of earphone with camera, applied to an earphone end, the method comprising:

[0008] controlling the camera to collect at least one frame of environmental image when the earphone is in a wearing state;

[0009] sending the at least one frame of environmental image to a terminal device, so that an image analysis end deployed by the terminal device analyzes the environmental image to obtain a detection result of a first wearing posture of the earphone;

[0010] receiving the detection result of the first wearing posture sent by the terminal device, and in response to the first wearing posture not meeting a target shooting requirement, performing a first prompt to the user to remind the user to adjust the wearing posture of the earphone.

[0011] In a possible implementation, the method further comprises: in response to the first wearing posture meeting the target shooting requirement, performing a second prompt to the user.

[0012] In a possible implementation, the at least one frame of environment image is sent to the terminal device, so that an image analysis end deployed by the terminal device analyzes the environment image to obtain the detection result of the first wearing posture of the earphone, including: the at least one frame of environment image is sent to the terminal device, so that an image analysis end deployed by the terminal device performs intention analysis processing on the environment image to obtain a first intention analysis result of the user, and the detection result of the first wearing posture of the earphone is obtained according to the first intention analysis result.

[0013] In a possible implementation, further comprising: collecting the first speech of the user; and sending the first speech to the terminal device, so that an image analysis end deployed by the terminal device performs comprehensive analysis on the first speech and the environment image to obtain a second intention analysis result of the user, and the detection result of the first wearing posture of the earphone is obtained according to the second intention analysis result.

[0014] In a second aspect, the embodiments of the present application provide a control method of an earphone with a camera, the earphone is provided with a posture detector, the posture detector is used to detect a second wearing posture of the earphone, and the method comprises the following steps: determining whether a current posture of the earphone meets a target shooting requirement according to the second wearing posture; and in response to the current posture of the earphone not meeting the target shooting requirement, performing third prompting on a user to remind the user to adjust a wearing posture of the earphone.

[0015] In a possible implementation, further comprising: after the user adjusts the wearing posture of the earphone according to the third prompting, controlling the camera to collect at least one frame of current environment image, and jumping to the step of sending the at least one frame of environment image to the terminal device.

[0016] In a possible implementation, further comprising: in response to the current posture of the earphone meeting the target shooting requirement, performing second prompting on the user.

[0017] In a possible implementation, a micro-motion mechanism is arranged on the earphone, and the micro-motion mechanism is used to automatically adjust a shooting angle of the camera in response to the first wearing posture not meeting the target shooting requirement.

[0018] In a third aspect, the embodiments of the present application further provide a control method of an earphone with a camera, applied to a terminal device, and the method comprises the following steps:

[0019] receiving at least one frame of environment image sent by an earphone end, wherein the at least one frame of environment image is collected by the earphone end when the earphone is in a wearing state;

[0020] analyzing the environment image to obtain a detection result of a first wearing posture of the earphone;

[0021] sending the detection result of the first wearing posture to the earphone end, so that the earphone end prompts the user for the first time to remind the user to adjust the wearing posture of the earphone in response to the first wearing posture not meeting the target shooting requirement.

[0022] In a possible implementation, after receiving the at least one frame of environment image sent by the earphone end, the method further includes: performing intention analysis processing on the environment image to obtain a first intention analysis result of the user, and obtaining the detection result of the first wearing posture of the earphone according to the first intention analysis result.

[0023] In a possible implementation, the method further includes: receiving a first voice sent by the earphone end, wherein the first voice is collected by the earphone end; performing comprehensive analysis on the first voice and the environment image to determine a second intention analysis result of the user, and obtaining the detection result of the first wearing posture of the earphone according to the second intention analysis result.

[0024] In a possible implementation, the earphone is provided with a posture detector, the posture detector is used to detect a posture of the earphone to generate a second wearing posture, and the method further includes: after the user adjusts the wearing posture of the earphone according to the third prompt, jumping to receiving the at least one frame of environment image sent by the earphone end;

[0025] The at least one frame of environment image is collected by the camera controlled by the earphone end after the user adjusts the wearing posture of the earphone according to the third prompt; the third prompt is given to the user in response to a current posture of the earphone not meeting the target shooting requirement; and the current posture is determined by the earphone end according to the second wearing posture.

[0026] In a possible implementation, the earphone is connected with a terminal device, the earphone is configured with an image control end, and the terminal device is configured with an image analysis end.

[0027] In a possible implementation, the image analysis end is used to display the at least one frame of environment image in a real-time display picture; accordingly, the method further includes: giving the first prompt to the user in the real-time display picture in response to the first wearing posture not meeting the target shooting requirement, or giving a second prompt to the user in the real-time display picture in response to the first wearing posture meeting the target shooting requirement.

[0028] In a fourth aspect, the embodiments of the present application further provide a control method of an earphone with a camera, including:

[0029] acquire at least one frame of environment image when the earphone is in a wearing state;

[0030] analyze the environment image to obtain a detection result of a first wearing posture of the earphone;

[0031] in response to the first wearing posture not meeting a target shooting requirement, perform first prompting on a user to remind the user to adjust the wearing posture of the earphone.

[0032] In a fifth aspect, the embodiments of the present application further provide a control device of an earphone with a camera, applied to an earphone end, the device comprising:

[0033] a collection module, configured to control the camera to collect at least one frame of environment image when the earphone is in a wearing state;

[0034] a first sending module, configured to send the at least one frame of environment image to a terminal device, so that an image analysis end deployed by the terminal device analyzes the environment image to obtain a detection result of a first wearing posture of the earphone;

[0035] a first receiving module, configured to receive the detection result of the first wearing posture sent by the terminal device, and in response to the first wearing posture not meeting a target shooting requirement, perform first prompting on a user to remind the user to adjust the wearing posture of the earphone.

[0036] In a sixth aspect, the embodiments of the present application further provide a control device of an earphone with a camera, applied to a terminal device, the device comprising:

[0037] a second receiving module, configured to receive at least one frame of environment image sent by an earphone end, wherein the at least one frame of environment image is collected by the earphone end by controlling the camera when the earphone is in a wearing state;

[0038] an analysis module, configured to analyze the environment image to obtain a detection result of a first wearing posture of the earphone;

[0039] a second sending module, configured to send the detection result of the first wearing posture to the earphone end, so that the earphone end performs first prompting on a user to remind the user to adjust the wearing posture of the earphone in response to the first wearing posture not meeting a target shooting requirement.

[0040] In a seventh aspect, the embodiments of the present application further provide an earphone, comprising: an earphone body, a camera, at least one processor and a memory;

[0041] the earphone body is configured to be worn by a user and establish a communication connection with an image processing end;

[0042] The camera is mounted on the earphone body, and the camera is configured to collect at least one frame of environment image.

[0043] The memory stores computer-executable instructions.

[0044] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the control method of the earphone with a camera as described in the first aspect.

[0045] In a possible implementation, the earphone further comprises a posture detector configured to detect and generate a wearing posture of the earphone body.

[0046] In a possible implementation, the earphone further comprises a micro-motion mechanism configured to drive the camera to rotate to adjust a shooting angle of the camera.

[0047] In an eighth aspect, the embodiments of the present application further provide a computer-readable storage medium, which stores computer-executable instructions, and when a processor executes the computer-executable instructions, the control method of the earphone with a camera as described in the first aspect, the second aspect or the third aspect is implemented.

[0048] The control method, device, earphone and storage medium of the earphone with a camera provided by the present application, wherein the method first controls the camera to collect at least one frame of environment image, then sends the at least one frame of environment image to a terminal device, so that an image analysis end deployed by the terminal device analyzes the environment image to determine a detection result of a first wearing posture of the earphone, finally receives the first wearing posture sent by the terminal device, and when it is detected that the first wearing posture does not meet a target shooting requirement, a first prompt is given to the user to remind the user to adjust the wearing posture of the earphone. In this way, the environment image collected by the earphone end control camera meets the target shooting requirement. The problem that the image quality of the camera shooting is low due to the wearing posture of the earphone with a camera is avoided, and the image quality of the collected environment image is improved. BRIEF DESCRIPTION OF DRAWINGS

[0049] In order to more clearly illustrate the technical solutions of the embodiments of the present application or the prior art, the drawings needed in the embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and those skilled in the art can also obtain other drawings according to these drawings without creative labor.

[0050] Fig. 1 is a schematic diagram of an application scenario of the control method of the earphone with a camera provided by the embodiments of the present application;

[0051] FIG. 2 is a schematic diagram of an application scenario of the control method of the earphone with a camera according to an embodiment of the present application;

[0052] FIG. 3 is a schematic diagram of a flow of the control method of the earphone with a camera according to an embodiment of the present application;

[0053] FIG. 4 is a schematic diagram of a flow of the control method of the earphone with a camera according to an embodiment of the present application;

[0054] FIG. 5 is a schematic diagram of an interaction flow of the control method of the earphone with a camera according to an embodiment of the present application;

[0055] FIG. 6 is a schematic diagram of a flow of the control method of the earphone with a camera according to an embodiment of the present application;

[0056] FIG. 7 is a schematic diagram of a structure of a control device of the earphone with a camera according to an embodiment of the present application;

[0057] FIG. 8 is a schematic diagram of a structure of a control device of the earphone with a camera according to an embodiment of the present application;

[0058] FIG. 9 is a schematic diagram of a connection structure between the hardware of the earphone according to an embodiment of the present application. DETAILED DESCRIPTION

[0059] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0060] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the related data all comply with the relevant laws, regulations and standards of the relevant countries and regions, take necessary security measures, do not violate public order and good customs, and provide corresponding operation portals for the user to choose authorization or refusal.

[0061] And the present application relates to the collection of information about the user's surroundings, including but not limited to personal biological characteristics such as images and voice, the environment around the body and personal items, etc., and using artificial intelligence technology to make automated decisions, based on the results of automated decision-making to make decisions that have a significant impact on personal rights and interests, providing the user with the appropriate authorization selection operation portal for the user to choose to agree or refuse the automated decision-making results; if the user chooses to refuse, the camera can be automatically turned off; if the user agrees, the user's surroundings can be collected.

[0062] The inventor found that when the earphone with a camera shoots the surrounding environment for image collection, in the case of wearing an earphone, the camera can be turned on to collect images of the user's surroundings. These images are transmitted to the image processing end such as a mobile phone, cloud or server, etc. After being saved in the image processing end for the user to view or after image recognition and analysis processing in the image processing end, the information related to the image is fed back to the user. The inventor also found that when the image processing end processes the collected images, there are certain requirements for the quality of the images. However, because the earphone is not worn in the right position, problems such as the shooting angle of the image, the proportion of the image being blocked by the face or hair, the clarity of the image, etc. may occur. When these problems occur, the quality of the image does not meet the expected requirements. This makes the user directly review the collected image and not satisfied with the image quality, or leads to incorrect image information feedback to the user after image recognition and analysis processing in the image processing end, resulting in poor user experience.

[0063] To solve the above technical problems, the embodiments of the present application provide the following technical ideas to solve the problem: first, in the case of the user wearing the earphone, the camera is controlled to collect images of the user's surroundings, and then the collected image information is sent to the terminal device connected with the earphone. The image analysis end deployed on the terminal device is used to analyze the image to obtain a first wearing posture. When the first wearing posture does not meet the target shooting requirements, the user is prompted for the first time to remind the user to adjust the wearing posture of the earphone. In addition, when the image analysis end is also deployed on the earphone, the image analysis end deployed on the earphone can be used to analyze the obtained image without the need for sending and receiving operations, and the detection result of whether the wearing posture of the earphone meets the shooting requirements can be obtained.

[0064] Fig. 1 is an application scenario diagram of the control method of the earphone with a camera provided by the embodiments of the present application. As shown in Fig. 1, the scenario includes an earphone 101 and a terminal device 102 with an image analysis end deployed.

[0065] The earphone 101 is internally provided with an earphone control end, which can be a controller or a chip. The earphone 101 is used for being worn by a user. The earphone 101 is provided with a camera for collecting at least one frame of environmental image around the user. The earphone 101 sends the environmental image collected by the camera to the terminal device 102.

[0066] The terminal device 102 can be a mobile phone. The terminal device 102 is internally provided with an image analysis end, which can be a built-in software such as an artificial intelligence large model or other image analysis software. When the image analysis end receives the environmental image, the image analysis end analyzes the environmental image to determine the wearing posture of the earphone 102, and returns the wearing posture to the earphone 101. The terminal device 102 can return specific posture data to the earphone 101 through the image analysis end, so that the earphone control end of the earphone 101 determines whether the posture data meets the target shooting requirement, and gives a corresponding prompt to the user. In addition, the terminal device 102 can also directly determine whether the shooting standard is met according to the environmental image through the image analysis end, and return a corresponding prompt to the earphone. Alternatively, the terminal device 102 can also obtain information related to the image according to the image environment through the image analysis end, and return the information to the earphone.

[0067] FIG. 2 is a schematic diagram of an application scenario of a control method of an earphone with a camera according to an embodiment of the present application. As shown in FIG. 2, the difference between this scenario and the scenario shown in FIG. 1 is that the terminal device 102 is a server, a personal computer, a tablet computer or other computer-related devices. In this embodiment, the terminal device 102 in FIG. 2 is a personal computer.

[0068] The difference between the application scenarios shown in FIG. 1 and FIG. 2 is that the present embodiment also provides an application scenario, which only includes an earphone with a camera. The earphone obtains at least one frame of environmental image in a wearing state through the camera, analyzes the environmental image to obtain a detection result of a first wearing posture, and gives a first prompt to the user to remind the user to adjust the wearing posture in response to the first wearing posture not meeting a target shooting requirement.

[0069] It should be noted that the earphone 101 in the above application scenario is only one type of earphone disclosed in this embodiment. In addition to this type of Bluetooth earphone, it can also be other wireless Bluetooth earphones, bone conduction earphones or wired earphones. For this, the present embodiment does not make special limitations here.

[0070] FIG. 3 is a flowchart of a control method of an earphone with a camera according to an embodiment of the present application. The execution subject of the present embodiment can be the earphone control end in the earphone 101 in the embodiments shown in FIG. 1 or FIG. 2, or other computer-related control components. For this embodiment, no special limitations are made.

[0071] As shown in FIG. 3, the control method of the earphone with a camera includes:

[0072] S301: When the earphone is in a wearing state, control the camera to capture at least one frame of environment image.

[0073] In this embodiment, the wearing state of the earphone refers to the state when the user wears the earphone on the head. The earphone end controls the camera to start shooting the environment in front of the user to capture at least one frame of environment image. Here, at least one frame of environment image refers to the camera shooting can be a video or a photo.

[0074] S302: Send the at least one frame of environment image to the terminal device, so that the image analysis end deployed by the terminal device analyzes the environment image to obtain a detection result of a first wearing posture of the earphone.

[0075] In this embodiment, the at least one frame of environment image can be sent to the image analysis end by using a Bluetooth connection communication mode, sent by a wired communication mode through an earphone line, or sent by a wireless transmission communication mode such as WIFI, which is not particularly limited in this embodiment.

[0076] In this embodiment, the analysis of the environment image can be an image processing and recognition operation using an artificial intelligence large model, and the first wearing posture can be a shooting angle of the camera or a proportion of effective pixels in a shooting image.

[0077] In this embodiment, the detection result can be posture data of the first wearing posture, text, voice or diagram describing whether the first wearing posture meets the target shooting requirement, and description information related to the environment image.

[0078] S303: Receive the detection result of the first wearing posture sent by the image analysis end, and in response to the first wearing posture not meeting the target shooting requirement, give a first prompt to the user to remind the user to adjust the wearing posture of the earphone.

[0079] In this embodiment, when it is detected that the first wearing posture does not meet the shooting requirement, it means that the quality of the environment image shot by the camera has problems such as being blocked, wrong shooting angle, or low clarity. At this time, the first prompt is given to the user to remind the user to adjust the wearing posture of the earphone. In this example, the first prompt can be information that can make the user perceive that the wearing posture of the earphone needs to be adjusted. For example: the first prompt can be voice information, warning sound or vibration. When the user adjusts the wearing posture of the earphone, the camera can be controlled to shoot the environment image that meets the requirement.

[0080] For example, the user wants to take a picture of a cup full of water on the table. At this time, the camera shooting angle should be a downward angle. After the image analysis end analyzes, it is determined that the camera shooting angle is an upward angle. It can be known that the first wearing posture does not meet the target shooting requirement. At this time, the wearing posture of the earphone is adjusted so that the camera shooting angle is a downward angle. Then the camera shoots the environment image containing the cup.

[0081] In summary, the control method of the earphone with a camera provided in the embodiments of the present application first controls the camera to collect at least one environment image. Then the at least one environment image is sent to a terminal device, so that an image analysis end deployed by the terminal device analyzes the environment image to determine a first wearing posture of the earphone. Finally, the detection result of the first wearing posture sent by the terminal device is received. When it is detected that the first wearing posture does not meet the target shooting requirement, a first prompt is given to the user to remind the user to adjust the wearing posture of the earphone. In this way, the environment image collected by the earphone end control camera meets the target shooting requirement. The problem of low image quality caused by the wearing posture of the earphone with a camera is avoided, and the image quality of the collected environment image is improved.

[0082] Based on the above embodiments, in an optional embodiment of the present application, the control method of the earphone with a camera further includes: in response to the first wearing posture meeting the target shooting requirement, a second prompt is given to the user.

[0083] In the embodiment, the first wearing posture meeting the target shooting requirement means that the image quality of the environment image meets the expectation after analysis. For example, the image of the environment image is clear, and the proportion of the occlusion is less than a preset value. The second prompt can be information reminding the user that the earphone has been adjusted to the correct posture. The second prompt can be voice, text or vibration that is obviously different from the first prompt. For example, the first prompt is vibration for 5 times, each time for 1 second, and the second prompt is vibration for 1 time, and the vibration time is 2 seconds. The first prompt is a voice broadcast of "earphone posture needs to be adjusted, please adjust in time" played through the loudspeaker of the earphone, and the second prompt is "the earphone has completed the posture adjustment, please keep the posture".

[0084] Based on the above embodiments, in an optional embodiment of the present application, the control method of the earphone with a camera further includes:

[0085] Step A: sending the at least one environment image to a terminal device, so that an image analysis end deployed by the terminal device analyzes the environment image to obtain a first intention analysis result of the user, and obtains the detection result of the first wearing posture of the earphone according to the first intention analysis result.

[0086] In this embodiment, the intent analysis process can be a process in which the image analysis end uses a pre-trained artificial intelligence large model to obtain a result reflecting the user's intent based on the position of the object in the environment image and the proportion of the object in the environment image, and the like.

[0087] In this embodiment, the result that the environment image does not meet the target shooting requirement according to the first intent analysis result can be that the environment image may return incorrect information related to the environment image after being analyzed by the image analysis end according to the first intent analysis result. These information is not what the user expects. At this time, the first prompt is given to the user to remind the user to adjust the wearing posture of the earphone. Otherwise, the second prompt is given to the user to remind the user to keep the current wearing posture so as to collect the environment image expected by the user.

[0088] In summary, the control method of the earphone with a camera provided in the embodiments of the present application further sends the environment image to the image analysis end, so that the image analysis end performs intent analysis processing on the environment image to obtain the first intent analysis result of the user, and then determines whether the first wearing posture meets the target shooting requirement according to the first intent analysis result, and gives the first prompt or the second prompt to the user, thereby further improving the accuracy of the posture detection, so that the image quality of the environment image collected by the camera is higher.

[0089] Based on the above embodiments, in an optional embodiment of the present application, the control method of the earphone with a camera further includes:

[0090] Step B: Collecting the first voice of the user.

[0091] In this embodiment, the first voice of the user can be collected by controlling the sound pickup device installed in the earphone to pick up the sound emitted by the user. The first voice can be information expressing the needs of the user, for example, the content of the first voice can be "I want to know how many calories a cup of milk on the table contains".

[0092] Step C: Sending the first voice to the terminal device, so that the image analysis end deployed by the terminal device performs comprehensive analysis on the first voice and the environment image to obtain the second intent analysis result of the user, and obtains the detection result of the first wearing posture of the earphone according to the second intent analysis result.

[0093] In this embodiment, the artificial intelligence model deployed in the image analysis end can also perform comprehensive analysis according to the first voice and the environmental image. The comprehensive analysis can be a process of analyzing key words in the first voice, and combining objects in the environmental image to identify and determine the real intention of the user to collect the environmental image to obtain a second intention analysis result. For example, the key words in the first voice are "milk" and "a cup", and there is a cup of milk in the center of the environmental image. At this time, according to the second intention analysis result, it can be determined that the first wearing posture meets the target shooting requirement, and at this time, the user is prompted. On the contrary, when the milk in the environmental image is located at the edge of the environmental image or is not fully displayed, the artificial intelligence model cannot identify and detect it, and the user is prompted. In this embodiment, the detection result of the first wearing posture can be the user's intention analyzed by the image analysis end, or information related to the environmental image, such as the specific value of the heat of a cup of water.

[0094] In summary, the control method of the earphone with a camera provided in the embodiments of the present application further sends the first voice to the image analysis end, so that the image analysis end performs comprehensive analysis in combination with the first voice and the environmental image to determine a second intention analysis result of the user, and then determines whether the first wearing posture meets the target shooting requirement according to the second intention analysis result, and prompts the user with the first prompt or the second prompt, thereby further improving the accuracy of posture detection, so that the image quality of the environmental image collected by the camera is higher.

[0095] In an optional embodiment of the present application, the earphone is provided with a posture detector, and the posture detector is used to detect the posture of the earphone to generate a second wearing posture. The control method of the earphone with a camera further includes:

[0096] Step D: determining whether the current posture of the earphone meets the target shooting requirement according to the second wearing posture.

[0097] In this embodiment, the posture detector can be a sensor, instrument or device for detecting the posture information of the earphone, such as an accelerometer, an inclination sensor, a magnetometer, an inertial measurement unit (IMU) or a gyroscope. The second wearing posture is the wearing posture of the earphone collected by the posture detector.

[0098] Step E: in response to the current posture of the earphone not meeting the target shooting requirement, prompting the user with a third prompt to remind the user to adjust the wearing posture of the earphone.

[0099] In this embodiment, determining whether the current posture of the earphone meets the target requirement according to the second wearing posture can be: detecting that the second wearing posture meets the target shooting requirement, and then determining that the current wearing posture of the earphone meets the target shooting requirement.

[0100] In some embodiments, the second wearing posture obtained by the posture detector is acquired before the camera is controlled to capture at least one frame of environment image, and whether the current posture of the earphone meets the target shooting requirement is determined according to the second wearing posture.

[0101] In an optional embodiment of the present application, the control method of the earphone with a camera further includes:

[0102] Step F: After the user adjusts the wearing posture of the earphone according to the third prompt, the camera is controlled to capture at least one frame of current environment image, and the step of sending the at least one frame of environment image to the image analysis end is jumped to.

[0103] In the embodiment, after the user adjusts the wearing posture of the earphone according to the third prompt, the step S302 can be returned to again to detect and adjust the wearing posture of the earphone again until the wearing posture of the earphone can meet the target shooting requirement.

[0104] In summary, through multiple detections and adjustments of the wearing posture of the earphone, the environment image captured by the camera of the earphone can meet the target shooting requirement, thereby improving the image quality of the environment image captured by the camera.

[0105] In an optional embodiment of the present application, the control method of the earphone with a camera further includes:

[0106] Step G: When it is detected that the current posture of the earphone meets the target shooting requirement, a second prompt is given to the user.

[0107] In the embodiment, the second prompt is similar to the second prompt in the above-mentioned embodiments, and thus will not be described here again.

[0108] In summary, the control method of the earphone with a camera provided in the embodiments of the present application further detects the posture of the earphone by the posture detector to generate a second wearing posture, and determines whether the current posture of the earphone meets the target shooting requirement according to the second wearing posture and / or the first wearing posture. When it is detected that the current posture of the earphone does not meet the target shooting requirement, a third prompt is given to the user to remind the user to adjust the wearing posture of the earphone, thereby further improving the image quality of the environment image captured by the camera on the earphone.

[0109] Based on the above-mentioned embodiments, in an optional embodiment of the present application, a micro-motion mechanism is arranged on the earphone, and the micro-motion mechanism is used to automatically adjust the shooting angle of the camera when it is detected that the first wearing posture or the second wearing posture does not meet the target shooting requirement.

[0110] In the embodiment, the micro-motion mechanism can be a driving motor and a rotating rod. The driving motor drives the rotating rod to move after being started, and the rotating rod drives the camera to rotate, thereby achieving the purpose of adjusting the shooting angle of the camera.

[0111] To sum up, the control method of the earphone with the camera provided in the embodiments of the present application can also adjust the shooting angle of the camera through the micro-motion mechanism on the earphone when it is detected that the first wearing posture does not meet the target shooting requirement. The manual adjustment action of the user is reduced, and the adjustment efficiency and accuracy of the wearing posture of the earphone are improved, and thus the image quality of the environment image shot by the camera is improved.

[0112] FIG. 4 is a flowchart of a control method of an earphone with a camera provided in the embodiments of the present application. The execution subject of the present embodiment can be the terminal device 102 in the embodiments shown in FIG. 1 or FIG. 2, and the terminal device 102 is deployed with an image analysis end. Of course, the execution subject of the present embodiment can also be other computer-related devices or servers deployed with an image analysis end, and the present embodiment is not particularly limited.

[0113] As shown in FIG. 4, the control method of the earphone with the camera includes the following steps.

[0114] S401: receiving at least one frame of environment image sent by the earphone end, wherein the at least one frame of environment image is collected by the camera under the control of the earphone end when the earphone is in a wearing state.

[0115] S402: analyzing the environment image by the image analysis end to obtain a detection result of the first wearing posture of the earphone.

[0116] S403: sending the detection result of the first wearing posture to the earphone end, so that the earphone end responds to the first wearing posture not meeting the target shooting requirement, and performs first prompting on the user to remind the user to adjust the wearing posture of the earphone.

[0117] In the present embodiment, the processing process of the environment image in the image analysis end in steps S401 to S403 has been described in steps S301 to S303, and thus will not be described here.

[0118] To sum up, the control method of the earphone with the camera provided in the embodiments of the present application first analyzes the environment image to determine the first wearing posture of the earphone, and finally sends the first wearing posture to the earphone end. The earphone end control end performs first prompting on the user to remind the user to adjust the wearing posture of the earphone when it is detected that the first wearing posture does not meet the target shooting requirement. In this way, the environment image collected by the camera of the earphone end meets the target shooting requirement. The problem that the image quality of the image shot by the camera of the earphone with the camera is low due to the wearing posture is avoided, and the image quality of the collected environment image is improved.

[0119] In addition to sending the first wearing posture to the earphone end for detection, the first wearing posture can be directly detected at the image analysis end and the user can be reminded to adjust the earphone posture. Based on the above embodiment, in an optional embodiment of the present application, a control method of an earphone with a camera is provided, and after step S402, the method further includes: when it is detected that the first wearing posture does not meet the target shooting requirement, a first prompt is given to the user to remind the user to adjust the wearing posture of the earphone.

[0120] In the embodiment, the process of giving the first prompt to the user to remind the user to adjust the wearing posture of the earphone is directly performed at the image analysis end, so that the user can not perceive the first prompt given by the earphone. The first prompt can be perceived by the user in time, and the wearing posture of the earphone can be adjusted, so that the image quality of the finally collected environment is higher.

[0121] In an optional embodiment of the present application, after step S401, the method further includes:

[0122] Step S404: performing intention analysis processing on the environment image by the image analysis end to obtain a first intention analysis result of the user, and detecting a first wearing posture of the earphone according to the first intention analysis result.

[0123] In the embodiment, the process of performing intention analysis processing on the environment image in step S404 to giving the first prompt to the user has been described in step A of the above embodiment, and thus will not be repeated here.

[0124] Based on the above embodiment, in an optional embodiment of the present application, the method further includes:

[0125] Step S405: receiving a first voice sent by the earphone end, wherein the first voice is collected by the earphone end.

[0126] Step S406: performing comprehensive analysis on the first voice and the environment image to determine a second intention analysis result of the user, and detecting a first wearing posture of the earphone according to the second intention analysis result.

[0127] In the embodiment, after receiving the first voice sent by the earphone end, the processes of steps S405 to S406 and the processes of processing the first voice in steps B to C have been described, and thus will not be repeated here.

[0128] Based on the above embodiment, in an optional embodiment of the present application, the method further includes: the earphone is provided with a posture sensor, the posture sensor is used to detect the posture of the earphone to generate a second wearing posture, and the method further includes:

[0129] S407: The earphone is provided with a posture detector, the posture detector is used to detect the posture of the earphone to generate a second wearing posture, and the method further includes: after the user adjusts the wearing posture of the earphone according to the third prompt, jumping to receiving at least one frame of environment image sent by the earphone end; the at least one frame of environment image is collected by the camera controlled by the earphone end after the user adjusts the wearing posture of the earphone according to the third prompt; the third prompt is given to the user in response to the current posture of the earphone not meeting the target shooting requirement; and the current posture is determined by the earphone end according to the second wearing posture.

[0130] In the embodiment, the process that the posture detector is used to detect the posture of the earphone to generate the second wearing posture can be understood as detecting the wearing angle of the earphone by the sensor, and calculating the corresponding second wearing posture through the wearing angle of the earphone.

[0131] Specifically, in the embodiment, a third prompt can be generated when the posture detector detects that the difference between the two earphone wearing angles is greater than a preset angle threshold, to prompt the user to adjust the wearing posture of the earphone. It can be understood that when the earphone is first worn, it is required that the first angle a of the left earphone and the second angle β of the right earphone meet that a and β are both greater than a first angle threshold and less than a second angle threshold, and the absolute value of the difference between a and β is less than the second angle threshold, where the first angle threshold is, for example, -10°, and the second angle threshold is, for example, 10°. In the embodiment, it is required that the user looks straight ahead when wearing the left earphone and the right earphone, and the first angle is the included angle between a first vector representing the wearing direction of the left earphone and a horizontal plane when the left earphone is worn. The second angle is the included angle between a second vector representing the wearing direction of the right earphone and the horizontal plane when the right earphone is worn. The posture detector provided in the earphone can be a sensor. It can be understood that the sensor includes an inertial measurement unit (IMU), and the first measurement data includes first inertial measurement data. The first inertial measurement data includes three-axis attitude angle and acceleration. In the embodiment, the number of sensors can be one or more, and the sensor can also be other sensors, such as a pressure sensor, a speed sensor, an angle sensor, etc., which are not limited in the embodiment.

[0132] In the embodiment, after the user adjusts the wearing posture of the earphone according to the third prompt, the image analysis end receives at least one frame of environment image sent by the earphone end, and continues to execute the subsequent steps S402 to S403 until the image quality of the environment image shot by the camera reaches the expectation.

[0133] In an optional embodiment of the application, the earphone end is connected with the terminal device, the earphone end is configured with an earphone control end, and the terminal device is configured with an image analysis end.

[0134] In the embodiment, the image analysis end is located at the terminal device, and the image analysis end can be used to display at least one frame of image in real time. When the image is located at a server connected to the terminal device, the server is configured to analyze the shooting intention of the user based on the at least one frame of environment image, and determine whether the first wearing posture of the earphone meets the target requirement based on the intention analysis result of the shooting intention of the user.

[0135] Further, in an optional embodiment of the present application, the image analysis end is used to display at least one frame of environment image in a real-time display picture; accordingly, the method further comprises:

[0136] Step S408: in response to the first wearing posture not meeting the target shooting requirement, the user is prompted in the real-time display picture.

[0137] In the embodiment, when the first wearing posture does not meet the target shooting requirement, the user is prompted in the real-time display picture to remind the user to adjust the wearing posture of the earphone. In the embodiment, the first prompt can be a text prompt, an icon prompt with a reminding function, or a picture position prompt reminding the user that the wearing posture of the earphone meets the target shooting requirement. For example, the environment picture is displayed in the real-time display picture, and the position of the horizontal line in the vertical direction is displayed, so that the user can judge and adjust the wearing posture of the earphone according to the vertical and horizontal positions.

[0138] Step S409: or in response to the first wearing posture meeting the target shooting requirement, the user is prompted in the real-time display picture.

[0139] In the embodiment, when the first wearing posture meets the target shooting requirement, the user can directly see in the real-time display picture of the image analysis end that the environment image meets the expected image quality requirement. The second prompt can be a text prompt, an icon prompt with a reminding function, or a picture position prompt reminding the user that the wearing posture of the earphone meets the target shooting requirement.

[0140] In summary, the control method of the earphone with a camera provided by the embodiment of the present application displays at least one frame of environment image in a real-time display picture, so that when the user watches the shot environment image in the image analysis end, the user can directly know whether the wearing posture of the earphone meets the preset shooting requirement, and obtain a first prompt or a second prompt.

[0141] FIG. 5 is a schematic diagram of an interactive process of the control method of the earphone with a camera provided by the embodiment of the present application.

[0142] As shown in FIG. 5, the control method of the earphone with a camera comprises the following steps:

[0143] S501: when the earphone is in a wearing state, the earphone end controls the camera to collect at least one frame of environment image.

[0144] S502: The earphone end sends at least one frame of environment image to the image analysis end.

[0145] S503: The image analysis end analyzes the environment image to determine the first wearing pose of the earphone.

[0146] S504: The image analysis end sends the first wearing pose to the earphone end.

[0147] S505: The earphone end gives the first prompt to the user to remind the user to adjust the wearing pose of the earphone when it is detected that the first wearing pose does not meet the target shooting requirement.

[0148] It should be noted that in the embodiment, other steps can also be included to correspond to the specific method steps in each possible embodiment in the method embodiments shown in FIG. 3 and FIG. 4.

[0149] FIG. 6 is a flowchart of a control method of an earphone with a camera according to an embodiment of the present application. The difference between the embodiment and the above-mentioned embodiments is that in the embodiment, there is no interaction process, and the process of collecting environment image and analyzing the environment image are both performed locally on the earphone.

[0150] As shown in FIG. 6, the control method of the earphone with a camera includes the following steps:

[0151] S601: When the earphone is in a wearing state, at least one frame of environment image is acquired.

[0152] S602: The environment image is analyzed to obtain a detection result of the first wearing pose of the earphone.

[0153] S603: In response to the first wearing pose not meeting the target shooting requirement, the first prompt is given to the user to remind the user to adjust the wearing pose of the earphone.

[0154] In the embodiment, the image analysis end is deployed on the earphone end, and the process of acquiring at least one frame of environment image can be that the earphone end controls the camera to collect the environment image around the user. The image analysis end locally on the earphone can also analyze the environment image to obtain a detection result of the first wearing pose of the earphone. The subsequent operation process is of the same principle type as in the above-mentioned method embodiments, and therefore will not be described here again.

[0155] It should be noted that in the embodiment, other steps can also be included to correspond to the specific method steps in each possible embodiment in the method embodiments shown in FIG. 3 and FIG. 4.

[0156] In an optional embodiment of the present application, the control method of the earphone with a camera further includes:

[0157] S604: In the earphone is in the wearing state, the detection result of the second wearing state is obtained.

[0158] S605: In response to the second wearing state not meeting the target shooting requirement, the user is prompted for the first time to remind the user to adjust the wearing state of the earphone.

[0159] In this embodiment, the process of obtaining the second wearing state can be that the earphone end controls the posture detector to detect the wearing state of the earphone. When the target shooting requirement can be determined only according to the second wearing state, the user can be directly prompted for the first time without image analysis, so that the detection process is faster and more efficient. Of course, the result of image analysis can also be combined to determine whether the target shooting requirement is met, so as to improve the accuracy of the wearing detection and make the image quality of the obtained environment image higher.

[0160] FIG. 7 is a structural schematic diagram of a control device of an earphone with a camera according to an embodiment of the present application. As shown in FIG. 7, the control device of the earphone with the camera is applied to the earphone end, and the device includes a collection module 71, a first sending module 72, and a first receiving module 73.

[0161] The collection module 71 is configured to control the camera to collect at least one frame of environment image when the earphone is in the wearing state.

[0162] The first sending module 72 is configured to send the at least one frame of environment image to a terminal device, so that an image analysis end deployed by the terminal device analyzes the environment image to obtain a detection result of a first wearing state of the earphone.

[0163] The first receiving module 73 is configured to receive the detection result of the first wearing state sent by the terminal device, and in response to the first wearing state not meeting the target shooting requirement, the user is prompted for the first time to remind the user to adjust the wearing state of the earphone.

[0164] In an optional embodiment of the present application, the first receiving module 73 is further configured to: in response to the first wearing state meeting the target shooting requirement, the user is prompted for the second time.

[0165] In an optional embodiment of the present application, the first sending module 72 is further configured to: send the at least one frame of environment image to the terminal device, so that the image analysis end deployed by the terminal device performs intent analysis processing on the environment image to obtain a first intent analysis result of the user, and the detection result of the first wearing state of the earphone is obtained according to the first intent analysis result.

[0166] In an optional embodiment of the present application, the collection module 71 is further configured to collect a first voice of the user. The first sending module 72 is further configured to send the first voice to the terminal device, so that the image analysis end deployed by the terminal device performs comprehensive analysis on the first voice and the environmental image to obtain a second intent analysis result of the user, and a detection result of the first wearing posture of the earphone is obtained according to the second intent analysis result.

[0167] In an optional embodiment of the present application, the earphone is provided with a posture sensor, the posture sensor is configured to detect a second wearing posture of the earphone, and the first receiving module 73 is further configured to determine whether the current posture of the earphone meets the target shooting requirement according to the second wearing posture; and in response to the current posture of the earphone not meeting the target shooting requirement, the user is prompted for a third time to remind the user to adjust the wearing posture of the earphone.

[0168] In an optional embodiment of the present application, the first receiving module 73 is further configured to, after the user adjusts the wearing posture of the earphone according to the third prompt, control the camera to collect at least one frame of current environmental image, and jump to the step of sending the at least one frame of environmental image to the image analysis end.

[0169] In an optional embodiment of the present application, the first receiving module 73 is further configured to, in response to the current posture of the earphone meeting the target shooting requirement, prompt the user for a second time.

[0170] In an optional embodiment of the present application, a micro-motion mechanism is arranged on the earphone, and the micro-motion mechanism is configured to automatically adjust the shooting angle of the camera in response to the first wearing posture not meeting the target shooting requirement.

[0171] The control device of the earphone with the camera provided in the embodiment can be used to execute the technical solutions of the method embodiments, and has similar implementation principles and technical effects, which will not be described here in detail.

[0172] FIG. 8 is a structural schematic diagram of a control device of an earphone with a camera according to an embodiment of the present application. As shown in FIG. 8, the control device of the earphone with the camera is applied to a terminal device, the terminal device is deployed with an image analysis end, and the device comprises a second receiving module 81, an analysis module 82, and a second sending module 83.

[0173] The second receiving module 81 is configured to receive at least one frame of environmental image sent by the earphone end, wherein the at least one frame of environmental image is collected by the camera controlled by the earphone end when the earphone is in a wearing state.

[0174] The analysis module 82 is configured to analyze the environmental image by the image analysis end to obtain a detection result of a first wearing posture of the earphone.

[0175] The second sending module 83 is configured to send the detection result of the first wearing posture to the earphone end, so that the earphone end performs first prompting on the user to remind the user to adjust the wearing posture of the earphone when the first wearing posture does not meet the target shooting requirement.

[0176] In an optional embodiment of the present application, after the second receiving module 81 receives the at least one frame of environment image sent by the earphone end, the analysis module 82 is further configured to: perform intention analysis processing on the environment image through the image analysis end to obtain a first intention analysis result of the user, and obtain the detection result of the first wearing posture of the earphone according to the first intention analysis result.

[0177] In an optional embodiment of the present application, the second receiving module 81 is further configured to: receive the first voice sent by the earphone end, wherein the first voice is collected by the earphone end. The analysis module 82 is further configured to: perform comprehensive analysis on the first voice and the environment image to determine a second intention analysis result of the user, and obtain the detection result of the first wearing posture of the earphone according to the second intention analysis result.

[0178] In an optional embodiment of the present application, the image analysis end is configured to display the at least one frame of environment image in a real-time display picture in real time. Correspondingly, the analysis module 82 is further configured to: after the user adjusts the wearing posture of the earphone according to the third prompting, jump to receiving the at least one frame of environment image sent by the earphone end.

[0179] The control device of the earphone with a camera provided in the embodiment can be used to execute the technical solutions of the above-mentioned method embodiments, and has similar implementation principles and technical effects, which will not be described here in detail.

[0180] FIG. 9 is a schematic diagram of the connection structure between the various hardware of the earphone provided in the embodiment of the present application. As shown in FIG. 9, the earphone includes: an earphone body 901, a camera 902, at least one processor 903, and a memory 904.

[0181] The earphone body 901 is configured to be worn by the user and establish a communication connection with the image processing end.

[0182] The camera is installed on the earphone body 901, and the camera 902 is configured to collect at least one frame of environment image.

[0183] In the embodiment, the earphone body 901 can include earphone main body structures such as a shell, a microphone, a loudspeaker, etc.

[0184] The memory 904 is configured to store computer execution instructions.

[0185] The at least one processor 903 is configured to execute the computer execution instructions stored in the memory 904 to implement each step involved in the above-mentioned method embodiments. For details, please refer to the related description in the foregoing method embodiments.

[0186] Optionally, the memory 904 can be independent or integrated with the processor 901.

[0187] When the memory 902 is independent, the earphone further comprises a bus 905 for connecting the memory 904 and the processor 903.

[0188] Optionally, the earphone further comprises a posture detector 906, which is configured to detect and generate a wearing posture of the earphone body 901.

[0189] In the embodiment, the posture detector can be connected to the processor 904 in the earphone body 901 through electrical connection, and is configured to transmit the wearing posture of the earphone body 901 to the processor 904.

[0190] Optionally, the earphone further comprises a micro-motion mechanism 907, which is configured to drive the camera 902 to rotate to adjust a shooting angle of the camera 902. The micro-motion mechanism 907 is further connected to the processor 903 through electrical connection, and is configured to receive a control instruction sent by the processor 903.

[0191] The embodiment of the application further provides a computer readable storage medium, and the computer readable storage medium stores computer execution instructions. When the processor executes the computer execution instructions, the control method of the earphone with the camera is realized.

[0192] The embodiment of the application further provides a computer program product, which comprises a computer program. When the computer program is executed by the processor, the control method of the earphone with the camera is realized.

[0193] In the several embodiments provided by the present application, it should be understood that the disclosed device and method can be implemented in other ways. For example, the device embodiment described above is only illustrative. For example, the division of the above-mentioned modules is only a logical function division. In actual implementation, another division mode can be used. For example, a plurality of modules can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed modules can be indirect coupling or communication connection through some interfaces, devices or modules, and can be electrical, mechanical or other forms.

[0194] The modules described as separate components can or can not be physically separated, and the components displayed as modules can or can not be physical units, i.e. they can be located in one place or distributed on multiple network units. Some or all modules can be selected according to actual needs to realize the embodiment scheme.

[0195] In addition, each functional module in various embodiments of the present application can be integrated in one processing unit, or each module can be physically present alone, or two or more modules can be integrated in one unit. The unit composed of the above modules can be realized in the form of hardware or in the form of hardware plus software functional unit.

[0196] The integrated module realized in the form of software functional module can be stored in a computer readable storage medium. The software functional module is stored in a storage medium, and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to execute part of steps of the method of various embodiments of the present application.

[0197] It should be understood that the processor can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), etc. The general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the disclosed method can be directly embodied as hardware processor execution, or executed by a combination of hardware and software modules in the processor.

[0198] The memory can include a high-speed RAM memory, and can also include a non-volatile storage NVM, for example, at least one disk memory, and can also be a U disk, a mobile hard disk, a read-only memory, a magnetic disk or an optical disk, etc.

[0199] The bus can be an industry standard architecture (ISA) bus, a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, the bus in the drawings of the present application does not limit to only one bus or one type of bus.

[0200] The aforementioned storage medium can be realized by any type of volatile or nonvolatile storage devices or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic storage, a flash memory, a magnetic disk or an optical disk. The storage medium can be any available medium that can be accessed by a general or special purpose computer.

[0201] An exemplary storage medium is coupled to the processor so that the processor can read information from, and write information to, the storage medium. Of course, the storage medium can be a part of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the storage medium can exist as discrete components in the electronic device or host device.

[0202] Those skilled in the art can understand that all or part of the steps of the above-mentioned method embodiments can be completed by program instruction related hardware. The aforementioned program can be stored in a computer readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and various storage media that can store program codes.

[0203] The above description is intended to explain the technical solutions of the present application, but not to limit the present application; although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions recorded in the above embodiments can be modified, or some or all of the technical features can be replaced by equivalent technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A control method of an earphone with a camera, characterized by, The method applied to the earphone end comprises: When the earphone is in a wearing state, controlling the camera to capture at least one frame of environment image; Sending the at least one frame of environment image to a terminal device, so that an image analysis end deployed by the terminal device analyzes the environment image to obtain a detection result of a first wearing posture of the earphone; Receiving the detection result of the first wearing posture sent by the terminal device, and in response to the first wearing posture not satisfying a target shooting requirement, giving a first prompt to the user to remind the user to adjust the wearing posture of the earphone.

2. The method of claim 1, wherein, Further comprising: In response to the first wearing posture satisfying the target shooting requirement, giving a second prompt to the user.

3. The method according to claim 1 or 2, characterized in that, The step of sending the at least one frame of environment image to the terminal device, so that the image analysis end deployed by the terminal device analyzes the environment image to obtain the detection result of the first wearing posture of the earphone comprises: Sending the at least one frame of environment image to the terminal device, so that the image analysis end deployed by the terminal device performs intention analysis processing on the environment image to obtain a first intention analysis result of the user, and obtaining the detection result of the first wearing posture of the earphone according to the first intention analysis result.

4. The method of claim 3, wherein, Further comprising: Capturing a first voice of the user; Sending the first voice to the terminal device, so that the image analysis end deployed by the terminal device performs comprehensive analysis on the first voice and the environment image to obtain a second intention analysis result of the user, and obtaining the detection result of the first wearing posture of the earphone according to the second intention analysis result.

5. A control method of an earphone with a camera, characterized by, The method applied to the earphone end, the earphone is provided with a posture detector, the posture detector is used for detecting a second wearing posture of the earphone, the method comprises: Determining whether a current posture of the earphone satisfies a target shooting requirement according to the second wearing posture; In response to the current posture of the earphone not satisfying the target shooting requirement, giving a third prompt to the user to remind the user to adjust the wearing posture of the earphone.

6. The method of claim 5, wherein, Further comprising: After the user adjusts the wearing posture of the earphone according to the third prompt, controlling the camera to capture at least one frame of current environment image, and jumping to the step of sending the at least one frame of environment image to the terminal device.

7. The method of claim 5, wherein, Further comprising: In response to the current posture of the earphone satisfying the target shooting requirement, giving a second prompt to the user.

8. The method of claim 1 or 5, wherein, The earphone is provided with a micro-motion mechanism, the micro-motion mechanism is used for automatically adjusting a shooting angle of the camera in response to the first wearing posture or the second wearing posture not satisfying the target shooting requirement. 9.A method for controlling an earphone with a camera, the method comprising: The method applied to the terminal device, the terminal device is deployed with an image analysis end, the method comprises: Receiving at least one frame of environment image sent by an earphone end, wherein the at least one frame of environment image is captured by the earphone end when the earphone is in a wearing state; Analyzing the environment image by the image analysis end to obtain a detection result of a first wearing posture of the earphone; The detection result of the first wearing posture is sent to the earphone end, so that the earphone end prompts the user to adjust the wearing posture of the earphone when the first wearing posture does not meet the target shooting requirement.

10. The method of claim 9, wherein, After receiving the at least one frame of environment image sent by the earphone end, the method further comprises: The image analysis end analyzes the environment image to obtain a first intention analysis result of the user, and the detection result of the first wearing posture of the earphone is obtained according to the first intention analysis result.

11. The method of claim 9, wherein, Further comprising: Receiving the first voice sent by the earphone end, wherein the first voice is collected by the earphone end; According to the first voice and the environment image, a second intention analysis result of the user is obtained, and the detection result of the first wearing posture of the earphone is obtained according to the second intention analysis result.

12. The method of claim 11, wherein, The earphone is provided with a posture detector for detecting the posture of the earphone to generate a second wearing posture, and the method further comprises: after the user adjusts the wearing posture of the earphone according to the third prompt, jumping to receiving at least one frame of environment image sent by the earphone end; The at least one frame of environment image is collected by the camera controlled by the earphone end after the user adjusts the wearing posture of the earphone according to the third prompt; the third prompt is given to the user in response to the current posture of the earphone not meeting the target shooting requirement; and the current posture is determined by the earphone end according to the second wearing posture.

13. The method according to any one of claims 9 to 12, characterized in that, The earphone end is connected with a terminal device, and the earphone end is configured with an earphone control end, and the terminal device is configured with an image analysis end.

14. The method of claim 13, wherein, The image analysis end is used to display the at least one frame of environment image in a real-time display picture; Accordingly, the method further comprises: In response to the first wearing posture not meeting the target shooting requirement, the user is prompted in the real-time display picture; or In response to the first wearing posture meeting the target shooting requirement, the user is prompted in the real-time display picture.

15. A control method of an earphone with a camera, the method comprising: Comprising: When the earphone is in a wearing state, at least one frame of environment image is acquired; The environment image is analyzed to obtain a detection result of the first wearing posture of the earphone; In response to the first wearing posture not meeting the target shooting requirement, the user is prompted to adjust the wearing posture of the earphone.

16. The method of claim 15, wherein, Further comprising: When the earphone is in a wearing posture, a detection result of a second wearing posture is obtained; In response to the second wearing posture not meeting the target shooting requirement, the user is prompted to adjust the wearing posture of the earphone.

17. A control device for a camera-equipped earphone, characterized by Applied to the earphone end, the device comprises: The acquisition module is used to control the camera to collect at least one frame of environment image when the earphone is in a wearing state; The first sending module is used to send the at least one frame of environment image to a terminal device, so that an image analysis end deployed by the terminal device analyzes the environment image to obtain a detection result of the first wearing posture of the earphone; The first receiving module is configured to receive a detection result of a first wearing posture of the earphone sent by the terminal device, and in response to the first wearing posture not meeting a target shooting requirement, perform first prompting on a user to remind the user to adjust the wearing posture of the earphone.

18. A control device for a camera-equipped earphone, characterized by The method is applied to a terminal device, and the terminal device is deployed with an image analysis end. The second receiving module receives at least one frame of environment image sent by the earphone end, wherein the at least one frame of environment image is collected by the camera controlled by the earphone end when the earphone is in a wearing state. The analysis module is configured to analyze the environment image by using the image analysis end to obtain a detection result of a first wearing posture of the earphone. The second sending module is configured to send the detection result of the first wearing posture to the earphone end, so that the earphone end performs first prompting on a user to remind the user to adjust the wearing posture of the earphone in response to the first wearing posture not meeting a target shooting requirement.

19. An earphone, characterized by The earphone comprises: An earphone body, a camera, at least one processor and a memory. The earphone body is configured to be worn by a user and establish a communication connection with an image processing end. The camera is installed on the earphone body, and the camera is configured to collect at least one frame of environment image. The memory stores computer execution instructions. The at least one processor executes the computer execution instructions stored in the memory, so that the at least one processor executes the control method of the earphone with the camera according to any one of claims 1 to 4.

20. The earphone of claim 19, wherein, The earphone further comprises a posture detector configured to detect and generate a wearing posture of the earphone body.

21. The earphone of claim 19, wherein, The earphone further comprises a micro-motion mechanism configured to drive the camera to rotate to adjust a shooting angle of the camera.

22. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer execution instructions, and when the processor executes the computer execution instructions, the control method of the earphone with the camera according to any one of claims 1 to 8, 9 to 14 or 15 to 16 is implemented.

Images