Control method of earphone, earphone and storage medium

Abstract

The application discloses a control method of earphones, earphones and a storage medium, relates to the technical field of wireless earphones, and discloses a control method of earphones, which is applied to earphones, at least one earphone unit of the earphones is provided with an image module, the image module is connected with the earphone unit through a rotating mechanism, and the control method of the earphones comprises the following steps: determining an occlusion type according to an image collected by the image module; if the occlusion type is an avoidable occlusion, determining a rotating direction according to position information of the occlusion; and controlling the rotating mechanism to drive the image module to move in the rotating direction, so as to reduce the area of the avoidable occlusion in the image. Based on this, when the occlusion in the image collected by the image module is an avoidable occlusion, the earphones automatically calculate the direction that needs to be rotated based on the avoidable occlusion, thereby effectively controlling the rotating mechanism to drive the image module to rotate, so as to reduce the area of the occlusion in the image, and the shooting effect of the earphones is improved.

Description

Technical Field

[0001] This application relates to the field of wireless headphone technology, and more particularly to headphone control methods, headphone, and storage medium. Background Technology

[0002] For wireless earbuds with integrated camera functionality, the camera is mounted on the earbuds, allowing users to easily take photos from specific angles while wearing them. Because the shooting position is fixed, users often find obstructed parts in the image after taking the picture, and then adjust the earbud position based on the obstructed content. It can be seen that when shooting with earbuds, the image quality deteriorates due to obstructions.

[0003] The above content is only used to help understand the technical solution of this application and does not represent an admission that the above content is prior art. Summary of the Invention

[0004] The main objective of this application is to provide a control method for headphones, headphones, and a storage medium, aiming to solve the technical problem of poor headphone shooting effect caused by obstruction.

[0005] To achieve the above objectives, this application proposes a control method for headphones, wherein at least one earphone unit of the headphones is provided with an image module, the image module being connected to the earphone unit via a rotating mechanism, and the method comprising:

[0006] The type of obstruction is determined based on the image captured by the image module;

[0007] If the obstruction is an avoidable obstruction, the rotation direction is determined based on the position information of the obstruction;

[0008] The rotating mechanism is controlled to drive the image module to move in the rotation direction in order to reduce the area of ​​the occluder in the image.

[0009] In one embodiment, the step of determining the type of occlusion based on the image acquired by the image module includes:

[0010] Determine the occlusion position of the occluder in the image;

[0011] The selectable avoidance direction and the current state of the rotating mechanism are determined based on the obstruction position.

[0012] The type of obstruction is determined based on the selectable avoidance direction and the current state.

[0013] In one embodiment, the step of determining the type of obstruction based on the selectable avoidance direction and the current state includes:

[0014] The rotatable direction of the rotating mechanism is determined based on the current state;

[0015] If the rotatable direction is the same as the dodgeable direction, the obstruction type is determined to be an dodgeable obstruction.

[0016] Otherwise, the type of obstruction is determined to be an unavoidable obstruction.

[0017] In one embodiment, the step of determining the type of occlusion based on the image acquired by the image module includes:

[0018] Obtain the image recognition result of the image;

[0019] If the recognition result is a cheek, the obstruction is determined to be an avoidable obstruction.

[0020] If the identification result is hair, the occlusion type is determined based on the occlusion area of ​​the occluder.

[0021] In one embodiment, the step of determining the occlusion type based on the occlusion area of ​​the obstruction includes:

[0022] If the obstruction area is less than a preset threshold, the obstruction is determined to be an avoidable obstruction.

[0023] If the obstruction area is greater than or equal to a preset threshold, the obstruction is determined to be an unavoidable obstruction.

[0024] In one embodiment, the step of determining the rotation direction based on the position information of the obstruction includes:

[0025] The orientation of the occluder in the image is determined based on the location information;

[0026] Based on the stated direction, the target direction opposite to the stated direction is set as the rotation direction.

[0027] In one embodiment, after the step of controlling the rotation mechanism to drive the image module to move in the rotation direction to reduce the area of ​​the occluder in the image, the method further includes:

[0028] Obtain the area information of the obstruction when the rotating mechanism is in motion;

[0029] If the rotating mechanism is in motion and the area information is positively correlated with the motion time, the rotating mechanism is controlled to stop running.

[0030] In one embodiment, after determining the type of occlusion based on the image acquired by the image module, the method further includes:

[0031] If the obstruction is an unavoidable obstruction, an anti-obstruction prompt is output based on the location information of the obstruction.

[0032] In addition, to achieve the above objectives, this application also proposes an earphone, the earphone comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the earphone control method described above.

[0033] In addition, to achieve the above objectives, this application also proposes a storage medium, which is a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, it implements the steps of the headphone control method described above.

[0034] One or more technical solutions proposed in this application have at least the following technical effects:

[0035] During filming, if an obstruction appears within the field of view and is avoidable, the camera's image module is adjusted to a different shooting direction based on the obstruction's location. The rotating mechanism is then controlled to rotate the image module, reducing the area of ​​the obstruction within the shooting range. This allows the wireless earphones to effectively avoid obstructions during filming, thus improving the shooting results. Attached Figure Description

[0036] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0037] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0038] Figure 1 This is a flowchart illustrating the first embodiment of the headphone control method of this application;

[0039] Figure 2 A schematic diagram showing an optional obstruction within the shooting range provided for the control method of the headphones in this application;

[0040] Figure 3 Another optional schematic diagram showing the obstruction within the shooting range provided for the control method of the headphones in this application;

[0041] Figure 4 This is a flowchart illustrating the second embodiment of the headphone control method of this application.

[0042] Figure 5 This is a flowchart illustrating the third embodiment of the headphone control method of this application.

[0043] Figure 6 This is a flowchart illustrating the fourth embodiment of the headphone control method of this application.

[0044] Figure 7 This is a schematic diagram of the device structure of the hardware operating environment involved in the headphone control method in this application embodiment.

[0045] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0046] It should be understood that the specific embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit this application.

[0047] The main solution of this application embodiment is to determine the type of occlusion based on the image captured by the image module, and when the occlusion type is an avoidable occlusion, determine the corresponding rotation direction, and control the rotation mechanism to drive the image module to move in the rotation direction, so as to reduce the area of ​​the occlusion in the captured image. Based on this, the earphone equipped with the image module can actively avoid the detected occlusion when shooting, thereby improving the shooting effect.

[0048] In this embodiment, for ease of description, the following description uses headphones as the execution subject.

[0049] To better understand the technical solution of this application, a detailed description will be provided below in conjunction with the accompanying drawings and specific implementation methods.

[0050] This application provides a control method for headphones, applicable to wireless headphones such as OWS (Open Wearable Stereo) headphones, TWS (True Wireless Stereo) headphones, or over-ear headphones. The headphones include an image module connected to the headphone unit via a rotating mechanism. This rotating mechanism can be a single-axis rotating mechanism, a two-axis rotating mechanism, a ball joint rotating mechanism, or a universal joint rotating mechanism. The image module includes at least a camera device, a storage module, and an image processing module. The headphones capture and transmit images or videos based on the camera device of the image module.

[0051] Please refer to Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the headphone control method of this application.

[0052] In this embodiment, the control method for the headphones includes steps S10 to S30:

[0053] Step S10: Determine the type of occlusion based on the image captured by the image module.

[0054] It should be noted that obstructions are divided into avoidable obstructions and unavoidable obstructions. Avoidable obstructions refer to those whose proportion of the current shooting range can be reduced after the shooting position of the image module is changed by rotating the mechanism, while unavoidable obstructions are those whose proportion of the current shooting range can be reduced.

[0055] In this embodiment, when the earphone determines through image analysis that there is an obstruction in the currently captured image, or when it receives an obstruction avoidance command from a control terminal such as a charging case or mobile phone, the earphone analyzes the type of obstruction in the image captured by the image module.

[0056] Specifically, when the headphone's image module is in operation, it reads the currently captured preview image in real time, then divides the captured image into multiple small blocks and analyzes each block separately. By comparing each block with features in a preset occlusion feature library, it determines whether an occlusion exists in that block. Alternatively, it analyzes the light intensity of the preview image to determine the presence of an occlusion. For example, if the light intensity in a certain area is the same as the light intensity when hair is used to cover the image, then an occlusion is determined to be present in the captured image. Optionally, it can also identify the contour information of the image content, perform image analysis and comparison based on this contour information, and then identify whether an occlusion exists. For example, if a facial contour is identified, it is determined that an occlusion exists in the captured image.

[0057] When an obstruction appears in the acquired image, the type of obstruction can be determined by the rotatable space of the image module and the avoidable direction of the obstruction, or by the avoidable direction of the obstruction. Specifically, the rotatable space of the image module refers to the remaining rotation space of the image module in the current shooting state, which is determined based on the current state of the rotation mechanism. For example, if the rotation mechanism can rotate 20° to the right and 50° to the left, then the rotatable space is determined to be 20° to the right and 50° to the left.

[0058] The dodgeable direction refers to a direction different from the direction of the obstruction in the field of view. For example, after identifying the obstruction on the left side of the field of view, the dodgeable directions of the obstruction are determined to be the right side and the top and bottom sides. It should be understood that the above types of dodgeable directions are for illustrative purposes only, and can be rotated in three dimensions, not limiting the dodgeable direction to two dimensions.

[0059] Specifically, if there is a direction in the rotatable space that is the same as the dodgeable direction, then the occluder is determined to be an dodgeable occluder. Alternatively, if the occluder has an dodgeable direction when the image module can rotate in any direction, then the occluder is determined to be an dodgeable occluder.

[0060] In this embodiment, image analysis technology is used to identify the avoidable direction of obstructions in the image. At the same time, the type of obstruction is determined based on the rotatable space of the image module. When the obstruction is determined to be an avoidable obstruction, the rotation mechanism is controlled to adjust the shooting position of the image module, reducing the proportion of the obstruction in the shooting range. This allows the headphones to automatically identify and avoid obstructions that appear during the shooting process, thereby improving the shooting effect of the headphones.

[0061] Step S20: If the type of the obstruction is an avoidable obstruction, determine the rotation direction based on the position information of the obstruction.

[0062] It should be noted that the location information of the obstruction includes the current position of the obstruction, and the direction of rotation of the rotating mechanism can be determined based on the location information.

[0063] In this embodiment, during the process of determining the rotation direction based on position information, the position information of the occluder is first analyzed using an image processing algorithm to determine the orientation of the occluder in the image. Then, the orientation of the unoccluded position of the occluder is determined based on its orientation, so that this orientation is set as the rotation direction. For example, if the occluder is located on the left in the image, then the right, top, or bottom position is set as the rotation direction.

[0064] For example, please refer to Figure 2 , Figure 2 For an image captured by the current image module containing an avoidable obstruction, image analysis technology determines that the obstruction is located on the left side of the shooting range. The corresponding rotatable direction for the obstruction is either right, top, or bottom. When the image module rotates up or down, the area of ​​the obstruction within the shooting range may remain the same or increase after rotation. In determining the rotation direction, the direction opposite to the direction where the obstruction is located is usually chosen.

[0065] Therefore, as an alternative implementation, the orientation of the occluder in the image can be determined based on the location information, and then the target orientation opposite to that orientation can be set as the rotation direction.

[0066] It is understandable that the rotating mechanism can move in multiple directions. Therefore, in addition to selecting the target direction opposite to the direction of the obstruction as the rotation direction, other directions that can reduce the area of ​​the obstruction can also be selected as the rotation direction. For example, please refer to... Figure 3 At this point, the obstruction is located in the upper left corner. The downward direction can be selected as the rotation direction of the rotating mechanism, so that when the rotating mechanism rotates downward, the shooting range is downward, thereby gradually reducing the obstruction area.

[0067] In this embodiment, when the obstruction is an avoidable obstruction, the direction of rotation to be turned is calculated in real time based on the position information of the avoidable obstruction, so that the earphone can control the rotating mechanism to rotate based on the rotation direction, thereby realizing the automatic adjustment of the earphone to prevent obstruction, and at the same time, the shooting position can be adjusted in real time to improve the shooting effect.

[0068] Optionally, if the obstruction is unavoidable, an anti-obstruction prompt can be output based on the obstruction's location information. This prompt allows the user to adjust the headphone's shooting range or the rotation mechanism accordingly. For example, an anti-obstruction prompt voice message can be generated stating that an obstruction exists at the current left shooting position, affecting normal shooting results, and requesting the user to adjust the shooting position or remove the obstruction. This prompt information can then be output through the headphone's audio playback module.

[0069] Step S30: Control the rotating mechanism to drive the image module to move in the rotation direction to reduce the area of ​​the occluder in the image.

[0070] In this embodiment, controlling the rotation mechanism to drive the image module to move in the rotation direction not only reduces the area of ​​the obstruction in the image, i.e., reduces the overlap area between the avoidable obstruction and the shooting field of view, but also allows the avoidable obstruction to leave the shooting field of view of the image module, thereby improving the shooting effect of the headphones.

[0071] In controlling the rotating mechanism to drive the image module in the rotational direction, the rotation parameters of the rotating mechanism, including the required rotation step size, can be determined first. Then, the rotation mechanism's movement is controlled based on the rotation step size and rotation direction. The rotation step size can be determined based on the proportion or area of ​​the obstruction within the shooting range. Please refer to [further details omitted]. Figure 2 By calculating that the obstruction occupies 25% of the shooting range, and using the mapping relationship between the rotation angle of the rotating mechanism and the range of the image module, the step size for rotating to the right is determined to be 30°. At this point, it is necessary to control the rotating mechanism to rotate 30° to the right, thereby effectively reducing...

[0072] This embodiment provides a control method for headphones. When there is an obstruction in the image captured by the image module, the type of obstruction is identified. If the obstruction is an avoidable obstruction, the rotation direction of the rotating mechanism is determined based on the pose of the obstruction, and the rotating mechanism is controlled to run based on the rotation direction. This allows the avoidable obstruction to leave the current shooting field of view, or reduces the overlap area between the avoidable obstruction and the shooting field of view. When the image module based on the headphones is shooting, the headphones can automatically identify and avoid the obstruction, thereby improving the shooting effect.

[0073] Based on the first embodiment of this application, in the second embodiment of this application, the content that is the same as or similar to the first embodiment described above can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 4 Step S10 also includes steps S11 to S13:

[0074] Step S11: Determine the occlusion position of the occluder in the image.

[0075] In this embodiment, the position of the occluder in the image can be determined first using image recognition technology, and then an optional avoidance direction can be determined based on the occlusion position. For example, after detecting the occluder in the image using deep learning algorithms such as YOLO and SSD, the algorithm outputs the position, size, and category information of the occluder. The size includes the area occupied within the shooting range, and the category information includes basic information about the occluder, such as trees, hair, or a cheek. The optional avoidance direction is the direction opposite to the direction of the occlusion position, but it can also be other directions besides the direction of the occlusion position. For example, if the occlusion position is on the left, the optional avoidance directions can be the right, above, or below.

[0076] By determining the location of the obstruction, and then determining the optional avoidance direction of the rotating mechanism based on the location of the obstruction, the accuracy of determining the type of obstruction can be improved.

[0077] Step S12: Determine the selectable avoidance direction and the current state of the rotating mechanism based on the obstruction position.

[0078] In this embodiment, an optional avoidance direction can be generated based on the analysis of the obstruction position of the obstruction. The avoidance direction is the direction away from the obstruction area, ensuring that after the rotating mechanism adjusts the shooting range, the proportion of the obstruction in the shooting range gradually decreases or disappears.

[0079] After determining the possible evasion direction, it is also necessary to determine the current state of the rotating mechanism. The state of the rotating mechanism includes full rotation and non-full rotation. Full rotation means that the rotating mechanism cannot continue to rotate in a certain direction. For example, when it is in the right full rotation state, it means that the rotating mechanism cannot continue to rotate to the right to adjust the shooting field of the image module.

[0080] By determining the current state of the analysis rotation mechanism, the rotatable space of the image module is determined, so that when the rotatable space is the same as the selectable avoidance direction, the current occlusion is determined to be an avoidable occlusion.

[0081] Step S13: Determine the type of obstruction based on the selectable avoidance direction and the current state.

[0082] In this embodiment, after obtaining the evasive direction and the current state, it is necessary to first determine the rotatable direction of the rotating mechanism based on the current state. For example, if the current state is full right rotation, the rotatable direction is to the left. If the current state is not full rotation, the rotatable direction is the direction that the rotating mechanism is set to be able to rotate.

[0083] After determining the rotatable direction, if the rotatable direction is the same as the dodgeable direction, then the obstruction type is determined to be a dodgeable obstruction. In this case, the rotatable direction and the dodgeable direction are considered to be a single direction.

[0084] Optionally, the rotatable direction and the dodgeable direction can be a set of multiple directions in addition to being a single direction. Therefore, if a subset of the rotatable directions contains a subset that is the same as the dodgeable direction, then the occlusion type is determined to be a dodgeable occlusion.

[0085] If the rotatable direction and the avoidable direction are not the same, or if they do not share a common subset of directions, then the obstruction is determined to be an unavoidable obstruction. For example, if the obstruction is located to the left, right, or below the field of view, and the corresponding avoidable direction is upward, while the rotatable direction of the rotating mechanism is only to the right, then the obstruction cannot be avoided and is therefore determined to be an unavoidable obstruction.

[0086] This embodiment provides a control method for headphones. By analyzing the position information of the obstruction and the corresponding avoidable direction, as well as the current state of the rotating mechanism, it is possible to determine whether the obstruction is an avoidable obstruction based on the avoidable direction and the current state of the rotating mechanism. When the obstruction is an avoidable obstruction, the headphones can flexibly control the shooting field of view based on the type of obstruction, thereby improving the shooting effect.

[0087] Based on the first embodiment of this application, in the third embodiment of this application, the content that is the same as or similar to that in the first embodiment can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 5 Step S10 also includes steps S14 to S16:

[0088] Step S14: Obtain the image recognition result of the image.

[0089] Step S15: If the recognition result is a cheek, the obstruction is determined to be an avoidable obstruction.

[0090] Step S16: If the identification result is hair, determine the occlusion type based on the occlusion area of ​​the occluder.

[0091] In this embodiment, image recognition technology is used to analyze the specific content of the occlusion in the image. For example, the occlusion is determined to be hair based on the current shooting brightness.

[0092] For example, based on the current shooting brightness, methods such as adaptive histogram equalization or the Retinex algorithm can be used to enhance the image contrast, making the contrast between hair and background more obvious. This allows the occlusion to be identified as hair. Alternatively, the color vectors of pixels in the image can be analyzed, including the values ​​of the three channels: red (R), green (G), and blue (B). Since the color of hair is usually different from the ambient color, it can be initially distinguished using color features. Optionally, edge detection algorithms such as edge detection and the Sobel operator can be used to extract edge information from the image. The edges of hair are usually finer and irregular, while the edges of cheeks are relatively smooth. Based on this, the occlusion can be identified as hair or cheek. In this process, an image dataset containing images of hair and cheek occlusions needs to be prepared for training and validating the algorithm. The dataset should include images under different lighting conditions, at different angles, and with different degrees of occlusion. Then, the prepared dataset is used to train a machine learning or deep learning algorithm, and the performance of the algorithm is evaluated through methods such as cross-validation. Parameters are adjusted to optimize the recognition effect, and finally, the trained algorithm is applied to a real-world image recognition scenario.

[0093] As an alternative implementation, if the recognition result is a cheek, the position of the cheek is relatively fixed for the headphones, and the obstruction of the cheek can be bypassed by rotating. In this case, the obstruction is determined to be an avoidable obstruction.

[0094] Optionally, if the identified result is hair, the type of occlusion can be determined by analyzing the corresponding hairstyle. Hairstyles typically include long and short hair. When filming with headphones on, long hair essentially covers the headphones, making it impossible for the headphone's rotating mechanism to avoid the hair, regardless of its direction. However, with short hair, the headphones can rotate to bypass the hair's obstruction. Therefore, when identifying hair, the occlusion area can be determined based on the hair type, thus identifying the occlusion type based on the occlusion area.

[0095] Specifically, if the obstruction area is less than a preset threshold, the obstruction is determined to be an avoidable obstruction; if the obstruction area is greater than or equal to the preset threshold, the obstruction is determined to be an unavoidable obstruction. It is understandable that when the hairstyle is long hair, its area basically covers the headphone's shooting range, i.e., the corresponding obstruction area is relatively large; in this case, the hair is considered an unavoidable obstruction.

[0096] Optionally, the type of obstruction can be determined directly based on the hairstyle of the hair. For example, if the hairstyle is long, the obstruction is determined to be an unavoidable obstruction, and if the hairstyle is short, it is determined to be an avoidable obstruction.

[0097] This embodiment provides a control method for headphones. By analyzing the specific information of obstructions appearing in an image using image recognition technology, the image recognition result is obtained. When the image recognition result is a cheek, it is determined to be an avoidable obstruction. When the recognition result is hair, the obstruction area is calculated based on the hair's hairstyle information. The size of the obstruction area is then used to determine whether the obstruction is avoidable. This allows the headphones to flexibly control the shooting field of view based on the type of obstruction when the obstruction is avoidable, thereby improving the shooting effect.

[0098] Based on the first embodiment of this application, in the fourth embodiment of this application, the content that is the same as or similar to that in the first embodiment can be referred to the above description, and will not be repeated hereafter. Based on this, please refer to... Figure 6 After step S30, steps S40 to S50 are also included:

[0099] Step S40: Obtain the area information of the obstruction when the rotating mechanism is in motion.

[0100] Step S50: If the rotating mechanism is in motion and the area information is positively correlated with the motion time, control the rotating mechanism to stop running.

[0101] In this embodiment, when controlling the movement of the rotating mechanism, the earphone also needs to continuously determine whether the proportion of the obstruction in the current image is decreasing and then gradually increasing due to the rotation, which may cause the anti-obstruction effect of the rotating mechanism to deteriorate after rotation.

[0102] Therefore, it is necessary to obtain the area information of the obstruction when the rotating mechanism is in motion in real time. If the area information is positively correlated with the movement time of the rotating mechanism, it means that although the obstruction of the original obstruction is reduced during the movement of the rotating mechanism, the same type of obstruction or new obstruction appears in the field of view. At this time, it is necessary to control the rotating mechanism to stop running.

[0103] Optionally, after the rotating mechanism stops running, step S10 can be executed to determine the type of obstruction based on the image acquired by the image module, thereby restarting the rotation mechanism.

[0104] This embodiment provides a control method for headphones. During the rotation of the rotating mechanism, the current anti-obstruction effect is judged, and when the anti-obstruction effect deteriorates, the rotating mechanism is stopped in time to avoid the area of ​​the obstruction in the current shooting range increasing after the rotating mechanism moves.

[0105] This application provides an earphone, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to perform the earphone control method described in the first embodiment above.

[0106] The following is for reference. Figure 7 The diagram shows a structural schematic of an earphone suitable for implementing embodiments of this application. Figure 7 The headphones shown are merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of this application.

[0107] like Figure 7 As shown, the headphones may include a processing device 1001 (e.g., a central processing unit, a graphics processing unit, etc.) that can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for headphone operation. The processing device 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 1003 including, for example, magnetic tape, hard disk, etc.; and communication devices 1009. The communication device 1009 allows the headset to communicate wirelessly or wiredly with other devices to exchange data. Although headsets with various systems are shown in the figures, it should be understood that implementation or possession of all the systems shown is not required. More or fewer systems may be implemented alternatively.

[0108] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0109] The earphone provided in this application, employing the earphone control method described in the above embodiments, can solve the technical problem of poor earphone shooting effect caused by obstruction. Compared with the prior art, the beneficial effects of the earphone provided in this application are the same as those of the earphone control method provided in the above embodiments, and other technical features of the earphone are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0110] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0111] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0112] This application provides a computer-readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the headphone control method in the above embodiments.

[0113] The computer-readable storage medium provided in this application may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0114] The aforementioned computer-readable storage medium may be included in the headphones; or it may exist independently and not assembled into the headphones.

[0115] The aforementioned computer-readable storage medium carries one or more programs that, when executed by the headphones, cause the headphones to:

[0116] The type of obstruction is determined based on the image captured by the image module;

[0117] If the obstruction is an avoidable obstruction, the rotation direction is determined based on the position information of the obstruction;

[0118] The rotating mechanism is controlled to drive the image module to move in the rotation direction in order to reduce the area of ​​the occluder in the image.

[0119] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0120] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0121] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0122] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described headphone control method, which can solve the technical problem of poor headphone shooting effect caused by obstruction. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the headphone control method provided in the above embodiments, and will not be repeated here.

[0123] The above description is only a part of the embodiments of this application and does not limit the patent scope of this application. All equivalent structural transformations made under the technical concept of this application and using the contents of the specification and drawings of this application, or direct / indirect applications in other related technical fields, are included in the patent protection scope of this application.

Claims

1. A method for controlling headphones, characterized in that, An application is made to headphones, wherein at least one earphone unit of the headphones is provided with an image module, the image module being connected to the earphone unit via a rotation mechanism, and the control method of the headphones includes: Based on the image acquired by the image module, the type of occlusion is determined, including: determining the occlusion position of the occlusion in the image; determining an optional avoidance direction based on the occlusion position; determining the current state of the rotating mechanism; and determining the type of occlusion based on the optional avoidance direction and the current state, wherein the current state includes a full rotation state and a non-full rotation state; or obtaining the image recognition result of the image, if the recognition result is a cheek, determining the occlusion as an avoidable occlusion; if the recognition result is hair, determining the type of occlusion based on the occlusion area of ​​the occlusion. If the obstruction is an avoidable obstruction, the rotation direction is determined based on the position information of the obstruction; The rotating mechanism is controlled to drive the image module to move in the rotation direction in order to reduce the area of ​​the occluder in the image.

2. The headphone control method as described in claim 1, characterized in that, The step of determining the type of obstruction based on the selectable avoidance direction and the current state includes: The rotatable direction of the rotating mechanism is determined based on the current state; If the rotatable direction is the same as the dodgeable direction, the obstruction type is determined to be an dodgeable obstruction. Otherwise, the type of obstruction is determined to be an unavoidable obstruction.

3. The headphone control method as described in claim 1, characterized in that, The step of determining the type of the obstruction based on its obstruction area includes: If the obstruction area is less than a preset threshold, the obstruction is determined to be an avoidable obstruction. If the obstruction area is greater than or equal to a preset threshold, the obstruction is determined to be an unavoidable obstruction.

4. The headphone control method as described in claim 1, characterized in that, The step of determining the rotation direction based on the position information of the obstruction includes: The orientation of the occluder in the image is determined based on the location information; Based on the stated direction, the target direction opposite to the stated direction is set as the rotation direction.

5. The headphone control method as described in claim 1, characterized in that, After the step of controlling the rotation mechanism to drive the image module to move in the rotation direction to reduce the area of ​​the occluder in the image, the method further includes: Obtain the area information of the obstruction when the rotating mechanism is in motion; If the rotating mechanism is in motion and the area information is positively correlated with the motion time, the rotating mechanism is controlled to stop running.

6. The headphone control method as described in claim 1, characterized in that, After determining the type of occlusion based on the image acquired by the image module, the method further includes: If the obstruction is an unavoidable obstruction, an anti-obstruction prompt is output based on the location information of the obstruction.

7. An earphone, characterized in that, The earphone includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the earphone control method as claimed in any one of claims 1 to 6.

8. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the headphone control method as described in any one of claims 1 to 6.

Images