Earphone wearing adjustment method and system, earphone, readable storage medium and product

Abstract

The invention discloses an earphone wearing adjustment method and system, an earphone, a readable storage medium and a product, and relates to the technical field of earphones, and the method comprises the steps: collecting environment image data under the condition of determining that the earphone is in a wearing adjustment mode; and sending the environment image data to a display device connected with the earphone, so as to output the environment image data through the display device, thereby enabling a user to adjust the wearing position of the earphone based on the environment image data. According to the invention, the wearing comfort of the earphone and the aesthetic feeling of the earphone are improved, and the positioning accuracy and convenience of the auxiliary earphone are improved.

Description

Technical Field

[0001] The present application relates to the field of earphone technology, and in particular to an earphone wearing adjustment method, system, earphone, readable storage medium and product. Background Art

[0002] With the growing trend toward multimodal integration in smart wearable devices, headphones with integrated camera functionality are becoming an emerging product. By embedding a camera module within the earphone cavity, these devices leverage physical properties similar to those of the human eye to capture image data that approximates human vision. This provides the hardware foundation for innovative applications such as augmented reality interaction and intelligent environmental perception.

[0003] However, this design also brings new problems. Due to the diversity of wearing methods and usage scenarios of headphones, it is difficult for users to ensure that the camera's field of view is consistent with the desired direction when wearing headphones. Traditional auxiliary headphone wearing positioning methods usually design structural positioning points on the casing, such as bumps, ridges, etc., to help users adjust the wearing angle through the touch of their fingers. However, this method has many shortcomings: on the one hand, it requires additional design on the appearance of the casing, which may reduce wearing comfort and the beauty of the headphones; on the other hand, this structural positioning point relies on the user to judge the angle of the headphones by feel, and the human hand has an inherent lack of sensitivity to spatial position and angle, resulting in poor positioning accuracy and convenience. Summary of the Invention

[0004] The main purpose of this application is to provide a wearing adjustment method, system, headphones, readable storage medium and product for headphones, aiming to solve the technical problems of traditional auxiliary headphone wearing positioning methods, which require additional structural designs on the headphones and have poor positioning accuracy and convenience.

[0005] To achieve the above-mentioned object, the present application provides a method for adjusting the wearing of headphones, wherein the headphones are connected to a display device, and the method for adjusting the wearing of headphones comprises the following steps:

[0006] When it is determined that the headset is in the wearing adjustment mode, collecting environmental image data;

[0007] The environmental image data is sent to the display device, so that the environmental image data is output through the display device, so that the user can adjust the wearing position of the headset based on the environmental image data.

[0008] In one embodiment, the display device includes a mobile terminal and an earphone charging compartment, and the step of sending the environmental image data to the display device connected to the earphone includes:

[0009] Determine the projection path based on the preset video stream projection path selection strategy;

[0010] If the projection path indicates projection display via a mobile terminal, the environment image data is sent to the mobile terminal;

[0011] If the projection path indicates that the screen is projected and displayed through the earphone charging compartment, the environmental image data is sent to the earphone charging compartment;

[0012] If the screen projection path indicates that the screen is projected and displayed through the earphone charging compartment and the mobile terminal, the environmental image data is sent to the mobile terminal, and the environmental image data is sent to the earphone charging compartment.

[0013] In one embodiment, before the step of sending the environmental image data to the earphone charging compartment, the method further includes:

[0014] Obtaining the image resolution of the environmental image data and obtaining the display screen resolution of the earphone charging compartment;

[0015] If the display screen resolution is smaller than the image resolution, compressing the environment image data;

[0016] The step of sending the environmental image data to the earphone charging case is performed based on the compressed environmental image data.

[0017] In one embodiment, the step of collecting environmental image data includes:

[0018] Obtaining the current remaining power of the headset;

[0019] If the current remaining power is greater than a preset threshold, capturing environmental image data at a first preset low frame rate;

[0020] If the current remaining power is less than or equal to a preset threshold, the environmental image data is collected at a second preset low frame rate, wherein the second preset low frame rate is lower than the first preset low frame rate.

[0021] In one embodiment, after the step of collecting environmental image data, the method further includes:

[0022] If the display device is detected in the environmental image data, determining whether the display screen of the display device is located in the middle of the image;

[0023] If not, a prompt message is output.

[0024] In one embodiment, before the step of collecting environmental image data, the method further includes:

[0025] Acquiring status data of the headset, wherein the status data includes motion data and / or touch data;

[0026] If an adjustment operation for the wearing position of the earphone is detected according to the status data, the step of collecting environmental image data is performed.

[0027] In one embodiment, after the step of sending the environment image data to the display device, the method further includes:

[0028] If no adjustment operation for the wearing position of the headset is detected within a preset time period, it is determined that the headset exits the wearing adjustment mode; or,

[0029] If an operation indicating the end of adjusting the wearing position of the headset is detected, determining that the headset has exited the wearing adjustment mode; or

[0030] If a target feedback instruction sent by the display device is received, it is determined that the headset exits the wearing adjustment mode, wherein the target feedback instruction is an instruction to end the adjustment of the wearing position of the headset.

[0031] In addition, to achieve the above-mentioned purpose, the present application also provides a wearing adjustment system, wherein the wearing adjustment system connects headphones and a display device to each other.

[0032] The headset is configured to collect environmental image data and send the environmental image data to the display device when determining that the headset is in the wearing adjustment mode;

[0033] The display device is used to receive the environmental image data sent by the headset and output the environmental image data so that the user can adjust the wearing position of the headset based on the environmental image data.

[0034] In addition, to achieve the above-mentioned purpose, the present application also provides an earphone, which includes: a memory, a processor, and a wearing adjustment program stored on the memory and runnable on the processor. When the wearing adjustment program is executed by the processor, the steps of the wearing adjustment method of the earphone as described above are implemented.

[0035] In addition, to achieve the above-mentioned purpose, the present application also provides a readable storage medium, which is a computer-readable storage medium, and the computer-readable storage medium stores a program for implementing the wearing adjustment method of the earphones, and the program for implementing the wearing adjustment method of the earphones is executed by the processor to implement the steps of the wearing adjustment method of the earphones as described above.

[0036] The present application also provides a computer program product, including a computer program, which implements the steps of the above-mentioned earphone wearing adjustment method when executed by a processor.

[0037] One or more technical solutions proposed in this application have at least the following technical effects:

[0038] When the present application determines that the headset is in the wearing adjustment mode, the headset collects environmental image data and sends the collected environmental image data to a display device connected to the headset. The display device outputs and displays the environmental image data so that the user can adjust the wearing position of the headset based on the environmental image data. In this way, the wearing position of the headset is assisted to be adjusted based on the environmental image data captured by the headset in real time, without adding additional structural design to the appearance of the housing, thereby improving the wearing comfort and aesthetics of the headset. In addition, the user can correct the deviation between the camera field of view of the headset and the user's direct field of view by viewing the real-time environmental image data, and quickly adjust and position the headset to the desired wearing position, thereby improving the accuracy and convenience of auxiliary headset positioning. In addition, when wearing the headset, there is no need to touch the structural positioning points to assist in adjusting the wearing position of the headset, which is very friendly to users with hand impairments or poor tactile sensitivity, and can greatly improve their operating experience when wearing the headset. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0040] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0041] Figure 1 This is a flowchart of the first embodiment of the headphone wearing adjustment method of the present application;

[0042] Figure 2 This is a schematic diagram of the adjustment process involved in an embodiment of the earphone wearing adjustment method of the present application;

[0043] Figure 3 This is a flow chart of another embodiment of the headphone wearing adjustment method of the present application;

[0044] Figure 4 This is a schematic diagram of the system structure of the headphone wearing adjustment system of this application;

[0045] Figure 5 This is a schematic diagram of the device structure of the hardware operating environment involved in the wearing adjustment system in the embodiment of the present application.

[0046] The purpose, features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0047] To make the above-mentioned objects, features, and advantages of the present invention more clearly understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts shall fall within the scope of protection of the present invention.

[0048] Currently, smart wearable devices are developing in the direction of multimodal fusion, and the forms and functions of the products are becoming more and more diversified. For example, a camera has been added to a Bluetooth headset. In addition to the conventional audio functions, it can also be used for taking photos or shooting short videos, live streaming, and even combined with AI (Artificial Intelligence) to realize applications such as intelligent image recognition. The advantage of having a camera on the headset is that the camera position is very close to the human eye, the vertical height of the field of view is basically the same as that of the human eye, and there is no need for a separate wearing device. The user basically does not feel the change in physical sensation after adding the camera. However, there are also practical problems when wearing a camera on the headset, that is, it is difficult for the user to ensure that the direction of the camera's field of view is consistent with the desired direction when wearing it, and it is difficult to adjust the camera to the desired angle by relying solely on feel.

[0049] Conventional methods for assisting headphone positioning involve designing structural positioning points on the casing, such as bumps and ridges. This requires additional design elements on the casing's exterior, reducing both wearing comfort and the product's aesthetic appeal. Furthermore, these traditional positioning points rely on the user's sense of touch to determine the position of the headphones (specifically, the wearing angle). This approach, which relies on the human hand's sensitivity to spatial position and angle, inherently suffers from significant deviations. Typically, users' spatial angle judgments of headphone components based solely on tactile feedback can exceed ±15 degrees, making it difficult to meet the viewing angle accuracy requirements for image capture. Furthermore, repeated adjustments require the user to maintain the headphones in a blind position, which can easily lead to ear canal compression or auricular friction, severely impacting wearing comfort. In particular, protruding structures can easily snag on clothing during exercise, posing a safety hazard. These design compromises not only weaken the product's market competitiveness but also limit the potential for expanding the functionality of camera modules within headphone products.

[0050] Based on this, the main solution of this application is: when it is determined that the headphones are in wearing adjustment mode, environmental image data is collected; the environmental image data is sent to a display device connected to the headphones, so as to output the environmental image data through the display device, so that the user can adjust the wearing position of the headphones based on the environmental image data.

[0051] The present application, when determining that the headset is in a wearing adjustment mode, collects environmental image data through the headset, and sends the collected environmental image data to a display device connected to the headset, and displays the environmental image data through the display device, so that the user can adjust the wearing position of the headset based on the environmental image data. In this way, the wearing position of the headset is assisted in adjusting based on the environmental image data captured by the headset in real time, without adding additional structural design to the appearance of the housing, thereby improving the wearing comfort and aesthetics of the headset. In addition, the user can correct the deviation between the camera field of view of the headset and the user's direct field of view by viewing the real-time environmental image data, and quickly adjust and position the headset to the desired wearing position, thereby improving the accuracy and convenience of assisting the headset positioning. In addition, when wearing the headset, there is no need to touch the structural positioning points to assist in adjusting the wearing position of the headset, which is very friendly to users with hand disabilities or poor tactile sensitivity, and can greatly improve their operating experience when wearing the headset.

[0052] Based on this, the present application proposes a wearing adjustment method for headphones according to the first embodiment, wherein the headphones are connected to a display device, please refer to Figure 1 The earphone wearing adjustment method comprises the following steps:

[0053] Step S10: When it is determined that the headset is in the wearing adjustment mode, collecting environmental image data;

[0054] In this embodiment, the connection between the earphones and the display device refers to a communication connection between the earphone device and the display device, and the connection method of the communication connection includes but is not limited to Bluetooth communication connection, Wi-Fi (Wireless Fidelity) communication connection, ZigBee communication connection, NFC (Near Field Communication) communication connection, infrared communication connection, etc.

[0055] Headphones refer to electronic devices that can be worn on the ears for receiving and playing audio signals, such as TWS (True Wireless Stereo) headphones and OWS (Open Wearable Stereo) headphones.

[0056] A display device refers to an electronic device with an image visualization function. The display device presents visual information through a graphical user interface and establishes two-way data communication with the headset. Specifically, display devices include but are not limited to smartphones, headset charging pods, tablets, smart watches, smart bracelets, AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, and other electronic devices that can be equipped with display modules. The core function of the display device is to convert the invisible headset wearing position deviation into a visual image offset, thereby breaking through the spatial perception limitations of traditional tactile calibration methods.

[0057] When the headset is determined to be in wearing adjustment mode, ambient image data is collected via the headset. Specifically, a camera within the headset may be activated to collect ambient image data. Wearing adjustment mode refers to a mode in which the headset wearing position (specifically, the wearing angle) is being adjusted. In this mode, ambient image data collected by the headset is used to adjust the headset wearing position.

[0058] The environmental image data may specifically be visual information captured by a camera module in the headset, and may be expressed as a single-frame static image or a multi-frame continuous image sequence (i.e., a video stream). In a preferred embodiment, the environmental image data may be captured at a preset shooting frame rate to capture a multi-frame continuous image sequence and display it on a display device, thereby supporting real-time auxiliary headset positioning. Furthermore, considering that the purpose of the image at this time is to assist in adjusting the wearing position of the headset rather than recording video information, in order to save battery power, the preset shooting frame rate may be configured to a lower value, for example, 5 to 10 frames per second, so as to meet the purpose of auxiliary positioning while taking into account the low power consumption of the headset, thereby improving the battery life of the headset.

[0059] Step S20: Send the environmental image data to the display device to output the environmental image data through the display device, so that the user can adjust the wearing position of the headset based on the environmental image data.

[0060] After collecting the environmental image data, the collected environmental image data is sent to the display device for output via the display device, i.e., the environmental image data is displayed on the display device. Specifically, after collecting the environmental image data, the headset can encode the environmental image data and send the encoded data to the display device connected to the headset, such as by transmitting the encoded data to the display device via Wi-Fi (Wireless Fidelity) or Bluetooth. The display device receives the encoded data, decodes the data, and sends it to the display driver circuit, thereby displaying the image on the screen.

[0061] Furthermore, before sending the image data to the display device, the image resolution of the environmental image data and the display screen resolution of the display device can be obtained, and the image resolution and the display screen resolution can be compared to see if they are consistent. If they are inconsistent, the image resolution of the environmental image data can be adjusted to be consistent with the display screen resolution, and the environmental image data with the adjusted resolution can be sent to the display device to achieve adaptive display of the environmental image data. In addition, after receiving the image data, the display device can compare the resolutions of the two and determine whether to adjust the resolution of the environmental image data, so as to reduce the computing power requirements of the headset and reduce the algorithm programs that need to be embedded in the headset, so that the wearing adjustment method can be applied to more headsets and improve universality.

[0062] It should be noted that the image resolution refers to the information density of the environmental image data in the spatial dimension, which can be specifically expressed as the product of the number of horizontal pixels (such as 1600) and the number of vertical pixels (such as 1200) (i.e. 1600×1200). The display screen resolution refers to the addressable pixel array specification per unit area of the physical screen used by the display device to present the environmental image data, which can be specifically expressed as the product of the number of horizontal pixels (such as 1920) and the number of vertical pixels (such as 1080) (i.e. 1920×1080).

[0063] In this embodiment, when it is determined that the headset is in the wearing adjustment mode, the headset collects environmental image data and sends the collected environmental image data to a display device connected to the headset. The display device outputs and displays the environmental image data so that the user can adjust the wearing position of the headset based on the environmental image data. In this way, the wearing position of the headset is assisted by the environmental image data captured in real time by the headset, without adding additional structural design to the appearance of the housing, thereby improving the wearing comfort and aesthetics of the headset. In addition, the user can correct the deviation between the camera field of view of the headset and the user's direct field of view by viewing the real-time environmental image data, and quickly adjust and position the headset to the desired wearing position, thereby improving the accuracy and convenience of assisting the headset positioning. In addition, when wearing the headset, there is no need to touch the structural positioning points to assist in adjusting the wearing position of the headset, which is very friendly to users with hand impairments or poor tactile sensitivity, and can greatly improve their operating experience when wearing the headset.

[0064] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as those in the above-mentioned embodiment 1 can be referred to the above introduction and will not be repeated hereafter. On this basis, the display device includes a mobile terminal and an earphone charging compartment, and the step of sending the environmental image data to the display device connected to the earphone includes:

[0065] Step A10: determining a projection path according to a preset video stream projection path selection strategy;

[0066] A mobile terminal refers to a computer device that can be used in a mobile state, usually having the ability to wirelessly access a network, such as a mobile phone, a wearable device, a tablet computer, etc. For example, the mobile terminal is described below as a mobile phone.

[0067] The earphone charging case is specifically an earphone charging case that can be paired with the earphone. The preset video stream projection path selection strategy can specifically be a default path selection strategy set in the earphone, such as when the relevant APP (Application) on the mobile phone is turned on, the screen is projected on the mobile phone APP first, and when the mobile phone APP is not turned on, the screen is projected on the earphone charging case screen. It can also be a user-defined path selection strategy, such as fixedly projecting on the relevant APP on the mobile phone (under this configuration, if the APP is closed, the captured environmental image data will not be displayed), fixedly projecting on the earphone charging case screen, or simultaneously projecting on the mobile phone APP and the earphone charging case screen.

[0068] It should be noted that when the environmental image data is the first frame of image sent to the display device after the headset enters the wearing adjustment mode, the projection path is determined by the preset video stream projection path selection strategy, and subsequent frame images continue to be projected using the projection path. There is no need to repeatedly determine the projection path until the projection path is unavailable (such as the projection path is a mobile phone but the mobile phone is turned off) and then reselect the projection path to improve the projection efficiency of the environmental image data. At the same time, it ensures that when the projection path is unavailable, the available projection path is automatically switched to improve the user experience. Furthermore, if it is detected that there is no available projection path (such as the mobile phone and the headset charging case are both disconnected from the headset), a prompt message can also be output to remind the user that there is currently no device that can be used to display the image, so that the user can take relevant solutions to solve this problem.

[0069] Step A20: If the projection path indicates projection display via a mobile terminal, the environment image data is sent to the mobile terminal;

[0070] Step A30: If the projection path indicates projection through the earphone charging compartment, the environmental image data is sent to the earphone charging compartment;

[0071] Step A40: If the screen projection path indicates that the screen is projected and displayed through the earphone charging compartment and the mobile terminal, the environmental image data is sent to the mobile terminal, and the environmental image data is sent to the earphone charging compartment.

[0072] When there are multiple display devices connected to the headset, in this embodiment, there are two display devices, a mobile phone and a headset charging case. The headset automatically selects and determines the screen projection path based on the preset video stream projection path selection strategy, thereby effectively solving the problems of image transmission delay, display content fragmentation, and resource waste caused by competitive projection of multiple devices. It can also dynamically avoid screen freezes or interruptions caused by a busy display device or unstable signal. For example, when the headset is simultaneously connected to a mobile phone and a headset charging case with a display screen, the headset prioritizes projecting environmental image data to the headset charging case to provide a dedicated auxiliary positioning interface to avoid mobile phone call notifications or other application pop-ups interfering with the positioning operation; if it is detected that the charging case screen is in the off state, it seamlessly switches to the mobile phone display. By accurately matching the user's current scene requirements and device availability, the certainty and stability of the visual feedback channel can be guaranteed without manual intervention, thereby improving the operational consistency of the headset wearing position adjustment process.

[0073] In a possible implementation, before the step of sending the environmental image data to the headphone charging compartment, the method further includes:

[0074] Step B10: Obtaining the image resolution of the environmental image data and obtaining the display screen resolution of the earphone charging compartment;

[0075] Step B20: If the display screen resolution is smaller than the image resolution, compress the environment image data;

[0076] It should be noted that when the display screen resolution of the headphone charging case is smaller than the image resolution of the environmental image data, the environmental image data is compressed. Specifically, the image resolution of the compressed environmental image data is consistent with the display screen resolution.

[0077] Optionally, the image data is downsampled in the spatial dimension, specifically by using a bilinear interpolation algorithm to proportionally scale the high-resolution image data (such as 1280×720) to the display screen resolution of the headphone charging case (such as 800×480).

[0078] Step B30: executing the step of sending the environmental image data to the earphone charging case based on the compressed environmental image data.

[0079] In this embodiment, considering that the resolution of the display screen of the headphone charging case is generally not high due to the size limitation of the headphone charging case, the captured image cannot be fully displayed directly on the screen of the headphone charging case. Based on this, before the environmental image data is sent to the headphone charging case, the resolutions of the two are compared, and when it is detected that the resolution of the display screen of the headphone charging case is smaller than the image resolution of the environmental image data, the environmental image data is compressed to adapt to the number of pixels of the display screen of the headphone charging case, so that the image can be adapted to the display screen of the headphone charging case for display.

[0080] For example, in order to help understand the technical concept or technical principle of the wearing adjustment method for headphones after combining this embodiment with the first embodiment, a specific embodiment is now listed. In this specific embodiment, the working principle process is: the camera starts real-time shooting, the video stream projection path is selected, and it is determined whether to perform image sampling compression processing according to the selected path, and the video stream projection is displayed. Specifically, refer to Figure 2 As shown, the headphone wearing adjustment process starts from the user putting on the headphone and includes:

[0081] 1. The camera starts real-time shooting

[0082] When the user removes the earphones from the charging case (referred to as the charging case) and begins wearing them, the camera starts capturing real-time images of the surrounding environment, which is also known as a video stream. Since the images are used to assist in adjusting the wearing angle of the earphones rather than recording video information, to conserve battery power, the frame rate can be set to a lower value, for example, 5 to 10 frames per second. This allows for adjusting the wearing position while maintaining low power consumption.

[0083] 2. Video streaming screen projection path selection

[0084] Users may have one or two ways to view images captured by the camera: one is to view them in the relevant app on the mobile phone, and the other is to view them on the charging pod screen for charging pods with screens. For models with two viewing methods, the system can automatically select the video stream projection path by default. For example, when the mobile app is open, the screen is projected on the app first, and when the app is closed, the screen is projected on the charging pod screen. Users can also customize the projection path in the function menu, such as fixed projection on the app (in this configuration, if the app is closed, the captured image will no longer be displayed), fixed projection on the charging pod screen, or simultaneous projection on the app and charging pod screens.

[0085] 3. Determine whether to perform image sampling compression

[0086] Current mobile phone screens generally have a high pixel count, and images captured by the camera can be projected directly onto the phone screen. However, when projecting the video stream onto the charging dock screen, the pixel count is generally low due to the size of the dock screen, and the captured image cannot be fully displayed directly on the dock screen. Therefore, before the video stream is projected onto the dock, the image needs to be sampled and compressed to fit the pixel count of the dock screen. Whether to sample and compress the video stream is determined based on the screen being projected, and this process is handled by the headset's main control chip or ISP (Image Signal Processor) chip.

[0087] 4. Video streaming screen projection

[0088] After the image captured by the headphone camera is video encoded, the data is transmitted to the main control chip of the mobile phone or charging case via WIFI or Bluetooth. The GPU (Graphics Processing Unit) unit in the mobile phone or the video decoding chip in the charging case circuit decodes the data and sends it to the display driver circuit, thereby displaying the image on the screen.

[0089] It should be noted that the above examples are only used to assist in understanding the present application and do not constitute a limitation on the wearing adjustment process of the headphones of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0090] Based on the first and / or second embodiments of the present application, in the third embodiment of the present application, the same or similar contents as those in the first and second embodiments can be referred to above and will not be described in detail. On this basis, the step of collecting environmental image data includes:

[0091] Step C10, obtaining the current remaining power of the headset;

[0092] Step C20: if the current remaining power is greater than a preset threshold, capturing environmental image data at a first preset low frame rate;

[0093] Step C30: If the current remaining power is less than or equal to a preset threshold, the environmental image data is collected at a second preset low frame rate, wherein the second preset low frame rate is lower than the first preset low frame rate.

[0094] It should be noted that the second preset low frame rate is lower than the first preset low frame rate, and both can be lower than or equal to the above-mentioned preset shooting frame rate, so as to ensure low power consumption while intelligently and dynamically adjusting the shooting frame rate based on the current remaining power of the headset. When the power of the headset is reduced, data is collected at a lower frame rate to further reduce the power consumption of the headset.

[0095] In one possible implementation, refer to Figure 3 As shown, after the step of collecting environmental image data, the method further includes:

[0096] Step D10: if the display device is detected in the environmental image data, determining whether the display screen of the display device is located in the middle of the image;

[0097] Step D20: If not, output a prompt message.

[0098] It is understandable that when adjusting the wearing position of the earphones, the user needs to check the screen of the mobile phone or the earphone charging case. Generally, the user's direct field of view at this time is the mobile phone screen or the earphone charging case screen. Therefore, when the wearing position of the earphones is adjusted so that the middle position of the image taken by the camera is the mobile phone or the charging case screen, it can be determined that the camera's shooting field of view is basically the same as the user's direct field of view.

[0099] Based on this, when it is detected that the display screen of the display device is not located in the middle of the image, a prompt message is output (for easy distinction, recorded as the first prompt message) to remind the user that the wearing position of the headphones needs to be adjusted. In addition, when it is detected that the display screen of the real device is located in the middle of the image, a second prompt message can be output to remind the user that the current display screen is in the center of the display device, so that the user can decide whether the wearing position of the headphones needs to be adjusted.

[0100] It should be noted that the display screen of the display device is determined to be located in the middle of the image when it is detected that the pixel offset between the center point of the display screen and the center point of the image is within a preset tolerance range (such as a rectangular area consisting of ±5% frame width in the horizontal direction and ±3% frame height in the vertical direction).

[0101] By detecting the display device's position within the image and triggering a prompt mechanism, a precise mapping relationship between user actions and system feedback is effectively established. When the display screen deviates from the center of the image, a first prompt message (such as a flashing red light at the edge of the screen) is output to intuitively guide the user to adjust the headphone wearing position, leveraging the conditioned reflex characteristics of human movement to shorten the adjustment time of the headphone wearing position. When the display screen is centered, a second prompt message (such as a green check mark in the center of the screen) is output, confirming the positioning completion status through instant positive and negative feedback, eliminating the repeated verification operations caused by users' uncertainty about the adjustment results.

[0102] Furthermore, to ensure that the user looks at the display device during the wearing adjustment process of the headset, a third prompt message can be output to remind the user to look at the display device after determining that the headset has entered the wearing adjustment mode, such as through vibration prompts and voice guidance (such as "Please look at the center of the screen") to remind the user to focus their eyes on the display screen of the display device. At this time, the user's head is naturally facing the display device, so that the camera field of view axis of the headset and the actual observation direction of the user form a spatial consistency benchmark, so that the headset can intelligently and automatically determine whether the camera field of view of the headset is consistent with the user's intuitive field of view based on the display position of the display device in the image, while reducing repeated adjustment operations caused by the user's wandering eyes, and realizing an intuitive calibration experience of "what you see is what you are positioned".

[0103] In a possible implementation, before the step of collecting environmental image data, the method further includes:

[0104] Step E10, obtaining status data of the headset, wherein the status data includes motion data and / or touch data;

[0105] It should be noted that the motion data can specifically be data collected by the motion sensor built into the headset, such as an accelerometer, gyroscope, IMU (Inertial Measurement Unit), etc.; the touch data can specifically be data collected by the touch sensor built into the headset, such as an interdigital capacitive electrode.

[0106] Step E20: If an adjustment operation for the wearing position of the headset is detected according to the status data, the step of collecting environmental image data is executed.

[0107] When an adjustment operation for the wearing position of the earphone is detected based on the status data, environmental image data is collected, and at this time, the collection of environmental image data can be stopped after only one frame or a preset number of frames of image data are collected each time, until the adjustment operation for the wearing position of the earphone is detected again, and then the environmental image data is collected again. In this way, the environmental image data is collected again only when there is an adjustment operation for the wearing position of the earphone, which may cause the shooting field of view of the earphone to change. This can further reduce the amount of image data that needs to be collected, thereby further reducing the power consumption of the earphone and improving the battery life of the earphone.

[0108] It is understandable that when the user adjusts the wearing position of the earphone, on the one hand, the user needs to touch the earphone, and on the other hand, the wearing angle of the earphone will change. In this way, it is possible to detect through status data whether the user touches the earphone (for example, if the electrode capacitance value is detected to rise by 20fF based on touch data, it is determined that the user touches the earphone) and / or whether the wearing angle of the earphone changes (for example, if the rotation angular velocity of the earphone around the long axis of the earplug is detected to be greater than a preset threshold based on motion data, it is determined that the wearing angle of the earphone changes), and then determine whether an adjustment operation for the wearing position of the earphone is detected. If the user is detected to touch the earphone based on touch data and / or a change in the wearing angle of the earphone is detected based on motion data, it is determined that an adjustment operation for the wearing position of the earphone is detected.

[0109] In a possible implementation, after the step of sending the environment image data to the display device, the method further includes:

[0110] Step F10: If no adjustment operation for the wearing position of the headset is detected within a preset time period, it is determined that the headset exits the wearing adjustment mode; or

[0111] Step F20: If the operation indicating the end of adjusting the wearing position of the headset is detected, then determining that the headset has exited the wearing adjustment mode; or

[0112] Step F30 : If a target feedback instruction sent by the display device is received, determining that the headset exits the wearing adjustment mode, wherein the target feedback instruction is an instruction to end the adjustment of the wearing position of the headset.

[0113] After the user completes the wearing position adjustment, he or she can end the adjustment of the earphone wearing position through the preset operation instructions to exit the wearing adjustment mode and then enter the normal working mode. For example, the user can indicate the end of the adjustment of the earphone wearing position through the physical button operation of the earphone (such as double-clicking the touch area), or can manually indicate the end of the adjustment of the earphone wearing position through the completion confirmation button of the display device APP. When the display device receives the confirmation exit operation input by the user, it can send a target feedback instruction to the earphone, so that after the earphone receives the target feedback instruction, it determines that the earphone has exited the wearing adjustment mode.

[0114] If no adjustment operation for the wearing position of the headset is detected within the preset time, it may be because the user has adjusted the wearing position of the headset to meet the expectations, and therefore has not adjusted the wearing position of the headset for a long time. At this time, it is determined that the headset exits the wearing adjustment mode, so that even if the user does not perform specific operations, the headset can also intelligently and automatically exit the wearing adjustment mode, thereby reducing user operations and improving the user experience.

[0115] Furthermore, relevant personnel can also set other conditions for exiting the wearing adjustment mode based on actual needs, such as the interruption of the communication connection between the headphones and the display device; or the detection of the headphones being out of the ears, etc., without specific restrictions here.

[0116] Correspondingly, the user can also enter the wearing adjustment mode based on a preset method, such as being triggered by a combination of physical buttons on the headset (such as long pressing the touch area for 3 seconds) or the positioning entrance of the display device APP, or the headset automatically enters the wearing adjustment mode after detecting that a preset entry condition is met. The preset entry condition can be a pre-set event for entering the wearing adjustment mode, such as the recognition confidence of a preset reference object (such as a face outline, a horizon) in the camera capture image is lower than a threshold, or the built-in motion sensor of the headset detects that the pitch angle or roll angle of the headset deviates from the reference value by more than a preset tolerance range, or detects an in-ear event of the headset.

[0117] It is understood that when a user puts on headphones, the headphones are fixed to their ears, which is called an "on-ear event." When the user takes off the headphones, the headphones are separated from their ears, which is called a "off-ear event." For earbud headphones, an "on-ear event" can correspond to an "in-ear event" where the headphones are inserted into the ears, and a "off-ear event" can correspond to an "out-of-ear event" where the headphones are removed from the ears. For headphones, an "on-ear event" can correspond to an event where the earcup is fixed to the ears, and a "off-ear event" can correspond to an event where the earcup is removed from the ears. It is understood that when a user fixes or removes the headphones from their ears, sensor data representing the movement of the headphones will exhibit different signal patterns. For example, when an accelerometer is used to measure the movement of the headphones, the movement data from the accelerometer will exhibit different peaks and orientation changes when the user fixes or removes the headphones from the ears. Therefore, it is possible to determine whether the headphones have experienced an "on-ear" or "off-ear" event based on the sensor data representing the movement of the headphones.

[0118] In addition, the embodiment of the present application also proposes a wearing adjustment system, referring to Figure 4 As shown, the wearing adjustment system includes an earphone and a display device connected to each other, and the earphone is used to collect environmental image data and send the environmental image data to the display device when it is determined to be in the wearing adjustment mode;

[0119] The display device is used to receive the environmental image data sent by the headset and output the environmental image data so that the user can adjust the wearing position of the headset based on the environmental image data.

[0120] In one embodiment, the display device includes a mobile terminal and an earphone charging compartment, and the earphone is further used to:

[0121] Determine the projection path based on the preset video stream projection path selection strategy;

[0122] If the projection path indicates projection display via a mobile terminal, the environment image data is sent to the mobile terminal;

[0123] If the projection path indicates that the screen is projected and displayed through the earphone charging compartment, the environmental image data is sent to the earphone charging compartment;

[0124] If the screen projection path indicates that the screen is projected and displayed through the earphone charging compartment and the mobile terminal, the environmental image data is sent to the mobile terminal, and the environmental image data is sent to the earphone charging compartment.

[0125] In one embodiment, the earphone is further used for:

[0126] Obtaining the image resolution of the environmental image data and obtaining the display screen resolution of the earphone charging compartment;

[0127] If the display screen resolution is smaller than the image resolution, compressing the environment image data;

[0128] The step of sending the environmental image data to the earphone charging case is performed based on the compressed environmental image data.

[0129] In one embodiment, the earphone is further used for:

[0130] Obtaining the current remaining power of the headset;

[0131] If the current remaining power is greater than a preset threshold, capturing environmental image data at a first preset low frame rate;

[0132] If the current remaining power is less than or equal to a preset threshold, the environmental image data is collected at a second preset low frame rate, wherein the second preset low frame rate is lower than the first preset low frame rate.

[0133] In one embodiment, the earphone is further used for:

[0134] If the display device is detected in the environmental image data, determining whether the display screen of the display device is located in the middle of the image;

[0135] If not, a prompt message is output.

[0136] In one embodiment, the earphone is further used for:

[0137] Acquiring status data of the headset, wherein the status data includes motion data and / or touch data;

[0138] If an adjustment operation for the wearing position of the earphone is detected according to the status data, the step of collecting environmental image data is performed.

[0139] In one embodiment, the earphone is further used for:

[0140] If no adjustment operation for the wearing position of the headset is detected within a preset time period, it is determined that the headset exits the wearing adjustment mode; or,

[0141] If an operation indicating the end of adjusting the wearing position of the headset is detected, determining that the headset has exited the wearing adjustment mode; or

[0142] If a target feedback instruction sent by the display device is received, it is determined that the headset exits the wearing adjustment mode, wherein the target feedback instruction is an instruction to end the adjustment of the wearing position of the headset.

[0143] The wearing adjustment system provided in the embodiment of the present application can solve the technical problems of the traditional auxiliary earphone wearing positioning method, which requires additional structural design on the earphone and has poor positioning accuracy and convenience. Compared with the existing technology, the beneficial effects of the wearing adjustment system provided by the present application are the same as the beneficial effects of the earphone wearing adjustment method provided in the above embodiment, and the other technical features of the wearing adjustment system are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0144] In addition, an embodiment of the present application also proposes an earphone, which includes a memory, a processor, and a wearing adjustment program stored in the memory and executable on the processor. When the wearing adjustment program is executed by the processor, the steps of the wearing adjustment method of the earphone as described above are implemented.

[0145] refer to Figure 5 , which shows a schematic diagram of the structure of headphones suitable for implementing the embodiments of the present application. Figure 5As shown, the headset may include a processing system 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage system 1003 into a random access memory (RAM) 1004. Various programs and data required for the operation of the headset are also stored in the RAM 1004. The processing system 1001, the ROM 1002, and the RAM 1004 are connected to each other via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input system 1007 including, for example, a touch screen, a touchpad, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output system 1008 including, for example, a speaker, a vibrator, etc.; a storage system 1003 including, for example, a memory card, a memory stick, etc.; and a communication system 1009. Communication system 1009 can allow the headset to communicate with other devices wirelessly or wired to exchange data. Although the figure shows a headset with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have instead.

[0146] In particular, according to the embodiments disclosed in the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, the embodiments disclosed in the present application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program comprising program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0147] The earphones provided in the embodiments of the present application utilize the earphone wearing adjustment method of the aforementioned embodiments, which can resolve the technical issues of conventional auxiliary earphone wearing and positioning methods, which require additional structural designs on the earphones and suffer from poor positioning accuracy and convenience. Compared with the prior art, the beneficial effects of the earphones provided in the present application are the same as those of the earphone wearing adjustment method provided in the aforementioned embodiments, and the other technical features of the earphones are the same as those disclosed in the method of the aforementioned embodiment, which are not further described here.

[0148] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0149] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

[0150] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also provides a readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, and the computer-readable program instructions are used to execute the wearing adjustment method of the headphones in the above-mentioned embodiment.

[0151] The computer-readable storage medium provided in the embodiments of the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, system or device. The program code contained on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0152] The computer-readable storage medium may be contained in the earphone, or may exist independently without being assembled into the earphone.

[0153] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by the headphones, the headphones: collect environmental image data when it is determined that the headphones are in a wearing adjustment mode; send the environmental image data to a display device that is communicatively connected to the headphones, so as to output the environmental image data through the display device, so that the user can adjust the wearing position of the headphones based on the environmental image data.

[0154] Computer program code for performing the operations of the present application may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0155] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, program segment or a part of code, and the module, program segment or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a combination of dedicated hardware and computer instructions.

[0156] The modules described in the embodiments of the present application may be implemented in software or hardware, wherein the name of a module does not necessarily limit the unit itself.

[0157] The readable storage medium provided by this application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., a computer program) for executing the above-mentioned headphone wearing adjustment method. This can solve the technical problems of the traditional auxiliary headphone wearing positioning method, which requires additional structural design to be added to the headphone and has poor positioning accuracy and convenience. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided by this application are the same as the beneficial effects of the headphone wearing adjustment method provided by the above-mentioned embodiment, and will not be repeated here.

[0158] In addition, an embodiment of the present application further proposes a computer program product, including a wearing adjustment program, which implements the steps of the wearing adjustment method of the headset as described above when executed by a processor.

[0159] The specific implementation of the computer program product of the present application is basically the same as the embodiments of the above-mentioned headphone wearing adjustment method, and will not be repeated here.

[0160] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.

[0161] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0162] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software sensor, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0163] The above are only preferred embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for adjusting the wearing of headphones, characterized in that: The earphones are connected to a display device, and the earphone wearing adjustment method comprises the following steps: When it is determined that the headset is in the wearing adjustment mode, collecting environmental image data; The environmental image data is sent to the display device, so that the environmental image data is output through the display device, so that the user can adjust the wearing position of the headset based on the environmental image data.

2. The wearing adjustment method according to claim 1, wherein: The display device includes a mobile terminal and an earphone charging compartment, and the step of sending the environmental image data to the display device connected to the earphone includes: Determine the projection path based on the preset video stream projection path selection strategy; If the projection path indicates projection display via a mobile terminal, the environment image data is sent to the mobile terminal; If the projection path indicates that the screen is projected and displayed through the earphone charging compartment, the environmental image data is sent to the earphone charging compartment; If the screen projection path indicates that the screen is projected and displayed through the earphone charging compartment and the mobile terminal, the environmental image data is sent to the mobile terminal, and the environmental image data is sent to the earphone charging compartment.

3. The wearing adjustment method according to claim 2, wherein: Before the step of sending the environmental image data to the earphone charging compartment, the method further includes: Obtaining the image resolution of the environmental image data and obtaining the display screen resolution of the earphone charging compartment; If the display screen resolution is smaller than the image resolution, compressing the environment image data; The step of sending the environmental image data to the earphone charging case is performed based on the compressed environmental image data.

4. The wearing adjustment method according to any one of claims 1 to 3, characterized in that: The step of collecting environmental image data includes: Obtaining the current remaining power of the headset; If the current remaining power is greater than a preset threshold, capturing environmental image data at a first preset low frame rate; If the current remaining power is less than or equal to a preset threshold, the environmental image data is collected at a second preset low frame rate, wherein the second preset low frame rate is lower than the first preset low frame rate.

5. The wearing adjustment method according to any one of claims 1 to 3, characterized in that: After the step of collecting environmental image data, the method further includes: If the display device is detected in the environmental image data, determining whether the display screen of the display device is located in the middle of the image; If not, a prompt message is output.

6. The wearing adjustment method according to any one of claims 1 to 3, characterized in that: Before the step of collecting environmental image data, the method further includes: Acquiring status data of the headset, wherein the status data includes motion data and / or touch data; If an adjustment operation for the wearing position of the earphone is detected according to the status data, the step of collecting environmental image data is performed.

7. The wearing adjustment method according to any one of claims 1 to 3, characterized in that: After the step of sending the environmental image data to the display device, the method further includes: If no adjustment operation for the wearing position of the headset is detected within a preset time period, it is determined that the headset exits the wearing adjustment mode; or, If an operation indicating the end of adjusting the wearing position of the headset is detected, determining that the headset has exited the wearing adjustment mode; or If a target feedback instruction sent by the display device is received, it is determined that the headset exits the wearing adjustment mode, wherein the target feedback instruction is an instruction to end the adjustment of the wearing position of the headset.

8. A wearing adjustment system, characterized in that: The earphones and display device connected to each other by the wearing adjustment system, The headset is configured to collect environmental image data and send the environmental image data to the display device when determining that the headset is in the wearing adjustment mode; The display device is used to receive the environmental image data sent by the headset and output the environmental image data so that the user can adjust the wearing position of the headset based on the environmental image data.

9. A headset, characterized in that: The headset includes: a memory, a processor, and a wearing adjustment program stored in the memory and executable on the processor. When the wearing adjustment program is executed by the processor, the steps of the wearing adjustment method for the headset according to any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium is a computer-readable storage medium, on which is stored a program for implementing a method for adjusting the wearing of headphones. The program for implementing the method for adjusting the wearing of headphones is executed by a processor to implement the steps of the method for adjusting the wearing of headphones as described in any one of claims 1 to 7.

Images