Earphone wearing adjustment method and system, earphone, readable storage medium and product

Abstract

The application discloses an earphone wearing adjustment method and system, an earphone, a readable storage medium and a product, and relates to the technical field of earphones. The method comprises the following steps: collecting environmental image data under the condition that it is determined that the earphone is in a wearing adjustment mode; and sending the environmental image data to a display device connected with the earphone, so as to output the environmental image data through the display device, and to provide a user with the environmental image data for adjusting the wearing position of the earphone. The application improves the wearing comfort and aesthetics of the earphone, and improves the accuracy and convenience of assisting in positioning the earphone.

Description

Technical Field

[0001] This application relates to the field of headphone technology, and in particular to a method, system, headphone, readable storage medium, and product for adjusting the wearing of headphones. Background Technology

[0002] With the development of multimodal convergence in smart wearable devices, headphones with integrated camera functions are gradually becoming an emerging product form. These devices embed camera modules into the earphone cavity, utilizing their physical characteristics that are highly similar to the human eye to acquire image data that approximates human vision, providing a hardware foundation for innovative applications such as augmented reality interaction and intelligent environmental perception.

[0003] However, this design also brings new problems. Due to the diversity of how headphones are worn and the scenarios in which they are used, it is difficult for users to ensure that the camera's field of view matches the desired direction when wearing the headphones. Traditional methods for assisting with headphone wearing and positioning usually involve designing structural positioning points on the casing, such as raised dots or ridges, to help users adjust the wearing angle by touch. However, this method has many shortcomings: firstly, it requires additional design to the casing, which may reduce wearing comfort and the headphones' aesthetics; secondly, this structural positioning relies on the user to judge the headphone angle by touch, and the human hand has inherent limitations in its sensitivity to spatial position and angle, resulting in poor accuracy and convenience in positioning. Summary of the Invention

[0004] The main purpose of this application is to provide a method, system, earphone, readable storage medium and product for adjusting the wearing of earphones, which aims to solve the technical problems of traditional auxiliary earphone wearing and positioning methods, which require additional structural design on the earphones and have poor positioning accuracy and convenience.

[0005] To achieve the above objectives, this application provides a method for adjusting the wearing of headphones, wherein the headphones are connected to a display device, and the method for adjusting the wearing of headphones includes the following steps:

[0006] When it is determined that the headphones are in wearing adjustment mode, environmental image data is collected;

[0007] The environmental image data is sent to the display device so that the display device can output the environmental image data, allowing the user to adjust the wearing position of the headphones based on the environmental image data.

[0008] In one embodiment, the display device includes a mobile terminal and an earphone charging case, and the step of sending the environmental image data to the display device connected to the earphones includes:

[0009] The projection path is determined based on the preset video stream projection path selection strategy;

[0010] If the screen projection path indicates that the screen projection is performed via a mobile terminal, then the environmental image data is sent to the mobile terminal.

[0011] If the screen projection path indicates that the screen is projected through the headphone charging case, then the environmental image data is sent to the headphone charging case;

[0012] If the screen projection path indicates that the screen projection is displayed on the mobile terminal via the earphone charging case, then the environmental image data is sent to the mobile terminal and the environmental image data is also sent to the earphone charging case.

[0013] In one embodiment, prior to the step of sending environmental image data to the earphone charging case, the method further includes:

[0014] The image resolution of the environmental image data is obtained, and the display screen resolution of the earphone charging case is obtained;

[0015] If the resolution of the display screen is less than the resolution of the image, the environmental image data is compressed.

[0016] The step of sending the environmental image data to the earphone charging case is performed based on the compressed environmental image data.

[0017] In one embodiment, the step of acquiring environmental image data includes:

[0018] Obtain the current remaining battery level of the headphones;

[0019] If the current remaining battery power is greater than a preset threshold, then environmental image data is collected at a first preset low frame rate;

[0020] If the current remaining battery power is less than or equal to a preset threshold, then environmental image data is collected at a second preset low frame rate, wherein the second preset low frame rate is less than the first preset low frame rate.

[0021] In one embodiment, after the step of acquiring environmental image data, the method further includes:

[0022] If the display device is detected in the environmental image data, it is determined whether the display screen of the display device is located in the center of the image;

[0023] If not, a prompt message will be displayed.

[0024] In one embodiment, prior to the step of acquiring environmental image data, the method further includes:

[0025] Acquire the status data of the headphones, wherein the status data includes motion data and / or touch data;

[0026] If an adjustment operation for the wearing position of the headphones is detected based on the state data, then the step of collecting environmental image data is executed.

[0027] In one embodiment, after the step of sending the environmental image data to the display device, the method further includes:

[0028] If no adjustment operation for the wearing position of the headphones is detected within the preset time period, it is determined that the headphones have exited the wearing adjustment mode; or,

[0029] If an indication is detected that the adjustment operation to end the headphone wearing position has ended, then it is determined that the headphones have exited the wearing adjustment mode; or,

[0030] If a target feedback instruction is received from the display device, it is determined that the headphones have exited the wearing adjustment mode, wherein the target feedback instruction is an instruction to end the adjustment of the wearing position of the headphones.

[0031] Furthermore, to achieve the above objectives, this application also provides a wearing adjustment system, wherein the wearing adjustment system is interconnected with an earphone and a display device.

[0032] The headphones are used to collect environmental image data and send the environmental image data to the display device when it is determined that the headphones are in a wearing adjustment mode.

[0033] The display device is used to receive the environmental image data sent by the headphones and output the environmental image data so that the user can adjust the wearing position of the headphones based on the environmental image data.

[0034] In addition, to achieve the above objectives, this application also provides an earphone, the earphone comprising: a memory, a processor, and a wearing adjustment program stored in the memory and executable on the processor, wherein when the wearing adjustment program is executed by the processor, it implements the steps of the wearing adjustment method of the earphone as described above.

[0035] In addition, to achieve the above objectives, this application also provides a readable storage medium, which is a computer-readable storage medium, storing a program that implements a method for adjusting the wearing of headphones. The program that implements the method for adjusting the wearing of headphones is executed by a processor to implement the steps of the method for adjusting the wearing of headphones as described above.

[0036] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the headphone wearing adjustment method described above.

[0037] One or more technical solutions proposed in this application have at least the following technical effects:

[0038] This application, when the headphones are in wearing adjustment mode, collects environmental image data through the headphones and sends the collected environmental image data to a display device connected to the headphones. The display device then outputs and displays this environmental image data, allowing the user to adjust the wearing position of the headphones based on the environmental image data. This method uses real-time environmental image data captured by the headphones to assist in adjusting the headphone's wearing position without requiring additional structural design to the outer casing, thus improving the wearing comfort and aesthetics of the headphones. Furthermore, users can view the real-time environmental image data to correct discrepancies between the headphone's camera field of view and their direct line of sight, quickly adjusting and positioning the headphones to the desired wearing position, thereby improving the accuracy and convenience of the headphone positioning assistance. In addition, there is no need to touch structural positioning points to assist in adjusting the headphone's position while wearing it, which is very user-friendly for users with hand impairments or poor tactile sensitivity, greatly enhancing their user experience when wearing headphones. Attached Figure Description

[0039] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0040] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0041] Figure 1 This is a flowchart illustrating the first embodiment of the headphone wearing adjustment method of this application;

[0042] Figure 2 This is a schematic diagram of the adjustment process involved in one embodiment of the headphone wearing adjustment method of this application;

[0043] Figure 3 This is a flowchart illustrating another embodiment of the headphone wearing adjustment method of this application;

[0044] Figure 4 This is a schematic diagram of the system structure of the headphone wearing adjustment system of this application;

[0045] Figure 5 This is a schematic diagram of the device structure of the hardware operating environment involved in the wearing adjustment system in this application embodiment.

[0046] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0047] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0048] Currently, smart wearable devices are developing towards multimodal integration, with increasingly diversified product forms and functions. For example, cameras have been added to Bluetooth headphones, enabling not only regular audio functions but also photo or short video shooting, live streaming, and even integration with AI (Artificial Intelligence) for applications such as intelligent image recognition. The advantages of having a camera on headphones are that the camera's position is very close to the human eye, the vertical height of the field of view is basically the same as the human eye, and no separate wearing device is needed, so users basically don't feel any change in their tactile experience after adding the camera. However, there are also practical problems with having a camera on headphones, namely, it's difficult for users to ensure that the camera's field of view is aligned with their desired direction while wearing the headphones, and it's difficult to adjust the camera to the desired angle using only tactile feedback.

[0049] Conventional methods for assisting headphone positioning involve designing structural positioning points on the casing, such as protrusions or ridges. This requires additional design elements to the casing, reducing wearing comfort and aesthetics. Furthermore, traditional structural positioning relies on the user's tactile sense to determine the headphone's position (specifically, the wearing angle). This method depends on the human hand's sensitivity to spatial position and angle, inherently prone to significant errors. Users can typically make judgments about the spatial angle of headphone components based solely on tactile feedback with errors exceeding ±15 degrees, failing to meet the accuracy requirements of image capture. More importantly, repeated adjustments require users to maintain the wearing position while operating blindly, easily leading to ear canal pressure or ear friction, severely impacting wearing comfort. Particularly in sports scenarios, protruding structures can easily snag on clothing, posing a safety hazard. These design compromises not only weaken the product's market competitiveness but also limit the functional expansion possibilities of the camera module in headphone products.

[0050] Based on this, the main solution of this application is: when it is determined that the headphones are in the wearing adjustment mode, environmental image data is collected; the environmental image data is sent to the display device connected to the headphones, so that the display device can output the environmental image data, allowing the user to adjust the wearing position of the headphones based on the environmental image data.

[0051] This application, when the headphones are in adjustment mode, collects environmental image data through the headphones and sends the collected data to a display device connected to the headphones. The display device then outputs and displays this environmental image data, allowing the user to adjust the headphone's wearing position based on the environmental image data. This method uses real-time environmental image data captured by the headphones to assist in adjusting the headphone's position without requiring additional structural design to the outer casing, thus improving the headphones' wearing comfort and aesthetics. Furthermore, users can view the real-time environmental image data to correct discrepancies between the headphone's camera field of view and their direct line of sight, quickly adjusting and positioning the headphones to the desired wearing position, thereby improving the accuracy and convenience of the headphone positioning assistance. In addition, there is no need to touch structural positioning points to adjust the headphone's position while wearing it, which is very user-friendly for users with hand disabilities or poor tactile sensitivity, greatly enhancing their user experience when wearing the headphones.

[0052] Based on this, this application proposes a method for adjusting the wearing of headphones according to a first embodiment, wherein the headphones are connected to a display device. Please refer to... Figure 1 The method for adjusting the wearing of the headphones includes the following steps:

[0053] Step S10: If it is determined that the headphones are in wearing adjustment mode, environmental image data is collected;

[0054] In this embodiment, the connection between the headphones and the display device refers to the communication connection between the headphones and the display device. The communication connection methods include, but are not limited to, Bluetooth communication connection, Wi-Fi (Wireless Fidelity) communication connection, ZigBee communication connection, NFC (Near Field Communication) communication connection, infrared communication connection, etc.

[0055] Headphones are electronic devices that can be worn on the ears to receive and play audio signals, such as TWS (True Wireless Stereo) headphones and OWS (Open Wearable Stereo) headphones.

[0056] Display devices refer to electronic devices with image visualization capabilities. They present visual information through a graphical user interface and establish two-way data communication with the headphones. Specifically, display devices include, but are not limited to, smartphones, headphone charging cases, tablets, smartwatches, smart bracelets, AR (Augmented Reality) glasses, VR (Virtual Reality) glasses, and other electronic devices capable of carrying display modules. The core function of this display device is to convert invisible headphone wearing position deviations into visible image offsets, thereby overcoming the spatial perception limitations of traditional tactile calibration methods.

[0057] Once it's confirmed that the headphones are in wearing adjustment mode, environmental image data is collected via the headphones. Specifically, the camera in the headphones can be activated to capture environmental image data. Wearing adjustment mode refers to the mode in which the headphone's wearing position (specifically, the wearing angle) is being adjusted. In this mode, the environmental image data collected by the headphones is used to adjust the headphone's wearing position.

[0058] The environmental image data can specifically be visual information captured by the camera module in the earphone, which can be represented as a single-frame static image or a multi-frame continuous image sequence (i.e., a video stream). In a preferred embodiment, environmental image data can be captured at a preset shooting frame rate to obtain a multi-frame continuous image sequence, which is then displayed on a display device to support real-time assisted earphone positioning. Furthermore, considering that the purpose of the image at this time is to assist in adjusting the earphone wearing position rather than recording video information, in order to save battery power, the preset shooting frame rate can be configured to a lower value, for example, 5 to 10 frames per second, so as to meet the purpose of assisted positioning while taking into account the low power consumption of the earphone and improving the earphone's battery life.

[0059] Step S20: The environmental image data is sent to the display device so that the display device can output the environmental image data, allowing the user to adjust the wearing position of the headphones based on the environmental image data.

[0060] After acquiring environmental image data, the system sends the acquired data to a display device for output and display. Specifically, after acquiring the environmental image data, the headphones encode it and send the encoded data to a display device connected to the headphones, such as via Wi-Fi (Wireless Fidelity) or Bluetooth. The display device receives the encoded data, decodes it, and sends it to the display driver circuit, thus displaying the image on the screen.

[0061] Furthermore, before sending the image data to the display device, the image resolution of the ambient image data and the display screen resolution of the display device can be obtained, and the image resolution and display screen resolution can be compared. If they are inconsistent, the image resolution of the ambient image data can be adjusted to match the display screen resolution, and then the adjusted ambient image data can be sent to the display device to achieve adaptive display of the ambient image data. Alternatively, after receiving the image data, the display device can compare the resolutions of the two and determine whether to adjust the resolution of the ambient image data. This reduces the computing power requirements of the headphones and the amount of algorithm code that needs to be embedded in the headphones, making this wearing adjustment method applicable to more headphones and improving its universality.

[0062] It should be noted that the image resolution refers to the information density of the environmental image data in the spatial dimension, which can be specifically expressed as the product of the number of horizontal pixels (e.g., 1600) and the number of vertical pixels (e.g., 1200) (i.e., 1600×1200). The display screen resolution refers to the pixel array specification that the physical screen of the display device used to present environmental image data can address per unit area, which can be specifically expressed as the product of the number of horizontal pixels (e.g., 1920) and the number of vertical pixels (e.g., 1080) (i.e., 1920×1080).

[0063] In this embodiment, when the headphones are in adjustment mode, the headphones collect environmental image data and send it to a display device connected to the headphones. The display device then outputs and displays this environmental image data, allowing the user to adjust the headphone's position based on this data. This method uses real-time captured environmental image data to assist in adjusting the headphone's position without requiring additional structural design to the headset's exterior, thus improving both wearing comfort and aesthetics. Furthermore, users can correct discrepancies between the headphone's camera's field of view and their direct line of sight by viewing the real-time environmental image data, quickly adjusting and positioning the headphones to the desired position, thereby improving the accuracy and convenience of the headphone's positioning assistance. In addition, there is no need to touch structural positioning points to adjust the headphone's position, making it very user-friendly for users with hand impairments or poor tactile sensitivity, greatly enhancing their user experience.

[0064] Based on the first embodiment of this application, in the second embodiment of this application, the content that is the same as or similar to that in the first embodiment can be referred to the above description, and will not be repeated hereafter. Based on this, the display device includes a mobile terminal and an earphone charging case, and the step of sending the environmental image data to the display device connected to the earphones includes:

[0065] Step A10: Determine the casting path based on the preset video stream casting path selection strategy;

[0066] A mobile terminal refers to a computer device that can be used while on the move. It usually has the ability to access a wireless network, such as a mobile phone, wearable device, or tablet computer. For example, the following explanation will use a mobile phone as the mobile terminal.

[0067] The earphone charging case is specifically a charging case that can be paired with the earphones. The preset video stream casting path selection strategy can be a default path selection strategy set within the earphones, such as prioritizing casting to the mobile app when the relevant app is open, and casting to the earphone charging case screen when the mobile app is not open. Alternatively, it can be a user-defined path selection strategy, such as always casting to the relevant mobile app (in this configuration, if the app is closed, the captured environmental image data will not be displayed), always casting to the earphone charging case screen, or casting to both the mobile app and the earphone charging case screen simultaneously.

[0068] It should be noted that when the environmental image data is the first frame sent to the display device after the headphones enter the wearing adjustment mode, a preset video stream casting path selection strategy can be used to determine the casting path. Subsequent frames can then continue to be cast using this path, without needing to repeatedly determine the casting path until it becomes unavailable (e.g., the casting path is a mobile phone but the phone is powered off). This improves the efficiency of environmental image data casting and ensures that an available casting path is automatically switched when one becomes unavailable, enhancing the user experience. Furthermore, if no available casting path is detected (e.g., both the mobile phone and the headphone charging case are disconnected from the headphones), a prompt message can be output to remind the user that there is currently no device available for displaying images, allowing the user to take relevant measures to resolve the issue.

[0069] Step A20: If the projection path indicates projection via a mobile terminal, then the environmental image data is sent to the mobile terminal.

[0070] Step A30: If the screen projection path indicates that the screen is projected through the headphone charging case, then the environmental image data is sent to the headphone charging case.

[0071] Step A40: If the screen projection path indicates screen projection display via the earphone charging case and the mobile terminal, then the environmental image data is sent to the mobile terminal and the environmental image data is also sent to the earphone charging case.

[0072] When multiple display devices are connected to the earphones, this embodiment uses two display devices: a mobile phone and the earphone charging case. The earphones automatically select and determine the projection path according to a preset video stream projection path selection strategy, effectively solving problems such as image transmission delay, fragmented display content, and resource waste caused by competitive projection from multiple devices. Furthermore, it can dynamically avoid screen stuttering or interruptions caused by busy or unstable signals from a single display device. For example, when the earphones are simultaneously connected to both a mobile phone and the earphone charging case with a display screen, the earphones prioritize projecting environmental image data to the charging case to provide a dedicated auxiliary positioning interface, avoiding interference from phone call notifications or other application pop-ups. If the charging case screen is detected to be off, it seamlessly switches to the mobile phone display. By accurately matching the user's current scenario needs with device availability, the determinism and stability of the visual feedback channel can be guaranteed without manual intervention, improving the smoothness of the earphone wearing position adjustment process.

[0073] In one possible implementation, prior to the step of sending the environmental image data to the earphone charging case, the method further includes:

[0074] Step B10: Obtain the image resolution of the environmental image data and the display screen resolution of the earphone charging case;

[0075] Step B20: If the display screen resolution is less than the image resolution, then the environmental image data is compressed.

[0076] It should be noted that when the display screen resolution of the earphone charging case is lower than the image resolution of the ambient image data, the ambient image data is compressed. Specifically, the image resolution of the compressed ambient image data is consistent with the resolution of the display screen.

[0077] Optionally, the image data is downsampled in spatial dimension. Specifically, a bilinear interpolation algorithm is used to scale the high-resolution image data (e.g., 1280×720) to the display screen resolution of the earphone charging case (e.g., 800×480).

[0078] Step B30: Based on the compressed environmental image data, perform the step of sending the environmental image data to the earphone charging case.

[0079] In this embodiment, considering that the size of the earphone charging case limits the resolution of its display screen, the captured images cannot be displayed in full on the earphone charging case screen. Therefore, before sending the environmental image data to the earphone charging case, the resolutions of the two are compared. If the resolution of the earphone charging case's display screen is less than the resolution of the environmental image data, the environmental image data is compressed to match the pixel count of the earphone charging case's display screen, so that the image can be displayed on the earphone charging case's display screen.

[0080] For example, to aid in understanding the technical concept or principle of the headphone wearing adjustment method combined with the first embodiment, a specific embodiment is provided below. In this specific embodiment, the working principle is as follows: the camera starts real-time shooting, the video stream projection path is selected, it is determined whether to perform image sampling and compression processing based on the selected path, and the video stream is projected and displayed. Specifically, refer to... Figure 2 As shown, the headphone wearing and adjustment process from the moment the user puts on the headphones includes:

[0081] 1. Camera starts real-time shooting.

[0082] When a user removes the earbuds from the charging case and begins wearing them, the camera starts recording in real time, capturing environmental image data, i.e., a video stream. Considering that the purpose of the images at this time is to assist in adjusting the earbud wearing angle, rather than recording video information, the shooting frame rate can be configured to a lower value, such as 5 to 10 frames per second, in order to save battery power, thus satisfying the purpose of adjusting the wearing position while also ensuring low power consumption.

[0083] 2. Video stream casting path selection

[0084] Users may have one or two ways to view images captured by the camera: one is to view them in the relevant app on their mobile phone, and the other is to view them on the charging case screen if the charging case has a screen. For models with both viewing methods, the system can automatically select the video stream casting path by default, for example, casting to the app first when the mobile app is open, and casting to the charging case screen when the app is closed; or users can customize the casting path in the function menu, such as fixing it to casting to the app (in this configuration, if the app is closed, the captured image will not be displayed), fixing it to casting to the charging case screen, or casting to both the app and the charging case screen simultaneously.

[0085] 3. Determine whether image sampling and compression processing is required.

[0086] Current mobile phone screens generally have high pixel counts, allowing images captured by the camera to be directly projected onto the phone screen. However, when video streams are projected onto the charging case screen, the pixel count is typically lower due to the screen's size limitations. Therefore, the captured images cannot be displayed in full on the charging case screen. Consequently, the image needs to be sampled and compressed before being projected to the charging case to match the screen's pixel count. The decision to sample and compress the video stream depends on the screen being projected onto; this process is handled by the earphone's main control chip or ISP (Image Signal Processor) chip.

[0087] 4. Video streaming

[0088] The image captured by the camera on the earphone is encoded into video and then transmitted to the main control chip of the mobile phone or charging case via WIFI or Bluetooth. The GPU (Graphics Processing Unit) unit in the mobile phone or the video decoding chip in the charging case decodes the data and sends it to the display driver circuit, so that the image is displayed on the screen.

[0089] It should be noted that the above examples are only used to help understand this application and do not constitute a limitation on the wearing and adjustment process of the headphones in this application. Any simple modifications based on this technical concept are within the protection scope of this application.

[0090] Based on the first and / or second embodiments of this application, in the third embodiment of this application, the content that is the same as or similar to that in embodiments one and two above can be referred to the above description and will not be repeated hereafter. Based on this, the step of collecting environmental image data includes:

[0091] Step C10: Obtain the current remaining battery power of the earphone;

[0092] Step C20: If the current remaining battery power is greater than a preset threshold, then environmental image data is collected at a first preset low frame rate.

[0093] Step C30: If the current remaining battery power is less than or equal to a preset threshold, then environmental image data is collected at a second preset low frame rate, wherein the second preset low frame rate is less than the first preset low frame rate.

[0094] It should be noted that the second preset low frame rate is lower than the first preset low frame rate, and both can be less than or equal to the aforementioned preset shooting frame rate. This is to ensure low power consumption while intelligently and dynamically adjusting the shooting frame rate based on the current remaining battery power of the headphones. When the battery power of the headphones decreases, data is collected at a lower frame rate, further reducing the power consumption of the headphones.

[0095] In one possible implementation, refer to Figure 3 As shown, after the step of acquiring environmental image data, the method further includes:

[0096] Step D10: If the display device is detected in the environmental image data, determine whether the display screen of the display device is located in the center of the image;

[0097] Step D20: If not, output a prompt message.

[0098] It is understandable that users need to look at the screen of their phone or the charging case when adjusting the position of the earphones. Under normal circumstances, the user's direct field of vision is the screen of the phone or the charging case. Therefore, when the position of the earphones is adjusted so that the middle of the image captured by the camera is the screen of the phone or the charging case, it can be determined that the shooting field of the camera is basically consistent with the user's direct field of vision.

[0099] Based on this, when it is detected that the display screen of the display device is not in the center of the image, a prompt message (referred to as the first prompt message for easy distinction) is output to remind the user that the headphone wearing position needs to be adjusted. In addition, when it is detected that the display screen of the display device is in the center of the image, a second prompt message can be output to remind the user that the current display screen is in the center of the display device, so that the user can decide whether the headphone wearing position needs to be adjusted.

[0100] It should be noted that the display screen of the display device can be determined to be in the middle of the image when the pixel offset between the center point of the display screen and the center point of the image is within a preset tolerance range (such as a rectangular area consisting of ±5% of the frame width in the horizontal direction and ±3% of the frame height in the vertical direction).

[0101] By detecting the display device's position in the image and triggering a prompt mechanism, a precise mapping relationship between user actions and system feedback is effectively established. When the display screen deviates from the center of the image, the first prompt message (such as a flashing red light at the edge of the screen) is output to intuitively guide the user to adjust the headphone wearing position, shortening the adjustment time by utilizing the conditioned reflex characteristics of human body movements. When the display screen is in the center of the image, the second prompt message (such as a green checkmark in the center of the screen) is output, confirming the positioning completion status through immediate positive feedback and eliminating repeated verification operations caused by users' uncertainty about the adjustment result.

[0102] Furthermore, to ensure that users keep their eyes on the display device during the headphone adjustment process, a third prompt can be output after the headphones have entered the adjustment mode to remind users to look at the display device. This could be done through vibration prompts and voice guidance (such as "Please look at the center of the screen") to remind users to focus their gaze on the display screen. At this time, the user's head will naturally face the display device, making the headphone's camera field of view axis and the user's actual observation direction form a spatial consistency benchmark. This allows the headphones to intelligently and automatically determine whether the headphone's camera field of view is consistent with the user's intuitive field of view based on the display position of the display device in the image. At the same time, it reduces repeated adjustment operations caused by the user's gaze wandering, achieving an intuitive calibration experience of "what you see is what you are positioned".

[0103] In one possible implementation, prior to the step of acquiring environmental image data, the method further includes:

[0104] Step E10: Obtain the status data of the earphone, wherein the status data includes motion data and / or touch data;

[0105] It should be noted that the motion data can specifically be data collected by motion sensors built into the headphones, such as accelerometers, gyroscopes, and IMUs (Inertial Measurement Units); the touch data can specifically be data collected by touch sensors built into the headphones, such as interdigital capacitive electrodes.

[0106] Step E20: If an adjustment operation for the wearing position of the headphones is detected based on the state data, then the step of collecting environmental image data is executed.

[0107] When an adjustment operation related to the wearing position of the headphones is detected based on the status data, environmental image data is collected. At this time, the collection of environmental image data can be stopped after collecting only one frame or a preset number of frames of image data each time, until another adjustment operation related to the wearing position of the headphones is detected, at which point the environmental image data is collected again. In this way, environmental image data is only collected again when there is an adjustment operation related to the wearing position of the headphones, which may cause a change in the field of view of the headphones. This can further reduce the amount of image data that needs to be collected, thereby further reducing the power consumption of the headphones and improving the battery life of the headphones.

[0108] Understandably, when a user adjusts the wearing position of the headphones, the user needs to touch the headphones, and the wearing angle of the headphones will change. Thus, the system can detect whether the user touches the headphones (e.g., if the electrode capacitance value increases by 20fF based on touch data, it is determined that the user has touched the headphones) and / or whether the wearing angle of the headphones has changed (e.g., if the angular velocity of the headphones around the major axis of the earbud is greater than a preset threshold based on motion data, it is determined that the wearing angle of the headphones has changed). This allows the system to determine whether an adjustment operation for the wearing position of the headphones has been detected. If the user touches the headphones based on touch data and / or the wearing angle of the headphones is changed based on motion data, then an adjustment operation for the wearing position of the headphones has been detected.

[0109] In one possible implementation, after the step of sending the environmental image data to the display device, the method further includes:

[0110] Step F10: If no adjustment operation for the wearing position of the headphones is detected within a preset time period, then the headphones are determined to exit the wearing adjustment mode; or,

[0111] Step F20: If an indication is detected that the adjustment operation to end the headphone wearing position has ended, then it is determined that the headphones have exited the wearing adjustment mode; or,

[0112] Step F30: If a target feedback instruction is received from the display device, it is determined that the headphones have exited the wearing adjustment mode, wherein the target feedback instruction is an instruction to end the adjustment of the wearing position of the headphones.

[0113] After adjusting the wearing position, the user can exit the wearing adjustment mode and enter the normal working mode by using preset operation instructions to end the adjustment. For example, the user can end the wearing position adjustment by operating the physical buttons on the headphones (such as double-clicking the touch area) or by manually operating the confirmation button on the display device APP. When the display device receives the user's confirmation operation, it can send a target feedback command to the headphones so that the headphones can confirm that they have exited the wearing adjustment mode after receiving the target feedback command.

[0114] If no adjustment operation for the wearing position of the headphones is detected within the preset time, it may be because the user has already adjusted the wearing position of the headphones to meet expectations, which is why the wearing position of the headphones has not been adjusted for a long time. In this case, the headphones will exit the wearing adjustment mode, so that even if the user does not perform a specific operation, the headphones can intelligently and automatically exit the wearing adjustment mode, thereby reducing user operations and improving the user experience.

[0115] Furthermore, relevant personnel can set other conditions for exiting the wearing adjustment mode based on actual needs, such as interruption of communication between the headphones and the display device; or detection of a headphone being removed from the ear, etc., without specific restrictions here.

[0116] Correspondingly, users can also enter the wearing adjustment mode in a preset way, such as by combining physical buttons on the earphone (e.g., pressing and holding the touch area for 3 seconds) or by triggering the location entry of the display device APP. Alternatively, the earphone can automatically enter the wearing adjustment mode after detecting that the preset entry conditions are met. The preset entry conditions can be pre-set events that are expected to enter the wearing adjustment mode, such as the recognition confidence of a preset reference object (e.g., facial contour, horizon) in the camera's captured image being lower than a threshold, or the earphone's built-in motion sensor detecting that the earphone's pitch or roll angle deviates from the reference value by more than the preset tolerance range, or the detection of the earphone entering the ear.

[0117] Understandably, when a user puts on headphones, they secure them to their ears—this is an "up-ear" event. When a user removes headphones, they detach them from their ears—this is an "out-of-ear" event. For in-ear headphones, the "up-ear" event corresponds to the "insertion" event (inserting the headphones into the ear), and the "out-of-ear" event corresponds to the "removal" event (taking the headphones out of the ear). For over-ear headphones, the "up-ear" event corresponds to the "secured" event (secured to the earcups), and the "out-of-ear" event corresponds to the "removal" event (removing the earcups from the ear). Understandably, when a user secures or removes the headphones, the sensor data representing headphone motion will exhibit different signal patterns. For example, when using an accelerometer to measure headphone motion, the motion data from the accelerometer will show different peaks and orientation changes when the user secures or removes the headphones. Therefore, it is possible to determine whether the headphones have experienced an "up-ear" or "out-of-ear" event based on the sensor data representing headphone motion.

[0118] Furthermore, this application also proposes a wearing adjustment system, referring to... Figure 4 As shown, the wearing adjustment system includes an earphone and a display device connected to each other. The earphone is used to collect environmental image data and send the environmental image data to the display device when it is determined that the wearing adjustment mode is in progress.

[0119] The display device is used to receive the environmental image data sent by the headphones and output the environmental image data so that the user can adjust the wearing position of the headphones based on the environmental image data.

[0120] In one embodiment, the display device includes a mobile terminal and an earphone charging case, wherein the earphones are further configured to:

[0121] The projection path is determined based on the preset video stream projection path selection strategy;

[0122] If the screen projection path indicates that the screen projection is performed via a mobile terminal, then the environmental image data is sent to the mobile terminal.

[0123] If the screen projection path indicates that the screen is projected through the headphone charging case, then the environmental image data is sent to the headphone charging case;

[0124] If the screen projection path indicates that the screen projection is displayed on the mobile terminal via the earphone charging case, then the environmental image data is sent to the mobile terminal and the environmental image data is also sent to the earphone charging case.

[0125] In one embodiment, the earphones are further used for:

[0126] The image resolution of the environmental image data is obtained, and the display screen resolution of the earphone charging case is obtained;

[0127] If the resolution of the display screen is less than the resolution of the image, the environmental image data is compressed.

[0128] The step of sending the environmental image data to the earphone charging case is performed based on the compressed environmental image data.

[0129] In one embodiment, the earphones are further used for:

[0130] Obtain the current remaining battery level of the headphones;

[0131] If the current remaining battery power is greater than a preset threshold, then environmental image data is collected at a first preset low frame rate;

[0132] If the current remaining battery power is less than or equal to a preset threshold, then environmental image data is collected at a second preset low frame rate, wherein the second preset low frame rate is less than the first preset low frame rate.

[0133] In one embodiment, the earphones are further used for:

[0134] If the display device is detected in the environmental image data, it is determined whether the display screen of the display device is located in the center of the image;

[0135] If not, a prompt message will be displayed.

[0136] In one embodiment, the earphones are further used for:

[0137] Acquire the status data of the headphones, wherein the status data includes motion data and / or touch data;

[0138] If an adjustment operation for the wearing position of the headphones is detected based on the state data, then the step of collecting environmental image data is executed.

[0139] In one embodiment, the earphones are further used for:

[0140] If no adjustment operation for the wearing position of the headphones is detected within the preset time period, it is determined that the headphones have exited the wearing adjustment mode; or,

[0141] If an indication is detected that the adjustment operation to end the headphone wearing position has ended, then it is determined that the headphones have exited the wearing adjustment mode; or,

[0142] If a target feedback instruction is received from the display device, it is determined that the headphones have exited the wearing adjustment mode, wherein the target feedback instruction is an instruction to end the adjustment of the wearing position of the headphones.

[0143] The wearing adjustment system provided in this application can solve the technical problems of traditional auxiliary headphone wearing and positioning methods, which require additional structural design on the headphones and have poor positioning accuracy and convenience. Compared with the prior art, the beneficial effects of the wearing adjustment system provided in this application are the same as those of the headphone wearing adjustment method provided in the above embodiments, and other technical features of this wearing adjustment system are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0144] Furthermore, this application also proposes an earphone, which includes a memory, a processor, and a wearing adjustment program stored in the memory and executable on the processor. When the wearing adjustment program is executed by the processor, it implements the steps of the earphone wearing adjustment method described above.

[0145] refer to Figure 5 The diagram illustrates a structural schematic suitable for implementing the embodiments of this application. Figure 5As shown, the headphones may include a processing system 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage system 1003 into a random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for headphone operation. The processing system 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: an input system 1007 including, for example, a touchscreen, touchpad, image sensor, microphone, accelerometer, gyroscope, etc.; an output system 1008 including, for example, a speaker, vibrator, etc.; a storage system 1003 including, for example, a memory card, memory module, etc.; and a communication system 1009. Communication system 1009 allows the headset to communicate wirelessly or wiredly with other devices to exchange data. While the figure shows headsets with various systems, it should be understood that implementation or possession of all the systems shown is not required. More or fewer systems may be implemented alternatively.

[0146] Specifically, according to the embodiments disclosed in this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from storage device 1003, or installed from ROM 1002. When the computer program is executed by processing device 1001, it performs the functions defined in the methods of the embodiments disclosed in this application.

[0147] The headphones provided in this application, employing the headphone wearing adjustment method described in the above embodiments, can solve the technical problems of traditional auxiliary headphone wearing and positioning methods, which require additional structural design to the headphones and suffer from poor positioning accuracy and convenience. Compared with the prior art, the beneficial effects of the headphones provided in this application are the same as those of the headphone wearing adjustment method provided in the above embodiments, and other technical features of the headphones are the same as those disclosed in the previous embodiment method, and will not be repeated here.

[0148] It should be understood that the various parts disclosed in this application can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics can be combined in any suitable manner in one or more embodiments or examples.

[0149] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0150] In addition, to achieve the above objectives, this application embodiment also provides a readable storage medium having computer-readable program instructions (i.e., a computer program) stored thereon, the computer-readable program instructions being used to execute the headphone wearing adjustment method in the above embodiments.

[0151] The computer-readable storage medium provided in this application embodiment may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (Radio Frequency), etc., or any suitable combination thereof.

[0152] The aforementioned computer-readable storage medium may be included in the headphones; or it may exist independently and not assembled into the headphones.

[0153] The aforementioned computer-readable storage medium carries one or more programs that, when executed by the headphones, cause the headphones to: acquire environmental image data when it is determined that the headphones are in a wearing adjustment mode; and send the environmental image data to a display device communicatively connected to the headphones, so as to output the environmental image data through the display device for the user to adjust the wearing position of the headphones based on the environmental image data.

[0154] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0155] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0156] The modules described in the embodiments of this application can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0157] The readable storage medium provided in this application is a computer-readable storage medium that stores computer-readable program instructions (i.e., a computer program) for executing the above-described headphone wearing adjustment method. This solves the technical problem that traditional auxiliary headphone wearing positioning methods require additional structural design to the headphones and suffer from poor positioning accuracy and convenience. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as those of the headphone wearing adjustment method provided in the above embodiments, and will not be repeated here.

[0158] Furthermore, this application also proposes a computer program product, including a wearing adjustment program, which, when executed by a processor, implements the steps of the headphone wearing adjustment method described above.

[0159] The specific implementation method of the computer program product in this application is basically the same as the various embodiments of the above-mentioned headphone wearing adjustment method, and will not be described again here.

[0160] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0161] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0162] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software sensor. This computer software sensor is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0163] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A method for adjusting the wearing of headphones, characterized in that, The headphones are connected to the display device, and the method for adjusting the wearing of the headphones includes the following steps: Acquire the status data of the headphones, wherein the status data includes motion data and / or touch data; If an adjustment operation for the wearing position of the headphones is detected based on the state data, then environmental image data is collected; The environmental image data is sent to the display device so that the display device can output the environmental image data, allowing the user to adjust the wearing position of the headphones based on the environmental image data; If the display device is detected in the environmental image data, it is determined whether the display screen of the display device is located in the center of the image; If not, output a prompt message; The acquisition of environmental image data includes: stopping acquisition after acquiring one frame or a preset number of frames of image data each time, and acquiring environmental image data again after detecting an adjustment operation for the wearing position of the headphones.

2. The wearing adjustment method as described in claim 1, characterized in that, The display device includes a mobile terminal and an earphone charging case. The step of sending the environmental image data to the display device connected to the earphones includes: The projection path is determined based on the preset video stream projection path selection strategy; If the screen projection path indicates that the screen projection is performed via a mobile terminal, then the environmental image data is sent to the mobile terminal. If the screen projection path indicates that the screen is projected through the earphone charging case, then the environmental image data is sent to the earphone charging case; If the screen projection path indicates that the screen projection is displayed on the mobile terminal via the earphone charging case, then the environmental image data is sent to the mobile terminal and the environmental image data is also sent to the earphone charging case.

3. The wearing adjustment method as described in claim 2, characterized in that, Before the step of sending the environmental image data to the earphone charging case, the method further includes: The image resolution of the environmental image data is obtained, and the display screen resolution of the earphone charging case is obtained; If the resolution of the display screen is less than the resolution of the image, the environmental image data is compressed. The step of sending the environmental image data to the earphone charging case is performed based on the compressed environmental image data.

4. The wearing adjustment method according to any one of claims 1 to 3, characterized in that, The steps for acquiring environmental image data include: Obtain the current remaining battery level of the headphones; If the current remaining battery power is greater than a preset threshold, then environmental image data is collected at a first preset low frame rate; If the current remaining battery power is less than or equal to a preset threshold, then environmental image data is collected at a second preset low frame rate, wherein the second preset low frame rate is less than the first preset low frame rate.

5. The wearing adjustment method according to any one of claims 1 to 3, characterized in that, Before the step of acquiring environmental image data, the method further includes: Acquire the status data of the headphones, wherein the status data includes motion data and / or touch data; If an adjustment operation for the wearing position of the headphones is detected based on the state data, then the step of collecting environmental image data is executed.

6. The wearing adjustment method according to any one of claims 1 to 3, characterized in that, After the step of sending the environmental image data to the display device, the method further includes: If no adjustment operation for the wearing position of the headphones is detected within the preset time period, it is determined that the headphones have exited the wearing adjustment mode; or, If an indication is detected that the adjustment operation to end the headphone wearing position has ended, then it is determined that the headphones have exited the wearing adjustment mode; or, If a target feedback instruction is received from the display device, it is determined that the headphones have exited the wearing adjustment mode, wherein the target feedback instruction is an instruction to end the adjustment of the wearing position of the headphones.

7. A wearing adjustment system, characterized in that, The wearing adjustment system is interconnected with the headphones and display device. The earphone is used to acquire the status data of the earphone, wherein the status data includes motion data and / or touch data; If an adjustment operation for the wearing position of the headphones is detected based on the status data, then environmental image data is collected and sent to the display device; The display device is used to receive the environmental image data sent by the headphones and output the environmental image data so that the user can adjust the wearing position of the headphones based on the environmental image data; The earphone is also configured to determine whether the display screen of the display device is located in the center of the image if the display device is detected in the environmental image data; if not, output a prompt message. The earphone is also used to stop acquiring image data after acquiring one frame or a preset number of frames each time, and to acquire environmental image data again after detecting an adjustment operation for the wearing position of the earphone.

8. An earphone, characterized in that, The earphone includes: a memory, a processor, and a wearing adjustment program stored in the memory and executable on the processor, wherein when the wearing adjustment program is executed by the processor, it implements the steps of the wearing adjustment method of the earphone as described in any one of claims 1 to 6.

9. A readable storage medium, characterized in that, The readable storage medium is a computer-readable storage medium, on which a program for implementing a method for adjusting the wearing of headphones is stored, and the program for implementing the method for adjusting the wearing of headphones is executed by a processor to implement the steps of the method for adjusting the wearing of headphones as described in any one of claims 1 to 6.

Images