Control method and device of head-mounted device, and head-mounted device

Abstract

This application discloses a control method, apparatus, and head-mounted device for a head-mounted device, relating to the field of wearable device technology. The method is applied to a head-mounted device comprising: a headband, a pair of earphone components, and a position sensor. The method includes: in response to detecting that the number of times the position sensor continuously outputs a first signal reaches a first threshold, monitoring a first duration for which the position sensor continuously outputs the first signal; wherein the first signal indicates that the earphone components are physically separated from the headband; and when the first duration reaches a second threshold, controlling the earphone components to switch from a first mode to a second mode; wherein the first mode refers to a working mode in which the pair of earphone components perform the same task, and the second mode refers to a working mode in which each earphone component performs a task independently. This application solves the problem of limited functionality in head-mounted devices with an integrated structure, enriches the functionality of head-mounted devices, and achieves diversified functionality.

Description

Technical Field

[0001] This application belongs to the field of wearable device technology, and particularly relates to a control method, device and head-mounted device for a head-mounted device. Background Technology

[0002] Existing head-mounted devices typically employ an integrated structure where the headphones are fixed to the headband. Head-mounted devices with this structure have limited functionality, only capable of outputting audio from a single device.

[0003] There is still no effective solution to the problem of limited functionality in head-mounted devices with an integrated structure in related technologies. Summary of the Invention

[0004] This application provides a control method, apparatus, and head-mounted device for a head-mounted device, which at least solves the problem of limited functionality in head-mounted devices with an integrated structure in related technologies.

[0005] In a first aspect, embodiments of this application provide a control method for a head-mounted device, applied to a head-mounted device including: a headband, a pair of earphone components, and a position sensor, wherein the earphone components are detachably connected to the headband; the method includes: in response to detecting that the number of times the position sensor continuously outputs a first signal reaches a first threshold, monitoring a first duration for which the position sensor continuously outputs the first signal; wherein the first signal indicates that the earphone components are physically separated from the headband; and when the first duration reaches a second threshold, controlling the earphone components to switch from a first mode to a second mode; wherein the first mode refers to a working mode in which the pair of earphone components perform the same task, and the second mode refers to a working mode in which each earphone component performs a task independently.

[0006] In some embodiments, before monitoring a first duration of continuous output of the first signal by the position sensor in response to detecting that the number of times the position sensor continuously outputs the first signal reaches a first threshold, the method further includes: in response to detecting that the position sensor outputs the first signal, acquiring motion data of the earphone component collected by an inertial measurement unit in the earphone component; and determining the first threshold and the second threshold based on the motion data of the earphone component.

[0007] In some embodiments, determining the first threshold and the second threshold based on the motion data of the headphone component includes: determining the pose change of the headphone component based on the motion data of the headphone component; and determining the first threshold and the second threshold based on the pose change of the headphone component; wherein both the first threshold and the second threshold are negatively correlated with the pose change.

[0008] In some embodiments, the step of acquiring motion data of the earphone component collected by the inertial measurement unit in the earphone component in response to detecting the first signal output by the position sensor includes: acquiring the motion data of the earphone component collected by the inertial measurement unit in response to detecting the first signal output by the position sensor, and acquiring an environmental image collected by the camera in the head-mounted device; and the step of determining the first threshold and the second threshold based on the motion data of the earphone component includes: inputting the motion data and the environmental image into a trained scene recognition model to obtain a target scene output by the scene recognition model; searching for a target mapping relationship corresponding to the target scene from a preset mapping table; wherein the mapping table stores multiple mapping relationships, each of the multiple mapping relationships is used to associate a scene and a set of control parameters; obtaining target control parameters from the target mapping relationship, and setting a first parameter in the target control parameters as the first threshold, and setting a second parameter in the target control parameters as the second threshold.

[0009] In some embodiments, after controlling the headphone component to switch from a first mode to a second mode, the method further includes: determining a functional role configuration for each headphone component based on the target scenario; and controlling the headphone component to perform a target task corresponding to the functional role configuration based on the functional role configuration of each headphone component.

[0010] In some embodiments, the functional role configuration includes one of a display interaction configuration and an audio output configuration; controlling the headphone component to perform a target task corresponding to the functional role configuration based on the functional role configuration of each headphone component includes: for each of the pair of headphone components, when the functional role configuration of the headphone component is the display interaction configuration, controlling the headphone component to scan and connect to a target device associated with the target scene, and activating the display unit of the headphone component to display an interactive interface provided by the headphone component or the target device; when the functional role configuration of the headphone component is the audio output configuration, controlling the headphone component to connect to the target device associated with the target scene, and controlling the headphone component to output audio provided by the target device.

[0011] In some embodiments, the method further includes: in response to detecting that the number of times the position sensor continuously outputs the second signal reaches a third threshold, monitoring a second duration for which the position sensor continuously outputs the second signal; wherein the second signal represents a physical connection between the headphone component and the headband; and when the second duration reaches a fourth threshold, controlling the headphone component to switch from the second mode to the first mode.

[0012] Secondly, embodiments of this application provide a control device for a head-mounted device, applied to the head-mounted device, the head-mounted device including: a headband, a pair of earphone components, and a position sensor, the earphone components being detachably connected to the headband; the device includes: a detection module, used to monitor a first duration for which the position sensor continuously outputs the first signal in response to detecting that the number of times the position sensor continuously outputs a first signal reaches a first threshold; wherein the first signal indicates that the earphone components are physically separated from the headband; a control module, used to control the earphone components to switch from a first mode to a second mode when the first duration reaches a second threshold; wherein the first mode refers to a working mode in which the pair of earphone components perform the same task, and the second mode refers to a working mode in which each earphone component performs a task independently.

[0013] Thirdly, embodiments of this application provide a head-mounted device, including: a headband, a pair of earphone components, a position sensor, a memory, a processor, and a computer program stored in the memory and executable on the processor; wherein the pair of earphone components are detachably connected to the headband, the position sensor is used to detect the positional relationship between the earphone components and the headband; when the processor executes the computer program, it implements the control method of the head-mounted device described in any one of the first aspects above.

[0014] Fourthly, embodiments of this application provide a computer program product, including a computer program, which, when run, causes the control method of the head-mounted device described in any of the first aspects to be executed.

[0015] Compared to related technologies, the control method, apparatus, and head-mounted device provided in this application monitor the positional relationship between the headphone components and the headband using a position sensor. When the number of times the position sensor continuously outputs a first signal to characterize the physical separation of the headphone components and the headband reaches a first threshold, the method monitors the first duration of the position sensor continuously outputting the first signal. When the first duration reaches a second threshold, the method controls the headphone components to switch from a first mode to a second mode. The first mode refers to a working mode in which a pair of headphone components perform the same task, and the second mode refers to a working mode in which each headphone component performs a task independently. In this way, when the headphone components in the head-mounted device are not separated from the headband, the head-mounted device can be worn by the user, and the pair of headphone components work together to perform tasks (e.g., playing audio provided by the same terminal device); when the headphone components in the head-mounted device are separated from the headband, each headphone component can perform tasks independently (e.g., playing audio provided by different terminal devices), thereby enriching the functionality of the head-mounted device and realizing its multi-functionality; in addition, by controlling the headphone components to switch working modes when the number of times the position sensor continuously outputs the first signal and the first duration meet preset conditions, the probability of accidentally switching working modes due to loose headphone components or headband, poor contact, accidental touch, or misoperation can be reduced.

[0016] Details of one or more embodiments of this application are set forth in the following drawings and description to make other features, objects and advantages of this application more readily apparent. Attached Figure Description

[0017] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a schematic diagram of the structure of a head-mounted device according to an embodiment of this application; Figure 2 This is a flowchart of a control method for a head-mounted device according to an embodiment of this application; Figure 3 This is a flowchart of a control method for a head-mounted device according to another embodiment of this application; Figure 4 This is a flowchart of a control method for a head-mounted device according to another embodiment of this application. Figure 1 ; Figure 5This is a flowchart of a control method for a head-mounted device according to another embodiment of this application. Figure 2 ; Figure 6 This is a flowchart of a control method for a head-mounted device according to another embodiment of this application. Figure 3 ; Figure 7 This is a schematic diagram of the structure of a control device for a head-mounted device according to an embodiment of this application. Detailed Implementation

[0019] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0020] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0021] Existing head-mounted devices typically employ an integrated structure where the headphones are fixed to the headband. Head-mounted devices with this structure have limited functionality, only capable of outputting audio from a single device.

[0022] There is still no effective solution to the problem of limited functionality in head-mounted devices with an integrated structure in related technologies.

[0023] In view of this, embodiments of this application provide a control method for a head-mounted device, which monitors the positional relationship between the headphone components and the headband using a position sensor, and when the number of times the position sensor continuously outputs a first signal to characterize the physical separation of the headphone components and the headband reaches a first threshold, monitors a first duration for the position sensor to continuously output the first signal, and when the first duration reaches a second threshold, controls the headphone components to switch from a first mode to a second mode, wherein the first mode refers to a working mode in which a pair of headphone components perform the same task, and the second mode refers to a working mode in which each headphone component performs a task independently. In this way, when the headphone components in the head-mounted device are not separated from the headband, the head-mounted device can be worn by the user, and the pair of headphone components work together to perform tasks (e.g., playing audio provided by the same terminal device); when the headphone components in the head-mounted device are separated from the headband, each headphone component can perform tasks independently (e.g., playing audio provided by different terminal devices), thereby enriching the functionality of the head-mounted device and realizing its multi-functionality; in addition, by controlling the headphone components to switch working modes when the number of times the position sensor continuously outputs the first signal and the first duration meet preset conditions, the probability of accidentally switching working modes due to loose headphone components or headband, poor contact, accidental touch, or misoperation can be reduced.

[0024] The following describes an exemplary structure of the head-mounted device provided in the embodiments of this application. See also: Figure 1 , Figure 1 This is a schematic diagram of the structure of a head-mounted device according to an embodiment of this application. Figure 1 As shown, the head-mounted device 1 includes: at least one processor 10 ( Figure 1 (Only one is shown in the image), memory 11, computer program 12 stored in memory 11 and executable on at least one processor 10, headband 13, a pair of headphone components (including a first headphone component 14 and a second headphone component 15), and position sensor 130.

[0025] The headphone components are detachably connected to the headband 13. The position sensor 130 is used to detect the positional relationship between the headphone components and the headband 13. When the processor 10 executes the computer program 12, it implements the following: in response to detecting that the number of times the position sensor 130 continuously outputs the first signal reaches a first threshold, it monitors the first duration of the continuous output of the first signal by the position sensor 130. The first signal indicates that the headphone components are physically separated from the headband 13. When the first duration reaches a second threshold, it controls the headphone components to switch from a first mode to a second mode. The first mode refers to the working mode in which a pair of headphone components perform the same task, and the second mode refers to the working mode in which each headphone component performs a task independently.

[0026] In this embodiment, the position sensor 130 can be integrated onto the headband 13, and the position sensor 130 can be located at the connection between the headband 13 and the headphone component (e.g., at a buckle or hinge connection). The position sensor 130 can include any one of a Hall sensor, a micro switch, or a magnetic reed.

[0027] Taking the position sensor 130 as a Hall sensor as an example, a permanent magnet can be placed at the contact point between the headphone component and the headband 13. When the headphone component is physically separated from the headband 13, the Hall sensor moves away from the permanent magnet and can output a low level (i.e., the first signal); when the headphone component is physically connected to the headband 13, the Hall sensor moves closer to the permanent magnet and can output a high level (i.e., the second signal). The processor 10 can periodically sample the output level of the Hall sensor; for example, the processor 10 can sample the output level of the Hall sensor every 50 milliseconds.

[0028] When the processor 10 determines, based on the sampling results, that the number of times the Hall sensor continuously outputs a low level has reached the first threshold, it can determine that the headphone component and the headband 13 have been physically separated, thereby reducing the probability of momentary misjudgment caused by loose headphone component or poor contact of headband 13.

[0029] Then, the processor 10 can monitor the first duration of the Hall sensor continuously outputting a low level, and when the first duration reaches the second threshold, it can determine that the current physical separation state between the headphone component and the headband 13 is not caused by the user's accidental touch or operation, but by the user actively removing the headphone component from the headband 13. Therefore, it can control the headphone component to switch from the first mode to the second mode.

[0030] In this embodiment, in the first mode, the head-mounted device can provide a private audio output function. The first earphone component 14 and the second earphone component 15 can adopt a master-slave bridging mode. For example, the first earphone component 14 is the master device and the second earphone component 15 is the slave device. The first earphone component 14 and the second earphone component 15 jointly establish a communication connection with the terminal device (e.g., mobile phone, smart TV, smart watch, smart home control screen, smart speaker, tablet computer, in-vehicle smart terminal, and wearable device, etc.) (e.g., Bluetooth stereo Bluetooth connection with Advanced Audio Distribution Profile (A2DP) protocol). The head-mounted device can output the audio provided by the terminal device through the audio output units in a pair of earphone components (the first audio output unit 141 in the first earphone component 14 and the second audio output unit 151 in the second earphone component 15) and output two-channel stereo sound.

[0031] In the second mode, each earphone component can perform tasks independently. For example, the first earphone component 14 can establish a Bluetooth Hands-Free Profile (HFP) / A2DP connection with the terminal device independently, and can provide audio output through the first audio output unit 141 in the first earphone component 14. Correspondingly, the second earphone component 15 can also establish a communication connection with the same or different terminal devices independently, so that each earphone component can output audio and transmit data independently.

[0032] In this embodiment, each headphone component may also include a display unit. In the second mode, the headphone component may also activate the display unit to display an interactive interface provided by the headphone component or a terminal device connected to the headphone component. For example, the first headphone component 14 may be connected to a game controller, and the first display unit 140 in the first headphone component 14 may be activated to display the interactive interface provided by the first headphone component 14; or, the second headphone component 15 may be connected to a game console, and the second display unit 150 in the second headphone component 15 may be activated to display the interactive interface provided by the game console.

[0033] It will be understood by those skilled in the art that Figure 1 This is merely an example of head-mounted device 1 and does not constitute a limitation on head-mounted device 1. It may include more or fewer components than shown, or combine certain components, or different components, such as input / output devices, network access devices, environmental sensing units (e.g., inertial measurement units, cameras, etc.).

[0034] Processor 10 may be a Central Processing Unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0035] In some embodiments, memory 11 may be an internal storage unit of the head-mounted device 1, such as a hard disk or memory of the head-mounted device 1. In other embodiments, memory 11 may be an external storage device of the head-mounted device 1, such as a plug-in hard disk, smart media card (SMC), secure digital card (SD), flash card, etc., provided on the head-mounted device 1. In other embodiments, memory 11 may include both internal and external storage units of the head-mounted device 1. Memory 11 is used to store operating system, applications, bootloader, data, and other programs, such as the program code of computer program 12. Memory 11 may also be used to temporarily store data that has been output or will be output.

[0036] The control method of the head-mounted device provided in this application will be described with reference to the exemplary structure of the head-mounted device 1 provided in the embodiments of this application.

[0037] The following will combine Figure 2 A control method for a head-mounted device according to one embodiment of this application will be described.

[0038] Please see Figure 2 , Figure 2 This is a flowchart of a control method for a head-mounted device according to an embodiment of this application, such as... Figure 2 As shown, the method includes: Step S201: In response to detecting that the number of times the position sensor continuously outputs the first signal reaches a first threshold, monitor the first duration of the position sensor continuously outputting the first signal; wherein, the first signal represents the physical separation of the headphone component from the headband.

[0039] In this embodiment, in the initial state, the headphone component and headband of the headset are physically connected, and the position sensor continuously outputs a second signal. When the user removes the headphone component, the position sensor outputs a first signal. To reduce the probability of momentary misjudgment due to loose headphone component or poor contact of the headband, the number of times the position sensor continuously outputs the first signal can be counted. When the number of times the position sensor continuously outputs the first signal reaches a first threshold, it can be determined that the headphone component and headband have been physically separated.

[0040] Step S202: When the first duration reaches the second threshold, control the headphone components to switch from the first mode to the second mode; wherein, the first mode refers to the working mode in which a pair of headphone components perform the same task, and the second mode refers to the working mode in which each headphone component performs the task independently.

[0041] After determining that the headphone component has been physically separated from the headband, the system can monitor the first duration for which the position sensor continuously outputs a first signal. If the first duration reaches a second threshold, it can be determined that the headphone component and headband are in a relatively stable physical separation state. That is, it can be determined that the physical separation is not caused by accidental touch or operation by the user, but rather by the user actively removing the headphone component from the headband. Therefore, the system can control the headphone component to switch from the first mode to the second mode.

[0042] In this embodiment, the first mode refers to the working mode in which a pair of headphone components perform the same task together. For example, in the first mode, the headphone device can be used as a traditional headphone. At this time, the audio output unit in the headphone component can be in the audio privacy output mode to adapt to the near-ear listening scenario.

[0043] The second mode refers to a working mode where each earphone component performs tasks independently. In this mode, the master-slave relationship between the pair of earphone components in the headset can be broken, and each can operate as an independent device. For example, each earphone component can establish communication connections with different or the same terminal devices, independently perform audio acquisition and playback, and data transmission. Furthermore, each earphone component can activate its own display unit to provide an interactive interface. At this time, the audio output unit in the earphone component can switch to external audio output mode, increasing the output volume.

[0044] It should be noted that the first and second thresholds mentioned above can be set according to the actual application scenario and user expectations. For example, the head-mounted device can be configured with the first and second thresholds by default at the factory, with the first threshold being 3 times and the second threshold being 2 seconds.

[0045] In subsequent embodiments, the first threshold and the second threshold can be dynamically set based on the scene in which the head-mounted device is located and the motion state of the head-mounted device.

[0046] Figure 3 This is a flowchart of a control method for a head-mounted device according to another embodiment of this application, such as... Figure 3 As shown, before step S201 above, the method further includes: Step S301: In response to detecting the first signal output by the position sensor, acquire the motion data of the headphone component collected by the inertial measurement unit in the headphone component.

[0047] In this embodiment, an inertial measurement unit is also integrated inside the headphone component. This inertial measurement unit is used to collect motion data of the headphone component in real time (e.g., the three-axis acceleration, three-axis angular velocity, attitude offset, etc. of the headphone component).

[0048] When the position sensor first outputs a first signal at any sampling time, the motion data of the headphone component collected by the inertial measurement unit can be acquired while counting the number of times the position sensor continuously outputs the first signal. The first signal output by the position sensor and the motion data are assigned a timestamp to achieve synchronous sampling of the signal output event and the motion data. Thus, the motion state of the headphone component during the period when the position sensor first outputs the first signal can be identified based on the signal output event and the motion data.

[0049] Step S302: Determine the first threshold and the second threshold based on the motion data of the headphone components.

[0050] In this embodiment, the first threshold and the second threshold can be determined based on the motion data of the headphone components.

[0051] Specifically, if the motion data of the headphone components indicates significant changes in posture or acceleration, it can be determined that the current physical separation between the headphone components and the headband was caused by the user actively disassembling the headphone components. Therefore, a smaller first threshold and a smaller second threshold can be set (e.g., the first threshold is set to 2 times, and the second threshold is set to 500 milliseconds) to improve the switching speed of the headphone components' operating modes.

[0052] If the motion data of the headphone components indicates that they are experiencing minute vibrations or irregular, momentary jitters, then the current physical separation between the headphone components and the headband can be determined as a passive interference event. For example, loose headphone components or the headband, or poor contact between the headphone components and the headband, can also lead to physical separation. Therefore, a larger first threshold and a larger second threshold can be set (e.g., the first threshold is set to 5 times, and the second threshold is set to 3 seconds) to strictly filter out momentary interference events and reduce the probability of the headphone components' operating mode being mistakenly switched.

[0053] Figure 4 This is a flowchart of a control method for a head-mounted device according to another embodiment of this application. Figure 1 ,like Figure 4 As shown, in one embodiment, step S302 includes: Step S401: Determine the pose change of the headphone component based on the motion data of the headphone component.

[0054] In this embodiment, the pose change can represent the change between the initial pose of the headphone component (e.g., the pose when the headphone component is physically connected and fixed to the headband) and the current pose of the headphone component in a preset spatial coordinate system. The pose change can include the headphone component's rotation angle and translation displacement, etc.

[0055] Step S402: Based on the pose change of the headphone component, determine a first threshold and a second threshold; wherein both the first threshold and the second threshold are negatively correlated with the pose change.

[0056] In this embodiment, if the change in the pose of the headphone component is significant, and the motion characteristics of the headphone component match those of a user manually disassembling the headphone component (e.g., significant rotation of the headphone component, continuous and smooth acceleration changes), then it can be determined that the current physical separation between the headphone component and the headband is caused by the user actively disassembling the headphone component. In this case, to improve the response speed of the head-mounted device, a smaller first threshold and a smaller second threshold can be set. For example, the first threshold can be reduced from the default 3 times to 2 times, and the second threshold can be shortened from the default 2 seconds to 500ms. In this way, when the user actively disassembles the headphone component, the working mode of the headphone component can be switched in about 0.5 seconds, enabling the head-mounted device to respond quickly to the active disassembly event.

[0057] If the change in the headphone component's position is small—for example, if the change indicates minute vibrations or irregular momentary jitter—then it can be determined that the current physical separation between the headphone component and the headband is caused by a passive interference event (e.g., loose headphone component or headband, poor contact between the headphone component and headband, accidental touch, misoperation, etc.). In this case, to strictly filter out momentary passive interference events and reduce the probability of the headphone component's operating mode being mistakenly switched, a larger first threshold and a larger second threshold can be set. For example, the first threshold can be increased from the default 3 times to 5 times, and the second threshold can be extended from the default 2 seconds to 3 seconds. This way, even if a momentary passive interference event causes the position sensor to output the first signal multiple times in a short period, the position sensor's output mode will be insufficient to meet the requirements of higher continuous sampling times and longer durations, thereby reducing the probability of the headphone component's operating mode being mistakenly switched due to loose headphone component or headband, poor contact, accidental touch, or misoperation.

[0058] In one embodiment, step S301 includes: in response to detecting that the position sensor outputs a first signal, acquiring motion data of the headphone component collected by the inertial measurement unit, and acquiring environmental images collected by the camera in the head-mounted device.

[0059] In this embodiment, the earphone component also integrates a camera for capturing environmental images. The camera can be configured to trigger the capture of one or more environmental images when the position sensor first outputs a first signal at any sampling time; alternatively, the camera can be configured to periodically capture environmental images.

[0060] Figure 5 This is a flowchart of a control method for a head-mounted device according to another embodiment of this application. Figure 2 ,like Figure 5 As shown, in one embodiment, step S302 includes: Step S501: Input the motion data and environmental image into the trained scene recognition model to obtain the target scene output by the scene recognition model.

[0061] In this embodiment, a scene recognition model can be constructed based on a pre-trained machine learning model (e.g., a convolutional neural network or a temporal convolutional network). This scene recognition model can be deployed in the memory of the head-mounted device or on a cloud server. The input data for this scene recognition model can include environmental images and motion data synchronized with the timestamps of the environmental images. The scene recognition model can identify the scene in which the head-mounted device is located based on the above input data and output a target scene. The target scene can be, for example, any one of the following: an office scene, an audio-visual scene, a game scene, or a sports scene.

[0062] Step S502: Find the target mapping relationship corresponding to the target scene from the preset mapping table; wherein, the mapping table stores multiple mapping relationships, and each mapping relationship is used to associate a scene and a set of control parameters.

[0063] Step S503: Obtain the target control parameters from the target mapping relationship, and set the first parameter in the target control parameters as the first threshold and the second parameter in the target control parameters as the second threshold.

[0064] In this embodiment, the memory of the head-mounted device may pre-store a mapping table, which stores multiple mapping relationships. Each mapping relationship is used to associate a scenario and a set of control parameters. The control parameters may include a first parameter and a second parameter. The first parameter is used to determine whether the number of times the position sensor continuously outputs the first signal meets a preset condition, and the second parameter is used to determine whether the first duration of the position sensor continuously outputting the first signal meets a preset condition.

[0065] For example, in scenarios where there may be many passive interference events (e.g., sports scenarios (where users are running or exercising)), the control parameters for such scenarios can be set higher to improve the anti-accidental touch effect. For example, the first parameter can be 5 times and the second parameter can be 3 seconds, thereby improving the working stability of the headphone components in such scenarios.

[0066] For scenarios where there may be fewer passive interference events (e.g., office scenarios), appropriate control parameters can be set to balance the switching response speed and the anti-accidental touch effect. For example, the first parameter can be 3 times and the second parameter can be 2 seconds.

[0067] For scenarios where users are likely to disassemble the headphone components (e.g., in gaming scenarios, users may disassemble the headphone components to use them as speakers or monitors), smaller control parameters can be set to improve the switching response speed of the headphone components' working mode. For example, the first parameter can be 2 times and the second parameter can be 500 milliseconds.

[0068] As an example, if the environmental image and the motion data synchronized with the timestamp of the environmental image match the game scene, the target mapping relationship matching the game scene can be obtained from the mapping table, and the target control parameters can be obtained from the target mapping relationship. For example, the target control parameters corresponding to the game scene include: the first parameter is 2 times, and the second parameter is 500 milliseconds.

[0069] In this way, by identifying the target scene in which the head-mounted device is located and dynamically setting the first and second thresholds based on the target scene, the switching response speed and anti-mistouch effect of the headphone components can be better matched to the user's actual usage environment.

[0070] In one embodiment, after step S202 above, the method further includes: determining the functional role configuration of each headphone component based on the target scenario; and controlling the headphone component to perform the target task corresponding to the functional role configuration based on the functional role configuration of each headphone component.

[0071] In this embodiment, after determining the target scenario of the head-mounted device or earphone component, the differentiated functional roles of the two earphone components can be automatically configured and intelligently networked according to the target scenario to improve the task configuration speed and networking speed of the earphone components.

[0072] In one embodiment, the functional role configuration includes one of a display interaction configuration and an audio output configuration. Based on the functional role configuration of each headphone component, controlling the headphone component to perform the target task corresponding to the functional role configuration includes: for each of a pair of headphone components, if the functional role configuration of the headphone component is a display interaction configuration, controlling the headphone component to scan and connect to a target device associated with the target scene, and activating the display unit of the headphone component to display the interactive interface provided by the headphone component or the target device; if the functional role configuration of the headphone component is an audio output configuration, controlling the headphone component to connect to the target device associated with the target scene, and controlling the headphone component to output the audio provided by the target device.

[0073] In this embodiment, the display interaction configuration means that the headphone component can be used as a display, and the display unit in the headphone component can display the interactive interface provided by the headphone component or the target device that is communicatively connected to the headphone component; the audio output configuration means that the headphone component can be used as a speaker, and the audio output unit in the headphone component can output the audio provided by the target device that is communicatively connected to the headphone component.

[0074] For example, in a game scenario, a first headset component can communicate with a game console and can be configured as a display that provides the game screen; a second headset component can communicate with either the game console or the first headset component to output the audio provided by the first headset component or the game console.

[0075] In this embodiment, for each of a pair of earphone components, if the earphone component's functional role is configured for display and interaction, it can be controlled to activate Bluetooth or Wi-Fi scanning. Within the scanning range, it retrieves target devices associated with the target scenario from a pre-stored list of authorized devices. For example, after scanning for an authorized game console or game controller, the earphone component automatically initiates a communication connection request, completes the Bluetooth communication handshake and pairing, and establishes a dedicated connection. Then, the display unit of the earphone component can be activated, loading the interactive interface provided by the earphone component itself or the target device. At this point, the earphone component functions as a miniature game display terminal.

[0076] If the headphone component is configured for audio output, it can be controlled to connect to a target device (which may also include the other headphone component in a pair). For example, the second headphone component can establish a short-range local communication link with the first headphone component, allowing the first headphone component to forward audio received from the game console to the second headphone component; alternatively, the second headphone component can directly obtain audio from the game console. The second headphone component can independently output game stereo sound and environmental sound effects. Through the coordinated operation of both headphone components, adaptive configuration of dedicated audio modes for specific game scenarios can be achieved.

[0077] In this way, after the user removes the headphone components, there is no need for the user to set the task configuration for each headphone component separately or pair each headphone component with the corresponding target device. The headphone components can automatically perform task configuration and pairing, which can improve the task configuration and pairing speed of the headphone components and improve the user's product experience.

[0078] In one embodiment, to further improve the adaptability between the head-mounted device and the user's personalized behavioral habits, a lightweight user behavior prediction model can be constructed. This model can continuously record multi-dimensional data before and after the switching of the headphone component's operating mode, including but not limited to: time series of signal output events from the position sensor, motion data of the headphone component, timestamps, target scene, type of target device connected to the headphone component, and device location. This data can be uploaded to a cloud server or trained locally on the head-mounted device using lightweight algorithms (e.g., decision trees, small recurrent neural networks) to construct the user behavior prediction model.

[0079] The aforementioned user behavior prediction model can learn users' personalized behavioral habits. For example, a user might habitually disassemble headphone components and use them as speakers in an audio-visual setting between 8 PM and 9 PM daily. When the current time, target scene, and headphone component movement data match this pattern, the user behavior prediction model can predict in advance that the user is about to disassemble the headphone components. Therefore, a relatively small first and second threshold can be set in advance.

[0080] Specifically, the system can periodically acquire current time, target scene, and motion data of the headphone components, and input this data into a user behavior prediction model. Based on the user's historical behavior sequence data, the user behavior prediction model can predict whether the user will actively disassemble the components. When the confidence level of predicting that the user is about to actively disassemble the headphone components exceeds a certain threshold, a smaller first threshold and a second threshold can be set in advance to improve the switching response speed of the headphone components' working mode. When the confidence level of predicting that the user is about to actively disassemble the headphone components is less than a certain threshold, the current first threshold and the second threshold can be kept unchanged or a larger first threshold and the second threshold can be set to reduce the probability of the headphone components' working mode being switched erroneously.

[0081] Figure 6 This is a flowchart of a control method for a head-mounted device according to another embodiment of this application. Figure 3 ,like Figure 6 As shown, in one embodiment, after step S202 described above, the method further includes: Step S601: In response to detecting that the number of times the position sensor continuously outputs the second signal reaches a third threshold, monitor the second duration of the position sensor continuously outputting the second signal; wherein the second signal represents the physical connection between the headphone component and the headband.

[0082] In step S602, when the second duration reaches the fourth threshold, the headphone component is controlled to switch from the second mode to the first mode.

[0083] In this embodiment, when the user reinstalls the headphone components onto the headband, the position sensor can output a second signal. This second signal can be detected periodically, and when the number of times the position sensor continuously outputs the second signal reaches a third threshold, it can be determined that the headphone components and the headband are now physically connected.

[0084] It should be noted that the configuration method for the third threshold can be similar to that for the first threshold. Similarly, it can be a default configuration (for example, the third threshold is set to 3 times by default) or determined based on the motion data of the headphone components.

[0085] Accordingly, the configuration method for the fourth threshold can be similar to that for the second threshold. Similarly, it can be a default configuration (e.g., the fourth threshold is set to 2 seconds by default) or determined based on motion data from the headphone components.

[0086] In this way, when the user actively installs the headphone components onto the headband, the headphone components can quickly switch to the first mode; while brief connection events between the headphone components and the headband caused by shaking, collisions, etc., will be effectively filtered out, thereby avoiding frequent switching of the headphone components' working mode.

[0087] It should be noted that the information collection process involved in this application (e.g., motion data collection process, environmental image collection process, etc.) is carried out with the user's knowledge and permission. That is, the information collection process complies with the requirements of relevant standards and does not constitute an act that harms the public interest.

[0088] Through the above steps S201 to S202, the positional relationship between the headphone component and the headband is monitored by the position sensor. When the number of times the position sensor continuously outputs the first signal to characterize the physical separation of the headphone component and the headband reaches a first threshold, the first duration of the position sensor continuously outputting the first signal is monitored. When the first duration reaches a second threshold, the headphone component is controlled to switch from the first mode to the second mode. The first mode refers to the working mode in which a pair of headphone components perform the same task, and the second mode refers to the working mode in which each headphone component performs the task independently. In this way, when the headphone components in the head-mounted device are not separated from the headband, the head-mounted device can be worn by the user, and the pair of headphone components work together to perform tasks (e.g., playing audio provided by the same terminal device); when the headphone components in the head-mounted device are separated from the headband, each headphone component can perform tasks independently (e.g., playing audio provided by different terminal devices), thereby enriching the functionality of the head-mounted device and realizing its multi-functionality; in addition, by controlling the headphone components to switch working modes when the number of times the position sensor continuously outputs the first signal and the first duration meet preset conditions, the probability of accidentally switching working modes due to loose headphone components or headband, poor contact, accidental touch, or misoperation can be reduced.

[0089] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0090] Corresponding to the control method for the head-mounted device described in the above embodiments, Figure 7 A schematic diagram of the structure of a control device for a head-mounted device according to an embodiment of this application is shown. For ease of explanation, only the parts related to the embodiment of this application are shown.

[0091] Please see Figure 7 The control device 7 of the head-mounted device includes: a detection module 70, used to monitor a first duration of continuous output of the first signal by the position sensor in response to detecting that the number of times the position sensor continuously outputs the first signal reaches a first threshold; wherein the first signal indicates that the earphone component is physically separated from the headband; and a control module 71, used to control the earphone component to switch from a first mode to a second mode when the first duration reaches a second threshold; wherein the first mode refers to a working mode in which a pair of earphone components perform the same task, and the second mode refers to a working mode in which each earphone component performs a task independently.

[0092] In one embodiment, the control device 7 of the head-mounted device further includes a threshold determination module, which is used to acquire motion data of the headphone component collected by the inertial measurement unit in the headphone component in response to detecting the output of a first signal from the position sensor; and to determine a first threshold and a second threshold based on the motion data of the headphone component.

[0093] In one embodiment, the threshold determination module is further configured to determine the pose change of the headphone component based on the motion data of the headphone component; and to determine a first threshold and a second threshold based on the pose change of the headphone component; wherein both the first threshold and the second threshold are negatively correlated with the pose change.

[0094] In one embodiment, the threshold determination module is further configured to, in response to detecting a first signal output by a position sensor, acquire motion data of the earphone component collected by an inertial measurement unit and environmental images collected by a camera in a head-mounted device; input the motion data and environmental images into a trained scene recognition model to obtain a target scene output by the scene recognition model; search for a target mapping relationship corresponding to the target scene from a preset mapping table; wherein the mapping table stores multiple mapping relationships, and each mapping relationship is used to associate a scene and a set of control parameters; obtain target control parameters from the target mapping relationship, and set a first parameter in the target control parameters as a first threshold and a second parameter in the target control parameters as a second threshold.

[0095] In one embodiment, the control device 7 of the head-mounted device further includes a task configuration module, which is used to determine the functional role configuration of each headphone component based on the target scenario; and to control the headphone component to perform the target task corresponding to the functional role configuration based on the functional role configuration of each headphone component.

[0096] In one embodiment, the functional role configuration includes one of a display interaction configuration and an audio output configuration; the task configuration module is further configured to, for each of a pair of headphone components, when the functional role configuration of the headphone component is set to display interaction configuration, control the headphone component to scan and connect to a target device associated with the target scene, and activate the display unit of the headphone component to display the interactive interface provided by the headphone component or the target device; when the functional role configuration of the headphone component is set to audio output configuration, control the headphone component to connect to the target device associated with the target scene, and control the headphone component to output the audio provided by the target device.

[0097] In one embodiment, the detection module 70 is further configured to monitor a second duration of continuous output of the second signal by the position sensor in response to detecting that the number of times the position sensor continuously outputs the second signal reaches a third threshold; wherein the second signal represents the physical connection between the headphone component and the headband; the control module 71 is further configured to control the headphone component to switch from a second mode to a first mode when the second duration reaches a fourth threshold.

[0098] It should be noted that the control device 7 of the aforementioned head-mounted device can be or be applied to a computing service device with data processing, network communication and program execution functions, such as tablet computers, personal computers, mobile phones, servers and other electronic devices.

[0099] For example, the control device 7 of the head-mounted device can be applied to the head-mounted device, which includes a headband, a pair of earphone components, and a position sensor.

[0100] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0101] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0102] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, can implement the steps in the control method embodiments of the various head-mounted devices described above.

[0103] This application provides a computer program product that, when run on an electronic device, enables the electronic device to implement the steps described in the control method embodiments for the various head-mounted devices.

[0104] This application implements all or part of the processes in the methods of the above embodiments, which can be accomplished by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or some intermediate form. The computer-readable medium can include at least: a control device or any entity or device capable of carrying the computer program code to the head-mounted device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium, such as a USB flash drive, a portable hard drive, a magnetic disk, or an optical disk.

[0105] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0106] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0107] In the embodiments provided in this application, it should be understood that the disclosed apparatus / network devices and methods can be implemented in other ways. For example, the apparatus / network device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0108] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0109] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A control method for a head-mounted device, applied to a head-mounted device, characterized in that, The head-mounted device includes: a headband, a pair of earphone components, and a position sensor, wherein the earphone components are detachably connected to the headband; The method includes: In response to detecting that the number of times the position sensor continuously outputs the first signal reaches a first threshold, the system monitors a first duration for which the position sensor continuously outputs the first signal; wherein the first signal indicates that the headphone component is physically separated from the headband. When the first duration reaches the second threshold, the headphone component is controlled to switch from the first mode to the second mode; wherein, the first mode refers to the working mode in which the pair of headphone components perform the same task, and the second mode refers to the working mode in which each of the headphone components performs a task independently.

2. The method according to claim 1, characterized in that, Before monitoring a first duration of continuous output of the first signal by the position sensor in response to a first threshold number of times the number of times the position sensor continuously outputs the first signal reaches a first threshold, the method further includes: In response to detecting that the position sensor outputs the first signal, motion data of the earphone component collected by the inertial measurement unit in the earphone component is acquired; The first threshold and the second threshold are determined based on the motion data of the earphone component.

3. The method according to claim 2, characterized in that, Determining the first threshold and the second threshold based on the motion data of the earphone component includes: Based on the motion data of the headphone component, the pose change of the headphone component is determined; Based on the pose change of the headphone component, the first threshold and the second threshold are determined; wherein both the first threshold and the second threshold are negatively correlated with the pose change.

4. The method according to claim 2, characterized in that, The step of acquiring motion data of the earphone component collected by the inertial measurement unit in the earphone component in response to detecting the first signal output by the position sensor includes: In response to detecting the first signal output by the position sensor, the motion data of the headphone component collected by the inertial measurement unit is acquired, and the environmental image collected by the camera in the head-mounted device is acquired; and, Determining the first threshold and the second threshold based on the motion data of the earphone component includes: The motion data and the environmental image are input into a trained scene recognition model to obtain the target scene output by the scene recognition model; The target mapping relationship corresponding to the target scene is found in a preset mapping table; wherein, the mapping table stores multiple mapping relationships, and each of the multiple mapping relationships is used to associate a scene and a set of control parameters; The target control parameters are obtained from the target mapping relationship, and the first parameter in the target control parameters is set as the first threshold, and the second parameter in the target control parameters is set as the second threshold.

5. The method according to claim 4, characterized in that, After controlling the headphone component to switch from the first mode to the second mode, the method further includes: Based on the target scenario, determine the functional role configuration of each of the headphone components; Based on the functional role configuration of each of the headphone components, the headphone components are controlled to perform the target task corresponding to the functional role configuration.

6. The method according to claim 5, characterized in that, The functional role configuration includes one of a display interaction configuration and an audio output configuration; the step of controlling the headphone component to perform the target task corresponding to the functional role configuration based on the functional role configuration of each headphone component includes: For each of the pair of earphone components, when the functional role of the earphone component is configured as the display interaction configuration, the earphone component is controlled to scan and connect to the target device associated with the target scene, and the display unit of the earphone component is activated to display the interactive interface provided by the earphone component or the target device; When the headphone component is configured to function as an audio output device, the headphone component is controlled to connect to a target device associated with the target scene, and the headphone component is controlled to output audio provided by the target device.

7. The method according to any one of claims 1 to 6, characterized in that, The method further includes: In response to detecting that the number of times the position sensor continuously outputs the second signal reaches a third threshold, a second duration for which the position sensor continuously outputs the second signal is monitored; wherein the second signal represents the physical connection between the headphone component and the headband; When the second duration reaches the fourth threshold, the headphone component is controlled to switch from the second mode to the first mode.

8. A control device for a head-mounted device, applied to a head-mounted device, characterized in that, The head-mounted device includes: a headband, a pair of earphone components, and a position sensor, wherein the earphone components are detachably connected to the headband; The device includes: The detection module is configured to monitor a first duration for which the position sensor continuously outputs the first signal in response to detecting that the number of times the position sensor continuously outputs the first signal reaches a first threshold; wherein the first signal indicates that the headphone component is physically separated from the headband; The control module is used to control the earphone components to switch from a first mode to a second mode when the first duration reaches a second threshold; wherein the first mode refers to the working mode in which the pair of earphone components perform the same task, and the second mode refers to the working mode in which each of the earphone components performs a task independently.

9. A head-mounted device, characterized in that, Includes: a headband, a pair of earphone components, a position sensor, a memory, a processor, and a computer program stored in the memory and executable on the processor; The pair of earphone components are detachably connected to the headband, and the position sensor is used to detect the positional relationship between the earphone components and the headband. When the processor executes the computer program, it implements the control method for the head-mounted device as described in any one of claims 1 to 7.

10. A computer program product, characterized in that, Includes a computer program, which, when run, causes the control method for the head-mounted device as described in any one of claims 1 to 7 to be executed.

Images