Earphone system, earphone and control method of camera module of earphone

Abstract

The invention relates to the field of hearing equipment, in particular to an earphone system, an earphone and a control method of a camera module of the earphone. The earphone system comprises a motion detection module and a camera shooting module which are arranged on the earphone, and a processing module, the motion detection module is used for acquiring inertial data of the earphone; the camera module is used for shooting under the control of the processing module; and the processing module is used for determining the current state of the user according to the inertial data, and awakening the camera module to shoot under the condition that the current state is a preset state.

Description

Technical Field

[0001] The present disclosure relates to the field of hearing devices, and more specifically, to an earphone system, an earphone, and a control method for a camera module of the earphone. Background Art

[0002] Headphones are a necessity in the lives of modern young people. Whether they are commuting, traveling, reading indoors, etc., young people like to wear headphones to listen to music and enjoy life. However, the headphones on the market have a single function, usually only able to play music or answer calls, and do not have the function of taking pictures. In addition, even if the headphones are equipped with a camera module, the power consumption problem of the headphones caused by the camera module needs to be solved. Summary of the invention

[0003] An object of the present disclosure is to provide an earphone system, an earphone, and a control method for a camera module of the earphone, so that the earphone can have a photo-taking function without affecting the power consumption and battery life of the earphone.

[0004] According to a first aspect of the present disclosure, there is provided an earphone system, the earphone system comprising: a motion detection module and a camera module, and a processing module, which are arranged on the earphone;

[0005] A motion detection module, used to obtain inertial data of the headset;

[0006] A camera module, used for shooting under the control of the processing module;

[0007] The processing module is used to determine the current state of the user according to the inertial data, and wake up the camera module to shoot when the current state is in a preset state.

[0008] Optionally, the earphone system includes a wearing detection module arranged on the earphone, for detecting a wearing state of the earphone;

[0009] The processing module is further configured to wake up the motion detection module to obtain inertial data of the headset when the headset is worn.

[0010] Optionally, the processing module is further used to:

[0011] Acquire a first image and a second image from the images captured by the camera module, wherein the first image and the second image are two images acquired by the camera module at a preset time interval;

[0012] determining a motion state of the headset based on the first image and the second image;

[0013] Determine whether the motion state of the headset matches the inertial data, and if not, control the camera module to sleep.

[0014] Optionally, determining the current state of the user according to the inertial data includes:

[0015] The inertial data is input into a pre-trained state detection model, and the current state of the user is determined according to the state detection model.

[0016] Optionally, the processing module is further used to:

[0017] Acquire the image captured by the camera module, and determine whether the wearer of the headset makes a preset gesture according to the image;

[0018] When the wearer makes a preset gesture, it is determined to control the camera module to enter a sleep state.

[0019] Optionally, the earphone system comprises a first earphone body worn on the left ear of the user and a second earphone body worn on the right ear of the user, and the inertial data comprises movement speed and movement direction of the first earphone body and the second earphone body;

[0020] Determining a current state of the user according to the inertial data includes:

[0021] When the movement speeds of the first earphone body and the second earphone body are both greater than a speed threshold, and the angle between the movement directions of the first earphone body and the second earphone body is less than an angle threshold, it is determined that the user is in motion.

[0022] Optionally, the inertial data includes the acceleration and the direction of movement, and the earphone system further includes a wireless communication module;

[0023] The processing module is also used to control the camera module to capture an image and send it to a terminal device connected to the headset through the wireless communication module when the acceleration is detected to be within a first preset interval and the movement direction is within a second preset interval; wherein,

[0024] The first preset range is determined based on gravity acceleration, and the second preset range is determined based on gravity direction.

[0025] Optionally, the processing module is further used for:

[0026] When it is detected that the acceleration is within a first preset interval and the motion direction is within a second preset interval, determining a stationary time of the earphone according to inertial data of the earphone;

[0027] In the case where the static time is greater than a preset time threshold, the step of controlling the camera module to capture an image is executed, and the image is sent to a terminal device that is communicatively connected to the headset through the wireless communication module.

[0028] Optionally, the earphone system further comprises a speaker module arranged on the earphone, the earphone comprises a first earphone body worn on the left ear of the user and a second earphone body applied to the right ear of the user, and the inertial data comprises the acceleration and the movement direction;

[0029] The processing module is further configured to, when detecting that the acceleration of the first earphone body or the second earphone body is within a first preset interval and the movement direction is within a second preset interval, send a second sound prompt to the user through the speaker module of the other earphone body, wherein the second sound prompt reminds the user that the earphone has fallen; wherein,

[0030] The first preset range is determined based on gravity acceleration, and the second preset range is determined based on gravity direction.

[0031] According to a second aspect of the present disclosure, a method for controlling a camera module of an earphone is provided. The earphone is provided with a camera module, and the method comprises: acquiring inertial data of the earphone; determining a current state of the user based on the inertial data, and waking up the camera module on the earphone for shooting when the current state is in a preset state.

[0032] According to a third aspect of the present disclosure, there is provided an earphone, comprising the earphone system according to any one of the first aspect, or a processor and a memory, wherein the memory stores computer instructions, and when the computer instructions are executed by the processor, the steps of the method according to the second aspect are implemented.

[0033] One technical effect of the present disclosure is that a headset system is provided, including a motion detection module and a camera module, and a processing module, which are arranged on the headset. The motion detection module can obtain the inertial data of the headset, and the processing module can determine the current state of the user based on the inertial data of the headset, and wake up the camera module to shoot when the current state is in a preset state. In this way, the camera module of the headset can be intelligently awakened based on the inertial data, thereby avoiding power consumption problems. At the same time, for sports scenes, when it is inconvenient for users to take pictures by themselves, they do not have to worry about not being able to record the sports process, and can automatically shoot through the camera module in the headset.

[0034] Other features and advantages of the embodiments of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The accompanying drawings, which constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the embodiments of the present disclosure.

[0036] Figure 1 is a schematic structural diagram of an earphone system according to an embodiment;

[0037] Figure 2 is a schematic diagram of a second preset interval according to an embodiment;

[0038] Figure 3 is a flowchart of a method for controlling an earphone module according to an embodiment. DETAILED DESCRIPTION

[0039] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present invention unless otherwise specifically stated.

[0040] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses.

[0041] Techniques and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the techniques and equipment should be considered part of the specification.

[0042] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0043] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0044] The present application embodiment provides an earphone system 100, such as Figure 1 As shown, the earphone system 100 includes a motion detection module 101 and a camera module 102, and a processing module 103, which are arranged on the earphone; the motion detection module 101 includes an inertial measurement unit, which is used to obtain inertial data of the earphone; the camera module 102 is used to shoot under the control of the processing module; the processing module 103 is used to determine the current state of the user according to the inertial data, and when the current state is in a preset state, wake up the camera module to shoot.

[0045] In this example, the earphone system can be a TWS (True Wireless Stereo) earphone system or a headphone system. Taking the TWS earphone system as an example, it may include two earphone bodies suitable for the left and right ears of the user, and a charging storage device. In an embodiment of the present application, the motion detection module and the camera module of the earphone system can be all set on the two earphone bodies, and the processing module can be set on the earphone body or in the charging storage device. In the headphone system, the motion detection module and the camera module can be set in a group respectively near the left and right ears, to detect the inertial data of the left and right ear sides respectively.

[0046] In an embodiment of the present application, the motion detection module may include an inertial measurement unit. IMU (Inertial Measurement Unit) is a device that integrates multiple sensors and is mainly used to measure and monitor the linear acceleration and angular velocity of an object. It usually includes an accelerometer and a gyroscope. The inertial measurement unit can obtain inertial data such as the speed, acceleration and direction of movement of the object.

[0047] In the embodiment of the present application, the camera module also refers to the headset, and the camera module may include a camera module, and the lens equipped with the camera module may be set according to actual needs. In this embodiment, the camera module can be in a dormant state under normal circumstances to save power consumption, and will only be awakened to take images or record videos under the control of the processing module.

[0048] In this example, the processing module can obtain the inertial data of the earphone collected by the motion detection module, and determine the current state of the user based on the data, such as running state, motion state or static state, etc. In another example, the user's state can include the user's motion data, such as motion speed, acceleration and motion direction. In this example, the inertial data of the earphone under the relevant motion state can be pre-tested and stored, and when the earphone is actually used, the collected inertial data is compared with the pre-stored data to determine the current state of the user. In this example, the preset state can be a motion state, etc.

[0049] In this example, a headset system is provided, including a motion detection module and a camera module, and a processing module, which are arranged on the headset. The motion detection module includes an inertial measurement unit, which can obtain the inertial data of the headset. The processing module can determine the current state of the user based on the inertial data of the headset, and wake up the camera module for shooting when the current state is in a preset state. In this way, the headset can be intelligently awakened based on the inertial data, thereby avoiding power consumption problems. At the same time, for sports scenes, when it is inconvenient for users to take pictures by themselves, they do not have to worry about not being able to record the sports process, and can automatically shoot through the camera module in the headset.

[0050] In an example of this embodiment, the earphone system includes a wearing detection module arranged on the earphone, which is used to detect the wearing state of the earphone; the processing module is also used to wake up the motion detection module to obtain inertial data of the earphone when the earphone is worn.

[0051] In this embodiment, the wearing detection module can detect whether the earphone has been worn by the user. The wearing detection module may include an optical sensor, etc. The optical sensor emits light waves (usually infrared rays). After these light waves are reflected by an object (such as an ear), they return to a receiver near the earphone, thereby measuring the distance between the earphone and the human body to perform wearing detection, thereby waking up the motion detection module to obtain the inertial data of the earphone.

[0052] In this example, the motion detection module can be enabled to detect the inertial data of the headset only when the headset is worn, thereby further saving the power consumption of the headset.

[0053] In an example of the present embodiment, the processing module is further used to: obtain a first image and a second image from the image taken by the camera module, wherein the first image and the second image are two images obtained by the camera module at an interval of a preset time; determine the motion state of the headset based on the first image and the second image; determine whether the motion state of the headset matches the inertial data, and if not, control the camera module to sleep.

[0054] In this embodiment, the processing module can obtain two images at preset time intervals in the image captured by the camera module, for example, two images are obtained in the image at an interval of 100ms, and then the motion state of the headset is determined according to the content of the two images. Specifically, the position of certain specific objects in the image can be identified through an image analysis algorithm, and the position change of the same object in the two images can be used to determine the motion state of the headset, such as the motion speed and direction. Then, the motion state is matched with the inertial data obtained by the motion detection module. If the two match, the camera module can continue to be used for shooting. If the two do not match, it means that the inertial data obtained by the motion detection module is wrong or the processing module fails. When the user is not in the preset motion state, the camera is turned on for shooting. At this time, the camera can be controlled to sleep to avoid the inertial data error triggering the camera module to work, thereby further reducing the overall power consumption of the headset.

[0055] In an example of this embodiment, determining the current state of the user according to the inertia data includes: inputting the inertia data into a pre-trained state detection model, and determining the current state of the user according to the state detection model.

[0056] In this embodiment, the pre-trained state detection model may be a classification model, such as a SVM (support vector machine) model, or other multi-classification models, which is trained by pre-acquired inertial data of the earphones of the earphone wearer in motion. In this example, the inertial data acquired in real time may be input into the trained state detection model to obtain the current user state.

[0057] In an example of this embodiment, the processing module is also used to: obtain the image taken by the camera module, and determine whether the wearer of the headset makes a preset gesture based on the image; if the wearer makes a preset gesture, determine to control the camera module to enter a sleep state.

[0058] In this embodiment, the image captured by the camera module can be used to detect the area where a human hand appears in the image through a deep learning model, and then it is identified whether the user's gesture is a preset gesture. When the user's gesture is the preset gesture, the operation corresponding to the preset gesture is performed, for example, stopping shooting, controlling the camera module to enter a sleep state, or adjusting other operations such as aperture, focal length, and camera mode.

[0059] In this embodiment, the earphone system further comprises a speaker module arranged on the earphone, and the speaker module is used to send a sound prompt to the wearer of the earphone, and the sound prompt is used to prompt the wearer whether the camera module of the earphone is working.

[0060] In this embodiment, when the camera module in the headset is working or enters a dormant state, the speaker module of the headset can also issue a corresponding sound prompt, for example, a voice message of "start recording" or "stop recording". In this way, the user can be prompted whether the camera module in the headset is working, which is convenient for the user to determine the usage status of the headset. When the headset does not need to work, the user can refer to other embodiments, such as the implementation method in the aforementioned gesture recognition embodiment, and control the camera module to stop recording and enter a dormant state through gesture control.

[0061] In an example of this embodiment, the earphone system includes a first earphone body worn on the left ear of the user and a second earphone body applied to the right ear of the user, and the inertial data includes the movement speed and movement direction of the first earphone body and the second earphone body; the current state of the user is determined according to the inertial data, including: when the movement speeds of the first earphone body and the second earphone body are both greater than a speed threshold, and the angle between the movement directions of the first earphone body and the second earphone body is less than an angle threshold, determining that the user is in a moving state.

[0062] In the embodiment of the present application, the earphone body can be a small earplug or a comfortable ear hook or ear clip worn on the left and right sides of a wireless earphone; at the same time, it can also be a large earmuff in a head-mounted headset that wraps around the ears and provides excellent sound insulation, or the main part of an all-in-one earphone that integrates multiple functions and also covers the ears.

[0063] In this embodiment, in order to avoid false triggering, when determining the current state of the user, it can be determined simultaneously based on the inertial data in the two earphones. In this example, only when the movement speed of the two earphone bodies is greater than the speed threshold and the angle between the movement directions of the two earphone bodies is less than the angle threshold, can it be determined that the user is in a moving state, and the situation that the camera module is mistakenly turned on due to noise in the data of the motion detection module of a certain earphone body is excluded. At the same time, in this way, the false triggering caused by the user turning his head quickly can also be excluded. In this example, the preset angle threshold can be set to a value less than 180 degrees. Due to the characteristics of the human body structure, when the user turns his head, the movement directions of the two earphones are opposite. Therefore, according to actual needs, the preset angle threshold can be set to any value of 180 degrees, such as 30 degrees, 45 degrees, or even 120 degrees.

[0064] In this embodiment, after determining that the user is in motion, it can be determined whether to wake up the camera module according to whether the state is a preset state. In one example, the preset state is a motion state, then the camera module can be turned on to shoot in the motion state. In another example, the preset state can also be a static state, and when the current state is the preset state, the camera module in the headset can be turned off to shoot.

[0065] In this embodiment, the inertial data includes acceleration and direction of movement, and the headphone system also includes a wireless communication module; the processing module is also used to control the camera module to capture images and send them to a terminal device connected to the headphone through the wireless communication module when it is detected that the acceleration is within a first preset range and the direction of movement is within a second preset range; wherein the first preset range is determined based on the acceleration of gravity, and the second preset range is determined based on the direction of gravity.

[0066] In this embodiment, the headset system may further include a wireless communication module, such as a Bluetooth module or a WiFi module, etc. The module may be arranged on the headset and the storage box of the headset, and be connected to the terminal device by wireless communication.

[0067] In this embodiment, the first preset interval is an acceleration interval determined based on the gravity acceleration. In this example, the interval can be set with the gravity acceleration as the center, and the upper and lower limits of the interval are respectively within the preset range of the difference with the gravity acceleration, for example, 3 meters per second squared. The second preset interval is an angle interval determined based on the gravity direction. Similar to the first preset interval, the interval can include all directions with an angle with the gravity direction within the preset range, and the preset range can be set at 30 degrees. Figure 2 As shown, Figure 2 The direction of the solid arrow is the neutral direction, and the dotted arrow is the boundary range of the second preset interval. It can be understood that Figure 2 This is just an example, and in an actual scenario, the second preset interval may be a conical interval.

[0068] For wireless headphones, falling is a common occurrence. Since headphones are usually small, once they fall, discovery and detection are both big problems. In this embodiment, the processing module can perform drop detection based on the acceleration and movement direction of the headphones. In actual situations, those skilled in the art can set the range of the first preset interval and the second preset interval according to actual needs. When the acceleration of the headphones falls within the first interval set based on the acceleration of gravity, and the movement direction is within the second interval determined based on the direction of gravity, it can be determined that the movement state of the headphones is close to free fall. At this time, the camera module can be controlled to shoot and send it to the terminal device through the wireless communication module, so that the user can determine the drop position of the headphones and facilitate the detection of the headphones.

[0069] In this example, the earphones can turn on the camera to take pictures when they fall, and send them to the terminal device through the wireless communication module, so that the user can track the earphones based on the captured images. At the same time, it also solves the problem that the earphones are easy to fall off and difficult to track in sports scenes.

[0070] In an example of this embodiment, the processing module is also used to: when it is detected that the acceleration is within a first preset interval and the movement direction is within a second preset interval, and based on the inertial data of the earphone, determine the stationary time of the earphone; when the stationary time is greater than a preset time threshold, execute the step of controlling the camera module to capture an image and sending it to a terminal device connected to the earphone through the wireless communication module.

[0071] In this embodiment, the processing module can also continue to pay attention to the inertial data of the headset after monitoring the acceleration and movement direction of the headset in a preset interval, and determine the static duration of the headset based on the inertial data. If the static duration of the headset is less than the time threshold, or it has never been static, it means that the headset has been picked up by the user for patrolling, or the headset itself has not fallen off. The previous inertial data was generated when the user wore it. Therefore, the step of controlling the camera module to capture images and sending them to the terminal device connected to the headset through the wireless communication module can be omitted. When the static duration of the headset exceeds the preset time threshold, it means that the headset has fallen, and the user has not found the fall or the fall location is difficult to find. Therefore, in this case, the camera module can be controlled to capture images and send them to the terminal device to facilitate the user's patrol. In this example, the preset duration should not be set too long. For example, it can be set to 8 seconds to prevent the user from leaving the wireless communication range of the headset without finding that the headset has fallen.

[0072] In an example of this embodiment, the earphone system also includes a speaker module arranged on the earphone, the earphone includes a first earphone body worn on the user's left ear and a second earphone body applied to the user's right ear, and the inertial data includes acceleration and movement direction; the processing module is also used to, when it is detected that the acceleration of the first earphone body or the second earphone body is within a first preset interval and the movement direction is within a second preset interval, send a sound prompt to the user through the speaker module of the other earphone body, and the sound prompt reminds the user that the earphone has fallen; wherein the first preset interval is determined based on the acceleration of gravity, and the second preset range is determined based on the direction of gravity.

[0073] In this example, when any of the two earphone bodies falls off, the processing module can also send a sound prompt to the user through the speaker module of the other earphone, playing a prompt sound of the other earphone body falling off, such as "the other earphone fell off." In this example, the earphone that has not fallen off can prompt the user of the earphone falling off through the sound module when the other earphone falls off, solving the problem that the earphone is easy to fall off and the user is not easy to find in sports scenes.

[0074] The present application also provides a method for controlling an earphone camera module. Figure 3 As shown, the method includes:

[0075] Step S11, obtaining inertial data of the earphone;

[0076] Step S12, determining the current state of the user according to the inertial data, and waking up the camera module on the headset to shoot when the current state is in a preset state.

[0077] Optionally, acquiring the inertial data of the earphone includes: detecting a wearing state of the earphone; and acquiring the inertial data of the earphone when the earphone is worn.

[0078] Optionally, after waking up the camera module on the headset to shoot, the method further includes:

[0079] Acquire a first image and a second image from the captured image, wherein the first image and the second image are two images acquired at a preset time interval;

[0080] determining a motion state of the earphone based on the first image and the second image;

[0081] Determine whether the motion state of the headset matches the inertial data. If not, control the camera module to sleep.

[0082] Optionally, determining the current state of the user according to the inertia data includes: inputting the inertia data into a pre-trained state detection model, and determining the current state of the user according to the state detection model.

[0083] Optionally, the method also includes: acquiring an image captured by the camera module, and determining whether the wearer of the headset makes a preset gesture based on the image; if the wearer makes a preset gesture, determining to control the camera module to enter a sleep state.

[0084] Optionally, the earphone includes a first earphone body worn on the left ear of the user and a second earphone body worn on the right ear of the user, and the inertial data includes movement speed and movement direction of the first earphone body and the second earphone body;

[0085] Determine the user's current state based on inertial data, including:

[0086] When the movement speeds of the first earphone body and the second earphone body are both greater than the speed threshold, and the included angle between the movement directions of the first earphone body and the second earphone body is less than the angle threshold, it is determined that the user is in motion.

[0087] Optionally, the inertial data includes acceleration and movement direction, and the method further includes: when it is detected that the acceleration is within a first preset interval and the movement direction is within a second preset interval, controlling the camera module to capture an image and sending it to a terminal device connected to the headset for communication; wherein,

[0088] The first preset range is determined based on the gravity acceleration, and the second preset range is determined based on the gravity direction.

[0089] Optionally, the method further comprises: determining the stationary time of the earphone according to the inertial data of the earphone when the acceleration is detected to be within the first preset interval and the movement direction is within the second preset interval;

[0090] When the static time is greater than a preset time threshold, the step of controlling the camera module to capture an image is executed, and the image is sent to a terminal device connected to the headset for communication.

[0091] Optionally, the earphone includes a first earphone body worn on the left ear of the user and a second earphone body worn on the right ear of the user, and the inertial data includes acceleration and movement direction;

[0092] The method further includes: when it is detected that the acceleration of the first earphone body or the second earphone body is within a first preset interval and the movement direction is within a second preset interval, sending a second sound prompt to the user through the other earphone body, the second sound prompt reminding the user that the earphone has fallen; wherein,

[0093] The first preset range is determined based on the gravity acceleration, and the second preset range is determined based on the gravity direction.

[0094] An embodiment of the present application also provides an earphone, comprising any earphone system in the earphone system embodiment; or, comprising a processor and a memory, wherein the memory stores computer instructions, and when the computer instructions are executed by the processor, the steps of any method in the control method of the camera module of the earphone are implemented.

[0095] Each embodiment in the present disclosure is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device and equipment embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0096] The above describes specific embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0097] The embodiments of the present disclosure may be systems, methods and / or computer program products. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the embodiments of the present disclosure.

[0098] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0099] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0100] The computer program instructions for performing the operation of the embodiments of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be personalized by utilizing the state information of a computer-readable program instruction, and the electronic circuit may execute a computer-readable program instruction, thereby realizing various aspects of the embodiments of the present disclosure.

[0101] Various aspects of the embodiments of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0102] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0103] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0104] The flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of an instruction, and a part of a module, a program segment or an instruction contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or the flowchart, and the combination of the boxes in the block diagram and / or the flowchart can be implemented by a dedicated hardware-based system that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that it is equivalent to implement it by hardware, implement it by software, and implement it by combining software and hardware.

[0105] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A headphone system, characterized in that: The earphone system comprises: a motion detection module and a camera module arranged on the earphone, and a processing module; A motion detection module, used to obtain inertial data of the headset; A camera module, used for shooting under the control of the processing module; The processing module is used to determine the current state of the user according to the inertial data, and wake up the camera module to shoot when the current state is in a preset state.

2. The earphone system according to claim 1, characterized in that The earphone system comprises a wearing detection module arranged on the earphone, for detecting the wearing state of the earphone; The processing module is further configured to wake up the motion detection module to obtain inertial data of the headset when the headset is worn.

3. The earphone system according to claim 1, characterized in that The processing module is further used for: Acquire a first image and a second image from the images captured by the camera module, wherein the first image and the second image are two images acquired by the camera module at a preset time interval; determining a motion state of the headset based on the first image and the second image; Determine whether the motion state of the headset matches the inertial data, and if not, control the camera module to sleep.

4. The earphone system according to claim 1, characterized in that The determining the current state of the user according to the inertial data comprises: The inertial data is input into a pre-trained state detection model, and the current state of the user is determined according to the state detection model.

5. The earphone system according to claim 1, characterized in that The processing module is further used for: Acquire the image captured by the camera module, and determine whether the wearer of the headset makes a preset gesture according to the image; When the wearer makes a preset gesture, it is determined to control the camera module to enter a sleep state.

6. The earphone system according to claim 1, characterized in that The earphone system comprises a first earphone body worn on the left ear of a user and a second earphone body worn on the right ear of the user, and the inertial data comprises movement speed and movement direction of the first earphone body and the second earphone body; Determining a current state of the user according to the inertial data includes: When the movement speeds of the first earphone body and the second earphone body are both greater than a speed threshold, and the angle between the movement directions of the first earphone body and the second earphone body is less than an angle threshold, it is determined that the user is in motion.

7. The earphone system according to claim 1, characterized in that The inertial data includes the acceleration and the direction of motion, and the headset system further includes a wireless communication module; The processing module is also used to control the camera module to capture images and send them to the terminal device connected to the headset through the wireless communication module when the acceleration is detected to be within the first preset interval and the movement direction is within the second preset interval; wherein, The first preset range is determined based on gravity acceleration, and the second preset range is determined based on gravity direction.

8. The earphone system according to claim 7, characterized in that The processing module is also used for: When it is detected that the acceleration is within a first preset interval and the motion direction is within a second preset interval, determining a stationary time of the earphone according to inertial data of the earphone; In the case where the static time is greater than a preset time threshold, the step of controlling the camera module to capture an image is executed, and the image is sent to a terminal device that is communicatively connected to the headset through the wireless communication module.

9. The earphone system according to claim 1, characterized in that The earphone system comprises a first earphone body worn on the left ear of the user and a second earphone body worn on the right ear of the user, and the inertial data comprises the acceleration and the movement direction; The processing module is further configured to, when detecting that the acceleration of the first earphone body or the second earphone body is within a first preset interval and the movement direction is within a second preset interval, send a second sound prompt to the user through the speaker module of the other earphone body, wherein the second sound prompt reminds the user that the earphone has fallen; wherein, The first preset range is determined based on gravity acceleration, and the second preset range is determined based on gravity direction.

10. A method for controlling a camera module of an earphone, characterized in that: The method comprises: Acquiring inertial data of the earphone; The current state of the user is determined according to the inertial data, and when the current state is in a preset state, the camera module on the headset is awakened to take pictures.

11. A headset, characterized in that: The invention comprises the earphone system as claimed in claims 1 to 9; or comprises a processor and a memory, wherein the memory stores computer instructions, and when the computer instructions are executed by the processor, the steps of the method as claimed in claim 10 are implemented.

Images