Wearable device

Abstract

The invention discloses a wearable device. The wearable device comprises a device body, a movable part and a camera. The device body has a frame structure for a user to wear. The movable part is arranged on the equipment body in a movable connection mode. The camera is arranged on the movable part, and the shooting direction of the camera can be adjusted by adjusting the relative position relation between the movable part and the equipment main body, so that the camera can shoot the central point of a direct view field when a user wears the wearable equipment.

Description

Technical Field

[0001] The present application relates to the field of intelligent electronic devices, and in particular to a wearable device. Background Art

[0002] With the rapid development of science and technology, artificial intelligence (AI) has gradually penetrated into various fields, and its application in the field of wearable devices is becoming increasingly extensive. The rise of multimodal large model technology has brought richer application scenarios to wearable devices, and can provide powerful data processing and analysis capabilities, enabling these devices to better realize and understand and respond to users' diverse needs with higher quality.

[0003] Currently, the wearable devices that are closely integrated with AI in the market are mainly smart glasses. These products integrate hardware components such as cameras and displays, and combine them with AI algorithms to provide users with a variety of services such as navigation, information display, and facial recognition. However, these products have obvious limitations in design and use:

[0004] 1) Unfriendly to corrective glasses wearers: For users who need to wear corrective glasses, smart glasses are often not their target products because they are incompatible with corrective glasses. Even if they can be used with corrective glasses, wearing them additionally often causes inconveniences, such as increased weight and limited field of vision, which seriously affects the user experience;

[0005] 2) Limitations of wearing methods: Existing smart glasses products are usually designed to be worn in the same way as traditional glasses. This design method determines that the shape, specifications and other parameters of the product are greatly restricted, making it difficult to meet the personalized needs of different users;

[0006] 3) Single function: Although smart glasses perform well in image-based visual assistance, they are relatively weak in processing and responding to other sensory inputs (such as hearing) due to the limitations of their infrastructure and basic positioning, which limits the expansion of their application scenarios.

[0007] In view of the above problems, there is an urgent need for a new type of wearable device that can be better adapted to people with different needs. Summary of the invention

[0008] In order to overcome at least some of the problems existing in the prior art, the present application proposes a wearable device.

[0009] According to one aspect of the present application, a wearable device is provided. The wearable device comprises: a device body having a frame structure for being worn by a user; an active component disposed on the device body in a movable connection manner; and a camera disposed on the active component, and the shooting direction of the camera can be adjusted by adjusting the relative position relationship between the active component and the device body, so that the camera can shoot the center point of the direct viewing field of the user when wearing the wearable device.

[0010] In some embodiments, the wearable device also includes: a microphone, arranged on the device body or the movable part, for collecting the user's voice; a processing unit, electrically connected to the camera and the microphone, configured to receive a voice control command generated based on the user's voice from the microphone, and control the camera to obtain image information based on the voice control command; and a communication unit, electrically connected to the processing unit and capable of communicating with a server, configured to send the image information or processed image information to the server and receive answer information from the server, wherein the processed image information is generated by the processing unit after performing image processing on the image information.

[0011] In some embodiments, the processing unit is configured to process a sequence of image information acquired from the camera within a period of time to generate the processed image information.

[0012] In some embodiments, the wearable device further includes: a result output unit, electrically connected to the processing unit, and configured to output the answer information in a manner that can be perceived by a user.

[0013] In some embodiments, the result output unit includes at least one of a speaker, a display, or a projection unit.

[0014] In some embodiments, the wearable device further includes: an environmental microphone, disposed on the device body or the movable component, for collecting sounds from the environment, wherein the sounds from the environment include the voice of the user's communication partner.

[0015] In some embodiments, the wearable device further includes: an eye tracking camera, disposed on the device body or the movable component, for obtaining eye movement information of the user.

[0016] In some embodiments, the movable connection is a rotational connection or a sliding connection.

[0017] In some embodiments, the camera is configured to shoot a video file, and the image information is a frame selected from each frame image of the video file.

[0018] In some embodiments, the wearable device further includes: a laser emitter, disposed on the movable component, wherein the direction of the light emitted by the laser emitter is the same as the shooting direction of the camera.

[0019] In some embodiments, the wearable device is headphones, a helmet, a headband, a collar, a mask, or a headgear.

[0020] Through the wearable device of the present application, an active part that is movably connected to the device body is set on the device body, and a camera is set on the active part to achieve shooting of the user's focus range through adjustment. As a result, the interaction between the wearable device and the multimodal large model server is no longer limited to smart glasses products, and has better adaptability to people with different needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A schematic structural diagram of a wearable device according to an embodiment of the present application is shown.

[0022] Figure 2 A schematic structural diagram of a wearable device according to another embodiment of the present application is shown. DETAILED DESCRIPTION

[0023] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of them. Based on the described embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without creative work belong to the scope of protection of this application. It should be noted that throughout the accompanying drawings, the same elements are represented by the same or similar reference numerals. In the following description, some specific embodiments are only used for descriptive purposes and should not be understood as any limitation to the present application, but are only examples of the embodiments of the present application. Conventional structures or constructions will be omitted when they may cause confusion in the understanding of the present application.

[0024] The technical solution of the present application is based on the communication application scenario of the wearable device in the multimodal large model server, but it is not limited to this. It can be understood that the technical solution of the present application can also be adapted to specific groups of people or specific functional requirements in other scenarios. In the application scenario based on the present application, the wearable device takes a picture of the area of ​​interest of the user (such as the screen being read) under the control command of the user, sends the obtained image to the server for processing through the multimodal large model, receives the analysis results after the large model processing from the server, and presents the analysis results to the user in the form of voice or image.

[0025] The wearable device of the present application can be specifically implemented as earphones, helmets, headbands, collars, masks or headwear, etc., which are suitable for implementing the technical solution of the present application. Without loss of generality, in the following description of the technical solution in conjunction with specific embodiments, the present application takes the earphone as an example.

[0026] In the present application, the direct viewing field is the visible range of the user looking straight ahead of the face. In theory, the visible range is similar to the range of a spherical cone. It can be considered that the line connecting the midpoint of the spherical surface of the spherical cone and the center of the sphere corresponds to the center line of the direct viewing field in the present application, and the focus of the center line and the interface that the user is concerned about corresponds to the center point of the direct viewing field in the present application.

[0027] Embodiment 1

[0028] Figure 1 A schematic structural diagram of a wearable device 100 according to an embodiment of the present application is shown.

[0029] like Figure 1 As shown, the wearable device 100 in this embodiment is a back-hanging earphone. Specifically, the wearable device 100 includes a device body 110 and an active component 120.

[0030] The device body 110 has a frame structure for being worn by a user. Figure 1 In the embodiment, the frame structure is a rear-hanging frame adapted to the shape of the back of the head, and its two ends form curved ear-hanging structures suitable for being worn on the left and right ears respectively, so as not to slip off easily.

[0031] The two ends of the device body 110 are respectively formed as speaker structures for accommodating speakers, so that the speakers can extend into the user's ear canal at a suitable angle (such as in-ear headphones or ordinary earplugs) or rest against the skin near the user's ears (such as bone conduction headphones).

[0032] On one side of the device body 110, a movable component 120 is provided. The movable component 120 is provided on the device body 110 in a movable connection manner. In some embodiments, the movable connection manner is a rotational connection manner. In other embodiments, the movable connection manner is a sliding connection manner. For example, an arc-shaped slide groove can be provided on the device body, and an arc-shaped slider can be provided on the movable component 120. The movable connection between the two can be achieved by moving the slider in the slide groove.

[0033] exist Figure 1In the embodiment, the movable part 120 has a rod-shaped structure, one end of the rod-shaped structure is movably connected to the outer surface of the speaker structure through a connecting member 125, and the connecting member 125 is rotatably fixed on the outer surface of the speaker structure. The other end of the rod-shaped structure is a free end, and as the connecting member 125 rotates, the free end can rotate around the speaker structure.

[0034] The wearable device 100 further includes a camera 130. The camera 130 is disposed on the movable component 120, and the shooting direction of the camera 130 can be adjusted by adjusting the relative position relationship between the movable component 120 and the device body 110, so that the camera 130 can shoot the center point of the direct viewing field of the user when wearing the wearable device 100.

[0035] exist Figure 1 In the embodiment, the camera 130 is arranged at the free end of the rod-shaped structure of the movable part 120, and its shooting direction can be set to be consistent with the extension direction of the rod-shaped structure. Thus, as the movable part 120 rotates, the shooting direction of the camera 130 can be adjusted. In some embodiments, the specific shape of the rod-shaped structure (such as the bending direction and the bending angle) can also be designed to be adapted to the overall structure, so that the shooting direction of the camera 130 can be adjusted to be parallel or nearly parallel to the central direction of the direct viewing field of the user wearing the wearable device 100.

[0036] In actual use, different users may have quite different head shapes, wearing habits, and eye habits, which may cause the relative position relationship between the direction in which the user looks forward and the wearable device when wearing the wearable device to be different. In particular, for headphone products, this situation is much more obvious than for eyeglass products. In this application, by setting the camera on a movable part that is movable relative to the device body, different users can adjust the camera to a more ideal direction, thereby reducing the objective usage differences of the product for different people.

[0037] The wearable device 100 may further include a microphone 140a. Figure 1 In the embodiment, microphone 140a is located inside the speaker structure (in Figure 1 In other embodiments, the microphone 140a may also be disposed on the movable component 120.

[0038] exist Figure 1 In the embodiment, the wearable device 100 may further include a containing structure 150, which is a relatively raised portion on the device body and can be used to contain functional components required for the normal operation of the wearable device 100, such as a processing unit, a communication unit, a battery, etc.

[0039] In some embodiments, the wearable device 100 includes a processing unit ( Figure 1 ) and a communication unit, which are not shown, may be located in the containing structure 150, or may be disposed in other parts of the device body 110 or the movable component 120 in other ways.

[0040] The processing unit is electrically connected to the camera 130 and the microphone 140 a , and is configured to receive a voice control command generated based on the user's voice from the microphone 140 a , and control the camera 130 to acquire image information based on the voice control command.

[0041] The communication unit is electrically connected to the processing unit and is capable of communicating with the server. The communication unit is configured to send image information or processed image information obtained from the camera 130 to the server, and receive answer information from the server. The processed image information is generated by the processing unit after performing image processing on the image information obtained from the camera 130.

[0042] In some embodiments, the processing unit is configured to process the image information sequence acquired from the camera 130 within a period of time to generate the processed image information. Due to head shaking and other reasons, the image information collected by the camera 130 may produce image jitter and offset. By processing the continuous image information sequence acquired within a period of time as a whole, the jitter offset component can be separated to obtain more ideal image information.

[0043] In some embodiments, the camera 130 is further configured to shoot a video file, and the image information may be a frame selected from each frame image of the video file.

[0044] The wearable device 100 may further include a result output unit 160. The result output unit 160 is electrically connected to the processing unit and is configured to output the answer information in a manner that the user can perceive. Figure 1 In the embodiment, the result output unit 160 is implemented as a speaker, which is located in a speaker structure at the end of the device body 110 and can output the answer information received from the server in the form of sound.

[0045] In other embodiments, the result output unit 160 may also be implemented as other types of products, such as a display or a projection unit, etc. For example, the result output unit 160 may be a holographic projection unit, and the result output unit 160 may present the answer information in the form of text in front of the user through holographic projection.

[0046] The wearable device 100 may also include an ambient microphone 140b for collecting sounds from the environment, including the voice of the user's communication partner. Figure 1In the embodiment, the ambient microphone 140b is disposed on the movable part 120. In other embodiments, the ambient microphone 140b may also be disposed on the device body 110 according to the different structures and positions of the device body 110 and the movable part 120.

[0047] The wearable device 100 may also include an eye tracking camera 170 for acquiring eye movement information of the user. Figure 1 In the embodiment, the eye tracking camera 170 is arranged on the device body or the movable part. By tracking the user's eyes, the user's attention content can be narrowed down to a smaller image range according to the eye direction in the image captured by the camera 130, thereby increasing the accuracy and pertinence of the answer information obtained from the server.

[0048] The wearable device 100 may also include a laser transmitter ( Figure 1 (not shown). The laser emitter is disposed on the movable part 120, and the direction of the light emitted by the laser emitter is the same as the shooting direction of the camera 130. In this arrangement, the shooting direction of the camera 130 can be indicated by the laser emitter, so that the user can adjust the direction of the movable part 120 by the spot position of the laser emitter. In some embodiments, the laser emitter can be disposed adjacent to the camera 130 to increase the accuracy of the adjustment.

[0049] exist Figure 1 In the embodiment, the wearable device 100 further includes a button 180, and the operation of the button 180 can be used to control the operating system of the wearable device. For example, a single short press of the button 180 can wake up the system, and after waking up, the user can issue a voice command to control the operation of the wearable device 100; continuous pressing of the button 180 (for example, for several seconds) can turn the device on or off; flicking upward on the surface of the button 180 can increase the volume of the speaker, etc.

[0050] In this embodiment, the movable component 120 is disposed at one end of the device body 110. It should be understood that in other embodiments, a movable component 120 may be disposed at both ends of the device body 110, and a camera may be disposed on each of the two movable components 120, so that better technical effects can be obtained by shooting with two cameras.

[0051] In this embodiment, the two ends of the device body 110 are asymmetrical structures, wherein one end on which the movable component 120 is installed is integrally formed, and the other end is movable. In other embodiments, the two ends may be symmetrical structures.

[0052] Embodiment 2

[0053] Figure 2A structural schematic diagram of a wearable device 200 according to another embodiment of the present application is shown. Figure 2 The left side in the middle is an inner view of the wearable device 200 , and the right side is an outer view of the wearable device 200 .

[0054] like Figure 2 As shown, the wearable device 200 in this embodiment is an ear-hanging headphone. Specifically, the wearable device 200 includes a device body 210 and an active component 220.

[0055] The device body 210 has a frame structure for being worn by a user. Figure 2 In the embodiment, the frame structure is an ear-hanging frame adapted to the shape of the user's ear, which is suitable for being worn on a single ear so as not to slip off easily.

[0056] One end of the device body 210 includes a speaker structure for accommodating a speaker, so that the speaker can extend into the user's ear canal at a suitable angle (for example, Figure 2 The earphones shown in the figure or ordinary earplugs) or against the skin near the user's ear (such as bone conduction headphones).

[0057] The device body 210 is provided with a movable part 220. The movable part 220 is provided on the device body 210 in a movable connection manner. In some embodiments, the movable connection manner is a rotating connection manner. In other embodiments, the movable connection manner is a sliding connection manner.

[0058] exist Figure 2 In the embodiment, the movable part 220 has a rod-shaped structure, one end of which is rotatably connected to the outer surface of the speaker structure, for example, the rod-shaped structure can be connected to the outer surface of the speaker structure by threads or rotatably buckled together. The other end of the rod-shaped structure is a free end, which can rotate around the speaker structure.

[0059] The wearable device 200 further includes a camera 230. The camera 230 is disposed on the movable component 220, and the shooting direction of the camera 230 can be adjusted by adjusting the relative position relationship between the movable component 220 and the device body 210, so that the camera 230 can shoot the center point of the direct viewing field of the user when wearing the wearable device 200.

[0060] exist Figure 2 In the embodiment, the camera 230 is arranged at the free end of the rod-shaped structure of the movable part 220, and its shooting direction can be arranged to be consistent with the extending direction of the rod-shaped structure. Thus, as the movable part 220 rotates, the shooting direction of the camera 230 can be adjusted.

[0061] The wearable device 200 may also include a microphone ( Figure 2 The microphone may be located on the device body 210 or the movable part 220 to collect the user's voice.

[0062] The wearable device 200 may further include a processing unit and a communication unit ( Figure 2 are not shown).

[0063] The processing unit is electrically connected to the camera 230 and the microphone, and is configured to receive a voice control command generated based on the user's voice from the microphone, and control the camera 230 to acquire image information based on the voice control command.

[0064] The communication unit is electrically connected to the processing unit and is capable of communicating with the server. The communication unit is configured to send image information or processed image information obtained from the camera 230 to the server, and receive answer information from the server. The processed image information is generated by the processing unit after performing image processing on the image information obtained from the camera 230.

[0065] In some embodiments, the processing unit is configured to process the image information sequence acquired from the camera 230 within a period of time to generate the processed image information. Due to head shaking and other reasons, the image information collected by the camera 230 may produce image jitter offset. By processing the continuous image information sequence acquired within a period of time as a whole, the jitter offset component can be separated to obtain more ideal image information.

[0066] In some embodiments, the camera 230 is further configured to shoot a video file, and the image information may be a frame selected from each frame image of the video file.

[0067] The wearable device 200 may further include a result output unit 260. The result output unit 260 is electrically connected to the processing unit and is configured to output the answer information in a manner that the user can perceive. Figure 2 In the embodiment, the result output unit 260 is implemented as a speaker, which is located in a speaker structure at the end of the device body 210 and can output the answer information received from the server in the form of sound.

[0068] exist Figure 2 The direction of the speaker can also be adjusted within a certain range to better suit the ear structures of different users.

[0069] The wearable device 200 may also include an ambient microphone ( Figure 2The ambient microphone 20 is used to collect sounds from the environment, including the voice of the user's communication partner. In the embodiment of the present application, the ambient microphone 20 can be arranged on the device body 210 or on the movable part 220 according to the different structures and positions of the device body 210 and the movable part 220.

[0070] The wearable device 200 may also include a laser transmitter ( Figure 2 (not shown). The laser emitter is disposed on the movable part 220, and the direction of the light emitted by the laser emitter is the same as the shooting direction of the camera 230. In this arrangement, the shooting direction of the camera 230 can be indicated by the laser emitter, so that the user can adjust the direction of the movable part 220 by the spot position of the laser emitter. In some embodiments, the laser emitter can be disposed adjacent to the camera 230 to increase the accuracy of the adjustment.

[0071] exist Figure 2 In the embodiment, the wearable device 200 further includes a button ( Figure 2 (not shown in the figure), the operating system of the wearable device can be controlled by operating the button. For example, a single short press of the button can wake up the system, and after waking up, the user can issue a voice command to control the operation of the wearable device 200; continuous pressing of the button (for example, for several seconds) can turn the device on or off; flicking upward on the surface of the button can increase the volume of the speaker, etc.

[0072] In addition to the above embodiments, the present application may also have other implementation modes. Any technical solutions formed by equivalent replacement or equivalent transformation shall fall within the protection scope required by the present application.

Claims

1. A wearable device, characterized in that: The wearable device comprises: A device body having a frame structure for being worn by a user; A movable part is movably connected to the device body; and A camera is arranged on the movable component, and the shooting direction of the camera can be adjusted by adjusting the relative position relationship between the movable component and the device body, so that the camera can shoot the center point of the user's direct field of view when wearing the wearable device.

2. The wearable device according to claim 1, further comprising: A microphone, disposed on the device body or the movable component, for collecting the user's voice; a processing unit, electrically connected to the camera and the microphone, configured to receive a voice control command generated based on a user's voice from the microphone, and control the camera to acquire image information based on the voice control command; as well as A communication unit, which is electrically connected to the processing unit and capable of communicating with the server, is configured to send the image information or processed image information to the server and receive answer information from the server, wherein the processed image information is generated after the processing unit performs image processing on the image information.

3. The wearable device according to claim 2, wherein: The processing unit is configured to process a sequence of image information acquired from the camera within a period of time to generate the processed image information.

4. The wearable device according to claim 2, further comprising: A result output unit is electrically connected to the processing unit and is configured to output the answer information in a manner that can be perceived by the user. Wherein, the result output unit includes at least one of a speaker, a display or a projection unit.

5. The wearable device according to any one of claims 2 to 4, further comprising: The environmental microphone is arranged on the device body or the movable part, and is used to collect sounds from the environment, wherein the sounds from the environment include the voice of the user's communication partner.

6. The wearable device according to any one of claims 1 to 4, further comprising: The eye tracking camera is arranged on the device body or the movable component, and is used to obtain the user's eye movement information.

7. The wearable device according to any one of claims 1 to 4, wherein: The movable connection mode is a rotation connection or a sliding connection.

8. The wearable device according to any one of claims 2 to 4, wherein: The camera is configured to shoot a video file, and the image information is a frame selected from each frame image of the video file.

9. The wearable device according to any one of claims 1 to 4, further comprising: A laser emitter is arranged on the movable component, wherein the direction of the light emitted by the laser emitter is the same as the shooting direction of the camera.

10. The wearable device according to any one of claims 1 to 4, wherein: The wearable device is earphones, a helmet, a headband, a collar, a mask or a headgear.

Images