Wearable devices, headphones, and head-mounted displays
By using encrypted imaging technology in optical modules, the problems of privacy leakage and difficulty in miniaturization in human-computer interaction of wearable devices are solved, achieving a balance between privacy protection and device miniaturization.
Patent Information
- Application Number
- CN202522691050.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-18
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2035-12-18
AI Technical Summary
Existing wearable devices pose privacy risks during human-computer interaction and are difficult to miniaturize.
Encrypted imaging is achieved by using an optical module. The combination of optical and photosensitive elements, along with a control unit, enables the encrypted imaging process, preventing privacy leaks and reducing device size.
While enabling human-computer interaction, it effectively prevents privacy leaks and significantly reduces the size of the device, adapting to the miniaturization needs of wearable devices.
Smart Images

Figure CN224958181U_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic device technology, and more particularly to a wearable device, headphones, and head-mounted display device. Background Technology
[0002] With the increasing popularity of wearable devices, in order to improve the human-computer interaction capabilities of these devices, some existing technologies will set up imaging units or other sensing units in the devices to trigger their own functions by detecting the environmental conditions around the devices.
[0003] To achieve functions such as gesture recognition, imaging units typically require high image quality. This not only puts significant pressure on the internal transmission of image data and the computation of the processing module, but also risks user privacy leaks. Furthermore, imaging units usually have a certain size, which hinders the miniaturization of wearable devices and makes it difficult to adapt related functions to small wearable devices. Utility Model Content
[0004] One of the purposes of this application is to provide a wearable device to solve the technical problems of privacy leakage risks and difficulty in miniaturization in the human-computer interaction of existing wearable devices.
[0005] One of the purposes of this application is to provide an earphone.
[0006] One of the purposes of this application is to provide an alternative wearable device.
[0007] One of the purposes of this application is to provide a head-mounted display device.
[0008] To achieve one of the above-mentioned application objectives, one embodiment of this application provides a wearable device, including: a housing, a functional component disposed on the housing, the functional component being used to implement the inherent functions of the wearable device, an optical module disposed on the housing, the optical module including an optical element and a photosensitive element, the optical element being used to perform encrypted imaging of a predetermined area, the photosensitive element being used to receive light signals from the optical element and convert them into electrical signals, and a control unit coupled to the functional component and the photosensitive element.
[0009] Optionally, the surface of the optical module is provided with a light-shielding layer.
[0010] Optionally, the light-shielding layer is formed by spraying light-blocking ink onto the surface of the optical module.
[0011] Optionally, the optical module includes a first optical element and a second optical element, wherein the first optical element is a metasurface element and the second optical element includes a metasurface formed by grating structure units.
[0012] Optionally, the wearable device is configured according to at least one of the following: the second optical element is disposed between the first optical element and the photosensitive element, the first optical element is disposed near the surface of the housing, the housing surrounds and forms a cavity, and the photosensitive element is disposed within the cavity.
[0013] Optionally, the optical module includes a filter and an aperture, which are disposed between the optical element and the photosensitive element.
[0014] Optionally, the wearable device includes a substrate, the photosensitive element is disposed on a first surface of the substrate, and the optical element is disposed on the side of the photosensitive element away from the substrate.
[0015] Optionally, the substrate is a flexible circuit board, and the wearable device includes a reinforcing plate disposed on the second surface of the substrate corresponding to the position of the photosensitive element. The first surface and the second surface are two opposing surfaces on the substrate.
[0016] Optionally, the wearable device includes a light source disposed on the first surface, and the wearable device also includes a heat sink disposed on a second surface of the substrate corresponding to the position of the light source, wherein the first surface and the second surface are two opposing surfaces on the substrate.
[0017] Optionally, the wearable device is configured according to at least one of the following: the optical element includes a metasurface for encrypted imaging of the predetermined area; the optical module includes a metasurface element; the optical module includes a refractive optical element; the optical module includes a diffractive optical element; the optical module includes a scattering medium element.
[0018] Optionally, the predetermined region is located in the normal direction of the optical element or in the direction of a specified deflection angle.
[0019] Optionally, the predetermined area covers an area 5cm to 150cm away from the optical element.
[0020] Optionally, the wearable device is configured according to at least one of the following: the horizontal field of view of the optical module is greater than or equal to 90 degrees; the vertical field of view of the optical module is greater than or equal to 60 degrees.
[0021] Optionally, the wearable device includes: an image recognition processor coupled to the optical module, comprising a deep learning component and an output module, wherein the deep learning component is a processing component with a neural network model, the deep learning component is used to identify the type of limb pose located in the predetermined area based on the encrypted imaging results of the optical module, and the output module is used to generate first information based on the type of limb pose and a preset correspondence; the control unit is coupled to the image recognition processor and is used to send the first information to the functional component.
[0022] To achieve one of the above-mentioned objectives, one embodiment of this application provides an earphone, comprising: a housing; a sound-generating unit disposed in the housing, the sound-generating unit being used to convert electrical signals into mechanical signals to generate sound wave signals; an optical module disposed in the housing, the optical module including optical elements and photosensitive elements, the optical elements being used to perform encrypted imaging of a predetermined area, the photosensitive elements being used to receive light signals from the optical elements and convert them into electrical signals; and a control unit coupled to the sound-generating unit and the photosensitive elements.
[0023] Optionally, the headphones are configured as follows: the headphones are in-ear; the headphones are semi-in-ear; the headphones are over-ear; the headphones are ear-hook; or the headphones are neckband.
[0024] To achieve one of the above-mentioned application objectives, one embodiment of this application provides a wearable device, comprising: a device body, an earphone as described in any embodiment of this application, an image generation unit disposed on the device body, the image generation unit being used to generate a light signal containing image information, a light guide component being used to guide the light signal output by the image generation unit to the user's eyes, a control unit being coupled to the image generation unit, and a sound-generating unit and a photosensitive element of the earphone.
[0025] To achieve one of the above-mentioned objectives, one embodiment of this application provides a head-mounted display device, comprising: a device body; an image generation unit disposed on the device body, the image generation unit being used to generate light signals containing image information; a light guide assembly being used to guide the light signals output by the image generation unit to the user's eyes; an optical module disposed on the device body, the optical module including optical elements and photosensitive elements, the optical elements being used to perform encrypted imaging of a predetermined area, the photosensitive elements being used to receive light signals from the optical elements and convert them into electrical signals; and a control unit coupled to the image generation unit and the photosensitive elements.
[0026] Optionally, the head-mounted display device is configured according to one of the following: the device body is an eye mask; the device body includes a frame; the device body is a helmet.
[0027] Compared with the prior art, the wearable device provided in this application, by coupling the functional components and imaging results through the control unit and setting the imaging process as encrypted imaging, can effectively prevent privacy leakage while realizing functions such as human-computer interaction; at the same time, by setting optical elements to achieve encrypted imaging, compared with electronic encryption or other encryption methods, it can greatly save volume and adapt to the miniaturization requirements of wearable devices. Attached Figure Description
[0028] Figure 1 This is a schematic diagram of a wearable device according to one embodiment of this application.
[0029] Figure 2 This is a schematic diagram of a wearable device in one embodiment of this application.
[0030] Figure 3 This is a schematic diagram of the first embodiment of the optical module in this application.
[0031] Figure 4 This is a schematic diagram of the second embodiment of the optical module in this application.
[0032] Figure 5 This is a schematic diagram of the third embodiment of the optical module in this application.
[0033] Figure 6 This is a schematic diagram of the fourth embodiment of the optical module in this application.
[0034] Figure 7 This is a schematic diagram of the fifth embodiment of the optical module in this application.
[0035] Figure 8 This is a schematic diagram of some components inside the housing at a first angle in one embodiment of this application.
[0036] Figure 9 This is a schematic diagram of a portion of the internal components of the housing at a second angle according to one embodiment of this application.
[0037] Figure 10 This is an exploded view of a portion of the internal components of the housing at a third angle according to an embodiment of this application.
[0038] Figure 11 This is a schematic diagram of an earphone according to one embodiment of this application.
[0039] Figure 12 This is a schematic diagram of the interaction between the headphones and the user in one embodiment of this application.
[0040] Figure 13 This is a schematic diagram of another embodiment of the headphones in this application.
[0041] Figure 14 This is a schematic diagram of a head-mounted display device according to one embodiment of this application.
[0042] Figure 15 This is a schematic diagram of another embodiment of the head-mounted display device in this application.
[0043] Figure 16 This is a schematic diagram of yet another embodiment of the head-mounted display device in this application.
[0044] Figure 17 This is a schematic diagram of a wearable device in another embodiment of this application. Detailed Implementation
[0045] The present application will now be described in detail with reference to the specific embodiments shown in the accompanying drawings. However, these embodiments do not limit the present application, and any structural, methodological, or functional modifications made by those skilled in the art based on these embodiments are included within the scope of protection of this application.
[0046] It should be noted that the term "comprising" or any other variation thereof is intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus.
[0047] Furthermore, the terms "first," "second," "third," "fourth," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance. There is no necessary correlation between the terms "first," "second," "third," "fourth," etc.; for example, the inclusion of "second" in one embodiment provided in this application does not necessarily mean that "first" is included in that embodiment, and so on.
[0048] wearable devices
[0049] One embodiment of this application provides a wearable device 100, such as... Figure 1 As shown.
[0050] The wearable device 100 includes a housing 10.
[0051] The wearable device 100 includes a functional component 11. The functional component 11 is disposed in the housing 10. The functional component 11 is used to implement the inherent functions of the wearable device 100.
[0052] The wearable device 100 includes an optical module 12. The optical module 12 is disposed in the housing 10. The optical module 12 includes optical elements 20. The optical elements 20 are used for encrypted imaging of a predetermined area.
[0053] The optical module 12 includes a photosensitive element 21. The photosensitive element 21 is used to receive optical signals from the optical element 20 and convert them into electrical signals.
[0054] The wearable device 100 includes a control unit 13. The control unit 13 is coupled to the functional component 11 and the optical module 12; the control unit 13 is also coupled to the functional component 11 and the photosensitive element 21.
[0055] In this way, by coupling the control unit with the associated functional components and the imaging results, and by setting the imaging process to encrypted imaging, it is possible to effectively prevent privacy leaks while realizing functions such as human-computer interaction. At the same time, by using optical elements to achieve encrypted imaging, compared with electronic encryption or other encryption methods, it can greatly save the size of the device while ensuring the encryption effect, and adapt to the needs of miniaturization.
[0056] The following will describe the relevant configuration of the housing 10 in some embodiments of this application.
[0057] The housing 10 can be used to enclose and form a cavity. In some embodiments, the components included in the wearable device 100 can be disposed within the cavity, on the inner wall of the housing 10, or on the outer wall of the housing 10, thereby being disposed on the housing 10.
[0058] The shape and volume of the housing 10 can be set according to the part of the wearable device 100 that is worn.
[0059] When the wearable device 100 is used to work with the user's ear:
[0060] The housing 10 may have a shape and volume that fits into the concha cavity, thereby constituting a wearable device 100 resembling an in-ear headphone;
[0061] The housing 10 may have a shape and volume that can be snapped behind the tragus and stably supported on the antitragus, thereby constituting a wearable device 100 resembling a semi-in-ear headphone.
[0062] The housing 10 may have sufficient depth and diameter to cover the ears, thus forming a wearable device 100 resembling headphones.
[0063] When the wearable device 100 is used to interact with a user's head or face:
[0064] The housing 10 may have an arc-shaped profile that conforms to the brow bone curve and adapts to the user's nose bridge, thereby forming a wearable device 100 that resembles an eye mask for a head-mounted display device.
[0065] The housing 10 can have structural strength that meets application requirements, and its interior can be equipped with a shock-absorbing structure, thereby forming a wearable device 100 in the shape of a smart helmet.
[0066] The housing 10 may include a frame. The frame may have sturdy and lightweight temples and nose pads that provide support and distribute pressure, thus forming a wearable device 100 resembling smart eyeglasses.
[0067] The housing 10 does not necessarily constitute the cavity as a whole. In some embodiments, when the housing 10 includes a frame, the cavity for accommodating components can be formed by the temples.
[0068] The housing 10 may also include other parts not intended for use with the user, which may have a shape configuration primarily for functionality. For example, a wearable device 100 intended for use with the ear may include a stem for touch control.
[0069] The following will describe the relevant configuration of functional component 11 in some embodiments of this application.
[0070] When the wearable device 100 is used with a user, the functional components 11 can be at least partially oriented toward the user.
[0071] Functional component 11 may be a single component or a combination of multiple components for implementing the inherent functions of wearable device 100.
[0072] When the wearable device 100 has the function of emitting sound, the functional component 11 may be a sound-emitting unit or a speaker, or the functional component 11 may include a sound-emitting unit or a speaker.
[0073] When the wearable device 100 has the function of displaying images, the functional component 11 can be an image generation unit or a display screen, or the functional component 11 can include an image generation unit or a display screen.
[0074] When the wearable device 100 has human-computer interaction functions such as alerts, the functional component 11 can be a linear motor or other components, or the functional component 11 may include a linear motor or other components.
[0075] The functional component 11 can be disposed within the cavity formed by the housing 10. The functional component 11 and the housing 10 can be disposed relatively fixedly.
[0076] Wearable device 100 can cooperate with a user by the user wearing the wearable device 100. For other wearable devices 100, their functions are not limited to wearing. In this case, states such as hand-held or hanging can also be considered as the wearable device 100 cooperating with the user.
[0077] The functional component 11 is at least partially oriented towards the user. Specifically, this means that a portion of the functional component 11 is closer to the user than other portions of the functional component 11, or that at least a portion of the functional component 11 is closer to the user than other portions of the wearable device 100. The term "oriented" is intended to express a relative positional relationship and does not necessarily mean that the functional component 11 is necessarily in contact with the user's limbs. By defining this positional relationship through "oriented," the functional component 11 can deliver its corresponding function to the user with less loss and energy consumption; delivering the corresponding function to the user can specifically include playing audio, displaying images, etc.
[0078] The configuration of the optical module 12 in some embodiments of this application will be described below.
[0079] For optical element 20, when the wearable device 100 is used with a user, optical element 20 can be oriented toward the predetermined area. The orientation of optical element 20 can be the normal direction of optical element 20.
[0080] A portion of the optical module 12 may be disposed within the cavity formed by the housing 10, while another portion may be disposed near the outer surface of the housing 10 or exposed outside the outer surface of the housing 10.
[0081] In one embodiment, the optical element 20 may include a metasurface, which can be used for encrypted imaging of the predetermined region. In one embodiment, the optical element 20 may be a metasurface element. In one embodiment, the optical module 12 may include a metasurface element.
[0082] The metasurface element can be an artificial layered material with a size smaller than or approximately equal to the wavelength, which can be regarded as a two-dimensional counterpart of metamaterials. The metasurface element can achieve the control of the polarization, phase, amplitude, frequency, propagation mode, and other characteristics of electromagnetic waves through surface subwavelength superstructure units, thereby realizing properties such as beam shaping, beam deflection, superlensing, superholography, optical rotation, anti-reflection and anti-reflection.
[0083] Meanwhile, the metasurface element is a subwavelength optical element, which is suitable for current micrometer-scale sensor architectures. Furthermore, its fabrication process is compatible with mature semiconductor sensor technology, making it highly practical and economical.
[0084] Specifically, the metasurface element includes a substrate and multiple superstructure units arranged in an array on the substrate. Each superstructure unit has a nanostructure at its center and / or vertex. The superstructure unit is obtained by dividing the metasurface element, resulting in a unit centered on each nanostructure. Each period of nanostructures constitutes a superstructure unit. The superstructure unit is a close-packed pattern, such as a regular square, regular hexagon, or sector. Each period contains one nanostructure, and the vertices and / or center of the superstructure unit may have nanostructures. In the case of a regular hexagonal superstructure unit, at least one nanostructure is located at each vertex and center. Similarly, the same applies to sector and square superstructure units.
[0085] The substrate of the metasurface element can be selected from materials with similar refractive indices, such as silicon dioxide, BF33, silicon, and polymethyl methacrylate. The nanostructure can be selected from materials such as monomeric silicon (c-Si), polycrystalline silicon (p-Si), amorphous silicon (a-Si), compound semiconductors (such as GaN, GaP, GaAs, SiC, etc.), TiO2, Si3N4, AlSb, AlAs, AlGaAs, AlGaInP, BP, ZnGeP2, and other suitable materials, as well as combinations of the above materials.
[0086] Specifically, nanostructures can be configured as polarization-dependent or polarization-independent structures. Depending on the application, the nanostructure units can be configured as either polarization-dependent or polarization-independent structures. Examples of polarization-independent structures include cylindrical, square prisms, cross-shaped prisms, and square prisms with circular holes. Examples of polarization-dependent structures include elliptical cylinders, rectangular prisms, and hexagonal prisms. Nanostructures can be positive or negative structures. For example, the shapes of nanostructures include cylinders, hollow cylinders, square prisms, and hollow square prisms.
[0087] The metasurface element may also include a protective layer covering the nanostructure. The material of the protective layer may be any material with a low refractive index and absorption coefficient in the visible or near-infrared band, such as: silicon dioxide (SiO2), spin-coated glass (SOG), or polymers such as polymethyl methacrylate (PMMA), polydimethylsiloxane (PDMS), polymethylpentene (PMP), and combinations thereof, or it may be air (i.e., no protective layer).
[0088] If there are multiple ways in which the wearable device 100 can be paired with the user, then there can also be multiple predetermined areas that the optical element 20 faces. For example, when the wearable device 100 is paired with the user's ear, the optical element 20 can face a first predetermined area; when the wearable device 100 is paired with the user's hand, the optical element 20 can face a second predetermined area.
[0089] The predetermined area is related to the position of the optical element 20 in the wearable device 100; for example, when the optical element 20 is disposed on the first side of the housing 10, the predetermined area may be an area located outside the housing 10 opposite to the first side of the housing 10.
[0090] The predetermined area is related to the position of the optical element 20 when the wearable device 100 is in contact with the user; for example, when the wearable device 100 is in contact with the user's head, the optical element 20 is located on the user's head, and the predetermined area is located near the user's head.
[0091] The predetermined area can be set by adjusting the parameters of the optical element 20. The optical element 20 can be configured to process incident light from a specific direction, and the area corresponding to that specific direction is the predetermined area.
[0092] The optical element 20 can perform encrypted imaging in either a blur encryption or a contour encryption method.
[0093] When fuzzy encryption is implemented, the image obtained by the optical module 12 based on the optical element 20 can be a blurred image. The blurred image contains feature information of objects in a predetermined area after blurring.
[0094] When contour encryption is implemented, the image obtained by the optical module 12 based on the optical element 20 can be a contour image. The contour image contains contour feature information of objects in a predetermined area.
[0095] In one embodiment, the configuration of the optical element 20 can be determined by training the optical element 20.
[0096] For example: inputting first data into optical element 20 to determine intermediate data; determining an evaluation value based on the intermediate data and second data as target data of the first data; updating the configuration of optical element 20 based on the evaluation value until the evaluation value meets the preset numerical conditions, thereby obtaining the configuration information of optical element 20.
[0097] The first data may include a sample image; the second data may include actual identification information; the actual identification information can be characterized by the actual features of the target object in the sample image.
[0098] The intermediate data may include predictive recognition information corresponding to the sample image; the predictive recognition information can be characterized by features determined by the optical module 12 based on the sample image.
[0099] For example: output the first data to the optical element 20 to determine the intermediate image; determine whether the intermediate image meets the first preset condition; if not, update the configuration of the optical element 20 until the intermediate image meets the first preset condition.
[0100] Specifically, this may include: determining whether the intermediate image includes edge information based on changes in pixel channel values; if so, determining that the intermediate image satisfies a first preset condition regarding the contour. At this time, based on the configured optical element 20, the optical module 12 can generate a contour image and achieve contour encryption.
[0101] The change in pixel channel values at the edge positions in the intermediate image is greater than the preset change value.
[0102] Specifically, this may include: determining whether the blur value of the intermediate image is greater than a preset blur value, or determining whether the difference between the blur value of the intermediate image and the preset blur value meets a preset error condition; if so, then determining that the intermediate image meets the first preset condition for encryption. At this time, based on the configured optical element 20, the optical module 12 can generate a blurred image and achieve blurred encryption.
[0103] The optical element 20 can also be configured based on the optical system, configuration method, and identification method provided in Chinese Patent ZL202411555228.7. The optical element 20 can achieve encrypted imaging based on this configuration; specifically, the optical element 20 can achieve fuzzy encryption or contour encryption based on this configuration. In one embodiment, the optical element 20 can be trained, fixed, and implement encryption functions together with a related program (e.g., the first program in the Chinese patent).
[0104] Alternatively, the optical element 20 can also be configured based on the security system, configuration method, and security method provided in Chinese patent application 202412000216.4. In one embodiment, the optical element 20 itself can be used to implement the encryption function.
[0105] The photosensitive element 21 can be a photodetector array. Specifically, the photosensitive element 21 can be a CMOS image sensor (CIS), a CCD (charge-coupled device), an array of photodetectors, etc.
[0106] The configuration of the control unit 13 in some embodiments of this application will be described below.
[0107] The control unit 13 can be coupled to the functional component 11 by direct or indirect connection, or by electrical or communication connection.
[0108] The control unit 13 can be coupled to the photosensitive element 21 by direct or indirect connection, or by electrical or communication connection. For example, the control unit 13 can be connected to the photosensitive element 21 through one or more components.
[0109] The control unit 13 can be used to control the change of specific parameter indicators of the functional component 11 according to the first information; the first information can be determined based on the result of encrypted imaging.
[0110] In one embodiment, the first information is used to construct a response relationship between the encrypted imaging result and a specific parameter index of the functional component 11. The response relationship can be a unidirectional change relationship. For example, when the encrypted imaging result is used to indicate a certain characteristic parameter of a target object in a predetermined area, the control unit 13 controls the specific parameter index of the functional component 11 to increase when the characteristic parameter increases, or to decrease when the characteristic parameter decreases, based on the first information. Similarly, the established relationship can also be a reverse change relationship.
[0111] In some embodiments, regardless of whether the above-described response relationship is in the same direction or in the opposite direction, the response relationship can be established based on the first information obtained by the control unit 13, or it can be established entirely based on the electrical conduction effect between the components formed by the coupling.
[0112] Thus, the optical element 20 included in the optical module 12 images a predetermined area but not other areas, and this predetermined area is related to the interaction between the wearable device 100 and the user. Therefore, the imaging result of the optical module 12 will not contain too much other unnecessary information, reducing the pressure of information transmission and processing. Since the optical element 20 performs encrypted imaging, it not only further filters out unnecessary precise imaging results, but also fully protects the user's privacy. Even if information is leaked, malicious attackers will not be able to obtain other user information.
[0113] Compared to wearable devices that use millimeter-wave radar for sensing:
[0114] (1) In terms of imaging methods, millimeter-wave radar usually uses point cloud / reflection signals, which require frequency domain processing; while the technical solution provided in this application uses visual imaging, which is intuitive and adjustable.
[0115] (2) In terms of resolution, millimeter-wave radar has a low spatial resolution; while the technical solution provided in this application can preserve low-frequency textures by imaging from the optical module 12 to the control unit 13 in this end-to-end process.
[0116] (3) In terms of privacy protection, millimeter-wave radar is not visual in nature, but it can penetrate clothing and skin, and inevitably obtains privacy information; while the technical solution provided in this application can preserve the blurred outline of the encrypted image and hide sensitive privacy information.
[0117] (4) In terms of sensing range, millimeter-wave radar has strong penetration but it is difficult to distinguish specific user operations (such as fine hand shapes); while the technical solution provided in this application is sensitive to occlusion and has strong contour perception performance.
[0118] (5) In terms of trainability and compatibility with processing algorithms, the point cloud format of millimeter-wave radar needs to rely on a dedicated processing structure; while the technical solution provided in this application is compatible with CV (Computer Vision) model training and is more closely integrated.
[0119] (6) In terms of algorithm generality, millimeter-wave radar requires the design of radar-specific networks; while the technical solution provided in this application can reuse visual model frameworks (e.g., YOLO and ViT).
[0120] (7) In terms of hardware complexity, millimeter-wave radar requires antenna arrays and analog-to-digital converters, which have high hardware complexity; while the technical solution provided in this application relies entirely on the configuration of optical element 20, and the hardware structure is simple.
[0121] (8) In terms of space occupation, millimeter-wave radar requires the arrangement of antenna arrays, which restricts the layout of wearable devices; while the technical solution provided in this application has a simple structure and is easier to integrate with the housing 10.
[0122] In one embodiment, such as Figure 2 The wearable device 100 includes an image recognition processor 14.
[0123] Image recognition processor 14 is coupled to optical module 12. Image recognition processor 14 may be coupled to photosensitive element 21.
[0124] The control unit 13 can be coupled to the optical module 12 via the image recognition processor 14. The control unit 13 can also be coupled to the photosensitive element 21 via the image recognition processor 14.
[0125] The image recognition processor 14 may include a deep learning component 141. The deep learning component 141 may be coupled to the optical module 12. The deep learning component 141 may be coupled to the photosensitive element 21.
[0126] The deep learning component 141 is a processing component with a neural network model. The deep learning component 141 is used to identify the type of limb pose located in the predetermined region based on the encrypted imaging results of the optical module 12.
[0127] The limb pose may include the position of the limb within the predetermined area, and / or the posture of the limb within the predetermined area. The limb pose may be a gesture, etc.
[0128] The image recognition processor 14 may include an output module 142. The output module 142 is coupled to the deep learning component 141. The output module is also coupled to the control unit 13.
[0129] The output module 142 is used to generate first information based on the type of limb posture and the preset correspondence.
[0130] The first information may carry control information for the corresponding functional component 11, thereby controlling specific parameter indicators of the functional component 11.
[0131] The preset correspondence can be the relationship between the type of limb posture and the first information. In this way, after obtaining the type of limb posture, the output module 142 can determine the first information corresponding to the type of the current limb posture by querying the preset correspondence and send it to the control unit 13.
[0132] Control unit 13 is coupled to image recognition processor 14. Control unit 13 is coupled to output module 142.
[0133] The control unit 13 is used to control the functional component 11 according to the first information.
[0134] In some embodiments, the optical module 12 may include multiple optical elements.
[0135] In one embodiment, each optical element includes a metasurface to form a plurality of metasurface elements. The metasurfaces in the plurality of optical elements can be fabricated with the same or different parameters.
[0136] refer to Figure 3 (a) The optical module 12 may include one of the optical elements and one of the photosensitive elements. (See reference) Figure 3 (b) The optical module 12 may include n optical elements (e.g., the first optical element to the nth optical element) and one photosensitive element.
[0137] In some embodiments, such as Figures 4 to 7 As shown, the optical module 12 includes at least one of the aforementioned optical elements, at least one lens, and a photosensitive element. When the optical module 12 includes multiple optical elements and / or multiple lenses, the multiple optical elements may have the same or different parameters, and the multiple lenses may have the same or different parameters.
[0138] refer to Figure 4 (a) and Figure 4 (b) The optical module 12 includes one of the optical elements, a lens and a photosensitive element. Figure 4 In the optical module 12 shown in (a), the lens, the optical element and the photosensitive element are arranged sequentially along the direction of light propagation. Figure 4In the optical module 12 shown in (b), the optical element, the lens and the photosensitive element are arranged sequentially along the direction of light propagation.
[0139] refer to Figure 5 (a) to Figure 5 (c) The optical module 12 includes one optical element, m lenses (e.g., the first lens to the mth lens) and a photosensitive element. Figure 5 In the optical module 12 shown in (a), the m lenses, the optical elements and the photosensitive elements are arranged sequentially along the direction of light propagation. Figure 5 In the optical module 12 shown in (b), the optical element, the m lenses and the photosensitive element are arranged sequentially along the direction of light propagation. Figure 5 In the optical module 12 shown in (c), some of the m lenses, the optical element, another part of the m lenses, and the photosensitive element are arranged sequentially along the direction of light propagation.
[0140] refer to Figure 6 (a) to Figure 6 (c) The optical module 12 includes n optical elements (e.g., the first optical element to the nth optical element), a lens and a photosensitive element. Figure 6 In the optical module 12 shown in (a), the n optical elements, the lens and the photosensitive element are arranged sequentially along the direction of light propagation. Figure 6 In the optical module 12 shown in (b), the lens, the n optical elements and the photosensitive element are arranged sequentially along the direction of light propagation. Figure 6 In the optical module 12 shown in (c), some of the n optical elements, the lens, another part of the lens among the n optical elements, and the photosensitive element are arranged sequentially along the direction of light propagation.
[0141] refer to Figure 7 (a) to Figure 7 (g) The optical module 12 includes n optical elements (e.g., the first optical element to the nth optical element), m lenses (e.g., the first lens to the mth lens) and a photosensitive element. Figure 7 In the optical module 12 shown in (a), the m lenses, the n optical elements and the photosensitive elements are arranged sequentially along the direction of light propagation. Figure 7 In the optical module 12 shown in (b), the n optical elements, the m lenses and the photosensitive elements are arranged sequentially along the direction of light propagation. Figure 7 In the optical module 12 shown in (c), some of the m lenses, the n optical elements, another part of the m lenses, and the photosensitive element are arranged sequentially along the direction of light propagation. Figure 7In the optical module 12 shown in (d), the first part of the n optical elements, some of the m lenses, the second part of the n optical elements, another part of the m lenses, the third part of the n optical elements and the photosensitive element are arranged sequentially along the direction of light propagation. Figure 7 In the optical module 12 shown in (e), the first part of the m lenses, some of the n optical elements, the second part of the m lenses, another part of the n optical elements, the third part of the m lenses, and the photosensitive element are arranged sequentially along the direction of light propagation. Figure 7 In the optical module 12 shown in (f), the first part of the n optical elements, the first part of the m lenses, the second part of the m lenses, the second part of the n optical elements, the third part of the n optical elements, the third part of the m lenses, and the photosensitive element are arranged sequentially along the direction of light propagation. Figure 7 In the optical module 12 shown in (g), the first part of the m lenses, the first part of the n optical elements, the second part of the m lenses, the second part of the n optical elements, the third part of the m lenses, the third part of the n optical elements, and the photosensitive element are arranged sequentially along the direction of light propagation.
[0142] In some embodiments, the optical element and the photosensitive element in the above embodiments can be independently separated or integrally disposed. When integrally disposed, the optical element and the photosensitive element can be combined by means of thermal bonding, plasma bonding, adhesive bonding, etc.; or, the optical element and the photosensitive element can be integrated into one by directly fabricating a metasurface on the photosensitive element. For example, firstly, an optical film layer is formed on the light-receiving surface of a semiconductor substrate, and then the optical film layer is etched into a metasurface by photolithography.
[0143] In some embodiments, the two or more optical elements described in the above embodiments can be independently separated or integrally disposed. When integrally disposed, the two or more optical elements can be combined by means of thermal bonding, plasma bonding, adhesive bonding, etc.; or, another metasurface can be directly prepared on the substrate side or the element side of the optical element. For example, firstly, an optical film layer is formed on the substrate side or the nanostructure side of the optical element, and then the optical film layer is etched into another metasurface by photolithography.
[0144] In some embodiments, when the optical element and the photosensitive element are independently and separately disposed, the optical module 12 may further include a dielectric layer located between the optical element and the photosensitive element. The material of the dielectric layer may be any material with a low refractive index and absorption coefficient in the visible or near-infrared band, such as: silicon dioxide (SiO2), spin-coated glass (SOG), or polymers such as polymethyl methacrylate (PMMA), polydimethylsiloxane (PDMS), polymethylpentene (PMP), and combinations thereof.
[0145] In one embodiment, the optical element 20 may be a refractive optical element. In another embodiment, the optical module 12 may include a refractive optical element. The refractive optical element may include, but is not limited to, lenses or prisms made of materials such as optical glass, optical plastics, and optical crystals.
[0146] In one embodiment, optical element 20 may be a diffractive optical element. In another embodiment, optical module 12 may include a diffractive optical element. Diffractive optical elements may include, but are not limited to, two-step or multi-step diffractive optical elements, gratings, Dammann gratings, metasurfaces, holograms, diffusers, phase masks, intensity masks, spatial light modulators, etc.
[0147] In one embodiment, the optical element 20 may be a scattering medium element. In another embodiment, the optical module 12 may include a scattering medium element. The scattering medium element may include, but is not limited to, frosted glass.
[0148] When configuring the optical module 12, at least one of the following can be included: for the optical module 12, parameters such as the combination method of the optical elements 20 and the spacing of each optical element 20 can be configured; for the metasurface, parameters such as the arrangement period, material, shape, size, and position coordinates of its nanostructures can be configured; for the refractive optical element, parameters such as refractive index and radius of curvature can be configured; for the diffractive optical element, parameters such as its focal length characteristics, phase function of the diffraction surface, radial radius at the abrupt change of each ring zone of the diffraction surface, ring zone depth of the diffraction surface, and diffraction efficiency can be configured.
[0149] Figure 8 A side view of the optical module 12 and control unit 13 of this application is shown, wherein the optical module 12 is cut out to show the overall structure of the optical module 12.
[0150] In one embodiment, a light-shielding layer 31 is disposed on the surface of the optical module 12.
[0151] The light-shielding layer 31 can be used to prevent external ambient light from affecting the transmission of incident light within the optical module 12; in particular, it can be used to prevent ambient light from affecting the optical element 20 to achieve its function of participating in encrypted imaging.
[0152] In one embodiment, the light-shielding layer 31 is formed of light-blocking ink.
[0153] In one embodiment, the light-shielding layer 31 is formed by spraying light-blocking ink onto the surface of the optical module 12.
[0154] In one specific embodiment, the light-shielding layer 31 can be formed by spraying on the outside of the non-working area of the optical module 12 using ultra-precision spraying technology.
[0155] In one embodiment, the light-shielding layer 31 is formed as an ultra-thin, high-density light-shielding film. The light-shielding layer 31 can have a thickness of any value from 10 μm to 50 μm. This helps to achieve a high degree of integration and miniaturization of the optical module 12.
[0156] like Figures 8 to 10 As shown, in one embodiment, the optical module 12 includes a first optical element 201. The first optical element 201 may be a metasurface element.
[0157] The first optical element 201 can be used to converge incident light from a predetermined region. A nanostructure unit is disposed at least on either the light-incident side or the light-outceasing side of the first optical element 201. The nanostructure unit is used to form a metasurface. In other embodiments, the first optical element 201 may also be composed of a refractive lens group.
[0158] In one embodiment, the optical module 12 includes a second optical element 202. The second optical element 202 includes a metasurface formed from grating structure units.
[0159] The second optical element 202 can be used to receive incident light and generate polarized light signals. A grating structure unit is provided at least at one of the light-incident or light-outceasing sides of the second optical element 202. The grating structure unit is used to form a metasurface. In other embodiments, the second optical element 202 may also be composed of other polarizing optical elements.
[0160] Optical element 20 includes a metasurface, and may be either a first optical element 201 or a second optical element 202, at least one of which includes a metasurface.
[0161] In one embodiment, the first optical element 201 includes a metasurface, and the second optical element 202 may be composed of at least one of a refractive optical element, a diffractive optical element, or a scattering medium element.
[0162] In one embodiment, the second optical element 202 includes a metasurface, and the first optical element 201 may be composed of at least one of a refractive optical element, a diffractive optical element, or a scattering medium element.
[0163] The configuration of the optical module 12 can also be configured with reference to Chinese patent application No. 202510819541.5. The metasurface formed by the grating structure unit can be configured with reference to Chinese patent applications Nos. 202311139934.9, 202311140629.1 and 202311139940.4.
[0164] In one embodiment, the second optical element 202 is disposed between the first optical element 201 and the photosensitive element 21. When the two optical elements are configured according to the aforementioned embodiment, the first optical element 201 can effectively converge external incident light for modulation by the optical module 12 to facilitate miniaturization, and the second optical element 202 can modulate the light signal output by the first optical element 201 to achieve optical encryption in a predetermined area.
[0165] In one embodiment, combined with Figure 1 and Figure 11 As shown, the first optical element 201 is disposed close to the surface of the housing 10. This facilitates the first optical element 201 to focus the incident light from the outside of the housing 10 and propagate it to other optical elements 20 in the optical module 12 for processing.
[0166] The housing 10 surrounds and forms a cavity, in which the photosensitive element 21 is disposed. This protects the photosensitive element 21, which performs photoelectric conversion, from external impacts or dust.
[0167] When the second optical element 202 is disposed between the first optical element 201 and the photosensitive element 21, the second optical element 202 can also be disposed within the cavity. Figure 8 As shown, in the optical module 12, the side of the first optical element 21 can be close to the housing 10, and the side of the photosensitive element 21 can be close to the housing 10.
[0168] The first optical element 201 may be fixed to the housing 10. The first optical element 201 may be at least partially exposed outside the housing 10.
[0169] The optical module 12 may include a filter 121. The filter 121 can be used to filter out optical signals other than the target wavelength.
[0170] The optical module 12 may include an aperture 122. The aperture 122 can be used to limit the beam interface, which is beneficial for the photosensitive element 21 to process the optical signal.
[0171] The filter 121 and the aperture 122 can be integrated or set separately.
[0172] The filter 121 can be disposed between the optical element 20 (e.g., the first optical element 201, the second optical element 202) and the photosensitive element 21. The aperture 122 can be disposed between the optical element 20 and the photosensitive element 21.
[0173] In one embodiment, the wearable device 100 further includes a substrate 30.
[0174] Optical or electronic components in the wearable device 100 can be disposed on the substrate 30 to achieve relative fixation of their positions. In other words, the substrate 30 can be used to support the optical or electronic components constituting the wearable device 100.
[0175] The photosensitive element 21 can be disposed on the first surface 301 of the substrate 30. When other electronic components are disposed on the substrate 30, the photosensitive element 21 can be electrically or communicatively connected to the other electronic components.
[0176] The optical element 20 can be disposed on the side of the photosensitive element 21 away from the substrate 30. In this way, the optical element 20 protrudes relative to the first surface 301 of the substrate 30, thereby better receiving the input light signal.
[0177] When the optical module 12 also includes a filter 121 and an aperture 122, a first optical element 201, a second optical element 202, a filter 121, an aperture 122 and a photosensitive element 21 can be sequentially arranged from the direction close to the first surface 301.
[0178] In one embodiment, the substrate 30 is a flexible circuit board. This facilitates the arrangement of components to fit the shape of wearable devices.
[0179] In one embodiment, the wearable device 100 includes a reinforcing plate 34. This prevents the optical module 12 and the photosensitive element 21 from deforming or losing function due to interference.
[0180] The reinforcing plate 34 can be disposed on the second surface 302 of the substrate 30. Specifically, the reinforcing plate 34 can be disposed on the second surface 302 at a position corresponding to the photosensitive element 21.
[0181] The first surface 301 and the second surface 302 can be two opposing surfaces on the substrate 30.
[0182] Thus, the reinforcing plate 34 can effectively prevent interference from the second surface 302 side and protect the optical module 12, the photosensitive element 21 and the substrate 30 itself from damage.
[0183] In one embodiment, the wearable device 100 includes a light source 32.
[0184] The light source 32 can be used to provide illumination for the imaging process of the optical module 12. The light source 32 can be positioned close to the optical module 12.
[0185] The light source 32 can be disposed on the first surface 301. The light source 32 and the optical module 12 can be located on the same side of the substrate 30.
[0186] In one embodiment, the wearable device 100 includes a heat sink 33.
[0187] The heat sink 33 can be disposed on the second surface 302 of the substrate 30. Specifically, the heat sink 33 can be disposed on the second surface 302 at a position corresponding to the light source 32.
[0188] The first surface 301 and the second surface 302 can be two opposing surfaces on the substrate 30.
[0189] In this way, the heat sink 33 can effectively dissipate the heat generated by the light source 32 when it is working, thereby ensuring the normal operation of the light source 32 and other nearby components.
[0190] The substrate 30 can be formed into a T-shaped plate or a J-shaped plate. In one embodiment, the J-shaped plate is as follows: Figure 9 and Figure 10 As shown; in one embodiment, the T-shaped plate can be a J-shaped plate substrate, the shape after removing the portion used to fix the light source 32 and the heat sink 33.
[0191] In one embodiment, the functional component 11 may also be disposed on the substrate 30. Specifically, the functional component 11 may be disposed on the substrate 30 at a position away from the optical module 12. Figure 11 In the embodiment shown, when the functional component 11 and the optical module 12 are fixed in the housing 10 by the substrate 30, the functional component 11 can be disposed in the sound-emitting cavity formed by the housing 10 surrounding one end of the wearable device 100; the optical module 12 can be disposed in the handle at the other end of the wearable device 100.
[0192] In one embodiment, circuit wiring can be performed at the substrate 30. Specifically, the electrical or communication connections between the functional component 11 and the optical module 12, between the functional component 11 and the control unit 13, and between the optical module 12 and the control unit 13 can be achieved through circuit wiring in the substrate 30.
[0193] In one embodiment, the wearable device 100 further includes an image recognition processor. The image recognition processor may be integrated with the control unit 13.
[0194] In one embodiment, when the result of the encrypted imaging matches a predetermined trigger event, the control unit 13 obtains the first information and controls the change of a specific parameter index of the control function component 11.
[0195] In some embodiments, the image recognition processor may determine whether the result of the encrypted imaging conforms to a predetermined trigger event.
[0196] The results of encrypted imaging can be in the form of images or parameters, and the predetermined triggering events are characterized by image conditions or parameter conditions.
[0197] The results of encrypted imaging can be used to indicate the current state of a target object within a predetermined area. When the result in image form meets the corresponding image conditions, the current state matches a predetermined trigger event, and the control unit 13 obtains first information for controlling the change of specific parameter indicators of the functional component 11. When the result in parameter form meets the corresponding parameter conditions, the current state matches a predetermined trigger event, and the control unit 13 obtains first information for controlling the change of specific parameter indicators of the functional component 11.
[0198] In some embodiments, when the result of the encrypted imaging meets a predetermined trigger event, the control unit 13 controls the specific parameter index of the functional component 11 to be enhanced or its value increased according to the first information. For example, when the result of the encrypted imaging meets the predetermined trigger event, the volume of the sound wave signal output by the functional component 11 is increased; as another example, the brightness of the light signal output by the functional component 11 is increased; as yet another example, the volume data indicated by the image information contained in the light signal output by the functional component 11 is increased.
[0199] In one embodiment, the optical element 20 performs encrypted imaging of the user's limbs located in the predetermined area.
[0200] The optical element 20 can perform encrypted imaging of the user's limbs, which can always remain within the predetermined area, or enter the predetermined area under specific circumstances.
[0201] The optical element 20 can continuously perform encrypted imaging of a predetermined area. During this time, any limb of the user located within the predetermined area, whether it is a limb that is always within the predetermined area or a limb that enters the predetermined area under specific circumstances, can be imaged in a timely manner. The optical element 20 can also perform encrypted imaging only when any limb of the user or a designated limb of the user is present in the predetermined area.
[0202] The optical element 20 can perform encrypted imaging of at least the user's limbs within a predetermined area, but it can also perform encrypted imaging of the entire predetermined area.
[0203] The user's limbs include, but are not limited to, arms and legs, and may also include feet, hands, head, or even specific facial features. In some embodiments, the optical element 20 is used to perform encrypted imaging of fingers located in or entering a predetermined area.
[0204] In one embodiment, the control unit 13 is coupled to the functional component 11 and the optical module 12 to achieve the effect of controlling specific parameter indicators of the functional component 11 according to the position of the limb.
[0205] Combination Figure 12 As shown, in some embodiments, when the position of a user's limb in the predetermined area matches a predetermined trigger event, a specific parameter of the functional component 11 changes. For example, when the position of the limb matches a predetermined position, the specific parameter of the functional component 11 changes. Specifically, for example, when the position of the limb matches a first predetermined position, the specific parameter of the functional component 11 increases; when the position of the limb matches a second predetermined position, the specific parameter of the functional component 11 decreases.
[0206] For example, when a finger is located in a predetermined area, the optical element 20 performs encrypted imaging of the finger. If it is determined that the finger is located in the upper half of the predetermined area, the volume of the sound wave signal or the brightness of the light signal output by the functional component 11 increases; if it is determined that the finger is located in the lower half of the predetermined area, the volume of the sound wave signal or the brightness of the light signal output by the functional component 11 decreases.
[0207] In one embodiment, the control unit 13 is coupled to the functional component 11 and the optical module 12 to achieve the effect of controlling specific parameter indicators of the functional component 11 according to the posture of the limb.
[0208] Combination Figure 12 As shown, in some embodiments, when the posture of a user's limb in a predetermined area conforms to a predetermined trigger event, a specific parameter of functional component 11 changes. For example, when the posture of the limb conforms to a predetermined posture, the specific parameter of functional component 11 changes. Specifically, for example, when the posture of the limb conforms to a first predetermined posture, the specific parameter of functional component 11 increases; when the posture of the limb conforms to a second predetermined posture, the specific parameter of functional component 11 decreases.
[0209] For example, when a finger is located in a predetermined area, the optical element 20 performs encrypted imaging of the finger. If it is determined that the finger has a posture pointing from the lower half of the predetermined area to the upper half, the volume of the acoustic signal output by the functional component 11 increases or the brightness of the optical signal increases; if it is determined that the finger has a posture pointing from the upper half of the predetermined area to the lower half, the volume of the acoustic signal output by the functional component 11 decreases or the brightness of the optical signal decreases.
[0210] In one embodiment, the control unit 13 is coupled to the functional component 11 and the optical module 12 to achieve the effect of specific parameter indicators of the motion control functional component 11 of the limb.
[0211] Combination Figure 12 As shown, in some embodiments, when the movement of a user's limb in a predetermined area conforms to a predetermined trigger event, a specific parameter of the functional component 11 changes. For example, when the movement of the limb conforms to a predetermined trajectory, speed, direction, or travel length, the specific parameter of the functional component 11 changes. Specifically, for example, when the movement of the limb conforms to a first predetermined trajectory, the specific parameter of the functional component 11 increases; when the movement of the limb conforms to a second predetermined trajectory, the specific parameter of the functional component 11 decreases.
[0212] For example, when a finger is located in a predetermined area, the optical element 20 performs encrypted imaging of the finger. If it is determined that the finger has a movement trajectory from the lower half to the upper half of the predetermined area, the volume of the sound wave signal output by the functional component 11 increases or the brightness of the light signal increases; if it is determined that the finger has a movement trajectory from the upper half to the lower half of the predetermined area, the volume of the sound wave signal output by the functional component 11 decreases or the brightness of the light signal decreases.
[0213] In some embodiments, the wearable device 100 supports controlling the volume increase or decrease, or controlling the output or stop of the sound wave signal by waving the user's hand in front of their ear. In this case, the predetermined area of the optical element 20 can be in front of the user's ear, and the predetermined trigger event can be set to the movement of the user's hand within the predetermined area. Specifically, for example, when the encrypted imaging result shows that the user's hand moves from bottom to top or from right to left within the predetermined area, the volume of the sound wave signal output by the functional component 11 increases; when the hand moves from top to bottom or from left to right within the predetermined area, the volume of the sound wave signal output by the functional component 11 decreases.
[0214] In some embodiments, the wearable device 100 supports the user's gripping in front of their ear to control the volume increase or decrease, or to control the output or stop of the sound wave signal. In this case, the predetermined area of the optical element 20 can be in front of the user's ear, and the predetermined trigger event can be set to the posture of the user's hand within the predetermined area. Specifically, for example, when the encrypted imaging result shows that the user's hand is clenched in the predetermined area, the functional component 11 stops outputting the sound wave signal; when the hand is open in the predetermined area, the functional component 11 starts outputting the sound wave signal.
[0215] The image recognition processor and optical module 12 are coupled together, and can recognize discrete gesture types as well as continuous gesture trajectories. In some specific embodiments, the volume curve of the sound wave signal that the functional component 11 should output can be determined based on the hand movement trajectory (e.g., including trajectory length, speed, and direction).
[0216] In some embodiments, the rate of change of the volume of the sound wave signal can be controlled according to the speed and rhythm of the hand movements. In some specific embodiments, when rapid hand movements are detected, the volume is controlled to change significantly; conversely, when slow hand movements are detected, the volume is controlled to change slightly.
[0217] In this application, some embodiments use the hand as an example for illustration. This is not intended to limit the application scenarios of the wearable device 100 or the target object imaged by the optical element 20, but merely to represent a feasible implementation scenario. The hand and fingers can naturally be replaced with other limbs of the user or other objects outside the user's limbs.
[0218] Specifically, in some embodiments of the wearable device 100 provided in any embodiment of this application, the result of the encrypted imaging includes a blurred image of the user's limbs located in the predetermined area.
[0219] In one embodiment, a blurred image can be obtained by configuring the optical element 20. The configuration scheme of the optical element 20 can be implemented according to any of the technical solutions mentioned in this application.
[0220] In one embodiment, the position, posture, or movement of a limb can be determined based on a blurred image, and specific parameter indicators of the functional component 11 change according to the determined position, posture, or movement information of the limb. This process can be implemented by the image recognition processor and the control unit 13; for example, the image recognition processor obtains a blurred image from the optical module 12, determines at least one of the position, posture, or movement information of the limb based on the blurred image, determines whether the information matches a predetermined trigger event, and generates first information if it does, the control unit 13 obtains the first information, and controls the change of specific parameter indicators of the functional component 11.
[0221] In some embodiments, the result of the encrypted imaging includes a contour image of a user's limb located in the predetermined area.
[0222] In one embodiment, an optical element 20 can be configured to obtain a contour image. The configuration of the optical element 20 can be implemented according to any of the technical solutions mentioned in this application.
[0223] In one embodiment, the position, posture, or movement of a limb can be determined based on a contour image, and specific parameter indicators of the functional component 11 change according to the determined position, posture, or movement information of the limb. This process can be implemented by the image recognition processor and the control unit 13; for example, the image recognition processor obtains a contour image from the optical module 12, determines at least one of the position, posture, or movement information of the limb based on the contour image, determines whether the information matches a predetermined trigger event, and generates first information when it does. The control unit 13 obtains the first information and controls the change of specific parameter indicators of the functional component 11.
[0224] When the wearable device 100 is used with a user, it can be located on various parts of the user's body. For example, it can be located on the head, face, ears, mouth, neck, shoulders, chest, arms, wrists, palms, fingers, waist, hips, legs, ankles, feet, and toes. Depending on the part of the wearable device 100 it is used with, the orientation of the functional components 11 and the optical elements 20 will also change. For a wearable device 100 that can be used interchangeably with multiple parts of the user's body, different parts and orientations will result in different supported functions.
[0225] like Figure 11 and Figure 12 As shown, the wearable device 100 can be configured to fit the shape of the ear; in one specific embodiment, the wearable device 100 can be shaped like headphones and worn on the user's ear.
[0226] In one embodiment, the predetermined region is located in the normal direction of the optical element 20. The normal may be a reference line perpendicular to the surface of the optical element 20.
[0227] In one embodiment, the predetermined region is located in a specified deflection angle direction relative to the normal direction of the optical element 20. The deflection angle direction can be a direction having a specified deflection angle relative to the normal direction.
[0228] In one embodiment, when the wearable device 100 is used with a user, a first direction D1 can be defined as the orientation of the user's face; a second direction D2 can be defined as the direction from the part of the user wearing the wearable device 100 towards the wearable device 100. Of course, this definition is not limited to the scenario where the wearable device 100 is used with the user's ear; this definition of direction can also be applied to scenarios where the wearable device 100 is used with other parts of the user's body.
[0229] In one embodiment, when the wearable device 100 is used in conjunction with a user, the predetermined area is located in a first direction D1 of the wearable device 100. The first direction D1 of the wearable device 100 may be the normal direction of the optical element 20.
[0230] When the face orientation is defined as forward, the predetermined area can be located in front of the wearable device 100. The user can change specific parameter indicators of the functional component 11 by performing gestures in front of the wearable device 100.
[0231] In one embodiment, when the wearable device 100 is engaged with a user, the predetermined area is located in a first direction D1 of the user. The first direction D1 of the user may be the normal direction of the optical element 20.
[0232] When the face orientation is defined as forward, the predetermined area can be located in front of the user. The user can change specific parameter indicators of functional component 11 by performing gestures in front of their body.
[0233] In one embodiment, when the wearable device 100 is used in conjunction with a user, the predetermined area is located in a second direction D2 of the wearable device 100. The second direction D2 of the wearable device 100 may be the normal direction of the optical element 20.
[0234] When the wearable device 100 is located on the right side of the user's body, the first direction D2 can be defined as right, and the predetermined area can be located on the right side of the wearable device 100. The user can change specific parameter indicators of the functional component 11 by performing gestures on the right side of the wearable device 100.
[0235] In one embodiment, when the wearable device 100 is engaged with a user, the predetermined area is located in a second direction D2 of the user. The second direction D2 of the user may be the normal direction of the optical element 20.
[0236] When the second direction D2 is defined as right, the predetermined area can be located to the right of the user. The user can change specific parameter indicators of the functional component 11 by performing gestures on the right side of their body.
[0237] In one embodiment, the predetermined area covers an area 5cm to 150cm away from the optical element 20.
[0238] The optical module 12 is used to detect a range of 5 cm to 150 cm relative to the optical element 20; in some embodiments, this range of distances may be distributed in the normal direction of the optical element 20, which may be defined as the detection depth direction of the optical module 12; in this case, the detection depth range of the optical module 12 may be 5 cm to 150 cm.
[0239] In one embodiment, the detection depth direction of the optical module 12 can be a first direction D1, and the plane containing the predetermined area can be perpendicular to the first direction D1; any plane perpendicular to the first direction D1 that is 5cm to 150cm away from the wearable device 100 on the first direction D1 can be the predetermined area.
[0240] In one embodiment, the detection depth direction of the optical module 12 can be the second direction D2, and the plane containing the predetermined area can be perpendicular to the second direction D2; any plane perpendicular to the second direction D2 that is 5cm to 150cm away from the wearable device 100 on the second direction D2 can be the predetermined area.
[0241] Continue as Figure 12 As shown, in one embodiment, the horizontal field of view of the optical module 12 is greater than or equal to 90 degrees. For example, the field of view of the optical module 12 in the third direction D3 and its opposite direction is greater than or equal to 90 degrees.
[0242] In one specific embodiment, the angle between the imaging optical axis of the optical module 12 and its limiting imaging direction along the third direction D3 is greater than or equal to 45 degrees; the angle between the imaging optical axis of the optical module 12 and its limiting imaging direction in the opposite direction along the third direction D3 is also greater than or equal to 45 degrees. The direction of the imaging optical axis of the optical module 12 can be the normal direction of the optical element 20.
[0243] In one embodiment, the vertical field of view of the optical module 12 is greater than or equal to 60 degrees. For example, the field of view of the optical module 12 in the fourth direction D4 and its opposite direction is greater than or equal to 60 degrees.
[0244] In one specific embodiment, the angle between the imaging optical axis of the optical module 12 and its limiting imaging direction along the fourth direction D4 is greater than or equal to 30 degrees; the angle between the imaging optical axis of the optical module 12 and its limiting imaging direction in the opposite direction along the fourth direction D4 is greater than or equal to 45 degrees. The direction of the imaging optical axis of the optical module 12 can be the normal direction of the optical element 20.
[0245] In one embodiment, the optical module 12 simultaneously meets the above two field-of-view settings. The third direction D3 can be perpendicular to the fourth direction D4.
[0246] The aforementioned field of view setting determines the size and range of the predetermined area imaged by the optical element 20. Based on this, the optical module 12 can set the field of view according to the size and range of the predetermined area that the wearable device 100 needs to detect.
[0247] In one embodiment, when the wearable device 100 is engaged with a user and the user is standing vertically, the third direction D3 can be horizontal.
[0248] In one embodiment, when the wearable device 100 is engaged with a user and the user is standing vertically, the fourth direction D4 can be the vertical direction.
[0249] By controlling the field of view in at least two directions and adjusting the size and extent of the predetermined area, the imaging range can be precisely limited to avoid privacy leaks, thus forming a dual privacy protection with encrypted imaging.
[0250] In one embodiment, the imaging frame rate of the optical module 12 is 30 FPS (Frames Per Second).
[0251] The frame rate may be the image acquisition frame rate of the optical module 12, the processing frame rate of the image recognition processor, and / or the processing frame rate of the control unit 13.
[0252] The imaging of the optical module 12 is set to a high frame rate, which can support the recognition of continuous motion information and avoid the omission of motion information; and in specific scenarios, it can also enable the wearable device 100 to support the fitting of gesture trajectories.
[0253] In one embodiment, the delay time of the control unit 13 is less than 50ms.
[0254] In one embodiment, the image recognition processor has a latency of less than 50ms.
[0255] The delay time can be the delay time from the start of image acquisition by the optical module 12 to the output of the encrypted imaging result.
[0256] Based on the low latency configuration, the image recognition processor and / or control unit 13 can be equipped with a lightweight processing model or set up a parallel processing architecture.
[0257] By setting high frame rate and low latency, smooth control of functional component 11 can be achieved, improving the human-computer interaction experience.
[0258] In one embodiment, the overall power consumption of the wearable device 100 is less than 200mW.
[0259] In one specific embodiment, the peak power consumption of the wearable device 100 may be less than 200mW.
[0260] The low-power configuration can be achieved by using optical elements 20 containing metasurfaces to replace complex lens groups, thereby reducing optical path loss.
[0261] Based on the low power consumption configuration requirement, the optical module 12 can perform encrypted imaging using visible light during the day and encrypted imaging using infrared light at night; thus, dual-band operation is achieved.
[0262] In addition to the light source 32, the optical module 12 may also include an environmental sensor for determining whether it is daytime or nighttime. In some embodiments, the time of daytime or nighttime may also be determined by timing.
[0263] earphone
[0264] One embodiment of this application provides an earphone 100A, such as... Figures 11 to 13 As shown.
[0265] The earphone 100A can be considered as a separate technical solution from the aforementioned wearable device 100, or it can be considered as a specific / unique technical solution belonging to the wearable device 100. When the earphone 100A is considered as a type of wearable device 100, the aforementioned technical solutions for wearable device 100 also apply to the earphone 100A, and will not be repeated hereafter.
[0266] The earphone 100A includes a housing 10.
[0267] The housing 10 has an appearance that conforms to the user's ear or covers the user's ear.
[0268] The headphone 100A includes a sound-generating unit 11A. The sound-generating unit 11A is disposed in the housing 10. The sound-generating unit 11A is used to convert electrical signals into mechanical signals to generate sound wave signals.
[0269] The sound-generating unit 11A can be considered as one of the aforementioned functional components 11.
[0270] When a user wears the headphones 100A, the sound unit 11A can be at least partially exposed outside the housing 10 and can be facing the user.
[0271] The sound-generating unit 11A can be a moving coil unit. Specifically, it may include: a diaphragm, a voice coil, a permanent magnet, a magnetic plate or magnetic circuit, a front cover, and a rear cavity.
[0272] The sound-generating unit 11A can be a balanced armature unit. Specifically, it may include: a balance armature, a drive rod, a diaphragm, and a housing.
[0273] The sound-generating unit 11A can be a planar magnet unit. Specifically, it can include a planar diaphragm and a magnet array. During operation, current flows through the entire planar diaphragm, which experiences a force in a uniform magnetic field, generating a large-area piston motion. The resulting sound wave signal is clear, has low distortion, and good transient response.
[0274] The sound-generating unit 11A can be an electrostatic unit. Specifically, it may include: an ultra-thin diaphragm and a bias voltage. During operation, audio signals are applied to the two stator plates with opposite phases, causing the electrostatic force to pull the diaphragm to produce sound. The resulting sound wave signal is extremely delicate and transparent.
[0275] The earphone 100A includes an optical module 12. The optical module 12 is disposed within the housing 10. The optical module 12 includes an optical element 20. The optical element 20 is used for encrypted imaging of a predetermined area. The optical module 12 includes a photosensitive element. The photosensitive element is used to receive light signals from the optical element and convert them into electrical signals.
[0276] When the wearable device 100 is used in conjunction with a user, the optical element 20 may be oriented toward the predetermined area. The orientation of the optical element 20 may be the normal direction of the optical element 20.
[0277] The optical module 12 and optical element 20 can be configured as in any of the foregoing embodiments.
[0278] The earphone 100A includes a control unit 13. The control unit 13 is coupled to the sound-emitting unit 11A and the optical module 12 (specifically, it may be coupled to the photosensitive element). The control unit 12 can be used to control the volume of the sound wave signal output by the sound-emitting unit 11A based on the result of encrypted imaging (specifically, based on first information).
[0279] In one embodiment, the volume change of the sound wave signal output by the sound unit 11A when the result of the encrypted imaging matches a predetermined trigger event.
[0280] In one embodiment, the earphone 100A is an in-ear type; such as Figure 11 and Figure 12 As shown.
[0281] In one embodiment, the earphone 100A is a semi-in-ear type.
[0282] In one embodiment, the earphone 100A is an over-ear type; such as Figure 13 As shown.
[0283] In one embodiment, the earphone 100A is an ear-hook type.
[0284] In one embodiment, the earphone 100A is a neckband type.
[0285] The shell 10 of the earphone 100A can be determined in terms of its appearance based on the above selection of the earphone 100A.
[0286] In addition, the headset 100A may also include a cable, a microphone or in-line control module, a plug or contacts. When the headset 100A is configured as a wireless headset, it may also include components such as a Bluetooth module, an antenna, a battery, a noise cancellation system, a touch sensor, an accelerometer or gyroscope.
[0287] To ensure the stability of the earphone 100A when worn, the earphone 100A housing 10 may also include mechanical structures such as headband, ear hooks, and ear tips; to ensure sound quality, the earphone 100A may also include acoustic damping materials, such as various meshes, foams, and fiber materials filled in specific locations within the cavity; the earphone 100A may also include a mesh or dustproof mesh, especially covering the sound outlet near the sound-generating unit 11A, to prevent foreign objects from entering and damaging the diaphragm or other structures.
[0288] In one embodiment, the optical element 20 performs encrypted imaging of the user's hand located in the predetermined area.
[0289] The optical element 20 can be configured to face the user's hand area under normal conditions, or it can be configured to face other areas under normal conditions, but the user's hand enters the predetermined area under specific circumstances.
[0290] In one embodiment, the control unit 13 is coupled to the sound-emitting unit 11A and the optical module 12 to control the volume of the sound wave signal output by the sound-emitting unit 11A according to the position of the palm (specifically, according to first information).
[0291] For example, the earphone 100A also includes an image recognition processor, which determines first information based on the position of the palm and sends it to the control unit 13.
[0292] For example, when the palm is located in the upper half of the predetermined area, the palm position information contained in the encrypted imaging result is considered to match a predetermined trigger event, and the volume of the sound wave signal output by the sound unit 11A increases. Conversely, when the palm is located in the lower half of the predetermined area, the volume of the sound wave signal output by the sound unit 11A decreases.
[0293] In one embodiment, the control unit 13 is coupled to the sound-generating unit 11A and the optical module 12 to control the volume of the sound wave signal output by the sound-generating unit 11A according to the position of the finger (specifically, according to first information).
[0294] For example, the earphone 100A also includes an image recognition processor, which determines first information based on the position of the finger and sends it to the control unit 13.
[0295] For example, when the fingertip is located in the upper half of the predetermined area, the finger position information contained in the encrypted imaging result is considered to match a predetermined trigger event, and the volume of the sound wave signal output by the sound-emitting unit 11A increases. Conversely, when the fingertip is located in the lower half of the predetermined area, the volume of the sound wave signal output by the sound-emitting unit 11A decreases.
[0296] In one embodiment, the control unit 13 is coupled to the sound-emitting unit 11A and the optical module 12 to control the volume of the sound wave signal output by the sound-emitting unit 11A according to the posture of the hand (specifically, according to first information).
[0297] For example, the earphone 100A also includes an image recognition processor that determines first information based on the posture of the hand and sends it to the control unit 13.
[0298] For example, when the palm is facing upwards, it is assumed that the palm posture information contained in the encrypted imaging result matches a predetermined trigger event, and the volume of the sound wave signal output by the sound unit 11A increases. Conversely, when the palm is facing downwards, the volume of the sound wave signal output by the sound unit 11A decreases.
[0299] In one embodiment, the control unit 13 is coupled to the sound-generating unit 11A and the optical module 12 to control the volume of the sound wave signal output by the sound-generating unit 11A according to the posture of the finger (specifically, according to first information).
[0300] For example, the earphone 100A also includes an image recognition processor, which determines first information based on the posture of the finger and sends it to the control unit 13.
[0301] For example, when a finger points upwards, the finger posture information contained in the encrypted imaging result is considered to match a predetermined trigger event, and the volume of the sound wave signal output by the sound-emitting unit 11A increases. Conversely, when a finger points downwards, the volume of the sound wave signal output by the sound-emitting unit 11A decreases.
[0302] In one embodiment, the control unit 13 is coupled to the sound-emitting unit 11A and the optical module 12 to control the volume of the sound wave signal output by the sound-emitting unit 11A according to the movement of the palm (specifically, according to first information).
[0303] For example, the earphone 100A also includes an image recognition processor that determines first information based on the movement of the hand and sends it to the control unit 13.
[0304] For example, when the palm is waved upwards, the palm movement information contained in the encrypted imaging result is considered to match a predetermined trigger event, and the volume of the sound wave signal output by the sound-emitting unit 11A increases. Conversely, when the palm is waved downwards, the volume of the sound wave signal output by the sound-emitting unit 11A decreases.
[0305] In one embodiment, the control unit 13 is coupled to the sound-generating unit 11A and the optical module 12 to control the volume of the sound wave signal output by the sound-generating unit 11A according to the movement of the finger (specifically, according to the first information).
[0306] For example, the earphone 100A also includes an image recognition processor that determines first information based on the movement of the finger and sends it to the control unit 13.
[0307] For example, when a finger is shaken upwards, the finger movement information contained in the encrypted imaging result is considered to match a predetermined trigger event, and the volume of the sound wave signal output by the sound-emitting unit 11A increases. Conversely, when a finger is shaken downwards, the volume of the sound wave signal output by the sound-emitting unit 11A decreases.
[0308] The result of encrypted imaging is not necessarily a single gesture information. The volume of the sound wave signal can be changed only when the hand meets multiple preset events. For example, when the finger points upward and shakes upward, the result of encrypted imaging meets the predetermined trigger event, and the volume of the sound wave signal output by the sound unit 11A increases.
[0309] Specifically, in some embodiments of the earphone 100A provided in any embodiment of this application, the result of the encrypted imaging includes a blurred image of the user's hand located in the predetermined area.
[0310] The technical solutions for fuzzy encryption or generating encrypted images can be configured according to any of the embodiments mentioned in this application.
[0311] In some embodiments, the result of the encrypted imaging includes a contour image of the user's hand located in the predetermined area.
[0312] The technical solutions for contour encryption or contour image generation can be configured according to any of the embodiments mentioned in this application.
[0313] Head-mounted display device
[0314] One embodiment of this application provides a head-mounted display device 100B, such as... Figures 14 to 16 As shown.
[0315] The head-mounted display device 100B can be considered as another technical solution independent of the aforementioned wearable device 100, or it can be considered as a specific / special technical solution belonging to the wearable device 100. When the head-mounted display device 100B is considered as a type of wearable device 100, the aforementioned technical solutions for wearable device 100 also apply to the head-mounted display device 100B, and will not be repeated hereafter.
[0316] The head-mounted display device 100B includes a device body 10B.
[0317] The device body 10B has an appearance that conforms to the user's face, or an appearance that conforms to the user's head, or an appearance that is at least supported on the user's face.
[0318] The head-mounted display device 100B includes an image generation unit 111B. The image generation unit 111B is disposed on the main body 10B of the device. The image generation unit 111B is used to generate light signals containing image information.
[0319] The image generation unit 111B can be a microdisplay; the microdisplay can be controlled by a driving circuit.
[0320] The head-mounted display device 100B includes a light guide assembly 112B. The light guide assembly 112B is used to guide the light signal output by the image generation unit 111B to the user's eyes.
[0321] When a user wears the head-mounted display device 100B, the light guide assembly 112B can be located between the image generation unit 111B and the user's eyes.
[0322] The light guide component 112B may include a magnifying lens (e.g., a Fresnel lens, an aspherical lens, a pancake lens, etc.) to present a magnified virtual image to the user's eyes at a distance, allowing the human eye to focus comfortably and fill the field of vision. Based on this, the head-mounted display device 100B can realize virtual reality technology (VR).
[0323] The light guide component 112B can also guide light through waveguides, BirdBath, freeform / prism waveguides, or off-axis optics. Specifically, the waveguide utilizes total internal reflection within a glass / plastic waveguide sheet to propagate light, which is then coupled to the eye using a grating or prism. The BirdBath uses a curved semi-reflective lens (or prism) as a combiner to reflect light from the display / projector into the eye while simultaneously transmitting real-world light. Based on this, the head-mounted display device 100B can implement Augmented Reality (AR) technology.
[0324] The head-mounted display device 100B includes an optical module 12. The optical module 12 is disposed on the device body 10B. The optical module 12 includes optical elements 20. The optical elements 20 are used for encrypted imaging of a predetermined area. The optical module 12 includes a photosensitive element. The photosensitive element is used to receive light signals from the optical elements and convert them into electrical signals.
[0325] When a user wears the head-mounted display device 100B, the optical element 20 is oriented towards the predetermined area. The orientation of the optical element 20 may be the normal direction of the optical element 20.
[0326] The optical module 12 and optical element 20 can be configured as in any of the foregoing embodiments.
[0327] The head-mounted display device 100B includes a control unit 13. The control unit 13 is coupled to an image generation unit 111B and an optical module 12 (specifically, it may be coupled to the photosensitive element). The control unit 13 can be used to control the light signal output by the image generation unit 111B based on the result of encrypted imaging (specifically, based on first information).
[0328] In one embodiment, when the result of the encrypted imaging matches a predetermined trigger event, the light signal output by the image generation unit 111B changes.
[0329] The change in the optical signal can be a change in the image information carried by the optical signal, or a change in the brightness or other characteristics of the optical signal.
[0330] In one embodiment, the main body 10B of the device is an eye mask; such as Figure 14 As shown.
[0331] In one embodiment, the device body 10B includes a frame; as shown Figure 15 As shown.
[0332] In one embodiment, the main body 10B of the device is helmet-shaped; such as Figure 16 As shown.
[0333] The appearance of the main body 10B can be determined based on the above selection of the head-mounted display device 100B.
[0334] In addition, the head-mounted display device 100B may include an inertial measurement unit, an ambient light sensor, a proximity sensor, a head tracking sensor, an eye tracking sensor (e.g., an inward-facing camera, an infrared sensor, an orientation sensor, a contact sensor, etc.), an outward-facing camera (e.g., an RGB camera, a depth sensor, etc.), a microphone array, a speaker, a battery, a charging interface, a WiFi module, a Bluetooth module, a near-field communication module, a storage module, a heat dissipation system, input / output interfaces, peripheral device interfaces, a light shield, a diopter adjustment module, and other components.
[0335] In one embodiment, the optical element 20 performs encrypted imaging of the user's limbs located in the predetermined area.
[0336] The optical element 20 can be configured to face a specific area of the user's limb in a normal state, or it can be configured to face other areas in a normal state, but allow a specific limb of the user to enter the predetermined area under specific circumstances. The specific limb includes, but is not limited to, the arm, wrist, palm, fingers, leg, ankle, foot, and toes.
[0337] In one embodiment, the control unit 13 is coupled to the image generation unit 111B and the optical module 12 to control the light signal output by the image generation unit 111B according to the position of the limb (specifically, according to first information).
[0338] For example, the head-mounted display device 100B also includes an image recognition processor that determines first information based on the position of the limb and sends it to the control unit 13.
[0339] For example, when the hand is located in the upper half of the predetermined area, the hand position information contained in the encrypted imaging result is considered to meet a predetermined trigger event. The brightness of the light signal output by the image generation unit 111B increases, or the first element in the image information carried by the output light signal becomes larger, rises, forms an upward curve, or forms an upward animation effect. Conversely, when the hand is located in the lower half of the predetermined area, the brightness of the light signal output by the image generation unit 111B decreases, or the first element in the image information carried by the output light signal becomes smaller, falls, forms a downward curve, or forms a downward animation effect.
[0340] In one embodiment, the control unit 13 is coupled to the image generation unit 111B and the optical module 12 to control the light signal output by the image generation unit 111B according to the posture of the limb (specifically, according to first information).
[0341] For example, the head-mounted display device 100B also includes an image recognition processor that determines first information based on the posture of the limbs and sends it to the control unit 13.
[0342] For example, when the hand is facing the upper half of the predetermined area, the hand position information contained in the encrypted imaging result is considered to meet a predetermined trigger event, and the brightness of the light signal output by the image generation unit 111B increases, or the first element in the image information carried by the output light signal becomes larger, rises, forms an upward curve, or forms an upward animation effect. As another example, when the hand is facing the lower half of the predetermined area, the brightness of the light signal output by the image generation unit 111B decreases, or the first element in the image information carried by the output light signal becomes smaller, falls, forms an upward curve, or forms a downward animation effect.
[0343] In one embodiment, the control unit 13 is coupled to the image generation unit 111B and the optical module 12 to control the light signal output by the image generation unit 111B according to the movement of the limb (specifically, according to first information).
[0344] For example, the head-mounted display device 100B also includes an image recognition processor that determines first information based on the movement of the limb and sends it to the control unit 13.
[0345] For example, when the hand moves upward, it is assumed that the hand position information contained in the encrypted imaging result matches a predetermined trigger event. The brightness of the light signal output by the image generation unit 111B increases, or the first element in the image information carried by the output light signal becomes larger, rises, forms an upward curve, or forms an upward animation effect. Conversely, when the hand moves downward, the brightness of the light signal output by the image generation unit 111B decreases, or the first element in the image information carried by the output light signal becomes smaller, falls, forms an upward curve, or forms a downward animation effect.
[0346] Changes in the light signal can be triggered based on a single hand position, posture, or movement, or only when multiple conditions are met simultaneously.
[0347] Specifically, in some embodiments of the head-mounted display device 100B provided in any embodiment of this application, the result of the encrypted imaging includes a blurred image of the user's limbs located in the predetermined area.
[0348] The technical solutions for fuzzy encryption or generating encrypted images can be configured according to any of the embodiments mentioned in this application.
[0349] In some embodiments, the result of the encrypted imaging includes a contour image of a user's limb located in the predetermined area.
[0350] The technical solutions for contour encryption or contour image generation can be configured according to any of the embodiments mentioned in this application.
[0351] wearable devices
[0352] One embodiment of this application provides another wearable device 100C, such as... Figure 17 As shown.
[0353] The aforementioned technical solutions for wearable device 100, headphones 100A, and head-mounted display device 100B are also applicable to the other wearable device 100C, and will not be repeated hereafter.
[0354] Another wearable device 100C includes a device body 10C.
[0355] The device body 10C has an appearance that conforms to the user's auricle or has an appearance that covers the user's ear, and / or has an appearance that conforms to the user's face, has an appearance that conforms to the user's head, or has an appearance that is at least supported on the user's face.
[0356] Another wearable device 100C includes an earphone 100A. The earphone 100A can be configured according to any embodiment of this application.
[0357] Another wearable device 100C includes an image generation unit 111B. The image generation unit 111B is disposed on the device body 10C. The image generation unit 111B is used to generate light signals containing image information. The image generation unit 111B can be configured according to the image generation unit in the head-mounted display device 100B in any embodiment of this application.
[0358] Another wearable device 100C includes a light guide component 112B. The light guide component 112B is used to guide the light signal output by the image generation unit 111B to the user's eyes. The light guide component 112B can be configured according to the light guide component in the head-mounted display device 100B in any embodiment of this application.
[0359] When another wearable device 100C is used with the user, the light guide component 112B can be located between the image generation unit 111B and the user's eye.
[0360] Another wearable device 100C includes a control unit 13. The control unit 13 is coupled to the image generation unit 111B, the sound-emitting unit of the earphone 100A, and the optical module 12 (specifically, it may be coupled to the photosensitive element). The control unit 13 can be used to control the volume of the sound wave signal output by the sound-emitting unit and the light signal output by the image generation unit 111B in order to achieve encrypted imaging results (specifically, according to first information).
[0361] Specifically, the control unit 13 can be implemented based on coupling:
[0362] (1) Control the volume of the sound wave signal based on the results of encrypted imaging.
[0363] (2) Control the brightness of the light signal based on the results of encrypted imaging.
[0364] (3) Control the image information carried by the optical signal based on the result of encrypted imaging.
[0365] (4) Control the brightness of the light signal according to the volume of the sound wave signal.
[0366] (5) Control the image information carried by the light signal according to the volume of the sound wave signal.
[0367] In one embodiment, when the result of the encrypted imaging matches a predetermined trigger event, the volume of the acoustic signal changes, and the optical signal changes accordingly.
[0368] For example, when the result of encrypted imaging indicates that the user's hand or other limbs are moving upwards, the result of encrypted imaging is considered to meet a predetermined trigger event. The volume of the sound wave signal increases, and the first element in the image information carried by the light signal that indicates the volume increases, so that the user is aware of the current volume change.
[0369] In one embodiment, when the result of the encrypted imaging matches a predetermined trigger event, the optical signal changes, and the volume of the acoustic signal changes accordingly.
[0370] For example, when the result of encrypted imaging indicates that the user's hand or other limbs are moving upwards, the result of encrypted imaging is considered to meet the predetermined trigger event. The first element in the image information carried by the light signal follows the hand movement, and the volume of the sound wave signal fluctuates to indicate the action.
[0371] Alternatively, when the encrypted imaging result indicates that the user's hand or other limbs are moving upwards, the encrypted imaging result is considered to meet a predetermined trigger event, the brightness of the light signal increases, and the volume of the sound wave signal fluctuates to indicate the increase in brightness.
[0372] In one embodiment, the optical element 20 performs encrypted imaging of the user's hand located in the predetermined area.
[0373] The optical element 20 can be configured to face the user's hand area under normal conditions, or it can be configured to face other areas under normal conditions, but the user's hand enters the predetermined area under specific circumstances.
[0374] In some embodiments, the result of the encrypted imaging includes a blurred image of the user's hand located in the predetermined area.
[0375] The technical solutions for fuzzy encryption or generating encrypted images can be configured according to any of the embodiments mentioned in this application.
[0376] In some embodiments, the result of the encrypted imaging includes a contour image of the user's hand located in the predetermined area.
[0377] The technical solutions for contour encryption or contour image generation can be configured according to any of the embodiments mentioned in this application.
[0378] The other wearable device 100C can be regarded as a combination of the headphones 100A and the head-mounted display device 100B provided above in this application.
[0379] In summary, the wearable device, headphones, and head-mounted display device provided in this application, by coupling the functional components and imaging results through the control unit and setting the imaging process as encrypted imaging, can effectively prevent privacy leakage while realizing functions such as human-computer interaction; at the same time, by setting optical elements to achieve encrypted imaging, compared with electronic encryption or other encryption methods, it can greatly save volume and adapt to the miniaturization requirements of wearable devices.
[0380] It should be understood that although this specification describes embodiments, not every embodiment contains only one independent technical solution. This way of describing the specification is only for clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each embodiment can also be appropriately combined to form other embodiments that can be understood by those skilled in the art.
[0381] The detailed descriptions listed above are merely specific descriptions of feasible implementation methods of this application and are not intended to limit the scope of protection of this application. All equivalent implementation methods or modifications made without departing from the spirit of the art of this application should be included within the scope of protection of this application.
Claims
1. A wearable device, characterized in that, include: case, Functional components, disposed in the housing, are used to implement the inherent functions of the wearable device. An optical module, disposed within the housing, includes optical elements and a photosensitive element. The optical elements are used for encrypted imaging of a predetermined area, and the photosensitive element is used for receiving optical signals from the optical elements and converting them into electrical signals. The control unit is coupled to the functional components and the photosensitive element.
2. The wearable device according to claim 1, characterized in that, The optical module has a light-shielding layer on its surface.
3. The wearable device according to claim 2, characterized in that, The light-shielding layer is formed by spraying light-blocking ink onto the surface of the optical module.
4. The wearable device according to claim 1, characterized in that, The optical module includes a first optical element and a second optical element. The first optical element is a metasurface element. The second optical element includes a metasurface formed by grating structure units.
5. The wearable device according to claim 4, characterized in that, Based on at least one of the following settings: The second optical element is disposed between the first optical element and the photosensitive element. The first optical element is disposed close to the surface of the housing. The housing surrounds and forms a cavity, and the photosensitive element is disposed within the cavity.
6. The wearable device according to claim 1, characterized in that, The optical module includes filters and apertures. The filter and aperture are disposed between the optical element and the photosensitive element.
7. The wearable device according to claim 1, characterized in that, The wearable device includes a substrate. The photosensitive element is disposed on the first surface of the substrate. The optical element is disposed on the side of the photosensitive element away from the substrate.
8. The wearable device according to claim 7, characterized in that, The substrate is a flexible circuit board. The wearable device includes a reinforcing plate. The reinforcing plate is disposed on the second surface of the substrate corresponding to the position of the photosensitive element, and the first surface and the second surface are two opposite surfaces on the substrate.
9. The wearable device according to claim 7, characterized in that, The wearable device includes a light source. The light source is disposed on the first surface. The wearable device also includes a heat sink. The heat sink is disposed on the second surface of the substrate corresponding to the position of the light source, and the first surface and the second surface are two opposite surfaces on the substrate.
10. The wearable device according to claim 1, characterized in that, Based on at least one of the following settings: The optical element includes a metasurface, which is used for encrypted imaging of the predetermined region; The optical module includes metasurface elements; The optical module includes refractive optical elements; The optical module includes diffractive optical elements; The optical module includes a scattering medium element.
11. The wearable device according to claim 1, characterized in that, The predetermined region is located in the normal direction of the optical element or in the direction of the specified deflection angle.
12. The wearable device according to claim 1, characterized in that, The predetermined area covers a region 5cm to 150cm away from the optical element.
13. The wearable device according to claim 1, characterized in that, Based on at least one of the following settings: The horizontal field of view of the optical module is greater than or equal to 90 degrees; The vertical field of view of the optical module is greater than or equal to 60 degrees.
14. The wearable device according to claim 1, characterized in that, include: An image recognition processor, coupled to the optical module, includes a deep learning component and an output module. The deep learning component is a processing component with a neural network model. The deep learning component is used to identify the type of limb pose located in the predetermined area based on the encrypted imaging results of the optical module. The output module is used to generate first information based on the type of limb pose and a preset correspondence. The control unit is coupled to the image recognition processor and is used to control the functional components according to the first information.
15. An earphone, characterized in that, include: case, A sound-generating unit, disposed in the housing, is used to convert electrical signals into mechanical signals to generate sound wave signals. An optical module, disposed within the housing, includes optical elements and a photosensitive element. The optical elements are used for encrypted imaging of a predetermined area, and the photosensitive element is used for receiving optical signals from the optical elements and converting them into electrical signals. The control unit is coupled to the sound-generating unit and the photosensitive element.
16. The earphone according to claim 15, characterized in that, Configure according to one of the following: The headphones are in-ear type; The earphones are semi-in-ear type; The headphones are over-ear type; The headphones are ear-hook type; The headphones are neckband style.
17. A wearable device, characterized in that, include: Equipment body, The headphones according to any one of claims 15 to 16, An image generation unit, disposed on the main body of the device, is used to generate an optical signal containing image information. A light guide assembly is used to direct the light signal output from the image generation unit to the user's eyes. The control unit is coupled to the image generation unit, as well as the sound-generating unit and photosensitive element of the earphone.
18. A head-mounted display device, characterized in that, include: Main body of the device An image generation unit is disposed in the main body of the device, and the image generation unit is used to generate an optical signal containing image information. A light guide assembly is used to direct the light signal output from the image generation unit to the user's eyes. An optical module, disposed on the main body of the device, includes optical elements and a photosensitive element. The optical elements are used for encrypted imaging of a predetermined area, and the photosensitive element is used for receiving light signals from the optical elements and converting them into electrical signals. The control unit is coupled to the image generation unit and the photosensitive element.
19. The head-mounted display device according to claim 18, characterized in that, Configure according to one of the following: The main body of the device is an eye mask; The main body of the device includes a mirror frame; The main body of the device is helmet-shaped.
Citation Information
Patent Citations
Multi-focus vector super lens, design method and optical system
CN118444478A
Optical system, configuration method and identification method
CN119065125A
Structural parameter library construction method, super-lens design method and optical system
CN119575639A
Multi-focus vector super lens, design method and optical system
CN119575640A
Secrecy system, configuration method and secrecy method
CN119854425A
