AR device and camera control method thereof, smart watch and smart wearable device assembly

Through the crown action information from smart watches, AR devices have achieved more flexible and convenient camera function control, solving the problem of equipment jitter and unstable shooting caused by interactive control methods in existing technologies.

CN115426454BActive Publication Date: 2025-01-24GEER TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211053167.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-31
Publication Date
2025-01-24
Estimated Expiration
2042-08-31

AI Technical Summary

Technical Problem

The interactive control method of camera functions of existing AR devices mainly relies on touch interaction, causing device shaking and shooting screens to vibrate, making it difficult for users to accurately adjust shooting parameters, and there is less flexibility and convenience.

Method used

The crown action information from smart watches controls its own entry of the camera, and performs corresponding camera movements according to the movement information, including mode switching, parameter adjustment, and function execution.

Benefits of technology

It improves the convenience and flexibility of users using AR devices for cameras, and avoids the problem of equipment jitter and shooting screen tremor. Users can use the crown component of the smart watch without directly touching the AR device for shooting operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115426454B_ABST
    Figure CN115426454B_ABST
Patent Text Reader

Abstract

The present invention discloses an AR device and a camera control method thereof, a smart watch and a smart wearable device component. The AR device camera control method comprises: the AR device obtains crown action information transmitted by the smart watch; and when the crown action information is obtained, the AR device controls itself to enter a camera state; and according to the crown action information, the camera action corresponding to the crown action information is executed. The present invention aims to improve the flexibility and convenience of users using the shooting function of the AR device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of AR device photography technology, and in particular to an AR device and a camera control method thereof, a smart watch, and a smart wearable device component. Background Art

[0002] With the development of augmented reality technology, AR devices, such as AR glasses, are considered to be the products with the most development and sales potential. However, when users use the camera function of AR devices, the main interactive control method is touch interaction, such as touching the temples of AR glasses. However, this interactive control method easily causes the AR device to shake, which in turn causes the captured image to shake and become distorted. In addition, it is difficult for users to accurately operate to adjust the required shooting parameters, which has poor flexibility and low convenience, giving users a relatively bad experience when shooting with AR devices. Summary of the invention

[0003] The main purpose of the present invention is to provide an AR device camera control method, aiming to improve the flexibility and convenience of users using the shooting function of the AR device.

[0004] To achieve the above object, the present invention proposes an AR device camera control method, comprising:

[0005] The AR device obtains crown action information from the smartwatch;

[0006] When the crown action information is obtained, the device controls itself to enter the camera state;

[0007] According to the crown action information, a camera action corresponding to the crown action information is performed.

[0008] Optionally, the AR device includes a display component and a shooting component, the crown action information includes crown touch information, and when the crown action information is acquired, the step of controlling the AR device to enter a shooting state is specifically:

[0009] When the duration of acquiring the crown touch information reaches a first preset duration, determining that the user has a camera requirement, and controlling the device to enter the camera state;

[0010] The camera state specifically includes: starting the camera component and displaying the image acquired by the camera component on the display component.

[0011] Optionally, the crown action information includes crown rotation information and crown pressing information, and the step of executing a camera action corresponding to the crown action information according to the crown action information includes:

[0012] Determining a target camera mode according to the acquired crown rotation information;

[0013] When the crown pressing information is obtained, controlling itself to enter a camera mode corresponding to the target camera mode;

[0014] When the crown pressing information is acquired again, the camera function corresponding to the camera mode is executed.

[0015] Optionally, between the step of controlling itself to enter a camera mode corresponding to the target camera mode when the crown pressing information is acquired and the step of executing a camera function corresponding to the camera mode when the crown pressing information is acquired again, the step of executing a camera action corresponding to the crown action information according to the crown action information further includes:

[0016] Determining target camera parameters corresponding to the target camera mode according to the acquired crown rotation information;

[0017] When the crown pressing information is obtained again, the camera parameter adjustment mode corresponding to the target camera parameter is entered, and the value of the target camera parameter is adjusted according to the obtained crown rotation information.

[0018] Optionally, the AR device camera control method further includes:

[0019] Execute an action withdrawal operation based on the crown action information.

[0020] The present invention further provides an AR device, comprising:

[0021] Memory;

[0022] A processor, an AR device photography control program stored in the memory and executed by the processor, wherein the AR device photography control program, when executed by the processor, implements the AR device photography control method as described in any one of the above items.

[0023] The present invention further provides a smart watch, comprising:

[0024] Crown assembly;

[0025] A trigger detection module, wherein the trigger detection component is used to output a corresponding trigger detection signal when the crown component is triggered by a user;

[0026] A communication module, wherein the communication module is used to communicate with the AR device;

[0027] A main control module, the main control module is electrically connected to the trigger detection module and the communication module respectively;

[0028] Among them, the main control module is used to determine whether the user triggers the trigger action of the crown component according to the trigger detection signal, and output the corresponding crown action signal to the AR device through the communication module, so that the AR device can control itself to enter the camera state when the crown action signal is obtained, and perform the camera action corresponding to the crown action information according to the crown action information.

[0029] Optionally, the crown action signal includes a crown touch signal;

[0030] The main control module is used for, when it is determined according to the trigger detection signal that the trigger action of the crown component triggered by the user is a touch action, outputting the crown touch signal to the AR device via the communication module, so that the AR device controls itself to enter a camera state when the duration of acquiring the crown touch signal reaches a first preset duration;

[0031] Alternatively, the AR device in the camera state performs an action withdrawal operation when the duration of obtaining the crown touch signal reaches a second preset duration.

[0032] Optionally, the crown action signal includes a crown rotation signal;

[0033] The main control module is used to output the corresponding crown rotation signal to the AR device via the communication module when it is determined according to the trigger detection signal that the user rotates the crown assembly, so that the AR device determines the target camera mode according to the crown rotation signal;

[0034] Alternatively, the AR device determines a target camera parameter corresponding to the target camera mode according to the crown rotation signal;

[0035] Alternatively, the AR device adjusts the value of the target camera parameter according to the crown rotation signal.

[0036] Optionally, the crown action signal includes a crown pressing signal;

[0037] The main control module is used to output the crown pressing signal to the AR device via the communication module when it is determined that the user presses the crown component according to the trigger detection signal, so that the AR device controls itself to enter a camera mode corresponding to the target camera mode when the crown pressing signal is obtained;

[0038] Alternatively, executing a camera function corresponding to the camera mode;

[0039] Alternatively, enter a camera parameter adjustment mode corresponding to the target camera parameter.

[0040] Optionally, the trigger detection module includes:

[0041] A touch detection component, the touch detection component is electrically connected to the main control module, and the touch detection component is used to output a crown touch detection signal when detecting that the crown component is touched by a user;

[0042] The main control module is used to determine that the crown component is in a touched state when the crown touch detection signal is obtained, and output the crown touch signal to the AR device via the communication module;

[0043] And / or, a rotation detection component, the rotation detection component is electrically connected to the main control module, the rotation detection component is used to detect the rotation state of the crown component and output a corresponding crown rotation detection signal;

[0044] The main control module is used to determine the rotation direction and rotation angle of the crown according to the crown rotation detection signal, and output a corresponding crown rotation signal to the AR device via the communication module;

[0045] and / or, a press detection component, when the user presses the crown component, the crown component triggers the press detection component, and the press detection component is used to output a crown press detection signal when triggered;

[0046] The main control module is used to determine that the crown assembly is in a pressed state when the crown pressing detection signal is obtained, and output the crown pressing signal to the AR device via the communication module.

[0047] Optionally, the dial is provided with a wearing side, and when the smart watch is worn by a user, the wearing side fits against the user's skin;

[0048] The touch detection component includes a touch detection member and a touch detection chip, the touch detection chip is electrically connected to the touch detection member and the main control module respectively, and the touch detection member is arranged on the crown component and away from the wearing side;

[0049] The touch detection component is used to output the crown touch detection signal when it is confirmed that the touch detection element is touched by the user.

[0050] The present invention also proposes a smart wearable device assembly, comprising the AR device described above and the smart watch described in any one of the above items.

[0051] In the scheme of the present invention, the AR device first obtains the crown action information transmitted by the smart watch, and when the crown action information is obtained, it controls itself to enter the camera state, and executes the camera action corresponding to the crown action information according to the crown action information. In this way, in actual application, the user can control the camera function of the AR device by triggering the crown component of the smart watch, without touching the main body of the AR device and the AR device does not need to be equipped with a special remote control device. The present invention effectively improves the convenience and flexibility of users using AR devices to take pictures. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying creative work.

[0053] Figure 1 A schematic diagram of a method flow of an embodiment of an AR device camera control method of the present invention;

[0054] Figure 2 A schematic diagram of a method flow chart of another embodiment of the AR device camera control method of the present invention;

[0055] Figure 3 A schematic diagram of a method flow of another embodiment of the AR device camera control method of the present invention;

[0056] Figure 4 This is a schematic diagram of functional modules of a smart watch according to an embodiment of the present invention;

[0057] Figure 5 A schematic diagram of functional modules of another embodiment of a smart watch of the present invention;

[0058] Figure 6 This is a schematic structural diagram of another embodiment of a smart watch of the present invention;

[0059] Figure 7 A schematic diagram of a display screen on a display component in an embodiment of an AR device of the present invention;

[0060] Figure 7 A is a schematic diagram of a display screen on a display component in an embodiment of an AR device of the present invention;

[0061] Figure 7 B is a schematic diagram of a display screen on a display component in another embodiment of an AR device of the present invention;

[0062] Figure 8A schematic diagram of a display screen on a display component in another embodiment of an AR device of the present invention;

[0063] Figure 8 A is a schematic diagram of a display screen on a display component in another embodiment of an AR device of the present invention;

[0064] Figure 8 B is a schematic diagram of a display screen on a display component in another embodiment of an AR device of the present invention;

[0065] Figure 8 C is a schematic diagram of a display screen on a display component in another embodiment of an AR device of the present invention;

[0066] Figure 8 D is a schematic diagram of a display screen on a display component in another embodiment of an AR device of the present invention.

[0067] Description of Figure Numbers:

[0068] Label name Label name 10 Main control module 20 Communication Module 30 Trigger detection module 11 Touch detection components 12 Rotation detection component 13 Press detection component 100 dial 200 Crown components 111 Touch detection area 210 Crown body 110 Wearing side

[0069] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0070] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0071] It should be noted that all directional indications in the embodiments of the present invention (such as up, down, left, right, front, back, etc.) are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0072] With the development of augmented reality technology, AR devices, such as AR glasses, are considered to be the products with the most development and sales potential. However, when users use the camera function of AR devices, the main interactive control method is touch interaction, such as touching the temples of AR glasses. However, this interactive control method easily causes the AR device to shake, which in turn causes the captured image to shake and become distorted. In addition, it is difficult for users to accurately operate to adjust the required shooting parameters, which has poor flexibility and low convenience, giving users a relatively bad experience when shooting with AR devices.

[0073] To this end, the present invention proposes an AR device and a camera control method thereof, which are applied to the AR device.

[0074] It is understandable that the AR device is provided with a processing module for storing and executing the following method, and a communication component, a display component and a shooting component electrically connected to the processing module. The processing module can be implemented by a main controller, such as MCU, DSP (Digital Signal Process), FPGA (Field Programmable Gate Array), etc. The communication component can be implemented by a Bluetooth communication component, a WIFI communication component, a local area network communication component, a 4G / 5G communication component, etc. The display component is a display screen arranged on the AR device. Optionally, the AR device is generally AR glasses or an AR helmet, and the display screen can be arranged on the glasses lens of the AR device to facilitate the user to obtain relevant information.

[0075] refer to Figure 1 In one embodiment of the present invention, the AR device camera control method includes:

[0076] S100 and AR devices obtain crown action information from smart watches;

[0077] In this embodiment, it can be seen from the above content that a communication component is also provided inside the AR device for communicating with a smart watch. After the user performs a matching operation on the smart watch / AR device, the AR device and the smart watch can establish a wireless communication connection to achieve interactive data. Specifically, after the AR device and the smart watch are able to establish a wireless communication connection, when the user triggers the crown component, such as touching, pressing, or rotating the crown component, the smart watch will detect the user's triggering action and output the corresponding crown action information to the processing module of the AR device through the communication module therein, so that the processing module receives the crown action information from the smart watch.

[0078] S200, when the crown action information is obtained, controlling the watch to enter a camera state;

[0079] Optionally, the AR device includes a display component and a shooting component, the crown action information includes crown touch information, and step S200 is specifically:

[0080] S210, when the duration of acquiring the crown touch information reaches a first preset duration, determining that the user has a camera requirement, and controlling the device to enter the camera state;

[0081] The camera state specifically includes: starting the camera component and displaying the image acquired by the camera component on the display component.

[0082] In this embodiment, the first preset duration can be preset in advance by the R&D personnel, or set by the user. When the processing module receives the duration from the smart watch via the communication component and reaches the first preset duration, it will confirm that the user currently wants to shoot, and will enter the shooting state. When the shooting component is started, the acquired image is displayed on the display component, and the camera interface corresponding to the camera state is entered to display related icons, such as camera mode icons, camera parameter icons, etc., for the user to make subsequent selections and triggers.

[0083] Optionally, the crown action information that triggers the processing module to enter the camera state may also be other crown action information, such as at least one of the crown rotation information or crown pressing information described below, and may be set accordingly by R&D personnel / users as needed.

[0084] It is understandable that the processing module may also be preset with crown action information corresponding to the exit from the camera state. When the user executes the crown trigger action corresponding to the crown action information for exiting the camera state, such as touching the crown component for 5S, the processing module will directly turn off the shooting component and directly exit the camera state, and switch the camera interface corresponding to the camera state displayed on the display component at this time to the default interface or the previous interface.

[0085] S300. Based on the crown action information, execute a camera action corresponding to the crown action information.

[0086] In this embodiment, the crown action information includes: at least one of the crown touch information, the crown rotation information and the crown pressing information. It is understandable that when the AR device is in the camera state, its camera action includes: camera mode switching action, camera parameter switching action, camera parameter adjustment action, confirmation action, return to the previous interface action, camera function start / stop action, exit camera state action, etc. Optionally, the R&D personnel set the crown action information corresponding to the camera action and different triggering methods during the research and development period. For example, when the AR device in the default state receives the crown touch information for a first time, such as 3S, it enters the camera state. And after entering the camera state, if the duration of receiving the crown touch information reaches a second duration, for example 4S, the camera state is exited and returned to the default state. In other words, when the user touches the crown component of the smart watch with his finger for 3S, the AR device will enter the camera state. In the camera state, when the user touches the crown component of the smart watch with his finger for 4S, the AR device will exit from the camera state to the default state; optionally, the above-mentioned triggering method can also be set by the user according to needs. The user can also set and match multiple actions with one crown action information. For example, the user will enter the camera state, enter the shooting mode, set the camera parameters to A parameters, and these multiple actions will match the duration of receiving the crown touch information to a third duration, for example 2S, and match the action of turning on the camera function with receiving a crown press information. In this way, in actual applications, when the AR device is in the default state, the user only needs to touch the crown component for 2 seconds, the AR device will automatically enter the shooting mode and set the camera parameters to the A parameters. At this time, the user only needs to press the crown component once, and the AR device will complete a photo taking action.

[0087] In the scheme of the present invention, the AR device first obtains the crown action information transmitted by the smart watch, and when the crown action information is obtained, it controls itself to enter the camera state, and executes the camera action corresponding to the crown action information according to the crown action information. In this way, in actual application, the user can control the camera function of the AR device by triggering the crown component of the smart watch, without touching the main body of the AR device and the AR device does not need to be equipped with a special remote control device. The present invention effectively improves the convenience and flexibility of users using AR devices to take pictures.

[0088] In addition, compared with the user using a smart terminal to control the camera function of the AR device, the method of using the crown of the smart watch for control is more convenient. It is understandable that most of the current smart terminals are controlled by a combination of touch screen and buttons. If you need to control the AR device, the user needs to enter the APP of the corresponding AR device, and control the above-mentioned camera action by pressing the correct button or touching the correct trigger area on the APP. This requires the user to look at the screen of his smart terminal or multiple buttons from time to time to ensure that he touches / presses the correct position. When the AR device, such as AR glasses, is in use, the picture to be shot is generally displayed directly on the lens of the glasses. If the user needs to observe his smart terminal, it cannot be guaranteed that the scene to be shot is always facing the scene to be shot, causing inconvenience in shooting. At the same time, if you want to control the AR device to shoot through the smart terminal, you also need to enter a special APP, which also causes cumbersome and inconvenient operation. In comparison, the solution of the present invention does not require the user to enter any APP, nor does it require the user to be distracted to observe the status of the smart watch, which further improves the convenience and experience of the user.

[0089] In one embodiment of the present invention, reference Figure 3 and Figure 7 The crown action information also includes crown rotation information and crown pressing information, and the step S300 includes:

[0090] S310, determining a target camera mode according to the acquired crown rotation information;

[0091] Optionally, the camera mode includes at least one of: a photo mode, a video mode and a QR code scanning mode.

[0092] Optionally, after the user operates the above embodiment to make the processing module of the AR device enter the camera state, in addition to turning on the shooting component and displaying the shooting component on the display component on one / both lenses of the AR device, the corresponding camera interface will also be displayed on the display component. It is understandable that the AR device will have a variety of different camera modes, such as photo mode, QR code mode and video mode, etc. The icons or texts corresponding to the above modes will be displayed on the camera interface. At the same time, it is understandable that the icon corresponding to the target camera mode currently switched to by the user will be highlighted on the camera interface. Reference Figure 7 A, Figure 7 A is the default camera interface when the processing module just enters the camera state. At this time, the icon corresponding to the photo mode will be highlighted by default.

[0093] In this embodiment, it can be seen from the following embodiments that the crown rotation information includes the direction of the current crown component rotation and the angle of rotation along the current direction. The processing module can also be preset by the R&D personnel / user with the crown action information corresponding to the target camera mode switching. Optionally, the processing module will display the icons corresponding to multiple camera modes in a certain order on the camera interface, and switch the target camera mode back and forth according to the angle and direction of the crown rotation. For example, every time the first preset angle is turned clockwise, the target camera mode is switched to the next camera mode, and every time the first preset angle is turned counterclockwise, the target camera mode is switched to the previous camera mode.

[0094] Specifically, refer to Figure 7 In one embodiment, the icons corresponding to the multiple camera modes are arranged from left to right. Every time the crown component is rotated 90° clockwise by the user, the current target camera mode will be switched to the next one to the left. Every time the crown component is rotated 90° counterclockwise by the user, the current target camera mode will be switched to the next one to the right. Figure 7 A. When the camera is in the state of recording, the three icons of "recording", "photo" and "QR code" are displayed from left to right on the camera interface. At this time, the target camera mode is the photo mode by default. When the processing module of the AR device determines that the user has turned the crown component clockwise by 90°, refer to Figure 7 B. The current target camera mode is switched to the video mode, and the text "video" corresponding to the video mode is also highlighted to remind the user that the currently selected target camera mode is the video mode.

[0095] S320, when the crown pressing information is obtained, controlling the watch to enter a camera mode corresponding to the target camera mode;

[0096] In this embodiment, the developer / user can preset the crown pressing information in the processing module as the corresponding "confirmation action", that is, when the user presses the crown component once, the processing module enters the camera mode corresponding to the target camera mode selected by the user. It can be understood that when the processing module enters the camera mode selected by the user, it will not only call the camera program corresponding to the current camera mode, but also display the icon corresponding to the current camera mode on the camera interface. Specifically, refer to Figure 8 A. After the user adjusts the target camera mode to the photo mode through the method of the above embodiment, the user presses the crown assembly once to make the processing module enter the photo mode, and the text icon "Photo" corresponding to the photo mode is displayed on the camera interface.

[0097] It is understandable that in actual applications, different camera modes often have different camera parameters. For example, in photo mode, there is a setting for focal length parameters. Figure 3 and Figure 8 In another embodiment, between step S320 and step S330, step S300 further includes:

[0098] S340, determining a target camera parameter corresponding to the target camera mode according to the acquired crown rotation information;

[0099] S350. When the crown pressing information is obtained again, enter the camera parameter adjustment mode, and adjust the value of the target camera parameter according to the obtained crown rotation information.

[0100] In this embodiment, when the processing module enters a certain camera mode, as in the above embodiment, multiple camera parameter icons / text icons corresponding to the multiple camera parameters corresponding to the current camera mode will be displayed on the camera interface in a certain order, and the icons / text icons corresponding to the default target camera parameters will be displayed prominently.

[0101] It is understandable that the switching method of the target camera parameter and the method of entering the corresponding camera parameter adjustment mode can refer to the method of switching the target camera mode and the method of entering the corresponding camera mode in the above embodiment, which will not be repeated here. When the processing module enters the camera parameter adjustment mode corresponding to the target camera parameter, the specific value of the current camera parameter will be displayed on the camera interface, and the adjustment of the parameter value will be determined by the rotation direction and rotation angle of the user's crown assembly in the same manner as in the above embodiment.

[0102] In addition, when the user has adjusted the value of the target camera parameter, he can press the crown component again. When the processing module receives the crown pressing information again at this time, it will enter the camera start-up state and display the specific value of the set target camera parameter on the camera interface.

[0103] Specifically, refer to Figure 8 , take adjusting the focal length parameter in photo mode as an example, refer to Figure 8 A. When the processing module just enters the photo mode, the three camera parameters "focal length", "exposure" and "flash" will be displayed from left to right, and the default target camera parameter is "exposure". Figure 8 B. The user turns the crown component 90° clockwise, and the processing module switches the target camera parameter to focal length, and highlights the "focal length" on the camera interface. Then, the user presses the crown component once, and the processing module enters the focal length adjustment mode, and displays the focal length and current focal length value on the camera interface (refer to Figure 8 C). After the user has completed the adjustment, the crown assembly will be pressed again. At this time, refer to Figure 8D. After receiving the crown pressing information again, the processing module will display "focal length 15MM" on the camera interface and enter the camera start-up state.

[0104] S330. When the crown pressing information is acquired again, executing a camera function corresponding to the camera mode.

[0105] In this embodiment, it can be seen from the above embodiments that after the user adjusts the camera parameters by triggering the crown assembly, the processing module will enter the camera start-up state. At this time, the user only needs to press the crown assembly again, and the processing module will start to execute the camera function corresponding to the camera mode, such as taking a photo once, starting a video, scanning a QR code, etc.

[0106] Through the above settings, users can flexibly control the AR device to take pictures by triggering the crown component of the smart watch, thereby improving the convenience of users taking pictures with the AR device.

[0107] It should be understood that in the process of the user controlling the AR device to perform the corresponding camera action by triggering the crown component, the processing module may perform an incorrect camera action due to inattention or accidental touching of the crown component. For example, the wrong camera mode or the wrong camera parameter adjustment mode may be entered. At this time, if the user controls the AR device to exit the camera state and then re-enter the camera state, the above operation needs to be performed again, which will cause unnecessary trouble to the user.

[0108] To this end, in one embodiment of the present invention, the AR device camera control method further includes:

[0109] Execute an action withdrawal operation based on the crown action information.

[0110] In this embodiment, the processing module may also be preset by R&D personnel / users with crown action information corresponding to the action withdrawal operation. For example, after entering the camera state, if the processing module receives crown touch information that lasts for a fourth time period, such as 2S, the action withdrawal procedure will be executed to return to the previous operation.

[0111] Specifically, refer to Figure 8 C. If the user enters the focus adjustment mode by mistake, he can touch the crown component for 2 seconds to change the content on the display interface from Figure 8 The style of C falls back to Figure 8B style, even if the processing module returns from the focus adjustment mode to the previous photo parameter selection mode. At this time, the user can select other target camera parameters by turning the crown assembly again. In this way, in actual applications, through the above settings, when the user does not pay attention or accidentally touches the crown assembly, causing the processing module to perform an erroneous camera action, the user can flexibly withdraw the camera action that has been performed by the processing module. The present invention further improves the convenience of users using the crown assembly of a smart watch to control the AR device for shooting.

[0112] The present invention also proposes an AR device, comprising:

[0113] Memory;

[0114] A processor, an AR device photography control program stored in a memory and executed by the processor, wherein the AR device photography control program, when executed by the processor, implements any of the above-mentioned AR device photography control methods.

[0115] It is worth noting that, because the AR device of the present invention includes all embodiments of the above-mentioned AR device camera control method, the AR device of the present invention has all the beneficial effects of the above-mentioned AR device camera control method, which will not be repeated here.

[0116] refer to Figure 4 and Figure 6 The present invention also proposes a smart watch for use with the above-mentioned AR device, the smart watch comprising:

[0117] Crown assembly 200;

[0118] A trigger detection module 10, the trigger detection component is used to output a corresponding trigger detection signal when the crown component 200 is triggered by the user;

[0119] A communication module 20, wherein the communication module 20 is used to communicate with the AR device;

[0120] A main control module 30, wherein the main control module 30 is electrically connected to the trigger detection module 10 and the communication module 20 respectively;

[0121] Among them, the main control module 30 is used to determine whether the user triggers the trigger action of the crown assembly 200 according to the trigger detection signal, and output the corresponding crown action signal to the AR device through the communication module 20, so that the AR device can control itself to enter the camera state when the crown action signal is obtained, and perform the camera action corresponding to the crown action information according to the crown action information.

[0122] It is important to understand that reference Figure 6The crown assembly 200 is disposed on the dial 100 and is adjustably connected to the dial 100; optionally, the crown assembly 200 can be disposed on the peripheral side surface of the dial 100, or on the upper surface of the dial 100, that is, the side where the display screen on the dial 100 is located; the crown assembly 200 can be adjustably connected to the dial 100, optionally, the crown assembly 200 can be rotated counterclockwise or clockwise relative to the dial 100, and can also be driven by the user's fingers to move the crown assembly 200 relative to the dial 100, for example, extend into the dial 100 or move away from the dial 100.

[0123] In this embodiment, the crown assembly 200 can be realized by a crown body 210 and a rotating shaft. Part of the rotating shaft extends into the interior of the dial 100. The user can turn the crown body 210 to make the crown body 210 drive the rotating shaft to rotate or move along a certain direction of the rotating shaft.

[0124] In this embodiment, the communication module 20 can be implemented by a wireless communication component, such as a Bluetooth communication component, a WIFI communication component, a local area network communication component, a 4G / 5G communication component, etc. The communication module 20 can establish a wireless communication connection with a communication module 20 of the same type as the AR device through a corresponding communication network, thereby enabling the AR device and the smart watch to transmit data to each other. The main control module 30 can be implemented by a main controller, such as an MCU, a DSP (Digital Signal Process, digital signal processing chip), an FPGA (Field Programmable Gate Array, programmable logic gate array chip), etc.

[0125] Optionally, the crown action signal includes a crown touch signal;

[0126] The main control module is used for, when it is determined according to the trigger detection signal that the trigger action of the crown component triggered by the user is a touch action, outputting the crown touch signal to the AR device via the communication module, so that the AR device controls itself to enter a camera state when the duration of acquiring the crown touch signal reaches a first preset duration;

[0127] Alternatively, the AR device in the camera state performs an action withdrawal operation when the duration of obtaining the crown touch signal reaches a second preset duration.

[0128] Optionally, the crown action signal includes a crown rotation signal;

[0129] The main control module is used to output the corresponding crown rotation signal to the AR device via the communication module when it is determined according to the trigger detection signal that the user rotates the crown assembly, so that the AR device determines the target camera mode according to the crown rotation signal;

[0130] Alternatively, the AR device determines a target camera parameter corresponding to the target camera mode according to the crown rotation signal;

[0131] Alternatively, the AR device adjusts the value of the target camera parameter according to the crown rotation signal.

[0132] Optionally, the crown action signal includes a crown pressing signal;

[0133] The main control module is used to output the crown pressing signal to the AR device via the communication module when it is determined that the user presses the crown component according to the trigger detection signal, so that the AR device controls itself to enter a camera mode corresponding to the target camera mode when the crown pressing signal is obtained;

[0134] Alternatively, executing a camera function corresponding to the camera mode;

[0135] Alternatively, enter a camera parameter adjustment mode corresponding to the target camera parameter.

[0136] In this embodiment, when the user triggers the crown assembly, such as touching the crown, rotating the crown, or pressing the crown, the main control module will output the corresponding crown pressing signal, crown rotation signal, and crown touch signal to the AR device based on the acquired trigger detection signal, so that the AR device can execute the corresponding program action. The specific interaction process between the smart watch and the AR device refers to the content of the specific embodiment of the AR device above, which will not be repeated here.

[0137] Optionally, refer to Figure 5 In one embodiment of the present invention, the trigger detection module 10 includes:

[0138] A touch detection component 11, wherein the touch detection component 11 is electrically connected to the main control module 30, and the touch detection component 11 is used to detect that the crown component 200 is touched by a user and output a crown touch detection signal;

[0139] The main control module 30 is used to determine that the crown assembly 200 is in a touched state when the crown touch detection signal is obtained, and output the crown touch signal to the AR device via the communication module 20;

[0140] In this embodiment, the touch detection component 11 can be implemented by a capacitive touch detection component 11, an optical touch detection component 11, etc. When the user touches the crown body 210 with a finger or other body tissue, the touch detection component 11 will confirm that the current crown component 200 is in a touched state, and then output a corresponding crown touch detection signal to the main control module 30.

[0141] and / or, a rotation detection component 12, the rotation detection component 12 being electrically connected to the main control module 30, the rotation detection component 12 being used to detect the rotation state of the crown component 200 and output a corresponding crown rotation detection signal;

[0142] The main control module 30 is used to determine the rotation direction and rotation angle of the crown according to the crown rotation detection signal, and output a corresponding crown rotation signal to the AR device via the communication module 20;

[0143] And / or, a press detection component 13, when the user presses the crown component 200, the crown component 200 triggers the press detection component 13, and the press detection component 13 is used to output a crown press detection signal when triggered;

[0144] The main control module 30 is used to determine that the crown assembly 200 is in a pressed state when the crown pressing detection signal is obtained, and output the crown pressing signal to the AR device via the communication module 20.

[0145] In this embodiment, the press detection component 13 is arranged in the position of the dial 100 relative to the crown component 200. Optionally, the rotation detection component 12 can be implemented by selecting a magnetic induction rotation detection component 12. The magnetic induction transmission detection component includes a magnetic core member arranged in the crown body 210 and at least two Hall sensors placed at different positions relative to the magnetic member. As the user rotates the crown body 210, the position of the magnetic member will move relatively. The main control module 30 can determine the current position of the magnetic member based on the magnetic induction signals detected by the at least two Hall sensors, and then determine the position of the magnetic member. changes, so as to determine the current direction and angle of crown rotation, and output a corresponding crown rotation detection signal to the AR device via the communication module 20, so that the AR device can determine the current direction and angle of crown rotation; optionally, the press detection component 13 can be implemented by a touch button or a membrane button, and the press detection component 13 is arranged in the dial 100, and the position of the corresponding rotation axis is arranged, so that when the user presses the crown body 210, the end of the rotation axis extending into the dial 100 will press on the press detection component 13 to trigger the press detection component 13, thereby causing it to output a crown press detection signal. Optionally, in another embodiment, the rotation detection component 12 and the press detection component 13 can also be the same detection component, that is, the digital crown optical sensor component. The digital crown optical sensor component can be implemented by a light emitting module, an optical tracking sensor, and an image sensor. The light emitting module and the image sensor are arranged below the rotation axis. The light emitting module and the image sensor take a picture once at a preset interval. The optical tracking sensor can determine the rotation direction, rotation distance and front and rear displacement distance of the rotation axis according to the image information transmitted by the image sensor, thereby determining the rotation direction of the crown body and the rotation angle along the direction and outputting a corresponding detection signal to the main control module 30, so that the main control module 30 determines the current rotation state and / or press state of the crown.

[0146] Thus, through the above-mentioned settings, combined with the content of the above-mentioned method implementation example, in actual applications, the user can control the camera function of the AR device by triggering the crown assembly 200 of the smart watch, thereby improving the convenience and flexibility of the user using the AR device for shooting.

[0147] refer to Figure 6 In one embodiment of the present invention, the dial 100 is provided with a wearing side 110, and when the smart watch is worn by a user, the wearing side 110 fits against the user's skin;

[0148] The touch detection component 11 includes a touch detection member and a touch detection chip. The touch detection chip is electrically connected to the touch detection member and the main control module 30 respectively. The touch detection member is arranged on the crown component 200 and is away from the wearing side 110.

[0149] The touch detection component 11 is used to output the crown touch detection signal when confirming that the touch detection element is touched by the user.

[0150] In this embodiment, optionally, the touch detection chip can be implemented by a capacitive touch detection IC, and the corresponding touch detection element electrically connected to the capacitive touch detection IC can be implemented by a metal electrode sheet, such as a copper sheet, a gold-plated electrode sheet, etc., or by a touch spring; specifically, the touch detection element, which is a metal electrode sheet, is close to / facing the inner wall of the crown body 210 in the crown assembly 200 and is electrically connected to the touch detection chip, and at the same time, its position is away from the wearing side 110 and does not change position as the crown assembly 200 rotates, so that the touch detection area 111 formed by the touch detection element is always away from the wearing side 110, thereby preventing the user from accidentally touching the touch detection area 111 with the skin on the wrist when wearing the smart watch, causing false triggering. When the user's finger is placed on the outer surface of the crown body 210 at a position corresponding to the touch detection element, that is, the touch detection area 111 formed by the touch detection element, the capacitance of the touch detection element relative to the capacitance of the ground terminal will change. The touch detection chip will detect the capacitance value of the touch detection element, and when the capacitance value change exceeds a preset value (the preset value can be set by the R&D personnel according to the actual sensitivity requirements, specifically by adjusting the parameters of some devices of its peripheral circuit according to the device specification), it is determined that the current user is touching the touch detection element, and outputs the crown touch detection signal to the main control module 30.

[0151] Through the above-mentioned settings, in actual applications, when the user actually wears the smart watch, the related camera functions of the AR device will not be mistakenly triggered due to the skin on the wrist accidentally touching the touch detection area 111, which further improves the convenience of the user using the crown assembly 200 in the smart watch of the present invention to control the AR device to realize the shooting function.

[0152] The present invention also proposes a smart wearable device assembly, comprising the AR device described above and the smart watch described above.

[0153] It is worth noting that, because the smart wearable device assembly of the present invention includes all embodiments of the above-mentioned smart watch and AR device, the smart wearable device assembly of the present invention has all the beneficial effects of the above-mentioned smart watch and AR device, which will not be repeated here.

[0154] The above descriptions are only optional embodiments of the present invention, and are not intended to limit the patent scope of the present invention. All equivalent structural changes made using the contents of the present invention's specification and drawings, or directly / indirectly applied in other related technical fields, are included in the patent protection scope of the present invention.

Claims

1. A method for controlling an AR device camera, characterized in that: include: The AR device obtains crown action information from the smartwatch; When the crown action information is obtained, the device controls itself to enter the camera state; According to the crown action information, executing a camera action corresponding to the crown action information; The AR device includes a display component and a shooting component, the crown action information includes crown touch information, and when the crown action information is obtained, the steps of controlling the device to enter a camera state are specifically as follows: When the duration of acquiring the crown touch information reaches a first preset duration, determining that the user has a camera requirement, and controlling the device to enter the camera state; The camera state is specifically: the AR device starts the camera component and displays the camera interface on the display component; the camera interface includes the camera mode, camera parameters and the image acquired by the camera component; According to the crown action information, executing a camera action corresponding to the crown action information includes: according to the crown action information, executing at least one of adjusting the camera mode, adjusting the camera parameters, adjusting the image acquired by the shooting component, and shooting the image displayed on the current camera interface.

2. The AR device camera control method according to claim 1, characterized in that: The crown action information includes crown rotation information and crown pressing information, and the step of executing a camera action corresponding to the crown action information according to the crown action information includes: Determining a target camera mode according to the acquired crown rotation information; When the crown pressing information is obtained, controlling itself to enter a camera mode corresponding to the target camera mode; When the crown pressing information is acquired again, the camera function corresponding to the camera mode is executed.

3. The AR device camera control method according to claim 2, characterized in that: Between the step of controlling itself to enter a camera mode corresponding to the target camera mode when the crown pressing information is acquired and the step of executing a camera function corresponding to the camera mode when the crown pressing information is acquired again, the step of executing a camera action corresponding to the crown action information according to the crown action information further includes: Determining target camera parameters corresponding to the target camera mode according to the acquired crown rotation information; When the crown pressing information is obtained again, the camera parameter adjustment mode corresponding to the target camera parameter is entered, and the value of the target camera parameter is adjusted according to the obtained crown rotation information.

4. The AR device camera control method according to any one of claims 1 to 3, characterized in that: The AR device camera control method further includes: Execute an action withdrawal operation based on the crown action information.

5. An AR device, characterized in that: include: Memory; A processor, an AR device photography control program stored in the memory and executed by the processor, wherein when the AR device photography control program is executed by the processor, the AR device photography control method according to any one of claims 1 to 4 is implemented.

6. A smart watch, characterized in that: The smart watch comprises: Crown assembly; A trigger detection module, the trigger detection module is used to output a corresponding trigger detection signal when the crown assembly is triggered by a user; A communication module, wherein the communication module is used to communicate with the AR device; A main control module, the main control module is electrically connected to the trigger detection module and the communication module respectively; The main control module is used to determine, according to the trigger detection signal, that the user triggers the trigger action of the crown component, and output a corresponding crown action signal to the AR device via the communication module, so that the AR device controls itself to enter a camera state when the crown action signal is obtained, and performs a camera action corresponding to the crown action signal according to the crown action signal; The camera state is specifically: the AR device starts the camera component and displays a camera interface on the display component of the AR device; the camera interface includes a camera mode, camera parameters and an image acquired by the camera component; The main control module is used to execute at least one of adjusting the camera mode, adjusting the camera parameters, adjusting the image acquired by the shooting component, and shooting the image displayed on the current camera interface according to the crown action signal.

7. The smart watch according to claim 6, characterized in that: The crown action signal includes a crown touch signal; The main control module is used for, when it is determined according to the trigger detection signal that the trigger action of the crown component triggered by the user is a touch action, outputting the crown touch signal to the AR device via the communication module, so that the AR device controls itself to enter a camera state when the duration of acquiring the crown touch signal reaches a first preset duration; Alternatively, the AR device in the camera state performs an action withdrawal operation when the duration of obtaining the crown touch signal reaches a second preset duration.

8. The smart watch according to claim 6, characterized in that: The crown action signal includes a crown rotation signal; The main control module is used to output the corresponding crown rotation signal to the AR device via the communication module when it is determined according to the trigger detection signal that the user rotates the crown assembly, so that the AR device determines the target camera mode according to the crown rotation signal; Alternatively, the AR device determines a target camera parameter corresponding to the target camera mode according to the crown rotation signal; Alternatively, the AR device adjusts the value of the target camera parameter according to the crown rotation signal.

9. The smart watch according to claim 6, characterized in that: The crown action signal includes a crown pressing signal; The main control module is used to output the crown pressing signal to the AR device via the communication module when it is determined that the user presses the crown component according to the trigger detection signal, so that the AR device controls itself to enter a camera mode corresponding to the target camera mode when the crown pressing signal is obtained; Alternatively, executing a camera function corresponding to the camera mode; Alternatively, enter a camera parameter adjustment mode corresponding to the target camera parameter.

10. The smart watch according to claim 6, characterized in that: The trigger detection module comprises: A touch detection component, the touch detection component is electrically connected to the main control module, and the touch detection component is used to output a crown touch detection signal when detecting that the crown component is touched by a user; The main control module is used to determine that the crown component is in a touched state when the crown touch detection signal is obtained, and output the crown touch signal to the AR device via the communication module; And / or, a rotation detection component, the rotation detection component is electrically connected to the main control module, the rotation detection component is used to detect the rotation state of the crown component and output a corresponding crown rotation detection signal; The main control module is used to determine the rotation direction and rotation angle of the crown according to the crown rotation detection signal, and output a corresponding crown rotation signal to the AR device via the communication module; and / or, a press detection component, when the user presses the crown component, the crown component triggers the press detection component, and the press detection component is used to output a crown press detection signal when triggered; The main control module is used to determine that the crown assembly is in a pressed state when the crown pressing detection signal is obtained, and output the crown pressing signal to the AR device via the communication module.

11. The smart watch according to claim 10, characterized in that: The smart watch is provided with a wearing side, and when the smart watch is worn by a user, the wearing side fits against the user's skin; The touch detection component includes a touch detection member and a touch detection chip, the touch detection chip is electrically connected to the touch detection member and the main control module respectively, and the touch detection member is arranged on the crown component and away from the wearing side; The touch detection component is used to output the crown touch detection signal when it is confirmed that the touch detection element is touched by the user.

12. A smart wearable device component, characterized in that: It comprises the AR device as described in claim 5 and the smart watch as described in any one of claims 6-11.

Citation Information

Patent Citations

  • Photography controlling method, intelligent watch, photography terminal and system

    CN105187710A

  • Intelligent terminal-based information interaction system and intelligent head-mounted device

    CN105933023A