Control method and apparatus, electronic device, and wearable ar device

Abstract

A control method and apparatus, an electronic device, and a wearable AR device, relating to the technical field of electronics. The method comprises: an electronic device displays a photographing preview interface (201); the electronic device transmits a real-time preview image in the photographing preview interface to a wearable AR device for display (202); the electronic device receives a control instruction (203), wherein the control instruction comprises photographing control information, and the control instruction is triggered by the electronic device, or the control instruction is sent by the wearable AR device; and on the basis of the photographing control information, the electronic device executes a control operation indicated by the photographing control information (204).

Description

Control methods, devices, electronic equipment and wearable AR devices

[0001] Cross-reference to related applications

[0002] This application claims priority to Chinese Patent Application No. 202410915811.8, filed on July 9, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application belongs to the field of electronic technology, specifically relating to a control method, device, electronic device, and wearable (Augmented Reality, AR) device. Background Technology

[0004] With the widespread use of social media and advancements in photography technology, users' demand for taking photos and videos from a distance has become increasingly strong. Currently, users can use electronic devices for long-distance shooting; for example, during travel and adventure, users want to capture details of distant scenery and magnificent landscapes. Or, during live music performances and concerts, users want to use their devices to capture performances and exciting moments on a distant stage.

[0005] However, when electronic devices take pictures at a distance, due to the large distance between the electronic device and the subject, it is usually necessary to adjust the shooting preview interface to enlarge the preview image of the subject captured by the electronic device. However, enlarging the preview image will reduce the pixel value of the image, resulting in the loss of many details in the captured image, which in turn leads to a poor display effect of the captured image. Summary of the Invention

[0006] The purpose of this application is to provide a control method, apparatus, electronic device, and wearable AR device that can improve the quality and effect of captured images.

[0007] In a first aspect, embodiments of this application provide a control method, which includes: an electronic device displaying a shooting preview interface; the electronic device transmitting a real-time preview image from the shooting preview interface to a wearable AR device for display; the electronic device receiving a control command, the control command containing shooting control information, the control command being triggered by the electronic device; or, the control command being sent by the wearable AR device; and the electronic device executing a control operation indicated by the shooting control information based on the shooting control information.

[0008] Secondly, embodiments of this application provide a control method, which includes: a wearable AR device displaying a preview screen transmitted by an electronic device, the preview screen being a real-time preview screen captured by the electronic device; upon receiving a first input from a user, the wearable AR device determining shooting control information and generating a control command, the control command including the shooting control information; and the wearable AR device sending the control command to the electronic device.

[0009] Thirdly, embodiments of this application provide a control device, which includes: a display module, a transmission module, a receiving module, and a processing module; the display module is used to display a shooting preview interface; the transmission module is used to transmit the real-time preview image in the shooting preview interface displayed by the display module to a wearable AR device for display; the receiving module is used to receive control commands, the control commands containing shooting control information, and the control commands being triggered by an electronic device; or, the control commands being sent by the wearable AR device; the processing module is used to execute the control operations indicated by the shooting control information based on the shooting control information received by the receiving module.

[0010] Fourthly, embodiments of this application provide a control device, which includes: a display module, a processing module, and a sending module; the display module is used to display a preview screen transmitted by an electronic device, the preview screen being a real-time preview screen captured by the electronic device; the processing module is used to determine shooting control information upon receiving a first input from a user; the processing module is also used to generate a control command, the control command containing the shooting control information; the sending module is used to send the control command generated by the processing module to the electronic device.

[0011] Fifthly, embodiments of this application provide an electronic device including a processor and a memory, the memory storing programs or instructions executable on the processor, the programs or instructions, when executed by the processor, implementing the steps of the method described in the first or second aspect.

[0012] In a sixth aspect, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first or second aspect.

[0013] In a seventh aspect, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the methods described in the first or second aspect.

[0014] Eighthly, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method as described in the first or second aspect.

[0015] In this embodiment, the electronic device displays a shooting preview interface and transmits the real-time preview image from the shooting preview interface to a wearable AR device for display. Then, the electronic device receives control commands and, based on shooting control information, executes the control operations indicated by the shooting control information. The control commands contain shooting control information and are triggered by the electronic device; alternatively, the control commands are sent by the wearable AR device. In this solution, the electronic device transmits the real-time preview image captured by the shooting preview interface to the wearable AR device, enabling the wearable AR device to clearly and completely display the image captured by the electronic device. The electronic device can control the electronic device to execute control operations based on the control commands returned by the wearable AR device or the shooting control information contained in the control commands triggered by the electronic device. Due to the characteristics of the wearable AR device, the clarity of the preview image viewed by the user is improved, and the user can control the electronic device to execute corresponding control operations based on the viewed image, thereby improving both the clarity of the preview image and the shooting effect of the electronic device. Attached Figure Description

[0016] Figure 1 is a schematic flowchart of one of the control methods provided in an embodiment of this application;

[0017] Figure 2 is a schematic diagram of one example of a mobile phone interface provided in an embodiment of this application;

[0018] Figure 3 is a second example of a mobile phone interface provided in an embodiment of this application;

[0019] Figure 4 is a second schematic flowchart of a control method provided in an embodiment of this application;

[0020] Figure 5 is a third example of a mobile phone interface provided in an embodiment of this application;

[0021] Figure 6 is a fourth example of a mobile phone interface provided in an embodiment of this application;

[0022] Figure 7 is a third schematic flowchart of a control method provided in an embodiment of this application;

[0023] Figure 8 is a schematic diagram of the interaction process between an electronic device and a wearable AR device provided in an embodiment of this application;

[0024] Figure 9 is a flowchart illustrating another control method provided in an embodiment of this application;

[0025] Figure 10 is a schematic diagram of one of the structures of a control device provided in an embodiment of this application;

[0026] Figure 11 is a second schematic diagram of a control device provided in an embodiment of this application;

[0027] Figure 12 is one of the hardware structure diagrams of an electronic device provided in an embodiment of this application;

[0028] Figure 13 is a second schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0029] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0030] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0031] The terms "at least one," "at least one of," etc., used in the specification and claims of this application refer to any one, any two, or a combination of two or more of the included items. For example, "at least one of a, b, and c" can mean: "a," "b," "c," "a and b," "a and c," "b and c," and "a, b, and c," where a, b, and c can be single or multiple. Similarly, "at least two" refers to two or more items, and its meaning is similar to that of "at least one."

[0032] The electronic devices in this application embodiment can be mobile phones, tablets, laptops, handheld computers, vehicle-mounted electronic devices, etc., and this application embodiment does not limit them.

[0033] The wearable device in this application embodiment can be: AR glasses, AR helmet, smart bracelet, smartwatch, etc., and this application embodiment does not limit it.

[0034] The control method, apparatus, electronic device, and wearable AR device provided in this application will be described in detail below with reference to the accompanying drawings and through specific embodiments and application scenarios.

[0035] With the widespread use of social media and advancements in photography technology, users' demand for taking photos and videos from a distance has become increasingly strong. This trend is mainly influenced by the following usage scenarios:

[0036] During travel and adventure, users want to be able to capture details and magnificent landscapes of distant scenery, such as distant mountains, rivers, oceans, or buildings;

[0037] For sports enthusiasts and professional photographers, capturing high-energy moments of long-distance sports competitions and events is a pressing need, such as football matches, horse races, and track and field events.

[0038] Nature photographers also need to be able to capture the behavior and habitats of wild animals from a distance, which requires techniques and equipment for long-distance shooting;

[0039] Live music performances and concerts are among the most popular subjects for users to photograph, as they hope to use their devices to capture performances and exciting moments on distant stages.

[0040] However, when using electronic devices, such as mobile phones, for long-distance shooting, users face a common problem: due to the small screen size, an immersive experience is impossible, making it difficult to clearly observe and appreciate distant content. This limits the user's viewing experience, preventing them from fully experiencing the realism and three-dimensionality of distant objects. Secondly, in long-distance shooting, to see details clearly, the phone screen needs to be magnified; however, magnifying the image reduces the pixel count, resulting in unclear details.

[0041] Therefore, in the development of long-distance shooting technology, improving the user's viewing experience and the shooting effect of electronic devices are aspects that users are very concerned about.

[0042] Currently, in the electronics industry, the main solution to the problem of small phone screens when shooting at long distances is to provide phones with larger screens to improve the viewing experience. Larger screens can improve the visual experience to some extent, allowing users to appreciate distant content more clearly and better observe and perceive the details and textures of distant objects. However, larger screens don't significantly enhance the user's immersive experience, and they are not suitable for all users. Large-screen devices are also less portable due to their size, and not all users desire a large phone.

[0043] The control method provided in this application involves an electronic device displaying a shooting preview interface and transmitting the real-time preview image from the shooting preview interface to a wearable AR device for display. The electronic device then receives control commands and, based on shooting control information, executes control operations indicated by the shooting control information. The control commands include shooting control information and are triggered by the electronic device; alternatively, the control commands are sent by the wearable AR device. In this solution, the electronic device transmits the real-time preview image captured by the shooting preview interface to the wearable AR device, enabling the wearable AR device to clearly and completely display the image captured by the electronic device. The electronic device can control the electronic device to execute control operations based on the shooting control information contained in the control commands returned by the wearable AR device or the control commands triggered by the electronic device. Due to the characteristics of the wearable AR device, the clarity of the preview image viewed by the user is improved, and the user can control the electronic device to execute corresponding control operations based on the viewed image. This improves both the clarity of the preview image and the shooting effect of the electronic device.

[0044] The execution subject of the control method provided in this embodiment can be a control device, which can be an electronic device, or a control module or processing module in the electronic device, etc. The following uses an electronic device as an example to illustrate the technical solution provided in this application embodiment.

[0045] This application provides a control method. Figure 1 shows a flowchart of a control method provided by this application, which can be applied to an electronic device. As shown in Figure 1, the control method provided by this application may include the following steps 201 to 204.

[0046] Step 201: The electronic device displays the shooting preview interface.

[0047] In some embodiments of this application, the aforementioned shooting preview interface is the interface of an electronic device when the camera is turned on or when a shooting application takes a picture.

[0048] For example, taking a mobile phone as an example, the shooting preview interface when the phone is placed vertically is shown in Figure 2, and the shooting preview interface when the phone is placed in landscape mode is shown in Figure 3. The shooting preview interface 21 of the phone displays the shooting content 22 in the real-time preview screen. The shooting content includes a forest, a person, and a bird. At the same time, the user can exit the current shooting preview interface by clicking the control 23 and long-pressing.

[0049] Step 202: The electronic device transmits the real-time preview image from the shooting preview interface to the wearable AR device for display.

[0050] In some embodiments of this application, the real-time preview screen in the above-mentioned shooting preview interface is a screen of the shooting object or shooting scene captured in real time by the electronic device.

[0051] In some embodiments of this application, the wearable AR device described above can be AR glasses, AR helmets, smart bracelets, smartwatches, etc., and this application does not limit it.

[0052] In some embodiments of this application, the electronic device establishes a connection with the wearable AR device.

[0053] For example, the connection can be established via Bluetooth, data cable, or network connection.

[0054] For example, electronic devices can establish a connection with wearable AR devices using a DP data cable.

[0055] In some embodiments of this application, the electronic device transmits the data stream of the real-time preview image collected by the electronic device to the wearable AR device for display through a connection with the wearable AR device.

[0056] Optionally, in some embodiments of this application, before the electronic device transmits the aforementioned real-time preview image to the wearable AR device, the user can select an effects mode in the electronic device, such as a telescope mode. This effects mode is used to indicate that the electronic device is connected to the wearable AR device. In this effects mode, the electronic device can clearly capture distant scenes and enable the electronic device to transmit the captured real-time preview image to the wearable AR device.

[0057] Step 203: The electronic device receives the control command.

[0058] In some embodiments of this application, the control instructions described above include shooting control information.

[0059] In some embodiments of this application, the control commands are triggered by an electronic device or sent by a wearable AR device.

[0060] In some embodiments of this application, the above control instructions are used to control the electronic device to adjust the real-time preview screen, or to control the electronic device to take pictures.

[0061] In some embodiments of this application, the above-mentioned shooting control information includes at least one of the following: control information for controlling shooting, and adjustment information for adjusting the preview screen captured by the electronic device.

[0062] In some embodiments of this application, when the shooting control information includes control information for controlling shooting, the above control instructions are used to control the electronic device to perform shooting operations.

[0063] In some embodiments of this application, when the shooting control information includes adjustment information for adjusting the preview screen captured by the electronic device, the above control instructions are used to adjust the preview screen captured by the electronic device.

[0064] In some embodiments of this application, the above-mentioned adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching shooting modes.

[0065] In some embodiments of this application, the above-mentioned field of view adjustment information may be a moving camera, a magnification factor of the field of view, or a reduction factor of the field of view, etc., and this application does not limit it in this regard.

[0066] For example, the aforementioned mobile camera specifically includes, but is not limited to, moving forward, backward, left, right, up, down, horizontally, and vertically. Alternatively, the aforementioned field-of-view adjustment information may also include the accompanying movement distance, such as moving forward 10 centimeters or moving upward 5 centimeters.

[0067] In some embodiments of this application, the above-mentioned shooting parameter adjustment information can be the adjustment amount of the shooting parameters.

[0068] For example, the above shooting parameters include, but are not limited to, brightness value, white balance, grayscale value, or beauty parameters.

[0069] In some embodiments of this application, the above-mentioned subject information is used to indicate one or more subjects, which are used to determine the subject to be focused.

[0070] For example, the above-mentioned determination of the focus object can be understood as determining the focus object in the currently captured preview screen.

[0071] In some embodiments of this application, the above-mentioned shooting modes include, but are not limited to, photo mode, video mode, beauty mode, or special effects mode.

[0072] Step 204: The electronic device executes the control operation indicated by the shooting control information based on the shooting control information.

[0073] In some embodiments of this application, when the shooting control information includes control information for controlling shooting, the above-mentioned control operation is to control the electronic device to perform a shooting operation.

[0074] In some embodiments of this application, when the shooting control information includes adjustment information for adjusting the preview screen captured by the electronic device, the above control operation is to control the electronic device to adjust the captured preview screen according to the adjustment information.

[0075] In some embodiments of this application, the above-mentioned control operation, which is the operation of controlling the electronic device to adjust the acquired preview screen according to the adjustment information, includes at least one of the following:

[0076] Adjust the shooting field of view;

[0077] The camera of an electronic device can be moved or rotated;

[0078] Adjust the focus object;

[0079] Adjust the shooting parameters;

[0080] Switch shooting modes.

[0081] In the control method provided in this application embodiment, an electronic device displays a shooting preview interface and transmits the real-time preview image in the shooting preview interface to a wearable AR device for display. Then, the electronic device receives a control command and, based on shooting control information, executes the control operation indicated by the shooting control information. The control command includes shooting control information and is triggered by the electronic device; alternatively, the control command is sent by the wearable AR device. In this solution, the electronic device transmits the real-time preview image captured by the shooting preview interface to the wearable AR device, enabling the wearable AR device to clearly and completely display the image captured by the electronic device. The electronic device can control the electronic device to execute control operations based on the shooting control information contained in the control command returned by the wearable AR device or the control command triggered by the electronic device. Due to the characteristics of the wearable AR device, the clarity of the preview image viewed by the user is improved, and the user can control the electronic device to execute corresponding control operations based on the viewed image, thereby improving both the clarity of the preview image and the shooting effect of the electronic device.

[0082] Optionally, in some embodiments of this application, when the control command is triggered by an electronic device, before step 203 "the electronic device receives the control command", the control method provided in this application further includes steps B1 and B2:

[0083] Step B1: The electronic device receives the user's first input to the display screen of the electronic device.

[0084] In some embodiments of this application, the first input described above is used to generate control commands.

[0085] In some embodiments of this application, the first input may include touch input by the user clicking the display screen, or voice command input by the user, or specific gesture input by the user. The specific input may be determined according to actual usage needs, and this application does not limit it.

[0086] For example, the aforementioned touch input includes user swiping input or clicking input on the display screen of the electronic device. Specific gestures in this application embodiment can be any one of a single-click gesture, a swipe gesture, a pressure-recognition gesture, a long-press gesture, an area-change gesture, a double-press gesture, or a double-tap gesture; the clicking input in this application embodiment can be a single-click input, a double-tap input, or any number of clicks, etc., and the aforementioned clicking input can also be a long-press input or a short-press input.

[0087] Step B2: The electronic device responds to the first input and generates a control command.

[0088] In some embodiments of this application, the electronic device generates different control commands when the first input is a different input parameter.

[0089] In some embodiments of this application, the above-mentioned input parameters include at least one of the following: input gesture, number of inputs, input duration, input trajectory, and input direction.

[0090] In one example, the first input mentioned above is clicking the display screen of the electronic device, which generates control instructions for controlling the electronic device to start or stop shooting.

[0091] For example, when a user is in photo mode, tapping the phone screen with their finger can capture a photo of the current moment; when a user is in video mode, tapping the phone screen to start recording will start the recording, and the glasses screen will begin recording the current moment and display the current recording duration; tapping the phone screen to stop recording will stop the recording.

[0092] In another example, the first input mentioned above is double-clicking the display screen of the electronic device, which generates control commands to control the electronic device to start or stop shooting.

[0093] For example, when a user is in photo mode, double-tapping the phone screen with their finger can capture a photo of the current moment; when a user is in video mode, double-tapping the phone screen with their finger to start recording will start the recording, and the glasses screen will begin recording the current moment and display the current recording duration; when a user wants to stop recording, double-tapping the phone screen with their finger will stop the recording.

[0094] In another example, if the first input is the display screen of a sliding electronic device, then control commands for adjusting the shooting mode are generated.

[0095] For example, when a user is in photo mode, moving their finger to the right on the phone screen switches to video mode; when a user is in video mode, swiping their finger to the left on the phone screen switches to photo mode.

[0096] It is understandable that the above sliding input can be a sliding motion in any direction.

[0097] In another example, if the first input is pinching the display screen of an electronic device with two fingers, then control commands are generated to narrow the field of view for shooting.

[0098] In another example, if the first input is to pull open the display screen of an electronic device with two fingers, then a control command is generated to magnify the field of view for shooting.

[0099] In another example, if the first input is clicking on a subject in the preview screen of an electronic device, then control instructions for adjusting the focus on that subject are generated.

[0100] For example, if there are trees, people, and birds in the current preview, and the user wants to adjust the focus to the bird, they can switch the focus by clicking on the bird, which is the subject of the photo.

[0101] In another example, if the first input is clicking a setting control on the display screen of an electronic device, then control instructions for adjusting shooting parameters are generated.

[0102] For example, when a user clicks on the settings controls on the display screen of an electronic device, the user can adjust parameters such as white balance, brightness, or skin smoothing.

[0103] In this way, after the electronic device transmits the preview image to the wearable AR device, the user can adjust the preview image transmitted to the wearable AR device by inputting the electronic device, thereby more conveniently and quickly achieving the desired viewing effect and improving the shooting quality.

[0104] Optionally, in some embodiments of this application, as shown in FIG4, when the shooting control information includes adjustment information for adjusting the preview screen, the above step 204 "the electronic device executes the control operation indicated by the shooting control information based on the shooting control information" specifically includes step 204a:

[0105] Step 204a: Based on the adjustment information, the electronic device updates the preview screen in the shooting preview interface and transmits the updated preview screen in the shooting preview interface to the wearable AR device for display.

[0106] In some embodiments of this application, the electronic device controls and adjusts the shooting field of view, shooting parameters or shooting object according to the above adjustment information, and then continues to collect the adjusted preview screen, thereby updating the preview screen collected by the electronic device, and transmitting the data stream corresponding to the updated preview screen to the wearable AR device.

[0107] For example, referring to Figure 3, if a user wants to observe a bird, the user can pull two fingers apart in the bird display area, which is the first input mentioned above. At this time, the electronic device determines that the shooting control information is to magnify the shooting field of view of the bird area, and then magnifies the shooting field of view of the bird area according to the shooting control information to update the display as shown in Figure 5, thereby obtaining the updated preview image, which is a single bird.

[0108] For example, referring to Figure 3, if the user is currently in photo mode and wants to control the shooting of the forest on the right, the user can slide the screen to the right. At this time, the electronic device determines that the shooting control information is to rotate the camera to the right, and then controls the camera of the electronic device to move 10 centimeters to the right according to the shooting control information, so as to update the display as shown in Figure 6, thus obtaining the updated preview image, which is a forest.

[0109] It should be noted that after the real-time preview image captured by the electronic device is updated, the preview image in the wearable AR device will also be updated accordingly.

[0110] In this way, the electronic device can update the preview screen in the shooting preview interface according to the adjustment information included in the shooting control information in the received control command, which improves the convenience of screen adjustment and also provides a variety of shooting methods.

[0111] Optionally, in some embodiments of this application, as shown in FIG7, when the shooting control information includes control information for controlling shooting, the above step 204 "the electronic device executes the control operation indicated by the shooting control information based on the shooting control information" specifically includes step 204b:

[0112] Step 204b: The electronic device controls the camera to capture images or videos and transmits the captured images or videos to the wearable AR device for display.

[0113] In some embodiments of this application, after receiving control information for controlling shooting, the electronic device performs shooting according to the shooting behavior indicated in the control information.

[0114] For example, the control information mentioned above may include at least one of the following: countdown shooting, start shooting, end shooting, timed shooting.

[0115] For example, when the control information is a countdown shooting, the control instruction can be to start shooting after the countdown ends in 3 seconds; when the control information is to start shooting, the control instruction can be to capture the current moment preview; when the control information is to end shooting, the control instruction can be to end the current shooting; when the control information is timed shooting, the control instruction can be to shoot video from the current moment to 1 minute later.

[0116] In some embodiments of this application, after controlling the camera to capture images, the electronic device can transmit the data stream corresponding to the captured images or videos to the wearable AR device through a connection with the wearable AR device.

[0117] In some embodiments of this application, when a wearable AR device receives a data stream corresponding to an image or video captured by an electronic device, it can perform image enhancement processing on the image or video to make the image details clearer.

[0118] Thus, when images or videos captured by electronic devices are transmitted to wearable AR devices, further image processing can be performed on the images or videos to obtain clearer images or videos with richer details, thereby improving the shooting effect.

[0119] The execution subject of the control method provided in this embodiment can be a control device, which can be a wearable AR device, or a control module or processing module in the wearable AR device, etc. The following uses a wearable AR device as an example to illustrate the technical solution provided in this application embodiment.

[0120] This application provides a control method. Figure 8 shows a flowchart of a control method provided by this application, which can be applied to wearable AR devices. As shown in Figure 8, the control method provided by this application may include the following steps 301 to 303.

[0121] Step 301: The wearable AR device displays the preview screen transmitted by the electronic device.

[0122] In some embodiments of this application, the above-mentioned preview screen is a real-time preview screen captured by an electronic device.

[0123] In some embodiments of this application, after the electronic device transmits the preview image to the wearable AR device, the wearable AR device can process the preview image before displaying it.

[0124] In some embodiments of this application, when a wearable AR device displays content using AR technology, the displayed content can be projected onto any carrier via a projection device. This projection device can be an AR-enabled projection device, such as the wearable AR device in the embodiments of this application.

[0125] When AR technology is used to display content on a virtual screen, the projection device can project the real-world scene acquired by the projection device (or integrated internally) onto the virtual screen, allowing the virtual screen to display this content and thus show the real-world scene to the user.

[0126] In one example, when the virtual screen is the lens of AR glasses, the projection device can be the AR glasses themselves. When a user wears the glasses, the user can take a picture of a real-world scene using an electronic device and project it onto the lens of the AR glasses, allowing the user to see the real-world scene through the lens of the AR glasses.

[0127] In some embodiments of this application, the preview image transmitted by the above-mentioned electronic device is processed and rendered in the renderer (SurfaceView) of the wearable AR device.

[0128] For example, the process by which the wearable AR device receives and displays the preview image transmitted by the electronic device is as follows:

[0129] On the wearable AR device, create a SurfaceViewTexture object, which will serve as the carrier for displaying the preview image. Next, in the wearable AR device's Extensible Markup Language (XML) layout file, add a SurfaceView and set its parameters to ensure the preview image is correctly displayed in the user's field of view. Simultaneously, use the SurfaceViewTexture's setOnFrameAvailableListener method to receive new preview frames. On the electronic device, use the Camera2 Software Development Kit (Camera2 SDK) to access and configure the system camera to acquire the preview image data stream and bind the wearable AR device's SurfaceViewTexture to the electronic device's camera preview image data stream. After configuring the electronic device's camera parameters, open the camera preview and send the preview image data to the wearable AR device's SurfaceViewTexture via a DP data connection. This allows the high-definition image captured by the electronic device's system camera to be displayed in real-time on the wearable AR device.

[0130] Step 302: Upon receiving the user's first input, the wearable AR device determines the shooting control information and generates control commands.

[0131] Step 303: The wearable AR device sends control commands to the electronic device.

[0132] In some embodiments of this application, the control instructions described above include shooting control information.

[0133] In some embodiments of this application, the above control instructions are used to control the electronic device to adjust the real-time preview screen, or to control the electronic device to take pictures.

[0134] In some embodiments of this application, the above-mentioned shooting control information includes at least one of the following: control information for controlling shooting, and adjustment information for adjusting the preview screen captured by the electronic device.

[0135] In some embodiments of this application, when the shooting control information includes control information for controlling shooting, the above control instructions are used to control the electronic device to perform shooting operations.

[0136] In some embodiments of this application, when the shooting control information includes adjustment information for adjusting the preview screen captured by the electronic device, the above control instructions are used to adjust the preview screen captured by the electronic device.

[0137] In some embodiments of this application, the above-mentioned adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching shooting modes.

[0138] In the control method provided in this application embodiment, the wearable AR device displays a preview image transmitted by an electronic device, the preview image being a real-time preview image captured by the electronic device. Upon receiving a first input from the user, the wearable AR device determines shooting control information and generates a control command, which includes the shooting control information. The wearable AR device then sends the control command to the electronic device. In this solution, the electronic device transmits the real-time preview image captured by the shooting preview interface to the wearable AR device, enabling the wearable AR device to clearly and completely display the image captured by the electronic device. The wearable AR device can generate different control commands based on the user's input, thereby controlling the electronic device to perform control operations, thus improving the shooting effect and the user's viewing experience.

[0139] Optionally, in some embodiments of this application, the "determine shooting control information" in step 302 above specifically includes step 302a:

[0140] Step 302a: The wearable AR device responds to the first input and determines shooting control information based on the input parameters of the first input.

[0141] In some embodiments of this application, the above-mentioned input parameters include at least one of the following: input duration, input direction, input trajectory, and input position.

[0142] In some embodiments of this application, the first input is used to determine adjustment information for adjusting the preview screen, or to control the shooting.

[0143] In some embodiments of this application, the first input may include air gesture input, voice command input by the user, or a specific gesture input by the user. The specific input may be determined according to actual usage requirements, and this application does not limit the specific input.

[0144] For example, the specific gesture in the embodiments of this application can be any one of the following: opening the palm, sliding gesture, area change gesture, and double-tap gesture.

[0145] In one example, if the first input is an open or closed hand gesture, then the shooting control information is determined to be the shooting control information.

[0146] For example, when a user is in photo mode, they extend their hand into the field of view of the camera on the wearable AR device, and input an open palm gesture to confirm the shooting control information as capturing a photo of the current moment. When a user is in video recording mode, they input an open palm gesture to confirm the shooting control information as starting video recording, and the wearable AR device begins recording the current moment and displays the current recording duration. When the user wants to stop recording, they input a closed palm gesture to stop recording.

[0147] In another example, if the first input is a swipe gesture, then the shooting control information is determined to be adjusting the shooting mode.

[0148] For example, when a user is in photo mode, they can extend their hand into the field of view of the camera on the wearable AR device that recognizes gestures, and swipe right to confirm the shooting control information to switch to video recording mode; when a user is in video recording mode, they can swipe left to confirm the shooting control information to switch to video recording mode.

[0149] It is understandable that the above swipe gesture can be a swipe in any direction.

[0150] In another example, if the first input is a two-finger pinch gesture, then the shooting control information is determined to be narrowing the shooting field of view.

[0151] In another example, if the first input is a two-finger pull gesture, then the shooting control information is determined to be magnified shooting field of view.

[0152] In another example, if the first input is a directional gesture, then the shooting control information is determined to identify the pointed shooting object as the focus object.

[0153] For example, if there are trees, people, and birds in the current preview image, and the user wants to adjust the focus to the bird, the user can put their hand within the shooting range of the camera that recognizes gestures on the wearable AR device and point at the bird, i.e., the aforementioned subject, to switch the focus.

[0154] In another example, if the first input is a special input trajectory, then the shooting control information is determined to be adjusting the shooting parameters.

[0155] For example, when a user places their hand within the field of view of the camera on a wearable AR device that recognizes gestures, and inputs a gesture with a specific input trajectory, the wearable AR device brings up a shooting parameter settings interface. The user can adjust shooting parameters in the shooting parameter interface, such as white balance parameters, brightness parameters, or skin smoothing parameters.

[0156] In another example, if the first input is voice input, the wearable AR device determines the shooting control information based on the recognized voice content.

[0157] Example 1: When in photo mode, you can enter the voice command "switch mode". The wearable AR device recognizes the voice command and confirms that the shooting control information is to switch the current mode to video recording. Similarly, when in video recording mode, you can also enter the voice command "switch mode" to confirm that the shooting control information is to switch the current mode to photo recording.

[0158] Example 2: When in photo mode, if you input the voice command "Take a photo", the wearable AR device will determine the shooting control information as capturing and recording the current moment; when in video mode, if you input the voice command "Start", the wearable AR device will determine the shooting control information as starting to record the current moment, and if you input the voice command "Stop", the wearable AR device will determine the shooting control information as stopping video recording.

[0159] Example 3: When the user inputs the voice command "I want to see further", the wearable AR device determines the shooting control information to increase the current camera focal length; when the user instructs "I want to see closer", the wearable AR device determines the shooting control information to decrease the current camera focal length.

[0160] Example 4: When a user indicates "I want to observe something in the distance more closely", the wearable AR device determines that the shooting control information is to switch the focus object and transmits the shooting control information to the electronic device.

[0161] Understandably, in Example 4, the electronic device uses target detection technology to locate the region of interest (ROI) of the object based on the shooting control information sent by the wearable AR device, controls the camera to zoom in, magnifies the ROI, and sends the magnified image back to the wearable AR device to display the magnified object to the user.

[0162] In this way, after the electronic device transmits the preview image to the wearable AR device, the user can adjust the preview image transmitted by the electronic device to the wearable AR device by inputting into the wearable AR device, thereby more conveniently and quickly achieving the desired viewing effect and improving shooting quality.

[0163] Optionally, in some embodiments of this application, step 302, "the wearable AR device determines shooting control information and generates control commands upon receiving the user's first input," specifically includes steps 302c and 302d:

[0164] Step 302c: Upon receiving the user's first input, the wearable AR device acquires the user's gaze focus information.

[0165] In some embodiments of this application, the aforementioned gaze focus information may be the gaze information of the user looking at the preview image.

[0166] In some embodiments of this application, the above-mentioned gaze focus information includes at least one of the following: gaze focus position, gaze focus movement trajectory, gaze focus movement direction, and gaze focus dwell time.

[0167] For example, the aforementioned focal point can be the location or area where the user's gaze is focused in the preview image.

[0168] For example, the movement trajectory of the aforementioned focal point can be the movement trajectory of the user's gaze in the preview screen.

[0169] For example, the direction of movement of the aforementioned focal point can be the direction of movement of the user's gaze in the preview screen.

[0170] For example, the duration of the focus of the gaze can be the duration of the user's gaze on the preview screen.

[0171] In some embodiments of this application, the first input is used to activate the wearable AR device to obtain the user's gaze focus information.

[0172] For example, the first input described above is used to activate the gaze recognition function of the wearable AR device. This gaze recognition function is used to capture the user's gaze as they look at the preview screen.

[0173] Step 302d: The wearable AR device determines the shooting control information based on the gaze focus information.

[0174] In some embodiments of this application, different line-of-sight focus information corresponds to different shooting control information.

[0175] In some embodiments of this application, wearable AR devices can identify the focus information of a user's eye gaze through specific recognition devices.

[0176] In one example, when the user's gaze is focused on a certain area in the preview screen, the wearable AR device determines the shooting control information based on the content displayed in that area.

[0177] Example 5: In photo mode, when the user's gaze is within the viewing area of ​​the preview screen and includes the shooting controls, the wearable AR device determines the shooting control information to capture the current preview screen. In video mode, when the user's gaze is within the viewing area of ​​the preview screen and includes the shooting controls, the wearable AR device determines the shooting control information to start recording the preview screen from the current moment; if the user's gaze is again detected within the viewing area of ​​the preview screen including the shooting controls, the wearable AR device determines the shooting control information to stop recording the preview screen.

[0178] Example 6: When the user's gaze is within the area of ​​focus in the preview screen, including the subject being photographed, the wearable AR device determines the shooting control information as switching the focus object.

[0179] In one example, when the user's gaze moves along a specific trajectory in the preview screen, the wearable AR device determines the shooting control information based on the different trajectories.

[0180] Example 7: In photo mode, when the user's gaze moves from left to right in the preview screen, the wearable AR device determines the shooting control information to switch to video recording mode. In video recording mode, when the user's gaze moves from right to left in the preview screen, the wearable AR device determines the shooting control information to switch to photo mode.

[0181] Example 8: When the user's gaze moves from top to bottom in the preview screen, the wearable AR device determines that the shooting control information is to adjust the shooting parameters. The shooting parameter interface can be brought up, and the user can adjust the shooting parameters in the shooting parameter interface, such as white balance parameters, brightness parameters, or skin smoothing parameters.

[0182] It should be noted that the input methods involved in the embodiments of this application are only illustrative examples and are not intended to limit the scope of this application.

[0183] In this way, wearable AR devices can directly recognize the user's gaze to generate control commands, thereby controlling electronic devices to perform control operations, improving the convenience of user operation and thus improving shooting efficiency.

[0184] Optionally, in some embodiments of this application, after step 303 "the wearable AR device sends a control command to the electronic device" described above, the control method provided in the embodiments of this application further includes step 401:

[0185] Step 401: The wearable AR device displays the first prompt message.

[0186] In some embodiments of this application, the first prompt information includes shooting control information.

[0187] In some embodiments of this application, after the wearable AR device sends control commands to the electronic device, it can display the shooting control information in the preview screen of the wearable AR device, thereby prompting the user to perform the operation.

[0188] In this way, by displaying prompts on wearable AR devices, the actions performed by users can be explained to them in a more concise and clear manner.

[0189] The following describes in detail the implementation process of the control method between the electronic device and the wearable device using one possible embodiment, as shown in Figure 9, specifically including steps A1 to A7:

[0190] Step A1: The electronic device displays the shooting preview interface and captures the real-time preview image through the camera of the electronic device.

[0191] Step A2: The electronic device sends the captured real-time preview image to the wearable AR device.

[0192] Step A3: The wearable AR device receives the real-time preview image sent by the electronic device.

[0193] Step A4: The wearable AR device displays the real-time preview image captured by the electronic device.

[0194] Step A5: The wearable AR device determines the shooting control information based on the user input, generates control commands, and executes step A6; or the electronic device receives the user input, generates control commands, skips step A6, and executes step A7.

[0195] Step A6: The wearable AR device sends control commands to the electronic device.

[0196] Step A7: The electronic device executes the control operation indicated by the shooting control information in the control command.

[0197] Specifically, the aforementioned electronic device can be a mobile phone, and the aforementioned wearable AR device can be AR glasses.

[0198] The user wears AR glasses and connects the phone and AR glasses using a DP cable. The phone can transmit the preview image from its camera to the SurfaceView on the AR glasses for display. After the connection is established, the user taps the camera app, opens the camera, selects and enters telescope mode to capture distant images. The phone then transmits the captured preview image to the AR glasses, allowing the user to view it in real-time. To adjust the preview, the user can make specific gestures, use voice input, or change their gaze. The AR glasses recognize these gestures, voice input, or changes in gaze and, based on the input, determine different shooting control information to generate control commands, thus adjusting the preview image. Alternatively, the user can directly input different information on the phone screen. The phone, based on the received input, determines different shooting control information and generates different control commands, thus adjusting the preview image. The user can also generate control information to control the phone's camera in the same way, enabling the electronic device to capture preview images.

[0199] Thus, this application proposes a long-distance shooting system based on wearable AR devices and electronic devices. Users can view distant scenes in real time through wearable AR devices, gaining an unprecedented immersive experience, as if they were actually there, deeply feeling the vivid details and emotional experience of the distant scene. At the same time, users can also use the shooting function to record those touching moments. In addition, users can control the electronic device to zoom through finger zoom or voice commands, adjusting the viewing distance and target in real time, allowing for intuitive and WYSIWYG viewing.

[0200] Each of the above-described method embodiments, or various possible implementations of each method embodiment, can be executed individually or in combination of any two or more. The specific implementation can be determined according to actual usage requirements, and this application does not impose any restrictions on this.

[0201] It should be noted that the control method provided in this application can be executed by a control device, an electronic device, or a functional module or entity within an electronic device. This application uses the execution of the control method by a control device as an example to illustrate the control device provided in this application.

[0202] Figure 10 shows a possible structural schematic diagram of the control device involved in an embodiment of this application. As shown in Figure 8, the control device 600 may include: a display module 601, a transmission module 602, a receiving module 603, and a processing module 604;

[0203] The display module 601 is used to display a shooting preview interface; the transmission module 602 is used to transmit the real-time preview image displayed by the display module 601 to the wearable augmented reality (AR) device for display; the receiving module 603 is used to receive control commands, which include shooting control information and are triggered by an electronic device; or, the control commands are sent by the wearable AR device; the processing module 604 is used to execute the control operations indicated by the shooting control information based on the shooting control information received by the receiving module 603.

[0204] Optionally, in some embodiments of this application, the above-mentioned shooting control information includes at least one of the following: control information for controlling shooting, and adjustment information for adjusting the preview screen; the adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting the shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching shooting modes.

[0205] Optionally, in some embodiments of this application, the shooting control information includes adjustment information for adjusting the preview screen; the processing module 604 is specifically used to update the preview screen in the shooting preview interface displayed by the display module 601 based on the adjustment information; the display module 601 is also used to transmit the updated preview screen in the shooting preview interface to the wearable AR device for display.

[0206] Optionally, in some embodiments of this application, the above-mentioned shooting control information includes control information for controlling shooting; the above-mentioned processing module 604 is specifically used to control the camera to shoot; the above-mentioned transmission module 602 is also used to transmit the captured images or videos to the wearable AR device for display.

[0207] The control device provided in this application transmits the real-time preview image captured by the shooting preview interface to the wearable AR device, enabling the wearable AR device to clearly and completely display the image captured by the control device. The control device can then execute control operations based on the shooting control information contained in the control commands returned by the wearable AR device. Due to the characteristics of the wearable AR device, the clarity of the preview image viewed by the user is improved, and the user can control the control device to execute corresponding control operations based on the viewed image. This enhances both the clarity of the preview image and the shooting effect of the control device.

[0208] Figure 11 shows a possible structural schematic diagram of the control device involved in an embodiment of this application. As shown in Figure 11, the control device 700 may include: a display module 701, a processing module 702, and a sending module 703;

[0209] The display module 701 is used to display a preview image transmitted by the electronic device, which is a real-time preview image captured by the electronic device; the processing module 702 is used to determine shooting control information upon receiving the user's first input; the processing module 702 is also used to generate control instructions, which contain shooting control information; and the sending module 703 is used to send the control instructions generated by the processing module 702 to the electronic device.

[0210] Optionally, in some embodiments of this application, the above-mentioned processing module 702 is specifically used for the wearable AR device to respond to the first input and determine shooting control information based on the input parameters of the first input; the input parameters include at least one of the following: input duration, input direction, input trajectory, and input position.

[0211] Optionally, in some embodiments of this application, the above-mentioned processing module 702 is specifically used for:

[0212] Upon receiving the user's first input, the wearable AR device acquires the user's gaze focus information.

[0213] Wearable AR devices determine shooting control information based on gaze focus information;

[0214] The eye focus information includes at least one of the following: eye focus location, eye focus movement trajectory, eye focus movement direction, and eye focus dwell time.

[0215] Optionally, in some embodiments of this application, the display module 701 is further configured to display first prompt information, which includes shooting control information.

[0216] In the control device provided in this application embodiment, the electronic device transmits the real-time preview image captured by the shooting preview interface to the control device, so that the control device can clearly and completely display the image captured by the electronic device. The control device can generate different control commands according to the user's input, thereby controlling the electronic device to perform control operations, thereby improving the shooting effect and the user's viewing experience while improving the clarity of the preview image.

[0217] The control device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television set (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the scope of the device.

[0218] The control device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.

[0219] The control device provided in this application embodiment can realize the various processes implemented in the control method embodiment, and will not be described again here to avoid repetition.

[0220] Optionally, as shown in FIG12, this application embodiment also provides an electronic device 800, including a processor 801 and a memory 802. The memory 802 stores a program or instructions that can run on the processor 801. When the program or instructions are executed by the processor 801, they implement the various steps of the above control method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0221] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0222] Figure 13 is a schematic diagram of the hardware structure of an electronic device that implements an embodiment of this application.

[0223] The electronic device 100 includes, but is not limited to, components such as: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, and processor 110.

[0224] Those skilled in the art will understand that the electronic device 100 may also include a power supply (such as a battery) for powering various components. The power supply may be logically connected to the processor 110 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The electronic device structure shown in Figure 13 does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0225] The display unit 106 is used to display a shooting preview interface; the radio frequency unit 101 is used to transmit the real-time preview image in the shooting preview interface displayed by the display unit 106 to the wearable augmented reality (AR) device for display; the user input unit 107 is used to receive control commands, which include shooting control information, and are triggered by an electronic device; or, the control commands are sent by the wearable AR device; the processor 110 is used to execute the control operation indicated by the shooting control information based on the shooting control information received by the user input unit 107.

[0226] Optionally, in some embodiments of this application, the above-mentioned shooting control information includes at least one of the following: control information for controlling shooting, and adjustment information for adjusting the preview screen; the adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting the shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching shooting modes.

[0227] Optionally, in some embodiments of this application, the shooting control information includes adjustment information for adjusting the preview screen; the processor 110 is specifically used to update the preview screen in the shooting preview interface displayed by the display unit 106 based on the adjustment information; the display unit 106 is also used to transmit the updated preview screen in the shooting preview interface to the wearable AR device for display.

[0228] Optionally, in some embodiments of this application, the above-mentioned shooting control information includes control information for controlling shooting; the above-mentioned processor 110 is specifically used to control the camera to shoot; the above-mentioned radio frequency unit 101 is also used to transmit the captured images or videos to the wearable AR device for display.

[0229] The electronic device provided in this application transmits the real-time preview image captured by the shooting preview interface to the wearable AR device, enabling the wearable AR device to clearly and completely display the image captured by the electronic device. The electronic device can then control the execution of control operations based on the shooting control information contained in the control commands returned by the wearable AR device. Due to the characteristics of the wearable AR device, the clarity of the preview image viewed by the user is improved, and the user can control the electronic device to perform corresponding control operations based on the viewed image. This enhances both the clarity of the preview image and the shooting effect of the electronic device.

[0230] It should be understood that, in this embodiment, the input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.

[0231] The memory 109 can be used to store software programs and various data. The memory 109 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 109 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 109 in the embodiments of this application includes, but is not limited to, these and any other suitable types of memory.

[0232] Processor 110 may include one or more processing units; optionally, processor 110 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into processor 110.

[0233] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described control method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0234] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0235] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above control method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0236] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0237] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the control method embodiments described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0238] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0239] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0240] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A control method, the method comprising: The electronic device displays the shooting preview interface; The electronic device transmits the real-time preview image from the shooting preview interface to the wearable augmented reality (AR) device for display; The electronic device receives a control command, which includes shooting control information, and the control command is triggered by the electronic device; or, the control command is sent by the wearable AR device. The electronic device executes the control operations indicated by the shooting control information based on the shooting control information.

2. The method according to claim 1, wherein, The shooting control information includes at least one of the following: control information for controlling shooting, and adjustment information for adjusting the preview screen; The adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching shooting modes.

3. The method according to claim 2, wherein, The shooting control information includes the adjustment information used to adjust the preview screen; The electronic device, based on the shooting control information, executes the control operations indicated by the shooting control information, including: Based on the adjustment information, the electronic device updates the preview screen in the shooting preview interface and transmits the updated preview screen in the shooting preview interface to the wearable AR device for display.

4. The method according to claim 2, wherein, The shooting control information includes the control information used to control shooting; The electronic device, based on the shooting control information, executes the control operations indicated by the shooting control information, including: The electronic device controls the camera to capture images or videos, and transmits the captured images or videos to the wearable AR device for display.

5. A control method, the method comprising: Wearable AR devices display preview images transmitted by electronic devices, wherein the preview images are real-time preview images captured by the electronic devices; Upon receiving the user's first input, the wearable AR device determines the shooting control information and generates a control command, which includes the shooting control information. The wearable AR device sends the control command to the electronic device.

6. The method according to claim 5, wherein, The determination of shooting control information includes: The wearable AR device responds to the first input and determines the shooting control information based on the input parameters of the first input; The input parameters include at least one of the following: input duration, input direction, input trajectory, and input location.

7. The method according to claim 5, wherein, Upon receiving the user's first input, the wearable AR device determines shooting control information, including: Upon receiving the user's first input, the wearable AR device acquires the user's gaze focus information. The wearable AR device determines the shooting control information based on the gaze focus information; The gaze focus information includes at least one of the following: gaze focus position, gaze focus movement trajectory, gaze focus movement direction, and gaze focus dwell time.

8. The method according to claim 5, wherein, After the wearable AR device sends the control command to the electronic device, the method further includes: The wearable AR device displays a first prompt message, which includes the shooting control information.

9. A control device, the control device comprising: Display module, transmission module, receiving module, and processing module; The display module is used to display the shooting preview interface; The transmission module is used to transmit the real-time preview image displayed on the shooting preview interface of the display module to the wearable augmented reality (AR) device for display. The receiving module is used to receive control commands, which include shooting control information, and are triggered by the electronic device; or, the control commands are sent by the wearable AR device. The processing module is used to execute the control operation indicated by the shooting control information received by the receiving module.

10. The apparatus according to claim 9, wherein, The shooting control information includes at least one of the following: control information for controlling shooting, and adjustment information for adjusting the preview screen; The adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching shooting modes.

11. A control device, the device comprising: Display module, processing module, and sending module; The display module is used to display a preview image transmitted by the electronic device, wherein the preview image is a real-time preview image captured by the electronic device; The processing module is used to determine shooting control information upon receiving the user's first input. The processing module is also used to generate control instructions, which include the shooting control information; The sending module is used to send the control command generated by the processing module to the electronic device.

12. The apparatus according to claim 11, wherein, The display module is also used to display a first prompt message, which includes the shooting control information.

13. An electronic device comprising a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the control method as described in any one of claims 1 to 4.

14. A wearable AR device, comprising a processor, a memory, and a program or instructions stored in the memory and executable on the processor, wherein the program or instructions, when executed by the processor, implement the steps of the control method as described in any one of claims 5 to 8.

15. A computer-readable storage medium storing a program or instructions that, when executed by a processor, implement the steps of the control method as claimed in any one of claims 1 to 4, or the steps of the control method as claimed in any one of claims 5 to 8.

16. A chip comprising a processor and a communication interface coupled to the processor, the processor being configured to run a program or instructions to implement the steps of the control method as described in any one of claims 1 to 4, or the steps of the control method as described in any one of claims 5 to 8.

17. A computer program product stored in a non-transient storage medium and executed by at least one processor to implement it.

Images