Control method and device, electronic equipment and wearable AR (Augmented Reality) equipment

By transmitting the preview interface of the electronic device to the wearable AR device and adjusting the shooting control according to user input, the problem of loss of picture details during long-distance shooting is solved, and the shooting effect and user experience are improved.

CN118890545APending Publication Date: 2024-11-01VIVO MOBILE COMM CO LTD
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202410915811.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-09
Publication Date
2024-11-01

AI Technical Summary

Technical Problem

When electronic devices are shooting at long distances, the shooting preview interface needs to be enlarged, resulting in reduced pixel values ​​of the picture and loss of details, resulting in poor shooting results.

Method used

By transmitting the real-time preview screen in the shooting preview interface to the wearable AR device, and adjusting the shooting control information of the electronic device, such as adjusting the shooting field, parameters and focus objects, according to the user's input or control instructions of the wearable AR device, To improve picture clarity and shooting effect.

Benefits of technology

It improves the picture clarity and user viewing experience during long-distance shooting, enhances the shooting effect, and provides a more convenient operation method, as if it is an immersive experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118890545A_ABST
    Figure CN118890545A_ABST
Patent Text Reader

Abstract

The invention discloses a control method and device, electronic equipment and a computer readable storage medium, and belongs to the technical field of electronics. The method comprises the following steps: the electronic equipment displays a shooting preview interface; the electronic device transmits a real-time preview picture in the shooting preview interface to the wearable AR device for display; the electronic equipment receives a control instruction, the control instruction comprises shooting control information, and the control instruction is triggered by the electronic equipment; or the control instruction is sent by the wearable AR device; and the electronic equipment executes a control operation indicated by the shooting control information based on the shooting control information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of electronic technology, and specifically relates to a control method, a device, an electronic device, a wearable (Augmented Reality, AR) device, and a computer-readable storage medium. Background Art

[0002] With the popularity of social media and the advancement of photography technology, users' demand for long-distance photography and video recording has become increasingly strong. Currently, users can use electronic devices to take long-distance photos. For example, during travel and exploration, users want to capture the details and grandeur of distant scenery. Or, during live music performances and concerts, users want to use their devices to capture the performances and wonderful moments on the distant stage.

[0003] However, when an electronic device is taking long-distance photos, since the distance between the electronic device and the subject is too large, it is usually necessary to adjust the shooting preview interface to enlarge the preview screen of the subject captured by the electronic device. Enlarging the preview screen will reduce the pixel value of the screen, causing the captured screen to lose many details, which in turn leads to poor display effect of the captured screen. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a control method, device, electronic device and wearable AR device, which can improve the quality and effect of captured images.

[0005] In a first aspect, an embodiment of the present application provides a control method, which includes: the electronic device displays a shooting preview interface; the electronic device transmits the real-time preview screen in the shooting preview interface to a wearable AR device for display; the electronic device receives a control instruction, the control instruction includes shooting control information, and the control instruction is triggered by the electronic device; or the control instruction is sent by the wearable AR device; the electronic device executes the control operation indicated by the shooting control information based on the shooting control information.

[0006] In a second aspect, an embodiment of the present application provides a control method, which includes: a wearable AR device displays a preview screen transmitted by an electronic device, where the preview screen is a real-time preview screen captured by the electronic device; when the wearable AR device receives a first input from a user, the wearable AR device determines shooting control information and generates a control instruction, where the control instruction includes the shooting control information; and the wearable AR device sends the control instruction to the electronic device.

[0007] In a third aspect, an embodiment of the present application provides a control device, which includes: a display module, a transmission module, a receiving module and a processing module; the display module is used to display a shooting preview interface; the transmission module is used to transmit the real-time preview screen in the shooting preview interface displayed by the above-mentioned display module to a wearable AR device for display; the receiving module is used to receive a control instruction, the control instruction includes shooting control information, and the control instruction is triggered by an electronic device; or, the control instruction is sent by a wearable AR device; the processing module is used to execute the control operation indicated by the shooting control information based on the shooting control information received by the above-mentioned receiving module.

[0008] In a fourth aspect, an embodiment of the present application provides a control device, which includes: a display module, a processing module and a sending module; the display module is used to display a preview screen transmitted by an electronic device, and the preview screen is a real-time preview screen collected by the electronic device; the processing module is used to determine shooting control information when receiving a first input from a user; the processing module is also used to generate a control instruction, and the control instruction includes the shooting control information; the sending module is used to send the control instruction generated by the above-mentioned processing module to the electronic device.

[0009] In a fifth aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect or the second aspect are implemented.

[0010] In a sixth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect or the second aspect are implemented.

[0011] In the seventh aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect or the second aspect.

[0012] In an eighth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect or the second aspect.

[0013] In an embodiment of the present application, the electronic device displays a shooting preview interface; and transmits the real-time preview image in the shooting preview interface to the wearable AR device for display; then the electronic device receives a control instruction and, based on the shooting control information, performs the control operation indicated by the shooting control information, the control instruction includes the shooting control information, and the control instruction is triggered by the electronic device; or, the control instruction is sent by the wearable AR device. In this solution, the electronic device transmits the real-time preview image collected by the shooting preview interface to the wearable AR device, so that the wearable AR device can clearly and completely display the image collected by the electronic device, and the electronic device can control the electronic device to perform the control operation according to the control instruction returned by the wearable AR device or the shooting control information contained in the control instruction triggered by the electronic device. Due to the characteristics of the wearable AR device, the clarity of the preview image viewed by the user is improved, and the electronic device can be controlled to perform the corresponding control operation according to the viewed image, thereby improving the shooting effect of the electronic device while improving the clarity of the preview image. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 This is one of the flow charts of a control method provided in an embodiment of the present application;

[0015] Figure 2 This is one of the example schematic diagrams of a mobile phone interface provided in an embodiment of the present application;

[0016] Figure 3 This is a second example schematic diagram of an interface of a mobile phone provided in an embodiment of the present application;

[0017] Figure 4 This is a second flow chart of a control method provided in an embodiment of the present application;

[0018] Figure 5 This is a third example schematic diagram of an interface of a mobile phone provided in an embodiment of the present application;

[0019] Figure 6 This is a fourth example schematic diagram of an interface of a mobile phone provided in an embodiment of the present application;

[0020] Figure 7 This is a third flow chart of a control method provided in an embodiment of the present application;

[0021] Figure 8 It is a schematic diagram of an interaction process between an electronic device and a wearable AR device provided in an embodiment of the present application;

[0022] Fig. 9 is a flow chart of another control method provided in an embodiment of the present application;

[0023] Fig.10It is one of the structural schematic diagrams of a control device provided in an embodiment of the present application;

[0024] Fig.11 This is the second structural schematic diagram of a control device provided in an embodiment of the present application;

[0025] Fig.12 This is one of the hardware structure diagrams of an electronic device provided in an embodiment of the present application;

[0026] Fig.13 This is the second schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0028] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0029] The terms "at least one (item)", "at least one of" and the like in the specification and claims of this application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" means two or more, and its meaning is similar to that of "at least one (item)".

[0030] The electronic device in the embodiment of the present application may be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, etc., and the embodiment of the present application is not limited to this.

[0031] The wearable device in the embodiment of the present application may be: AR glasses, AR helmets, smart bracelets, smart watches, etc., which are not limited in the embodiment of the present application.

[0032] The control method, device, electronic device and wearable AR device provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0033] With the popularity of social media and the advancement of photography technology, users' demand for long-distance photography and video recording has become increasingly strong. This trend is mainly influenced by the following usage scenarios:

[0034] When traveling and exploring, users want to capture the details and grandeur of distant scenery, such as distant mountains, rivers, oceans, or buildings;

[0035] For sports enthusiasts and professional photographers, capturing high-energy moments at long-distance sports competitions and events is a pressing need, such as football matches, horse races, track and field competitions, etc.

[0036] Nature photographers also need to be able to capture wildlife behaviors and habitats from a distance, which also requires long-distance photography techniques and equipment;

[0037] Live music performances and concerts are one of the most popular subjects for users to shoot. Users hope to be able to capture the performances and wonderful moments on the distant stage with their devices.

[0038] However, when using electronic devices, such as mobile phones, to shoot at a distance, users will face a common problem: due to the small screen of the mobile phone, it is impossible to get an immersive experience and it is difficult to clearly observe and appreciate the content shot at a distance. This limits the user's viewing experience and makes it impossible to fully feel the authenticity and three-dimensionality of the details of the distant scenery; secondly, when shooting at a distance, if you want to see the details of a certain picture clearly, you need to zoom in on the mobile phone screen, but because the zoomed-in shooting picture will make the picture pixel value too low, resulting in unclear details of the shot picture.

[0039] Therefore, in the development of long-distance shooting technology, improving the user's viewing experience and the shooting effect of electronic equipment is an aspect that users are very concerned about.

[0040] Currently, in the electronic equipment industry, the main solution to solve the problem of small mobile phone screens when shooting at a distance is to provide mobile phones with larger screens to improve the viewing experience. Mobile phones with larger screens can improve the visual experience to a certain extent, allowing users to appreciate the content shot at a distance more clearly and better observe and feel the details and textures of distant scenes. However, large-screen mobile phones do not significantly improve the user's immersive experience, and are not suitable for all users, because large-screen devices are also not portable due to their large size, and not all users want to use large-size mobile phones.

[0041] In the control method provided by the embodiment of the present application, the electronic device displays a shooting preview interface; and transmits the real-time preview image in the shooting preview interface to the wearable AR device for display; then the electronic device receives a control instruction and, based on the shooting control information, performs the control operation indicated by the shooting control information, the control instruction includes the shooting control information, and the control instruction is triggered by the electronic device; or, the control instruction is sent by the wearable AR device. In this solution, the electronic device transmits the real-time preview image collected by the shooting preview interface to the wearable AR device, so that the wearable AR device can clearly and completely display the image collected by the electronic device, and the electronic device can control the electronic device to perform the control operation according to the control instruction returned by the wearable AR device or the shooting control information contained in the control instruction triggered by the electronic device. Due to the characteristics of the wearable AR device, the clarity of the preview image viewed by the user is improved, and the electronic device can be controlled to perform the corresponding control operation according to the viewed image, thereby improving the shooting effect of the electronic device while improving the clarity of the preview image.

[0042] The control method provided in this embodiment may be executed by a control device, which may be an electronic device, or a control module or a processing module in the electronic device, etc. The technical solution provided in the embodiment of this application is described below using an electronic device as an example.

[0043] The present application provides a control method. Figure 1 FIG. 1 is a flow chart of a control method provided by an embodiment of the present application, which can be applied to electronic equipment. Figure 1 As shown, the control method provided in the embodiment of the present application may include the following steps 201 to 204.

[0044] Step 201: The electronic device displays a shooting preview interface.

[0045] In some embodiments of the present application, the shooting preview interface is the interface of the electronic device when the camera is turned on or a shooting application is used to shoot.

[0046] For example, taking a mobile phone as an example, the shooting preview interface of the mobile phone when it is placed vertically is as follows: Figure 2 As shown, the shooting preview interface when the phone is placed in landscape mode is as follows Figure 3 The shooting preview interface 21 of the mobile phone displays the shooting content 22 in the real-time preview screen, which includes a forest, a person and a bird. At the same time, the user can exit the current shooting preview interface by clicking the control 23 and pressing it for a long time.

[0047] Step 202: The electronic device transmits the real-time preview image in the shooting preview interface to the wearable AR device for display.

[0048] In some embodiments of the present application, in some embodiments of the present application, the real-time preview screen in the above-mentioned shooting preview interface is a screen of the shooting object or the shooting scene captured by the electronic device in real time.

[0049] In some embodiments of the present application, the above-mentioned wearable AR device can be AR glasses, AR helmets, smart bracelets, smart watches, etc., which are not limited to the embodiments of the present application.

[0050] In some embodiments of the present application, the electronic device establishes a connection with a wearable AR device.

[0051] Exemplarily, the above-mentioned way of establishing the connection may be: Bluetooth connection, data line connection, or network connection.

[0052] Exemplarily, the electronic device can establish a connection with the wearable AR device using a DP data connection cable.

[0053] In some embodiments of the present application, the electronic device transmits the data stream of the real-time preview image collected by the electronic device to the wearable AR device for display through the connection between the electronic device and the wearable AR device.

[0054] Optionally, in some embodiments of the present application, before the electronic device transmits the above-mentioned real-time preview screen to the wearable AR device, the user can select a special effects mode in the electronic device, for example, a telescope mode, which is used to indicate that the electronic device is connected to the wearable AR device. In this special effects mode, the electronic device can clearly capture distant scenes and enable the electronic device to transmit the captured real-time preview screen to the wearable AR device.

[0055] Step 203: The electronic device receives the control instruction.

[0056] In some embodiments of the present application, the above control instruction includes shooting control information.

[0057] In some embodiments of the present application, the above control instructions are triggered by an electronic device or sent by a wearable AR device.

[0058] In some embodiments of the present application, the above control instructions are used to control the electronic device to adjust the real-time preview screen, or to control the electronic device to shoot.

[0059] In some embodiments of the present application, the above-mentioned shooting control information includes at least one of the following: control information for controlling shooting, and adjustment information for adjusting the preview picture captured by the electronic device.

[0060] In some embodiments of the present application, when the shooting control information includes control information for controlling shooting, the above control instruction is used to control the electronic device to perform a shooting operation.

[0061] In some embodiments of the present application, when the shooting control information includes adjustment information for adjusting the preview screen captured by the electronic device, the above control instruction is used to adjust the preview screen captured by the electronic device.

[0062] In some embodiments of the present application, the above-mentioned adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting the shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching the shooting mode.

[0063] In some embodiments of the present application, the above-mentioned shooting field of view adjustment information can be a moving camera, or a multiple of enlarging the shooting field of view, or a multiple of reducing the shooting field of view, etc., and the present application does not impose any limitation on this.

[0064] For example, the mobile camera includes but is not limited to moving forward, backward, left, right, upward, downward, horizontal, and vertical. Alternatively, the shooting field of view adjustment information may also be an accompanying moving distance, such as moving forward 10 centimeters or moving upward 5 centimeters.

[0065] In some embodiments of the present application, the above-mentioned shooting parameter adjustment information may be an adjustment amount of the shooting parameter.

[0066] Exemplarily, the above-mentioned shooting parameters specifically include but are not limited to brightness value, white balance, grayscale value or beauty parameters.

[0067] In some embodiments of the present application, the above-mentioned shooting object information is used to indicate one or more shooting objects, and the shooting objects are used to determine the focus object.

[0068] Exemplarily, the above-mentioned determination of the focus object may be understood as determining the focus object in the currently captured preview picture.

[0069] In some embodiments of the present application, the above-mentioned shooting modes specifically include but are not limited to photo mode, video mode, beauty mode or special effects mode.

[0070] Step 204: The electronic device executes the control operation indicated by the shooting control information based on the shooting control information.

[0071] In some embodiments of the present application, when the shooting control information includes control information for controlling shooting, the above-mentioned control operation is to control the electronic device to perform a shooting operation.

[0072] In some embodiments of the present application, when the shooting control information includes adjustment information for adjusting the preview picture captured by the electronic device, the above control operation is to control the electronic device to adjust the captured preview picture according to the adjustment information.

[0073] In some embodiments of the present application, the control operation is to control the electronic device to adjust the collected preview screen according to the adjustment information, and includes at least one of the following:

[0074] Adjust the shooting field of view;

[0075] Moving or rotating the camera of an electronic device;

[0076] Adjust the focus object;

[0077] Adjust the shooting parameters for your shoot;

[0078] Switches shooting mode.

[0079] In the control method provided in the embodiment of the present application, the electronic device displays a shooting preview interface; and transmits the real-time preview image in the shooting preview interface to the wearable AR device for display; then the electronic device receives a control instruction and, based on the shooting control information, performs the control operation indicated by the shooting control information, the control instruction includes the shooting control information, and the control instruction is triggered by the electronic device; or, the control instruction is sent by the wearable AR device. In this solution, the electronic device transmits the real-time preview image collected by the shooting preview interface to the wearable AR device, so that the wearable AR device can clearly and completely display the image collected by the electronic device, and the electronic device can control the electronic device to perform the control operation according to the control instruction returned by the wearable AR device or the shooting control information contained in the control instruction triggered by the electronic device. Due to the characteristics of the wearable AR device, the clarity of the preview image viewed by the user is improved, and the electronic device can be controlled to perform the corresponding control operation according to the viewed image, thereby improving the shooting effect of the electronic device while improving the clarity of the preview image.

[0080] Optionally, in some embodiments of the present application, when the control instruction is triggered by an electronic device, before the above step 203 "the electronic device receives the control instruction", the control method provided in the embodiment of the present application further includes step B1 and step B2:

[0081] Step B1: The electronic device receives a first input from a user on a display screen of the electronic device.

[0082] In some embodiments of the present application, the first input is used to generate a control instruction.

[0083] In some embodiments of the present application, the above-mentioned first input may include touch input of a user clicking a display screen, or a voice command input by a user, or a specific gesture input by a user. The specific input may be determined based on actual usage requirements and is not limited by the embodiments of the present application.

[0084] Exemplarily, the touch input includes a user sliding input on the display screen of the electronic device, or a click input, etc. The specific gesture in the embodiment of the present application may be any one of a single-click gesture, a sliding gesture, a pressure recognition gesture, a long-press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application may be a single-click input, a double-click input, or any number of click inputs, etc., and the click input may also be a long-press input or a short-press input.

[0085] Step B2: The electronic device generates a control instruction in response to the first input.

[0086] In some embodiments of the present application, when the first input has different input parameters, the electronic device generates different control instructions.

[0087] In some embodiments of the present application, the above-mentioned input parameters include at least one of the following: input gesture, input number, input duration, input trajectory, and input direction.

[0088] In one example, the first input is clicking on the display screen of the electronic device, and a control instruction for controlling the electronic device to start or end shooting is generated.

[0089] For example, when the user is in photo mode, he can capture a photo of the current moment by clicking the phone screen with his finger; when the user is in video recording mode, when the user wants to start recording, he can click the phone screen with his finger to start recording, and the glasses screen will start recording the current moment and display the current recording time. When the user wants to stop recording, he can click the phone screen with his finger to stop recording.

[0090] In another example, the first input is double-clicking the display screen of the electronic device, and a control instruction for controlling the electronic device to start or end shooting is generated.

[0091] For example, when the user is in photo mode, he can double-click the phone screen with his finger to capture a photo of the current moment; when the user is in video recording mode, when the user wants to start recording, he can double-click the phone screen with his finger to start recording, and the glasses screen will start recording the current moment and display the current recording time. When the user wants to stop recording, he can double-click the phone screen with his finger to turn off recording.

[0092] In another example, the first input is sliding a display screen of the electronic device, and a control instruction for adjusting the shooting mode is generated.

[0093] For example, when the user is in the photo mode, moving the finger on the phone screen to the right switches to the video mode; when the user is in the video mode, sliding the finger on the phone screen to the left switches to the photo mode.

[0094] It can be understood that the above sliding input can be sliding in any direction.

[0095] In another example, the first input is pinching the display screen of the electronic device with two fingers, and a control instruction for reducing the shooting field of view is generated.

[0096] In another example, the first input is pulling open the display screen of the electronic device with two fingers, and a control instruction for enlarging the shooting field of view is generated.

[0097] In another example, the first input is clicking on a certain photographed object in a preview image on a display screen of the electronic device, and a control instruction for adjusting the focus object is generated.

[0098] For example, when there are trees, people and birds in the current preview screen, if the user wants to adjust the focus object to the bird, the focus object can be switched by clicking on the bird, that is, the above-mentioned shooting object.

[0099] In another example, the first input is clicking a setting control on a display screen of the electronic device, and a control instruction for adjusting the shooting parameters is generated.

[0100] For example, when a user clicks on a setting control on a display screen of an electronic device, the user can adjust white balance parameters, brightness parameters, or skin smoothing parameters included in the setting.

[0101] In this way, after the electronic device transmits the preview screen to the wearable AR device, the user can adjust the preview screen transmitted to the wearable AR device by inputting into the electronic device, thereby achieving the viewing effect the user wants more conveniently and quickly to improve the shooting quality.

[0102] Optionally, in some embodiments of the present application, Figure 4 As shown, in the case where the shooting control information includes adjustment information for adjusting the preview screen, the above step 204 "the electronic device performs the control operation indicated by the shooting control information based on the shooting control information" specifically includes step 204a:

[0103] Step 204a: The electronic device updates the preview screen in the shooting preview interface based on the adjustment information, and transmits the updated preview screen in the shooting preview interface to the wearable AR device for display.

[0104] In some embodiments of the present application, the electronic device controls the adjustment of the shooting field of view, shooting parameters or shooting objects, etc. according to the above-mentioned adjustment information, and then continues to capture the adjusted preview picture, thereby updating the preview picture captured by the electronic device, and transmitting the data stream corresponding to the updated preview picture to the wearable AR device.

[0105] For example, combining Figure 3 If the user wants to observe the bird, the user can open two fingers in the bird display area, that is, the first input. At this time, the electronic device determines that the shooting control information is to enlarge the shooting field of view of the bird area, and then enlarges the shooting field of view of the bird area according to the shooting control information to update the display. Figure 5 As shown, an updated preview image is obtained, which is a single bird.

[0106] For example, combining Figure 3 If the current mode is photo shooting, and the user wants to control the shooting of the woods on the right, the user can slide the screen to the right. At this time, the electronic device determines that the shooting control information is to turn the camera to the right, and then controls the camera of the electronic device to move 10 cm to the right according to the shooting control information to update the display to Figure 6 As shown, an updated preview image is obtained, which is a forest.

[0107] It should be noted that after the real-time preview image captured by the electronic device is updated, the preview image in the wearable AR device will also be updated accordingly.

[0108] In this way, the electronic device can update the preview screen in the shooting preview interface of the electronic device according to the adjustment information included in the shooting control information in the received control instruction, thereby improving the convenience of screen adjustment and providing a variety of shooting methods.

[0109] Optionally, in some embodiments of the present application, Figure 7 As shown, in the case where the shooting control information includes control information for controlling shooting, the above step 204 "the electronic device performs the control operation indicated by the shooting control information based on the shooting control information" specifically includes step 204b:

[0110] Step 204b: The electronic device controls the camera to shoot, and transmits the captured image or video to the wearable AR device for display.

[0111] In some embodiments of the present application, after receiving control information for controlling shooting, the electronic device performs shooting according to the shooting behavior indicated in the control information.

[0112] Exemplarily, the control information may include at least one of the following: countdown shooting, start shooting, end shooting, and timed shooting.

[0113] Exemplarily, when the control information is countdown shooting, the control instruction may be to shoot after the countdown is over for 3 seconds; when the control information is to start shooting, the control instruction may be to capture the preview screen at the current moment; when the control information is to end shooting, the control instruction may be to end the current shooting; when the control information is timed shooting, the control instruction may be to shoot a video from the current moment to 1 minute later.

[0114] In some embodiments of the present application, after controlling the camera to shoot, the electronic device can transmit the data stream corresponding to the captured image or video to the wearable AR device through a connection with the wearable AR device.

[0115] In some embodiments of the present application, when a wearable AR device receives a data stream corresponding to an image or video captured by an electronic device, it can perform enhanced image processing on the image or video to make the image details clearer.

[0116] In this way, when an image or video is captured by an electronic device and transmitted to a wearable AR device, the image or video can be further processed to obtain a clearer image or video with richer details, thereby improving the shooting effect.

[0117] The execution subject of the control method provided in this embodiment may be a control device, which may be a wearable AR device, or a control module or a processing module in the wearable AR device. The technical solution provided in the embodiment of this application is described below using a wearable AR device as an example.

[0118] The present application provides a control method. Figure 8 FIG. 1 is a flow chart of a control method provided in an embodiment of the present application, which can be applied to a wearable AR device. Figure 8 As shown, the control method provided in the embodiment of the present application may include the following steps 301 to 303.

[0119] Step 301: The wearable AR device displays a preview image transmitted by the electronic device.

[0120] In some embodiments of the present application, the preview screen is a real-time preview screen captured by the electronic device.

[0121] In some embodiments of the present application, after the electronic device transmits the preview image to the wearable AR device, the wearable AR device may process the preview image before displaying it.

[0122] In some embodiments of the present application, when the wearable AR device uses AR technology to display content, the displayed content can be projected to any carrier through a projection device. Among them, the projection device can be a projection device using AR technology, such as the wearable AR device in the embodiment of the present application.

[0123] When AR technology is used to display content on a virtual screen, the projection device can project the real scene acquired by the projection device (or integrated internally) onto the virtual screen, so that the virtual screen can display the content, thereby showing the real scene to the user.

[0124] In one example, when the virtual screen is a lens of AR glasses, the projection device may be the AR glasses. When the user wears the glasses, the user can shoot the real scene through the electronic device and project it onto the lens of the AR glasses for display, so that the user can see the real scene through the lens of the AR glasses.

[0125] In some embodiments of the present application, the preview image transmitted by the above-mentioned electronic device is processed and rendered by a renderer (SurfaceView) of the wearable AR device.

[0126] Exemplarily, the process of the wearable AR device receiving and displaying the preview screen transmitted by the electronic device is as follows:

[0127] On the wearable AR device side, create a SurfaceViewTexture object, which will serve as a carrier for displaying the preview screen. Secondly, in the layout Extensible Markup Language (XML) file on the wearable AR device side, add SurfaceView and set its parameters to ensure that the preview screen is displayed correctly in the user's field of view. At the same time, use the setOnFrameAvailableListener method of SurfaceViewTexture to receive new preview frames. On the electronic device side, use the Camera2 Software Development Kit (Camera2 SDK) to access and configure the system camera to obtain the data stream of the preview screen, and bind the SurfaceViewTexture on the wearable AR device side to the data stream of the preview screen of the electronic device camera. After configuring the camera parameters of the electronic device, turn on the camera preview, send the data of the preview screen to the SurfaceViewTexture on the wearable AR device side through the DP data cable, and the high-definition picture taken by the electronic device system camera can be displayed in real time on the wearable AR device side.

[0128] Step 302: Upon receiving the first input from the user, the wearable AR device determines shooting control information and generates a control instruction.

[0129] Step 303: The wearable AR device sends a control instruction to the electronic device.

[0130] In some embodiments of the present application, the above control instruction includes shooting control information.

[0131] In some embodiments of the present application, the above control instructions are used to control the electronic device to adjust the real-time preview screen, or to control the electronic device to shoot.

[0132] In some embodiments of the present application, the above-mentioned shooting control information includes at least one of the following: control information for controlling shooting, and adjustment information for adjusting the preview picture captured by the electronic device.

[0133] In some embodiments of the present application, when the shooting control information includes control information for controlling shooting, the above control instruction is used to control the electronic device to perform a shooting operation.

[0134] In some embodiments of the present application, when the shooting control information includes adjustment information for adjusting the preview screen captured by the electronic device, the above control instruction is used to adjust the preview screen captured by the electronic device.

[0135] In some embodiments of the present application, the above-mentioned adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting the shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching the shooting mode.

[0136] In the control method provided in the embodiment of the present application, the wearable AR device displays the preview screen transmitted by the electronic device, and the preview screen is a real-time preview screen collected by the electronic device; the wearable AR device determines the shooting control information and generates a control instruction when receiving the first input from the user, and the control instruction includes the shooting control information; the wearable AR device sends the control instruction to the electronic device. In this solution, the electronic device transmits the real-time preview screen collected by the shooting preview interface to the wearable AR device, so that the wearable AR device can clearly and completely display the screen collected by the electronic device. The wearable AR device can generate different control instructions according to the user's input, thereby controlling the electronic device to perform the control operation, thereby improving the shooting effect and the user's viewing experience.

[0137] Optionally, in some embodiments of the present application, the “determining shooting control information” in the above step 302 specifically includes step 302a:

[0138] Step 302a: The wearable AR device determines shooting control information in response to the first input based on input parameters of the first input.

[0139] In some embodiments of the present application, the above-mentioned input parameters include at least one of the following: input duration, input direction, input trajectory, and input position.

[0140] In some embodiments of the present application, the first input is used to determine adjustment information for adjusting the preview screen, or to control shooting.

[0141] In some embodiments of the present application, the above-mentioned first input may include an air input gesture, a voice command input by the user, or a specific gesture input by the user. The specific gesture can be determined according to actual usage requirements and is not limited by the embodiments of the present application.

[0142] Exemplarily, the specific gesture in the embodiments of the present application may be any one of an open palm, a sliding gesture, an area change gesture, and a double-click gesture.

[0143] In an example, the first input is an open or closed palm gesture, and the shooting control information is determined to be control information for controlling shooting.

[0144] For example, when the user is in photo mode, the user extends his hand into the shooting range of the camera of the wearable AR device that recognizes gestures, inputs an open palm gesture, and determines the shooting control information to capture a photo at the current moment; when the user is in video recording mode, when the user turns on video recording, inputs an open palm gesture, determines the shooting control information to turn on video recording, the wearable AR device starts recording the current moment, and displays the current video recording duration. When the user wants to stop recording, inputs a closed palm gesture to turn off video recording.

[0145] In another example, the first input is a sliding gesture, and the shooting control information is determined to be adjusting the shooting mode.

[0146] For example, when the user is in the photo taking mode, the user extends his hand into the shooting range of the camera of the wearable AR device that recognizes gestures, and slides his hand to the right to determine the shooting control information to switch to the video recording mode; when the user is in the video recording mode, the user slides his hand to the left to determine the shooting control information to switch to the shooting mode.

[0147] It is understandable that the above sliding gesture may be sliding in any direction.

[0148] In another example, the first input is a two-finger pinch gesture, and the shooting control information is determined to be reducing the shooting field of view.

[0149] In another example, the first input is a two-finger stretching gesture, and the shooting control information is determined to be enlarging the shooting field of view.

[0150] In another example, the first input is a directional gesture, and the shooting control information is determined to determine the pointed shooting object as the focus object.

[0151] For example, when there are trees, people and birds in the current preview screen, if the user wants to adjust the focus object to the bird, the user can extend his hand into the shooting range of the camera of the wearable AR device that recognizes gestures, and switch the focus object by pointing to the bird, that is, the above-mentioned shooting object.

[0152] In another example, the first input is a special input track, and the shooting control information is determined to be adjusting shooting parameters.

[0153] For example, when a user extends his hand into the shooting range of the camera of the wearable AR device that recognizes gestures and inputs a gesture with a specific input trajectory, the wearable AR device calls up a shooting parameter setting interface, and the user can adjust the shooting parameters in the shooting parameter interface, such as white balance parameters, brightness parameters, or skin smoothing parameters.

[0154] In another example, the first input is voice input, and the wearable AR device determines the shooting control information according to the recognized voice content.

[0155] Example 1: When in the photo taking mode, you can input the voice command "switch mode", the wearable AR device recognizes the voice command, and determines the shooting control information to switch the current mode to video recording; similarly, when in the video recording mode, you can also input the voice command "switch mode", and determine the shooting control information to switch the current mode to photo taking.

[0156] Example 2: When in the photo mode, the voice command "take a photo" is input, and the wearable AR device determines the shooting control information to capture and record the current moment; when in the video recording mode, the voice command "start" is input, and the wearable AR device determines the shooting control information to start recording the current moment; when the voice command "end" is input, the wearable AR device determines the shooting control information to stop video recording.

[0157] Example 3: When the user inputs the voice command "I want to see farther", the wearable AR device determines that the shooting control information is to control the increase of the current camera focal length; when the user indicates "I want to see closer", the wearable AR device determines that the shooting control information is to control the decrease of the current camera focal length.

[0158] Example 4: When the user indicates “I want to take a closer look at something in the distance”, the wearable AR device determines that the shooting control information is to switch the focus object, and transmits the shooting control information to the electronic device.

[0159] It can be understood that in Example 4, the electronic device uses target detection technology to locate the focus object indicated by the shooting control information sent by the wearable AR device, locates the region of interest (ROI) where the object is located, and controls the camera to enlarge the focal length, enlarge the ROI area, and transmits the current enlarged image back to the wearable AR device to display the enlarged object to the user.

[0160] In this way, after the electronic device transmits the preview screen to the wearable AR device, the user can adjust the preview screen transmitted by the electronic device to the wearable AR device through input to the wearable AR device, thereby achieving the user's desired viewing effect more conveniently and quickly to improve the shooting quality.

[0161] Optionally, in some embodiments of the present application, the above step 302 “the wearable AR device determines shooting control information and generates a control instruction when receiving the first input from the user” specifically includes step 302c and step 302d:

[0162] Step 302c: Upon receiving the first input from the user, the wearable AR device obtains the focus information of the user's gaze.

[0163] In some embodiments of the present application, the above-mentioned line of sight focus information may be gaze information of the user's line of sight gazing at the preview image.

[0164] In some embodiments of the present application, the above-mentioned sight focus information includes at least one of the following: the sight focus position, the moving trajectory of the sight focus, the moving direction of the sight focus, and the stay time of the sight focus.

[0165] Exemplarily, the above-mentioned sight focus position may be a gaze position or area of ​​the user's sight in the preview image.

[0166] Exemplarily, the moving track of the visual focus may be the moving track of the user's visual focus in the preview image.

[0167] Exemplarily, the moving direction of the visual focus may be the moving direction of the user's visual focus in the preview image.

[0168] Exemplarily, the dwell time of the visual focus may be the duration of the user's gaze on the preview screen.

[0169] In some embodiments of the present application, the first input is used to start the wearable AR device to obtain the focus information of the user's gaze.

[0170] Exemplarily, the first input is used to start a sight line recognition function of the wearable AR device. The sight line recognition function is used to collect the sight line of the user looking at the preview screen.

[0171] Step 302d: The wearable AR device determines shooting control information based on the line of sight focus information.

[0172] In some embodiments of the present application, different sight focus information corresponds to different shooting control information.

[0173] In some embodiments of the present application, the wearable AR device can identify the focus information of the user's eye line of sight through a specific recognition device.

[0174] In one example, when the user's gaze area in the preview screen is a certain area, the wearable AR device determines the shooting control information according to the content displayed in the area.

[0175] Example 5: In the case of the camera mode, when the user's line of sight includes the shooting control in the gaze area of ​​the preview screen, the wearable AR device determines the shooting control information to capture the preview screen at the current moment. In the case of the video recording mode, when the user's line of sight includes the shooting control in the gaze area of ​​the preview screen, the wearable AR device determines the shooting control information to start recording the preview screen from the current moment; if it is detected again that the user's line of sight includes the shooting control in the gaze area of ​​the preview screen, the wearable AR device determines the shooting control information to stop recording the preview screen.

[0176] Example 6: When the user's line of sight includes the shooting object in the gaze area in the preview screen, the wearable AR device determines that the shooting control information is to switch the focus object.

[0177] In one example, when the movement trajectory of the user's sight in the preview screen is a specific trajectory, the wearable AR device determines the shooting control information according to the different trajectories.

[0178] Example 7: In the case of the camera mode, when the user's line of sight moves from left to right in the preview screen, the wearable AR device determines the shooting control information to switch the recording mode. In the case of the recording mode, when the user's line of sight moves from right to left in the preview screen, the wearable AR device determines the shooting control information to switch the camera mode.

[0179] Example 8: When the user's line of sight moves from top to bottom in the preview screen, the wearable AR device determines that the shooting control information is to adjust the shooting parameters, and can call up the shooting parameter interface. The user can adjust the shooting parameters in the shooting parameter interface, such as white balance parameters, brightness parameters, or skin smoothing parameters.

[0180] It should be noted that the input methods involved in the embodiments of the present application are only for illustration and the present application does not impose any limitation on this.

[0181] In this way, the wearable AR device can directly identify the user's gaze to generate control instructions to control the electronic device to perform control operations, thereby improving the convenience of user operation and thus improving shooting efficiency.

[0182] Optionally, in some embodiments of the present application, after the above step 303 “the wearable AR device sends a control instruction to the electronic device”, the control method provided in the embodiment of the present application further includes step 401:

[0183] Step 401: The wearable AR device displays a first prompt message.

[0184] In some embodiments of the present application, the first prompt information includes shooting control information.

[0185] In some embodiments of the present application, after the wearable AR device sends a control instruction to the electronic device, the shooting control information can be displayed in the preview screen of the wearable AR device, thereby prompting the user to perform operations.

[0186] In this way, by displaying the prompt information on the wearable AR device, the user can be prompted more concisely and clearly about the operation being performed.

[0187] The following describes in detail the implementation process of the control method between the electronic device and the wearable device in a possible embodiment. Fig. 9 As shown, it specifically includes steps A1 to A7:

[0188] Step A1: The electronic device displays a shooting preview interface and captures a real-time preview image through the camera of the electronic device.

[0189] Step A2: The electronic device sends the collected real-time preview image to the wearable AR device.

[0190] Step A3: The wearable AR device receives the real-time preview image sent by the electronic device.

[0191] Step A4: The wearable AR device displays the real-time preview image captured by the electronic device.

[0192] Step A5: The wearable AR device determines the shooting control information according to the user input, generates a control instruction, and executes step A6, or the electronic device receives the user input to generate a control instruction, skips step A6 and executes step A7.

[0193] Step A6: The wearable AR device sends the control instruction to the electronic device.

[0194] Step A7: The electronic device executes the control operation indicated by the shooting control information based on the shooting control information in the control instruction.

[0195] Specifically, the above-mentioned electronic device can be taken as a mobile phone, and the above-mentioned wearable AR device can be taken as AR glasses.

[0196] The user wears AR glasses and uses a DP transmission line to connect the mobile phone and AR glasses. The mobile phone can transmit the preview screen of the mobile phone camera to the SurfaceView on the AR glasses end and display it through the DP data connection line. After the mobile phone and AR glasses are connected, the user clicks the camera application, opens the camera, selects and enters the telescope mode to shoot long-distance pictures. Then, the mobile phone transmits the captured preview screen to the AR glasses, and the user can watch the preview screen shot by the mobile phone in real time through the AR glasses. If the user wants to adjust the content of the preview screen, he can make a specific gesture, or voice input, or change the gaze line. When the AR glasses recognize a specific gesture, voice content or gaze line change, different shooting control information is determined according to different inputs to generate control instructions, thereby controlling the mobile phone to adjust the preview screen. Alternatively, if the user wants to adjust the content of the preview screen, the user can directly perform different inputs on the mobile phone screen. The mobile phone determines different shooting control information based on the different inputs received, and generates different control instructions, thereby controlling the mobile phone to adjust the preview screen. And the user can generate control information to control the shooting of the mobile phone in the same way, so that the electronic device can shoot the preview screen.

[0197] Thus, the embodiment of the present application proposes a long-distance shooting system based on a wearable AR device and an electronic device. Users can watch long-distance scenes in real time through wearable AR devices, and obtain an unprecedented immersive experience, as if they were there, and deeply feel the vivid details and emotional experience in the long-distance scenes. At the same time, users can also use the shooting function to record those heart-warming moments. In addition, users can also control electronic devices to perform zooming through finger pinching or voice commands, adjust the viewing distance and viewing target in real time, and follow their heart, and what they see is what they get.

[0198] Each of the above-mentioned method embodiments, or various possible implementation methods in each method embodiment can be executed separately, or any two or more of them can be executed in combination with each other. The specific implementation method can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0199] It should be noted that the control method provided in the embodiment of the present application can be executed by a control device or an electronic device, or a functional module or entity in the electronic device. In the embodiment of the present application, the control method executed by a control device is taken as an example to illustrate the control device provided in the embodiment of the present application.

[0200] Fig.10 A possible structural diagram of the control device involved in the embodiment of the present application is shown. Figure 8 As shown, the control device 600 may include: a display module 601, a transmission module 602, a receiving module 603 and a processing module 604;

[0201] Among them, the above-mentioned display module 601 is used to display the shooting preview interface; the above-mentioned transmission module 602 is used to transmit the real-time preview picture in the shooting preview interface displayed by the above-mentioned display module 601 to the wearable augmented reality AR device for display; the above-mentioned receiving module 603 is used to receive control instructions, the control instructions include shooting control information, and the control instructions are triggered by the electronic device; or, the control instructions are sent by the wearable AR device; the above-mentioned processing module 604 is used to execute the control operation indicated by the shooting control information based on the shooting control information received by the above-mentioned receiving module 603.

[0202] Optionally, in some embodiments of the present application, the above-mentioned shooting control information includes at least one of the following: control information for controlling shooting, adjustment information for adjusting the preview screen; the adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting the shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching the shooting mode.

[0203] Optionally, in some embodiments of the present application, the above-mentioned shooting control information includes adjustment information for adjusting the preview screen; the above-mentioned processing module 604 is specifically used to update the preview screen in the shooting preview interface displayed by the above-mentioned display module 601 based on the adjustment information; the above-mentioned display module 601 is also used to transmit the preview screen in the updated shooting preview interface to the wearable AR device for display.

[0204] Optionally, in some embodiments of the present application, the shooting control information includes control information for controlling shooting; the processing module 604 is specifically used to control camera shooting; the transmission module 602 is also used to transmit the captured image or video to a wearable AR device for display.

[0205] In the control device provided in the embodiment of the present application, the control device transmits the real-time preview image collected by the shooting preview interface to the wearable AR device, so that the wearable AR device can clearly and completely display the image collected by the control device, and the control device can control the control device to perform the control operation according to the shooting control information contained in the control instruction sent back by the wearable AR device. Due to the characteristics of the wearable AR device, the clarity of the preview image viewed by the user is improved, and the control device can be controlled to perform corresponding control operations according to the viewed image, thereby improving the shooting effect of the control device while improving the clarity of the preview image.

[0206] Fig.11 A possible structural diagram of the control device involved in the embodiment of the present application is shown. Fig.11 As shown, the control device 700 may include: a display module 701, a processing module 702 and a sending module 703;

[0207] Among them, the above-mentioned display module 701 is used to display the preview screen transmitted by the electronic device, and the preview screen is a real-time preview screen collected by the electronic device; the above-mentioned processing module 702 is used to determine the shooting control information when receiving the user's first input; the above-mentioned processing module 702 is also used to generate a control instruction, and the control instruction includes the shooting control information; the above-mentioned sending module 703 is used to send the control instruction generated by the above-mentioned processing module 702 to the electronic device.

[0208] Optionally, in some embodiments of the present application, the above-mentioned processing module 702 is specifically used for the wearable AR device to respond to the first input and determine the shooting control information based on the input parameters of the first input; the input parameters include at least one of the following: input duration, input direction, input trajectory, and input position.

[0209] Optionally, in some embodiments of the present application, the processing module 702 is specifically used to:

[0210] When receiving the first input from the user, the wearable AR device obtains the sight focus information of the user's sight line;

[0211] The wearable AR device determines shooting control information based on the sight focus information;

[0212] The sight focus information includes at least one of the following: the sight focus position, the moving track of the sight focus, the moving direction of the sight focus, and the stay time of the sight focus.

[0213] Optionally, in some embodiments of the present application, the display module 701 is further used to display first prompt information, where the first prompt information includes shooting control information.

[0214] In the control device provided in the embodiment of the present application, the electronic device transmits the real-time preview picture collected by the shooting preview interface to the control device, so that the control device can clearly and completely display the picture collected by the electronic device. The control device can generate different control instructions according to the user's input, so as to control the electronic device to perform the control operation, thereby improving the shooting effect and the user's viewing experience while improving the clarity of the preview picture.

[0215] The control device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0216] The control device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0217] The control device provided in the embodiment of the present application can implement each process implemented in the control method embodiment, and will not be described again here to avoid repetition.

[0218] Alternatively, if Fig.12 As shown, an embodiment of the present application also provides an electronic device 800, including a processor 801 and a memory 802, wherein the memory 802 stores programs or instructions that can be executed on the processor 801, and when the program or instructions are executed by the processor 801, the various steps of the above-mentioned control method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0219] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0220] Fig.13 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0221] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0222] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.13 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0223] Among them, the above-mentioned display unit 106 is used to display a shooting preview interface; the above-mentioned radio frequency unit 101 is used to transmit the real-time preview picture in the shooting preview interface displayed by the above-mentioned display unit 106 to the wearable augmented reality AR device for display; the above-mentioned user input unit 107 is used to receive a control instruction, the control instruction includes shooting control information, and the control instruction is triggered by an electronic device; or, the control instruction is sent by a wearable AR device; the above-mentioned processor 110 is used to execute the control operation indicated by the shooting control information based on the shooting control information received by the above-mentioned user input unit 107.

[0224] Optionally, in some embodiments of the present application, the above-mentioned shooting control information includes at least one of the following: control information for controlling shooting, adjustment information for adjusting the preview screen; the adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting the shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching the shooting mode.

[0225] Optionally, in some embodiments of the present application, the shooting control information includes adjustment information for adjusting the preview screen; the processor 110 is specifically used to update the preview screen in the shooting preview interface displayed by the display unit 106 based on the adjustment information; the display unit 106 is also used to transmit the preview screen in the updated shooting preview interface to the wearable AR device for display.

[0226] Optionally, in some embodiments of the present application, the shooting control information includes control information for controlling shooting; the processor 110 is specifically used to control camera shooting; the radio frequency unit 101 is also used to transmit the captured image or video to a wearable AR device for display.

[0227] In the electronic device provided in the embodiment of the present application, the electronic device transmits the real-time preview image collected by the shooting preview interface to the wearable AR device, so that the wearable AR device can clearly and completely display the image collected by the electronic device, and the electronic device can control the electronic device to perform control operations according to the shooting control information contained in the control instruction sent back by the wearable AR device. Due to the characteristics of the wearable AR device, the clarity of the preview image viewed by the user is improved, and the electronic device can be controlled to perform corresponding control operations according to the viewed image, thereby improving the shooting effect of the electronic device while improving the clarity of the preview image.

[0228] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0229] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0230] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.

[0231] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned control method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0232] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0233] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0234] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0235] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned control method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0236] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0237] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0238] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A control method, characterized in that: The method comprises: The electronic device displays a shooting preview interface; The electronic device transmits the real-time preview image in the shooting preview interface to the wearable augmented reality (AR) device for display; The electronic device receives a control instruction, where the control instruction includes shooting control information, and the control instruction is triggered by the electronic device; or, the control instruction is sent by the wearable AR device; The electronic device performs a control operation indicated by the shooting control information based on the shooting control information.

2. The method according to claim 1, characterized in that The shooting control information includes at least one of the following: control information for controlling shooting, adjustment information for adjusting the preview picture; The adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching the shooting mode.

3. The method according to claim 2, characterized in that The shooting control information includes the adjustment information for adjusting the preview picture; The electronic device performs a control operation indicated by the shooting control information based on the shooting control information, including: The electronic device updates the preview screen in the shooting preview interface based on the adjustment information, and transmits the updated preview screen in the shooting preview interface to the wearable AR device for display.

4. The method according to claim 2, characterized in that: The shooting control information includes the control information for controlling shooting; The electronic device performs a control operation indicated by the shooting control information based on the shooting control information, including: The electronic device controls the camera to shoot, and transmits the captured image or video to the wearable AR device for display.

5. A control method, characterized in that: The method comprises: The wearable AR device displays a preview screen transmitted by the electronic device, where the preview screen is a real-time preview screen collected by the electronic device; The wearable AR device determines shooting control information and generates a control instruction upon receiving a first input from a user, wherein the control instruction includes the shooting control information; The wearable AR device sends the control instruction to the electronic device.

6. The method according to claim 5, characterized in that The determining of the shooting control information includes: The wearable AR device determines the shooting control information in response to the first input based on an input parameter of the first input; The input parameter includes at least one of the following: input duration, input direction, input trajectory, and input position.

7. The method according to claim 5, characterized in that The wearable AR device determines shooting control information when receiving a first input from a user, including: The wearable AR device obtains the sight focus information of the user's sight line when receiving the first input from the user; The wearable AR device determines the shooting control information based on the line of sight focus information; The sight focus information includes at least one of the following: the sight focus position, the moving track of the sight focus, the moving direction of the sight focus, and the stay time of the sight focus.

8. The method according to claim 5, characterized in that After the wearable AR device sends the control instruction to the electronic device, the method further includes: The wearable AR device displays first prompt information, where the first prompt information includes the shooting control information.

9. A control device, characterized in that: The control device includes: a display module, a transmission module, a receiving module and a processing module; The display module is used to display a shooting preview interface; The transmission module is used to transmit the real-time preview image in the shooting preview interface displayed by the display module to the wearable augmented reality (AR) device for display; The receiving module is used to receive a control instruction, where the control instruction includes shooting control information, and the control instruction is triggered by the electronic device; or, the control instruction is sent by the wearable AR device; The processing module is used to execute the control operation indicated by the shooting control information based on the shooting control information received by the receiving module.

10. The device according to claim 9, characterized in that The shooting control information includes at least one of the following: control information for controlling shooting, adjustment information for adjusting the preview picture; The adjustment information includes at least one of the following: shooting field of view adjustment information for adjusting the shooting field of view, shooting parameter adjustment information for adjusting shooting parameters, shooting object information for adjusting the focus object, and shooting mode information for switching the shooting mode.

11. A control device, characterized in that: The device comprises: a display module, a processing module and a sending module; The display module is used to display the preview picture transmitted by the electronic device, and the preview picture is a real-time preview picture collected by the electronic device; The processing module is used to determine the shooting control information when receiving the first input from the user; The processing module is further used to generate a control instruction, wherein the control instruction includes the shooting control information; The sending module is used to send the control instruction generated by the processing module to the electronic device.

12. The device according to claim 11, characterized in that The display module is further used to display first prompt information, where the first prompt information includes the shooting control information.

13. An electronic device, characterized in that: The method comprises a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the control method as claimed in any one of claims 1 to 4.

14. A wearable AR device, characterized in that: The method comprises a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the control method as claimed in any one of claims 5 to 8.

15. A computer-readable storage medium, characterized in that: The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by the processor, the steps of the control method according to any one of claims 1 to 4, or the steps of the control method according to any one of claims 5 to 8 are implemented.

Citation Information

Cited By

  • Control method and apparatus, electronic device, and wearable ar device

    WO2026012205A1

  • Image capture device and system, and control method

    WO2026188487A1