Photographing method, augmented reality device, photographing system and computer readable storage medium

Abstract

The embodiment of the invention discloses a photographing method, augmented reality equipment, a photographing system and a computer readable storage medium, and the method is applied to the augmented reality equipment, and comprises the steps: obtaining a photographing preview image transmitted by the photographing equipment in real time; utilizing a virtual screen of the augmented reality equipment to carry out space display on the photographing preview picture; obtaining a first interaction action of a user, and generating a photographing instruction according to the first interaction action; and sending the photographing instruction to the photographing equipment, wherein the photographing instruction is used for controlling the photographing equipment to photograph. Therefore, the scheme can help the user to conveniently and quickly take satisfactory selfie photos.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of extended reality technology, and specifically to a photographing method, an extended reality device, a photographing system, and a computer-readable storage medium. Background Art

[0002] If a user needs to take a full-body selfie, he or she usually fixes the camera device in a certain position, sets the photo triggering conditions, and then walks in front of the device to take the selfie. However, with this method, the user cannot see the photo preview screen in the camera device, resulting in the user being unable to see his or her posture and composition in the current scene, and the photos taken are not satisfactory.

[0003] In order to solve this problem, the related art uses a smart watch to communicate with a camera device and displays a photo preview screen in the smart watch. However, this method requires the user to lower his head to look at the smart watch, which limits the user's photo posture and makes it impossible for the user to pose a satisfactory photo posture. Summary of the invention

[0004] The embodiments of the present application provide a photographing method, an extended reality device, a photographing system, and a computer-readable storage medium, which can help users take satisfactory selfies conveniently and quickly.

[0005] In a first aspect, an embodiment of the present application provides a photographing method, which is applied to an extended reality device, and the method includes:

[0006] Get the photo preview image transmitted in real time by the camera device;

[0007] Using the virtual screen of the extended reality device to display the photo preview screen in space;

[0008] Acquire a first interaction action of the user, and generate a photo taking instruction according to the first interaction action;

[0009] The photographing instruction is sent to the photographing device, and the photographing instruction is used to control the photographing device to take a photo.

[0010] In one embodiment, the using the virtual screen of the extended reality device to spatially display the photo preview screen includes:

[0011] Obtaining the location of the camera device;

[0012] The photo preview screen is spatially displayed at the position of the photo device using the virtual screen of the extended reality device.

[0013] In one embodiment, the using the virtual screen of the extended reality device to spatially display the photo preview screen includes:

[0014] Detecting the sight direction of the user;

[0015] The photo preview screen is spatially displayed in the direction of the user's sight using the virtual screen of the extended reality device.

[0016] In one embodiment, the method further comprises:

[0017] Acquire a second interaction action of the user;

[0018] generating an adjustment instruction according to the second interactive action;

[0019] The adjustment instruction is sent to the photographing device, and the adjustment instruction is used to control the photographing device to adjust the photographing preview screen.

[0020] In one embodiment, there are multiple photographing devices; using the virtual screen of the extended reality device to spatially display the photographing preview screen includes:

[0021] Generate a total display screen according to the photo preview screens transmitted by the plurality of photo devices;

[0022] The total display screen is spatially displayed using the virtual screen of the extended reality device.

[0023] In one embodiment, generating a total display screen according to the photo preview screens transmitted by the plurality of photo taking devices includes:

[0024] Acquire a third interaction action of the user;

[0025] Determining a target photo preview screen from the plurality of photo preview screens according to the third interaction action of the user;

[0026] Enlarging the target photo preview screen to obtain an enlarged photo preview screen;

[0027] The total display screen is generated according to the enlarged photographing preview screen and the other photographing preview screens.

[0028] In one embodiment, generating a photo-taking instruction according to the first interactive action includes:

[0029] Determine a target camera device selected by the first interactive action, wherein the target camera device is one of the plurality of camera devices;

[0030] According to the first interactive action, generating a target photographing instruction corresponding to the target photographing device;

[0031] The sending the photographing instruction to the photographing device includes:

[0032] The target photographing instruction is sent to the target photographing device, and the target photographing instruction is used to control the target photographing device to take a photo.

[0033] In a second aspect, an embodiment of the present application provides an extended reality device, the extended reality device comprising a virtual screen, an instruction generation module and a communication module;

[0034] The communication module is used to obtain the photo preview image transmitted in real time by the photo device;

[0035] The virtual screen is used to display the photo preview screen in space;

[0036] The instruction generation module is used to obtain a first interaction action of the user and generate a photo taking instruction according to the first interaction action;

[0037] The communication module is further used to send the photographing instruction to the photographing device, and the photographing instruction is used to control the photographing device to take a photo.

[0038] In one of the embodiments, the extended reality device further includes a position acquisition module;

[0039] The location acquisition module is used to acquire the location of the camera device;

[0040] The virtual screen is specifically used to utilize the virtual screen of the extended reality device to spatially display the photo preview screen at the position of the photo device.

[0041] In one of the embodiments, the extended reality device further includes a sight line detection module;

[0042] The sight line detection module is used to detect the sight line direction of the user;

[0043] The virtual screen is specifically used to utilize the virtual screen of the extended reality device to spatially display the photo preview screen in the direction of the user's sight.

[0044] In one embodiment, the instruction generation module is further used to obtain a second interaction action of the user, and generate an adjustment instruction according to the second interaction action;

[0045] The communication module is further used to send the adjustment instruction to the photographing device, and the adjustment instruction is used to control the photographing device to adjust the photographing preview screen.

[0046] In one embodiment, there are multiple photographing devices; and the virtual screen is further used for:

[0047] Generate a total display screen according to the photo preview screens transmitted by the plurality of photo devices;

[0048] The total display screen is spatially displayed using the virtual screen of the extended reality device.

[0049] In one embodiment, the instruction generation module is further used to: obtain a third interaction action of the user, and determine a target photo preview screen from the plurality of photo preview screens according to the third interaction action of the user;

[0050] The virtual screen is also used to enlarge the target photo preview screen to obtain an enlarged photo preview screen, and generate the total display screen according to the enlarged photo preview screen and other photo preview screens.

[0051] In one of the embodiments, the instruction generation module is further used to determine a target photographing device selected by the first interactive action, the target photographing device being one of the plurality of photographing devices, and to generate a target photographing instruction corresponding to the target photographing device according to the first interactive action;

[0052] The communication module is further used to send the target photographing instruction to the target photographing device, and the target photographing instruction is used to control the target photographing device to take a photo.

[0053] In a third aspect, an embodiment of the present application further provides a photographing system, the photographing system comprising an extended reality device and a photographing device;

[0054] The photographing device is used to transmit the photographing preview picture to the extended reality device in real time;

[0055] The extended reality device is used to spatially display the photo preview screen using a virtual screen of the extended reality device, obtain a first interaction action of the user, generate a photo instruction according to the first interaction action, and send the photo instruction to the photo device;

[0056] The photographing device is also used to take photographs according to the photographing instruction.

[0057] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above-mentioned photographing method are implemented.

[0058] In a fifth aspect, the embodiments of the present application further provide a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the method provided in various optional implementations described in the embodiments of the present application.

[0059] In summary, in the embodiment of the present application, the extended reality device can obtain the photo preview screen transmitted in real time by the photo device, and use the virtual screen to display the photo preview screen in space. The extended reality device can also directly generate a photo instruction according to the user's first interactive action, and send the photo instruction to the photo implementation to control the photo device to take a photo. In this way, the extended reality device displays the photo preview screen in space, and the user can directly see the photo preview screen displayed in space through the extended reality device without turning his face or sight toward other electronic devices, without destroying the photo posture; and when satisfied with the current photo preview screen, the first interactive action is used to control the photo device to take a photo, thereby taking a satisfactory photo. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions in the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0061] Figure 1 It is a schematic diagram of the steps of a photographing method provided by an embodiment of the present application;

[0062] Figure 2 It is a schematic diagram of the steps of a photographing method provided by an embodiment of the present application;

[0063] Figure 3 is a schematic diagram of the structure of an extended reality device provided in one embodiment of the present application;

[0064] Figure 4 It is a structural diagram of a photographing system provided in one embodiment of the present application. DETAILED DESCRIPTION

[0065] The following will be combined with the drawings in this application to clearly and completely describe the technical solutions in this application. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments in the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0066] Extended Reality (XR) technology combines the real and the virtual through computers to create a virtual environment for human-computer interaction. Extended reality includes but is not limited to: Augmented Reality (AR), Virtual Reality (VR) and Mixed Reality (MR). Extended reality devices refer to electronic devices with extended reality functions.

[0067] In one embodiment, Figure 1 As shown, a method for adjusting a picture is provided. Although a logical order is shown in the step schematic diagram, in some cases, the steps shown or described may be performed in an order different from that shown in the figure. In one embodiment, the picture adjustment method may be applied to an extended reality device. In particular, the extended reality device refers to a wearable extended reality device, in particular, optical see-through smart glasses.

[0068] It should be noted that the order of description of the following embodiments is not intended to limit the priority order of the embodiments.

[0069] according to Figure 1 The photographing method shown in the figure includes at least steps S110 to S140, which are described in detail as follows:

[0070] In step S110, a photo preview screen transmitted in real time by a photo taking device is obtained.

[0071] The camera device is a device with camera and communication functions, and may be a smart phone or a smart camera, etc. The camera preview screen is the screen when the camera page is entered but the shutter button has not been pressed; after the shutter button is pressed, the camera preview screen will be frozen as a photo.

[0072] The extended reality device can communicate with the camera device in real time, and the camera device transmits the current photo preview screen to the extended reality device in real time, so that the extended reality device displays the photo preview screen. The communication between the extended reality device and the camera device can be based on the network, Bluetooth communication and / or WIFI, etc., and this application does not limit this.

[0073] In step S120, the photo preview screen is spatially displayed using the virtual screen of the extended reality device.

[0074] The virtual screen of an extended reality device is not a real physical screen in the traditional sense, but a display area that can display various virtual information, images, videos, and interactive interfaces, which is simulated and generated through technical means, using elements such as light and images to allow users to perceive. The virtual screen of an extended reality device can have a sufficiently large field of view, which determines the size of the area covered by the virtual screen in the user's field of view. A larger field of view allows users to experience a wider virtual space.

[0075] Spatial display refers to using extended reality technology to display the screen in space. Extended reality technology can combine the real and the virtual, and can display virtual elements in a real environment. In one embodiment of the present application, the photo preview screen is actually displayed in space as a virtual element. The photo preview screen can be displayed in space in a semi-transparent or opaque state, and the transparency can be adjusted by the user.

[0076] The virtual screen of the extended reality device displays the photo preview screen in space, and the visual effect presented to the user wearing the extended reality device is that the photo preview screen is displayed at a certain position in the real environment. Therefore, the user only needs to watch the photo preview screen displayed in the real environment to determine the current photo posture and composition information, without looking down at the smart watch, so as not to disrupt the photo posture and can take a satisfactory photo.

[0077] In step S130, a first interaction action of the user is acquired, and a photo taking instruction is generated according to the first interaction action.

[0078] The corresponding relationship between the first interaction action and the photographing instruction is preset, and when the user performs the first interaction action, the photographing instruction can be generated according to the first interaction action. The user is a user wearing an extended reality device.

[0079] The first interactive action may be that the user makes a voice for taking a photo, or that the user makes a gesture for taking a photo, etc. When the first interactive action is that the user makes a voice for taking a photo, by recognizing the user's voice, when it is determined that the user's voice is a voice for taking a photo, a photo instruction is generated. When the first interactive action is that the user makes a gesture for taking a photo, if the user makes a gesture, it is identified whether the gesture is a gesture for taking a photo, and when it is determined that the gesture made by the user is a gesture for taking a photo, a photo instruction is generated.

[0080] In step S140, the photographing instruction is sent to the photographing device, and the photographing instruction is used to control the photographing device to take a photo.

[0081] After generating a photo-taking instruction, the extended reality device can transmit the photo-taking instruction to the photo-taking device in real time. The photo-taking device responds to the photo-taking instruction and freezes the current photo-taking preview screen as a photo.

[0082] By adopting the technical solution of the embodiment of the present application, the extended reality device can obtain the photo preview screen transmitted in real time by the photo device, and use the virtual screen to display the photo preview screen in space. The extended reality device can also directly generate a photo instruction according to the user's first interactive action, and send the photo instruction to the photo implementation to control the photo device to take a photo. In this way, the extended reality device displays the photo preview screen in space, and the user can directly see the photo preview screen displayed in space through the extended reality device without turning his face or sight toward other electronic devices, without destroying the photo posture; and when satisfied with the current photo preview screen, the first interactive action is used to control the photo device to take a photo, thereby taking a satisfactory photo.

[0083] Based on the above technical solution, as an embodiment, the use of the virtual screen of the extended reality device to spatially display the photo preview screen may include: obtaining the position of the photo device; and using the virtual screen of the extended reality device to spatially display the photo preview screen at the position of the photo device.

[0084] In the process of taking selfies, such as taking ID photos, the user usually needs to look at the camera device so that the photo can be taken with eyes full of spirit. Therefore, when the photo preview screen is displayed in space, the photo preview screen can be displayed at the position of the camera device to guide the user to look at the position of the camera device. To this end, the position of the camera device needs to be obtained.

[0085] Optionally, the photographing device may obtain its own location information and transmit the location information to the extended reality device, so that the extended reality device spatially displays the photographing preview screen at the location of the photographing device.

[0086] Optionally, the extended reality device has a camera that can collect surrounding environment information in real time to display virtual elements in the surrounding environment. The extended reality device can obtain the position of the camera in the environment through the camera, and when the camera preview screen is spatially displayed, the camera preview screen is directly used to cover the image of the camera in the real environment, thereby realizing the spatial display of the camera preview screen at the position of the camera. The camera preview screen can cover the image of the camera in a semi-transparent or opaque state.

[0087] By adopting the technical solution of the embodiment of the present application, the photo preview screen is spatially displayed at the position of the photo device, which not only allows the user to see the posture and composition during the photo shooting process through the photo preview screen, but also guides the user to look at the photo device, so as to take photos with bright eyes, thereby meeting the user's photo needs and improving the user's usage experience.

[0088] Based on the above technical solution, as an embodiment, the use of the virtual screen of the extended reality device to spatially display the photo preview screen may include: detecting the line of sight direction of the user; and using the virtual screen of the extended reality device to spatially display the photo preview screen in the line of sight direction of the user.

[0089] Optionally, the extended reality device may include an eye tracker, which can detect the direction of the user's line of sight. The extended reality device may also have a camera for photographing the user's eyes, and the user's line of sight is analyzed through the image of the user's eyes to determine the direction of the user's line of sight.

[0090] After determining the direction of the user's sight, the virtual screen of the extended reality device can be used to spatially display the photo preview screen in the direction of the user's sight. The photo preview screen can be spatially displayed at a position at a fixed distance from the user in the direction of the user's sight. The fixed distance can be set according to actual needs.

[0091] In one embodiment, the user wants to take a selfie of his / her back, the user's face is completely facing away from the camera, the user's line of sight can be level, and the photo preview screen is the user's back, then the photo preview screen will be displayed in the direction of the user's line of sight and directly facing the user's face. At this time, even though the user is facing away from the camera, the user can still clearly see the current photo preview screen.

[0092] By adopting the technical solution of the embodiment of the present application, the photo preview screen is spatially displayed in the direction of the user's line of sight, which not only allows the user to see the posture and composition of the photo during the photo shooting process through the photo preview screen, but also has no restrictions on the user's photo shooting posture. Among them, the display position of the photo preview screen is controlled by the user's line of sight, which solves the technical problem of the user's line of sight being controlled by the display position of the photo preview screen in the traditional technology, and can greatly improve the user's experience.

[0093] Based on the above technical solution, as an embodiment, Figure 2 As shown, the method may further include steps S150 to S170.

[0094] In step S150, a second interaction action of the user is obtained;

[0095] In step S160, an adjustment instruction is generated according to the second interaction action;

[0096] In step S170, the adjustment instruction is sent to the photographing device, and the adjustment instruction is used to control the photographing device to adjust the photographing preview screen.

[0097] During the photo-taking process, the photo-taking device usually needs to be adjusted, such as selecting different filters, adjusting the focal length, turning on or off the flash, and switching the ratio of the height and width of the photo, etc. Therefore, the corresponding relationship between the second interactive action and the adjustment instruction can be preset, and when the user performs the second interactive action, the adjustment instruction can be generated according to the second interactive action.

[0098] The second interaction action may be that the user issues an adjustment voice, or the user makes an adjustment gesture, etc. Different adjustment voices or adjustment gestures may correspond to different adjustment instructions.

[0099] The adjustment voice can directly indicate the adjustment instruction, and the corresponding adjustment instruction can be generated by recognizing the semantics of the adjustment voice. For example, if the adjustment voice is "switch the filter for taking photos", after recognizing the semantics of the adjustment voice as "switch filter", an adjustment instruction for switching the filter can be generated and sent to the camera device in real time, so that the camera device switches the filter.

[0100] The adjustment instructions corresponding to each adjustment gesture may be preset. For example, when the adjustment gesture is clapping, the corresponding relationship between the adjustment gesture and the adjustment instruction determines that the adjustment instruction corresponding to clapping is to turn on the flash, and then an adjustment instruction to turn on the flash may be generated and sent to the camera device in real time, so that the camera device turns on the flash.

[0101] By adopting the technical solution of the embodiment of the present application, the user can operate the camera device without returning to the location of the camera device to adjust the photo preview screen, and can also view the adjustment effect in real time through the displayed photo preview screen, thereby helping the user to take satisfactory photos.

[0102] Based on the above technical solution, as an embodiment, there are multiple photographing devices; using the virtual screen of the extended reality device to spatially display the photographing preview screen may include: generating a total display screen according to the photographing preview screen transmitted by the multiple photographing devices; and using the virtual screen of the extended reality device to spatially display the total display screen.

[0103] When the user's position or posture is fixed, the photos of the user taken by the camera at different angles are also different. If the position of the camera is fixed, it may be difficult to take an ideal photo even if the user's position and posture are changed. Therefore, in traditional shooting scenes, it is often necessary to move the position of the camera to achieve different compositions in order to take satisfactory photos.

[0104] In order to improve efficiency, multiple camera devices can be set up in multiple different locations and used to take photos. Each camera device can communicate with the extended reality device and transmit its own photo preview screen to the extended reality device in real time. Multiple photo preview screens can be displayed on the virtual screen of the extended reality device.

[0105] In one embodiment, the virtual screen of the extended reality device can sequentially display the photo preview screen corresponding to each photo device, and the user can switch the displayed photo preview screen by sliding gestures, etc. When the user sees a satisfactory photo preview screen, the extended reality device is controlled to issue a photo command to take a photo.

[0106] In another embodiment, the virtual screen of the extended reality device can simultaneously display the photo preview screens corresponding to multiple photo devices. When the extended reality device receives the photo preview screens transmitted in real time by multiple photo devices, it can synthesize the multiple photo preview screens into a total display screen. For example, when there are four photo devices, there will be four photo preview screens, and the four photo preview screens can be synthesized into a total display screen in the form of a four-square grid. The total display screen is spatially displayed using the virtual screen of the extended reality device.

[0107] By adopting the technical solution of the embodiment of the present application, taking pictures with multiple photographing devices can improve efficiency, and the total display screen includes various photo preview screens. Then, through the total display screen displayed in space, various photo preview screens can be seen at the same time, so that the user can compare multiple photo preview screens and determine the photo preview screen with the best photo effect.

[0108] On the basis of the above technical solution, as an embodiment, generating a total display screen according to the photo preview screens transmitted by multiple photo devices may include: obtaining a third interaction action of the user; determining a target photo preview screen from the multiple photo preview screens according to the third interaction action of the user; enlarging the target photo preview screen to obtain an enlarged photo preview screen; and generating the total display screen according to the enlarged photo preview screen and the other photo preview screens.

[0109] The third interactive action may be preset. For example, the third interactive action may be that the user clicks on one of the photo preview screens. It is understandable that the displayed photo preview screen is similar to a virtual element, and the user cannot actually touch the photo preview screen. It only appears from the user's perspective that the user clicks on the photo preview screen. The system processes the photo preview screen accordingly in response to the user's click operation, and the specific technical implementation method is not limited in this application.

[0110] The third interactive action is used to determine a target photo preview screen from a plurality of photo preview screens. The display area of ​​the target photo preview screen is larger than the display areas of other photo preview screens except the target photo preview screen. In a total display screen, there may be one or more target photo preview screens.

[0111] In response to the third interactive action, a target photo preview screen is determined, and the target photo preview screen is enlarged. The target photo preview screen is synthesized with other photo preview screens to obtain a total display screen.

[0112] Optionally, after determining a photo preview screen as a target photo preview screen, the user may determine another photo preview screen as a target photo preview screen through a third interactive action. The other photo preview screen may replace the previous target photo preview screen and become a new target photo preview screen, or may be the same as the previous target photo preview screen and both are target photo preview screens.

[0113] By adopting the technical solution of the embodiment of the present application, the target photo preview screen can be determined through the third interactive action, thereby realizing the enlarged display of the target photo preview screen, which helps the user to view the details of the target photo preview screen.

[0114] Based on the above technical solution, as an embodiment, multiple photo preview pictures are displayed. Specifically, multiple display modes may be preset in the virtual screen, and different display modes correspond to different numbers of photo preview pictures, and each display mode includes multiple display frames. When there are multiple photo preview pictures, a display mode is determined according to the number of photo preview pictures, and each photo preview picture is displayed in one of the display frames.

[0115] In the default setting, the areas of multiple display frames in the same display mode are equal. In response to the third interactive action, one of the display frames can be enlarged, and the photo preview screen in the display frame will also be enlarged accordingly. The user can drag the photo preview screen in the display frame, and the display position and display size of each photo preview screen are adaptively adjusted according to the corresponding display frame, thereby adjusting the display size and display position of each photo preview screen.

[0116] It is understandable that the user cannot actually touch the photo preview screen. It just appears from the user's perspective that the user has dragged the photo preview screen. The system processes the photo preview screen accordingly in response to the user's dragging operation. The specific technical implementation method is not limited in this application.

[0117] Based on the above technical solution, as an embodiment, generating a photographing instruction according to the first interactive action may include: determining a target photographing device selected by the first interactive action, the target photographing device being one of the plurality of photographing devices; and generating a target photographing instruction corresponding to the target photographing device according to the first interactive action. Sending the photographing instruction to the photographing device may include: sending the target photographing instruction to the target photographing device, the target photographing instruction being used to control the target photographing device to take a photograph.

[0118] When there are multiple camera devices, if the generated shooting instruction controls multiple camera devices to take pictures at the same time, some of the camera devices may take unqualified pictures that the user is not satisfied with, and the pictures taken will be stored in the camera devices, resulting in a waste of storage space. If the user wants to delete unqualified pictures, the user still needs to operate, which is troublesome. Therefore, a target shooting instruction can be generated for the target camera device.

[0119] The target camera device is the camera device selected by the user, and the camera preview screen of the target camera device is a screen that the user is satisfied with and can be frozen as a photo. In response to the user's first interactive action, the target camera device corresponding to the first interactive action is determined, and a target camera instruction is generated. The target camera instruction is sent to the target camera device, and the target camera device takes a photo in response to the target camera instruction. There can be one or more target cameras at the same time.

[0120] By adopting the technical solution of the embodiment of the present application, a target photographing instruction can be generated only for the target photographing device to control the target photographing device to take pictures, thereby preventing other photographing devices from taking unqualified pictures and wasting storage space.

[0121] In order to better implement the photographing method of the present application, the present application also provides an extended reality device based on the photographing method. The meanings of the terms are the same as those in the photographing method, and the specific implementation details can refer to the description in the method embodiment.

[0122] See also Figure 3 , Figure 3 It is a structural diagram of an extended reality device provided in an embodiment of the present application, wherein the extended reality device includes: a virtual screen, an instruction generation module and a communication module.

[0123] The communication module is used to obtain the photo preview image transmitted in real time by the photo device;

[0124] The virtual screen is used to display the photo preview screen in space;

[0125] The instruction generation module is used to obtain a first interaction action of the user and generate a photo taking instruction according to the first interaction action;

[0126] The communication module is further used to send the photographing instruction to the photographing device, and the photographing instruction is used to control the photographing device to take a photo.

[0127] In one of the embodiments, the extended reality device further includes a position acquisition module;

[0128] The location acquisition module is used to acquire the location of the camera device;

[0129] The virtual screen is specifically used to utilize the virtual screen of the extended reality device to spatially display the photo preview screen at the position of the photo device.

[0130] In one of the embodiments, the extended reality device further includes a sight line detection module;

[0131] The sight line detection module is used to detect the sight line direction of the user;

[0132] The virtual screen is specifically used to utilize the virtual screen of the extended reality device to spatially display the photo preview screen in the direction of the user's sight.

[0133] In one embodiment, the instruction generation module is further used to obtain a second interaction action of the user, and generate an adjustment instruction according to the second interaction action;

[0134] The communication module is further used to send the adjustment instruction to the photographing device, and the adjustment instruction is used to control the photographing device to adjust the photographing preview screen.

[0135] In one embodiment, there are multiple photographing devices; and the virtual screen is further used for:

[0136] Generate a total display screen according to the photo preview screens transmitted by the plurality of photo devices;

[0137] The total display screen is spatially displayed using the virtual screen of the extended reality device.

[0138] In one embodiment, the instruction generation module is further used to: obtain a third interaction action of the user, and determine a target photo preview screen from the plurality of photo preview screens according to the third interaction action of the user;

[0139] The virtual screen is also used to enlarge the target photo preview screen to obtain an enlarged photo preview screen, and generate the total display screen according to the enlarged photo preview screen and other photo preview screens.

[0140] In one of the embodiments, the instruction generation module is further used to determine a target photographing device selected by the first interactive action, the target photographing device being one of the plurality of photographing devices, and to generate a target photographing instruction corresponding to the target photographing device according to the first interactive action;

[0141] The communication module is further used to send the target photographing instruction to the target photographing device, and the target photographing instruction is used to control the target photographing device to take a photo.

[0142] By adopting the technical solution of the embodiment of the present application, the extended reality device can obtain the photo preview screen transmitted in real time by the photo device, and use the virtual screen to display the photo preview screen in space. The extended reality device can also directly generate a photo instruction according to the user's first interactive action, and send the photo instruction to the photo implementation to control the photo device to take a photo. In this way, the extended reality device displays the photo preview screen in space, and the user can directly see the photo preview screen displayed in space through the extended reality device without turning his face or sight toward other electronic devices, without destroying the photo posture; and when satisfied with the current photo preview screen, the first interactive action is used to control the photo device to take a photo, thereby taking a satisfactory photo.

[0143] When the specific extended reality device is wearable optical see-through smart glasses, in addition to the above structure, it also includes at least a glasses body frame, an optical display component, an electronic circuit component, a sensor, etc.

[0144] For the specific limitations of the extended reality device, please refer to the limitations of the photography method above, which will not be repeated here. Each module in the above-mentioned extended reality device can be implemented in whole or in part by software, hardware, and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0145] In order to better implement the photographing method of the present application, the present application also provides a photographing system based on the photographing method, wherein the meanings of the terms are the same as those in the photographing method, and the specific implementation details can refer to the description in the method embodiment.

[0146] See also Figure 4 , Figure 4is a structural schematic diagram of a photographing system provided by an embodiment of the present application, wherein the photographing system includes an extended reality device and a photographing device;

[0147] The photographing device is used to transmit the photographing preview picture to the extended reality device in real time;

[0148] The extended reality device is used to spatially display the photo preview screen using a virtual screen of the extended reality device, obtain a first interaction action of the user, generate a photo instruction according to the first interaction action, and send the photo instruction to the photo device;

[0149] The photographing device is also used to take photographs according to the photographing instruction.

[0150] By adopting the technical solution of the embodiment of the present application, the extended reality device can obtain the photo preview screen transmitted in real time by the photo device, and use the virtual screen to display the photo preview screen in space. The extended reality device can also directly generate a photo instruction according to the user's first interactive action, and send the photo instruction to the photo implementation to control the photo device to take a photo. In this way, the extended reality device displays the photo preview screen in space, and the user can directly see the photo preview screen displayed in space through the extended reality device without turning his face or sight toward other electronic devices, without destroying the photo posture; and when satisfied with the current photo preview screen, the first interactive action is used to control the photo device to take a photo, thereby taking a satisfactory photo.

[0151] For the specific limitations of the photographing system, please refer to the limitations on the photographing method above, which will not be repeated here.

[0152] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method described in any embodiment of the present application is implemented.

[0153] In some embodiments, a computer program product is also proposed, including a computer program or instructions, which implement the method described in any embodiment of the present application when executed by a processor.

[0154] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0155] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0156] To this end, the present application provides a computer-readable storage medium, on which a computer program is stored. The computer program can be loaded by a processor to execute the steps in any one of the photographing methods provided in the present application.

[0157] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0158] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0159] Since the instructions stored in the computer-readable storage medium can execute the steps in any one of the photographing methods provided in the present application, the beneficial effects that can be achieved by any one of the photographing methods provided in the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0160] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0161] The above is a detailed introduction to a photographing method, an extended reality device, a photographing system and a computer-readable storage medium provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A photographing method, characterized in that: Applied to an extended reality device; the method comprises: Get the photo preview image transmitted in real time by the camera device; Using the virtual screen of the extended reality device to display the photo preview screen in space; Acquire a first interaction action of the user, and generate a photo taking instruction according to the first interaction action; The photographing instruction is sent to the photographing device, and the photographing instruction is used to control the photographing device to take a photo.

2. The method according to claim 1, characterized in that The utilizing the virtual screen of the extended reality device to spatially display the photo preview screen includes: Obtaining the location of the camera device; The photo preview screen is spatially displayed at the position of the photo device using the virtual screen of the extended reality device.

3. The method according to claim 1, characterized in that The utilizing the virtual screen of the extended reality device to spatially display the photo preview screen includes: Detecting the sight direction of the user; The photo preview screen is spatially displayed in the direction of the user's sight using the virtual screen of the extended reality device.

4. The method according to claim 1, characterized in that The method further comprises: Acquire a second interaction action of the user; generating an adjustment instruction according to the second interactive action; The adjustment instruction is sent to the photographing device, and the adjustment instruction is used to control the photographing device to adjust the photographing preview screen.

5. The method according to claim 1, characterized in that There are multiple photographing devices; and using the virtual screen of the extended reality device to spatially display the photographing preview screen includes: Generate a total display screen according to the photo preview screens transmitted by the plurality of photo devices; The total display screen is spatially displayed using the virtual screen of the extended reality device.

6. The method according to claim 5, characterized in that The step of generating a total display screen according to the photo preview screens transmitted by the plurality of photo devices comprises: Acquire a third interaction action of the user; Determining a target photo preview screen from the plurality of photo preview screens according to the third interaction action of the user; Enlarging the target photo preview screen to obtain an enlarged photo preview screen; The total display screen is generated according to the enlarged photographing preview screen and the other photographing preview screens.

7. The method according to claim 5, characterized in that The generating a photo-taking instruction according to the first interactive action includes: Determine a target camera device selected by the first interactive action, wherein the target camera device is one of the plurality of camera devices; According to the first interactive action, generating a target photographing instruction corresponding to the target photographing device; The sending the photographing instruction to the photographing device includes: The target photographing instruction is sent to the target photographing device, and the target photographing instruction is used to control the target photographing device to take a photo.

8. An extended reality device, characterized in that: The extended reality device includes a virtual screen, an instruction generation module and a communication module; The communication module is used to obtain the photo preview image transmitted in real time by the photo device; The virtual screen is used to display the photo preview screen in space; The instruction generation module is used to obtain a first interaction action of the user and generate a photo taking instruction according to the first interaction action; The communication module is further used to send the photographing instruction to the photographing device, and the photographing instruction is used to control the photographing device to take a photo.

9. A photographing system, characterized in that: The photographing system includes an extended reality device and a photographing device; The photographing device is used to transmit the photographing preview picture to the extended reality device in real time; The extended reality device is used to spatially display the photo preview screen using a virtual screen of the extended reality device, obtain a first interactive action of the user, generate a photo instruction according to the first interactive action, and send the photo instruction to the photo device; The photographing device is also used to take photographs according to the photographing instruction.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the photographing method according to any one of claims 1 to 7 are implemented.

Images