Photographing method, device and electronic equipment

Abstract

The present application discloses a photography method, device and electronic device, belonging to the field of virtual reality technology. The method is applied to a first device, the first device can display a virtual display interface, the first device is connected to a second device in communication, and the method includes: displaying a virtual screen of the second device in the virtual display interface, the virtual screen includes a virtual shooting preview interface; obtaining a first input of a user on the second device; and executing a corresponding operation instruction on the virtual shooting preview interface according to the first input.

Description

Technical Field

[0001] The present application belongs to the field of virtual reality technology, and specifically relates to a photographing method, device and electronic equipment. Background Art

[0002] As more and more electronic product consumers are open and inclusive to new forms and technologies of smart terminal products, new forms of smart terminal devices such as VR are developing very fast. VR: Also known as "virtual reality", the scenes and characters you see are virtual, which puts you in a virtual world. VR devices are now widely used in games, movies and other scenes.

[0003] Currently, if users want to perform related operations in the VR world, they need to wear a hand sensor or handle. Traditional VR photography technology uses a sensor handle to virtualize a box for taking pictures. Users do not have the grip feeling of traditional photography methods when taking pictures, and cannot provide users with an immersive photography experience. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a photographing method, device and electronic device, which can solve the problem that the virtual reality photographing method of traditional technology cannot provide users with an immersive photographing experience.

[0005] In a first aspect, an embodiment of the present application provides a photographing method, which is applied to a first device, the first device can display a virtual display interface, the first device is communicatively connected with a second device, and the method includes:

[0006] Displaying a virtual screen of the second device in the virtual display interface, wherein the virtual screen includes a virtual shooting preview interface;

[0007] Obtaining a first input from a user on the second device;

[0008] According to the first input, a corresponding operation instruction is executed on the virtual shooting preview interface.

[0009] In a second aspect, an embodiment of the present application provides a photographing method, which is applied to a second device, the second device is communicatively connected to a first device, the first device can display a virtual display interface, and a virtual screen of the second device is displayed in the virtual display interface of the first device, the virtual screen includes a virtual shooting preview interface, and the method includes:

[0010] receiving a first input from a user on the second device;

[0011] In response to the first input, the first input is sent to the first device, so that the first device executes a corresponding operation instruction on the virtual shooting preview interface according to the first input.

[0012] In a third aspect, an embodiment of the present application provides a shooting device, which is applied to a first device, the first device can display a virtual display interface, the first device is communicatively connected with a second device, and the device includes:

[0013] A first display module, configured to display a virtual screen of the second device in the virtual display interface, wherein the virtual screen includes a virtual shooting preview interface;

[0014] An acquisition module, used to acquire a first input of a user on the second device;

[0015] A processing module is used to execute corresponding operation instructions on the virtual shooting preview interface according to the first input.

[0016] In a fourth aspect, an embodiment of the present application provides a shooting device, which is applied to a second device, the second device is communicatively connected to a first device, the first device can display a virtual display interface, and a virtual screen of the second device is displayed in the virtual display interface of the first device, the virtual screen includes a virtual shooting preview interface, and the device includes:

[0017] A first receiving module, configured to receive a first input from a user on the second device;

[0018] The first responding module is used to respond to the first input and send the first input to the first device, so that the first device executes a corresponding operation instruction on the virtual shooting preview interface according to the first input.

[0019] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect or the second aspect are implemented.

[0020] In a sixth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect or the second aspect are implemented.

[0021] In the seventh aspect, an embodiment of the present application provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect or the second aspect.

[0022] In an eighth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect or the second aspect.

[0023] In an embodiment of the present application, the first device is connected to the second device in communication, and the first device can display a virtual display interface, and display a virtual screen of the second device in the virtual display interface, and the virtual screen includes a virtual shooting preview interface; the first device obtains a first input from the user on the second device; and executes a corresponding operation instruction on the virtual shooting preview interface according to the first input. In this way, when the user wears the first device and holds the second device, the user can make a first input to the second device held in the hand based on the virtual screen of the second device displayed in the virtual reality world, and execute a corresponding operation instruction on the virtual shooting preview interface by receiving the first input sent by the second device, and complete the virtual shooting process in the virtual reality interface. This embodiment enables the user to obtain a real sense of holding when taking pictures in the virtual reality world, and brings an immersive shooting experience to the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is one of the flow charts of the photographing method according to an embodiment of the present application;

[0025] Figure 2 This is one of the schematic diagrams of the shooting preview interface of the embodiment of the present application;

[0026] Figure 3 This is the second schematic diagram of the shooting preview interface of the embodiment of the present application;

[0027] Figure 4 This is the third schematic diagram of the shooting preview interface of the embodiment of the present application;

[0028] Figure 5 This is the second flowchart of the photographing method of the embodiment of the present application;

[0029] Figure 6 It is one of the structural block diagrams of the photographing device in the embodiment of the present application;

[0030] Figure 7 This is the second structural block diagram of the photographing device according to the embodiment of the present application;

[0031] Figure 8 is a structural block diagram of a first device in an embodiment of the present application;

[0032] Fig. 9 is a hardware structure block diagram of the first device in an embodiment of the present application;

[0033] Fig.10 is a structural block diagram of a second device in an embodiment of the present application;

[0034] Fig.11 This is a hardware structure block diagram of the second device in an embodiment of the present application. DETAILED DESCRIPTION

[0035] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0036] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0037] The following is a detailed description of the photography provided by the embodiments of the present application through specific embodiments and their application scenarios in conjunction with the accompanying drawings.

[0038] See also Figure 1 The present application provides a photographing method, which is applied to a first device, the first device can display a virtual display interface, the first device is connected to a second device for communication, and the method specifically includes the following steps:

[0039] Step 101, displaying a virtual screen of a second device in a virtual display interface, where the virtual screen includes a virtual shooting preview interface;

[0040] It should be pointed out that the virtual shooting preview interface displays the framing image in the virtual reality world. The user determines the framing area to be photographed based on the virtual shooting preview interface. Specifically, when the user holds up the second device to prepare for taking a photo, the framing position can be adjusted by moving the position of the second device, thereby changing the framing image displayed in the virtual shooting preview interface. In specific implementation, during the movement of the second device, the display position of the virtual screen of the second device in the virtual display interface can be accurately identified based on the Simultaneous Localization And Mapping (SLAM) algorithm to achieve the adjustment of the framing area.

[0041] In a specific embodiment, a first control is displayed in the virtual display interface, and the first control is used to trigger the display of a virtual screen of the second device in the virtual display interface.

[0042] In another specific embodiment, a first control and a second control are displayed in the virtual display interface; wherein the first control is used to trigger the display of a virtual screen of the second device in the virtual display interface, and the second control is used to trigger the display of a virtual shooting frame in the virtual display interface based on the sensing handle, and the user performs a virtual shooting operation based on the virtual shooting frame and the handle. In this way, when the user enables the camera shooting function in the virtual reality interface, if the user needs to take a photo quickly, the virtual shooting can be completed based on the second control and the handle, and if the user needs to take an immersive photo, the virtual interface of the second device can be obtained based on the first control trigger. In specific implementation, it is determined whether to perform a shooting operation in the virtual display interface based on the second device; if so, the second device positioning system is started to display the virtual screen of the second device in the virtual display interface; if not, a virtual shooting frame is displayed in the virtual display interface based on the handle, and a virtual shooting operation is performed based on the virtual shooting frame and the handle.

[0043] In a specific application scenario, a first user wears a first device and holds a second device, the first device is a virtual reality VR device, and the second device is a mobile terminal (such as a mobile phone, a tablet computer, etc.).

[0044] Optionally, the virtual screen of the second device may also include any one or more of the following interfaces: a virtual startup interface, a virtual boot interface, a virtual home page and menu interface, a virtual login and personal information interface, a virtual application interface (such as a camera operation interface), and a virtual settings interface.

[0045] It should be pointed out that the virtual screen of the second device can be understood as mapping the display interface of the second device in proportion to the virtual display interface, so that the user can see the virtual screen of the second device in the virtual world and operate the second device in the real world with his hands, giving the user an immersive user experience.

[0046] Step 102, obtaining a first input of a user on a second device;

[0047] In this step, the first input may include but is not limited to at least one of click input, press input, long press input, pinch input, drag input, slide input and swipe input. That is to say, the first input may be one of the above inputs, or a combination of two or more of them.

[0048] Exemplarily, when the user adjusts the focal length through a pinch input on the second device, the second device sends the acquired pinch input to the first device, so that the first device acquires the pinch input.

[0049] Exemplarily, when the user adjusts the focus of the preview image through a click input on the second device, the second device sends the acquired click input to the first device, so that the first device acquires the click input.

[0050] Exemplarily, when the user triggers taking a photo by double-clicking the input on the second device, the second device sends the acquired double-click input to the first device, so that the first device acquires the double-click input.

[0051] Exemplarily, when the user triggers a photo-taking instruction by pressing a capture button on the second device, the second device sends the acquired input operation of pressing the capture button to the first device, so that the first device acquires the input operation of pressing the capture button.

[0052] Step 103: Execute a corresponding operation instruction on the virtual shooting preview interface according to the first input.

[0053] Exemplarily, when the first device obtains a pinch input for focusing input by the user on the second device, the first device executes a focusing operation instruction on the virtual shooting preview interface, that is, based on the pinch input, adjusts the focal length of the image displayed in the virtual shooting preview interface.

[0054] Exemplarily, when the first device obtains a click input for focus adjustment input by the user on the second device, the first device executes a focus operation instruction on the virtual shooting preview interface, that is, based on the click input, the first device performs focus processing on the image displayed in the virtual shooting preview interface.

[0055] Exemplarily, when the first device obtains the user's input of pressing the shooting button on the second device, the first device executes the shooting operation instruction on the virtual shooting preview interface, that is, based on the user's input of pressing the shooting button on the second device, the first device performs the shooting operation based on the virtual shooting preview interface to generate a photo.

[0056] In the above embodiment, when the user wears the first device and holds the second device, the user can make a first input to the second device held in the hand based on the virtual screen of the second device displayed in the virtual reality world, and execute corresponding operation instructions on the virtual shooting preview interface by receiving the first input sent by the second device, thereby completing the virtual shooting process in the virtual reality interface. This embodiment enables the user to obtain a real holding feeling when taking pictures in the virtual reality world, giving the user an immersive shooting experience.

[0057] In a specific embodiment of the present application, in the above step 103, executing a corresponding operation instruction on the virtual shooting preview interface according to the first input may specifically include:

[0058] Obtaining a relative position of an operation position of the first input on the second device;

[0059] Determining a corresponding operation instruction on the virtual shooting preview interface according to a relative position of the operation position of the first input on the second device;

[0060] Execute corresponding operation instructions on the virtual shooting preview interface.

[0061] In specific implementation, there is a mapping relationship between the relative position of the operation position of the first input on the second device and the operation instruction, that is, different operation positions correspond to different operation instructions. For example, the operation instruction corresponding to position 1 is to adjust the exposure of the preview image, the operation instruction corresponding to position 2 is to adjust the color saturation of the preview image, and the operation instruction corresponding to position 3 is a photo taking instruction, etc.

[0062] Taking the second device as a mobile phone as an example, the relative position relationship between the operation position of the first input and the second device, as well as operation information such as the operation method of the first input can be obtained through touch buttons or touch sensors, and the operation information can be synchronized to the first device through a wireless network (such as Bluetooth, Wi-Fi, etc.); further based on the mapping relationship between the relative position of the operation position of the first input on the second device and the operation instruction, the corresponding operation instruction is determined on the virtual shooting preview interface.

[0063] In addition, in the case where the user is separated from the second device, since the user cannot see the scene in the real physical space after wearing the first device, in order to enable the user wearing the first device to take the second device, in a specific embodiment of the present application, in the above step 101, before displaying the virtual screen of the second device in the virtual display interface, the method further includes:

[0064] The virtual image of the second device is displayed in the virtual display interface by using the synchronous positioning and map construction SLAM algorithm.

[0065] In specific implementation, since the virtual world is built based on the real physical space where the user is, the coordinates of the virtual space and the real physical space can be superimposed through the SLAM algorithm to determine the display position of the second device in the virtual display interface. When the position of the second device is the same as the position of the user, it is determined that the user has taken the second device. In this way, even if the second device is not with the user, the user can take the second device while wearing the first device.

[0066] In a specific embodiment of the present application, when the first input is used to trigger the execution of a photographing operation instruction, in the above step 103, according to the first input, executing a corresponding operation instruction on the virtual photographing preview interface includes:

[0067] According to the first input, performing a photo taking operation on the virtual photo taking preview interface to generate a first image;

[0068] The above method also includes: sending the first image to the second device.

[0069] The first image is a photo generated based on the virtual shooting preview interface, and the first image is a framing picture in the virtual world.

[0070] In this embodiment, by sending the first image to the second device, the second device that performs the photo-taking operation can use the first image as the captured image to replace the image captured by the camera of the second device. That is, after the second device performs the photo-taking operation, the second device does not save the captured photo, but saves the first image sent back to the second device by the first device. In this way, it is possible to avoid storing unwanted photos in the second device.

[0071] In a specific implementation, when a user operates a second device in a physical space to take a photo, in order to avoid storing unwanted photos in the second device, the following methods can be used:

[0072] Method 1: After the second device is connected to the first device, the second device automatically starts the function of taking photos without saving.

[0073] Method 2: Based on the user's input operation on the virtual display interface, the first device sends a deletion instruction to the second device, and the second device deletes the taken photos based on the deletion instruction.

[0074] In a specific embodiment of the present application, in the above step 101, after displaying the virtual screen of the second device in the virtual display interface, the method further includes:

[0075] The second image is sent to the second device so that the second image is displayed in the shooting preview interface of the second device; wherein the second image is an image displayed in the virtual shooting preview interface.

[0076] In specific implementation, it can be transmitted to a second device in a real physical space via a wireless network (such as Bluetooth, Wi-Fi, etc.) and displayed on the shooting preview interface of the second device, so that the shooting preview interface of the second device is the same as the image displayed on the virtual shooting preview interface.

[0077] In this embodiment, the shooting preview interface of the second device is the same as the image displayed in the virtual shooting preview interface in the virtual display interface. In this way, other users in the real physical space can understand the shooting content of the user in the virtual world through the shooting preview interface of the second device, thereby interacting with other users in the real interface and improving the user experience.

[0078] In a specific embodiment of the present application, in the above step 101, after displaying the virtual screen of the second device in the virtual display interface, the method further includes:

[0079] A third image is sent to the second device so that the third image is displayed in the shooting preview interface of the second device; wherein the third image is a preset image.

[0080] The preset image may be a randomly generated image that is irrelevant to the user's virtual world, or a preset blurred image, or a preset target image.

[0081] In this embodiment, the shooting preview interface of the second device is different from the image displayed by the virtual shooting preview interface in the virtual display interface. In this way, other users in the real physical space can be prevented from understanding the user's shooting content in the virtual world through the shooting preview interface of the second device, thereby protecting the user's privacy.

[0082] In a specific embodiment of the present application, in the above step 101, displaying a virtual shooting preview interface of the second device in the virtual display interface includes:

[0083] Determine whether the virtual shooting preview interface includes a first user, where the first user is a user wearing a first device;

[0084] In a case where the first user is included in the virtual shooting preview interface, a virtual character image of the first user is displayed in the virtual shooting preview interface.

[0085] It should be pointed out that in the virtual reality world, the user wearing the first device only has coordinate information but no graphic information. If he wants to take selfies or photos of others in the virtual display interface, he needs to generate a virtual character image, that is, simulate a character shape.

[0086] In this embodiment, by displaying the virtual character image of the first user in the second shooting preview interface, the user wearing the first device can take a photo with the virtual world when taking a selfie or a photo of others in the virtual display interface.

[0087] In an optional embodiment, in a scenario where others use the second device to take a photo of the head-mounted user, the virtual display interface may also include virtual characters of other users (referring to non-head-mounted users), and the virtual characters of other users hold the second device.

[0088] For example, Figure 4 As shown, taking the second device as a mobile phone as an example, by selecting the virtual photo preview screen of the synchronized VR world in the UI interface of the mobile phone, the first device transmits the virtual photo preview screen to the mobile phone for display, so that when other users use the second device to take photos of the head-mounted user, they can adjust the framing area according to the virtual photo preview screen displayed on the mobile phone. Other users can also adjust their position relative to the head-mounted user, where the position of the mobile phone will be located through the SLAM algorithm to achieve focal length adjustment during the virtual world photo taking process.

[0089] See also Figure 6 The present application provides a photographing method, which is applied to a second device, the second device is communicatively connected with a first device, the first device can display a virtual display interface, and a virtual screen of the second device is displayed in the virtual display interface of the first device, the virtual screen includes a virtual shooting preview interface, and the method includes the following steps:

[0090] Step 201, receiving a first input from a user on a second device;

[0091] In this step, the first input may include but is not limited to at least one of click input, press input, long press input, pinch input, drag input, slide input and swipe input. That is to say, the first input may be one of the above inputs, or a combination of two or more of them.

[0092] For example, the first input may include a pinch input for adjusting the focal length; for another example, the first input may include a click input for focusing; for another example, the first input may include a double-click input for triggering a photo operation instruction; for another example, the first input may include a press operation obtained based on a photo button.

[0093] Step 202: In response to a first input, the first input is sent to a first device, so that the first device executes a corresponding operation instruction on a virtual shooting preview interface according to the first input.

[0094] In this embodiment, by sending the acquired first input to the first device, the first device can execute the corresponding operation instruction on the virtual shooting preview interface according to the first input. When the user wears the first device and holds the second device, the user can perform the first input on the second device held in the hand to execute the corresponding operation instruction on the virtual shooting preview interface, complete the virtual shooting process in the virtual reality interface, and enable the user to obtain a real holding feeling when taking pictures in the virtual reality world, giving the user an immersive shooting experience.

[0095] In a specific embodiment of the present application, when a shooting preview interface is displayed on the second device, the method further includes:

[0096] A second image sent by the first device is received, and the second image is displayed in the shooting preview interface; the second image is the image displayed in the virtual shooting preview interface.

[0097] In specific implementation, it can be transmitted to a second device in a real physical space via a wireless network (such as Bluetooth, Wi-Fi, etc.) and displayed on the shooting preview interface of the second device, so that the shooting preview interface of the second device is the same as the image displayed on the virtual shooting preview interface.

[0098] In this embodiment, the shooting preview interface of the second device is the same as the image displayed in the virtual shooting preview interface in the virtual display interface. In this way, other users in the real physical space can understand the shooting content of the user in the virtual world through the shooting preview interface of the second device, thereby interacting with other users in the real interface and improving the user experience.

[0099] In a specific embodiment of the present application, when a shooting preview interface is displayed on the second device, the method further includes:

[0100] A third image sent by the first device is received, and the third image is displayed in a shooting preview interface; wherein the third image is a preset image.

[0101] The preset image may be a randomly generated image that is irrelevant to the user's virtual world, or a preset blurred image, or a preset target image.

[0102] In a specific implementation, if the user enables the privacy protection function, the third image is displayed in the shooting preview interface of the second device.

[0103] In this embodiment, the shooting preview interface of the second device is different from the image displayed by the virtual shooting preview interface in the virtual display interface. In this way, other users in the real physical space can be prevented from understanding the user's shooting content in the virtual world through the shooting preview interface of the second device, thereby protecting the user's privacy.

[0104] In a specific embodiment of the present application, the above method further includes:

[0105] In the case where the first input is used to trigger the execution of a photographing operation instruction, the photographing operation is performed in response to the first input, and the image data collected by the camera is deleted.

[0106] In this way, it is possible to avoid storing photos that the user does not want in the second device.

[0107] In a specific embodiment of the present application, the above method further includes:

[0108] In a case where the first input is used to trigger the execution of a photographing operation instruction, receiving a first image sent by the first device, where the first image is generated after the first device executes a photographing operation on the virtual shooting preview interface;

[0109] Save the first image.

[0110] In this embodiment, by sending the first image to the second device, the second device that performs the photo-taking operation can use the first image as the captured image to replace the image captured by the camera of the second device. That is, after the second device performs the photo-taking operation, the second device does not save the captured photo, but saves the first image sent back to the second device by the first device. In this way, it is possible to avoid storing unwanted photos in the second device.

[0111] The above-mentioned embodiments can realize the interaction between the first device and the second device in the real physical world, thereby enhancing the user's sense of immersion in taking photos.

[0112] The photographing method provided in the embodiment of the present application can be executed by a photographing device. In the embodiment of the present application, the photographing device provided in the embodiment of the present application is described by taking the photographing method executed by the photographing device as an example.

[0113] See also Figure 6 The present application provides a photographing device 600, which is applied to a first device, the first device is communicatively connected with a second device, the first device can display a virtual display interface, the first device is communicatively connected with the second device, and the device includes:

[0114] A first display module 601 is used to display a virtual screen of the second device in a virtual display interface, where the virtual screen includes a virtual shooting preview interface;

[0115] An acquisition module 602 is used to acquire a first input of a user on a second device;

[0116] The processing module 603 is used to execute a corresponding operation instruction on the virtual shooting preview interface according to the first input.

[0117] Optionally, the processing module 603 includes:

[0118] A first processing submodule, used for obtaining a relative position of an operation position of a first input on a second device;

[0119] A second processing submodule, configured to determine a corresponding operation instruction on the virtual shooting preview interface according to a relative position of an operation position of the first input on the second device;

[0120] The third processing submodule is used to execute corresponding operation instructions on the virtual shooting preview interface.

[0121] Optionally, the above device 600 further includes:

[0122] The second display module is used to display the virtual screen of the second device in the virtual display interface by using the synchronous positioning and map construction SLAM algorithm.

[0123] Optionally, when the first input is used to trigger the execution of a photographing operation instruction, the processing module 603 includes:

[0124] A fourth processing submodule, configured to perform a photo-taking operation on the virtual photo-taking preview interface according to the first input, and generate a first image;

[0125] The above-mentioned device 600 further includes:

[0126] The first sending module is used to send a first image to a second device.

[0127] Optionally, the above device 600 further includes:

[0128] The second sending module is used to send the second image to the second device so that the second image is displayed in the shooting preview interface of the second device; wherein the second image is the image displayed in the virtual shooting preview interface.

[0129] Optionally, the above device 600 further includes:

[0130] The third sending module is used to send the third image to the second device so that the third image is displayed in the shooting preview interface of the second device; wherein the third image is a preset image.

[0131] Optionally, the first display module 601 includes:

[0132] A judgment module, used to determine whether the virtual shooting preview interface includes a first user, where the first user is a user wearing a first device;

[0133] The first display submodule is used to display the virtual character image of the first user in the virtual shooting preview interface when the first user is included in the virtual shooting preview interface.

[0134] The photographing device 600 in the embodiment of the present application may be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal or other devices other than a terminal. Exemplarily, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It may also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0135] The photographing device 600 in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0136] The photographing device provided in the embodiment of the present application can achieve Figures 1 to 5 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0137] See also Figure 7 The present application provides a photographing device 700, which is applied to a second device, the second device is communicatively connected to a first device, the second device is communicatively connected to the first device, the first device can display a virtual display interface, a virtual screen of the second device is displayed in the virtual display interface of the first device, and the virtual screen includes a virtual shooting preview interface, the device 700 includes:

[0138] The first receiving module 701 is used to receive a first input from a user on a second device;

[0139] The first responding module 702 is used to respond to the first input and send the first input to the first device, so that the first device executes a corresponding operation instruction on the virtual shooting preview interface according to the first input.

[0140] Optionally, when a shooting preview interface is displayed on the second device, the apparatus 700 further includes:

[0141] The second receiving module is used to receive the second image sent by the first device and display the second image in the shooting preview interface; the second image is the image displayed in the virtual shooting preview interface.

[0142] Optionally, when a shooting preview interface is displayed on the second device, the apparatus 700 further includes:

[0143] The third receiving module is used to receive the third image sent by the first device and display the third image in the shooting preview interface; wherein the third image is a preset image.

[0144] Optionally, the above device 700 further includes:

[0145] The second response module is used to execute the photo-taking operation in response to the first input and delete the image data collected by the camera when the first input is used to trigger the execution of the photo-taking operation instruction.

[0146] Optionally, the above device 700 further includes:

[0147] A fourth receiving module is used to receive a first image sent by the first device when the first input is used to trigger the execution of a photographing operation instruction, where the first image is generated after the first device executes a photographing operation on the virtual shooting preview interface;

[0148] The storage module is used to store the first image.

[0149] The photographing device in the embodiment of the present application may be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal or other devices other than a terminal. Exemplarily, the electronic device may be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It may also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0150] The photographing device 700 in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0151] The photographing device 700 provided in the embodiment of the present application can realize Figures 2 to 5 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0152] Alternatively, if Figure 8 As shown, an embodiment of the present application also provides a first device 800, including a processor 801 and a memory 802, and the memory 802 stores a program or instruction that can be executed on the processor 801. When the program or instruction is executed by the processor 801, the various steps of the above-mentioned photographing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0153] It should be noted that the first device in the embodiment of the present application includes the above-mentioned mobile electronic device and non-mobile electronic device.

[0154] Fig. 9 A schematic diagram of the hardware structure of a first device for implementing an embodiment of the present application.

[0155] The first device 900 includes but is not limited to: a radio frequency unit 901, a network module 922, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, and a processor 910 and other components.

[0156] Those skilled in the art will appreciate that the first device 900 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 910 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig. 9 The first device structure shown in the figure does not constitute a limitation on the first device. The first device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0157] The first device can display a virtual display interface, and the first device is in communication connection with the second device, wherein:

[0158] A display unit 906, configured to display a virtual screen of the second device in a virtual display interface, where the virtual screen includes a virtual shooting preview interface;

[0159] The radio frequency unit 901 is used to obtain a first input of a user on a second device;

[0160] The processor 910 is configured to execute a corresponding operation instruction on the virtual shooting preview interface according to the first input.

[0161] Optionally, the processor 910 is further specifically configured to obtain a relative position of an operation position of the first input on the second device;

[0162] Determining a corresponding operation instruction on the virtual shooting preview interface according to a relative position of the operation position of the first input on the second device;

[0163] Execute corresponding operation instructions on the virtual shooting preview interface.

[0164] Optionally, the processor 910 is further specifically configured to display a virtual image of the second device in the virtual display interface by using a synchronous positioning and map construction SLAM algorithm.

[0165] Optionally, the processor 910 is further specifically configured to perform a photo taking operation on the virtual photo taking preview interface according to the first input to generate a first image;

[0166] The radio frequency unit 901 is further configured to send the first image to the second device.

[0167] Optionally, the RF unit 901 is further used to send a second image to the second device so that the second image is displayed in the shooting preview interface of the second device; wherein the second image is an image displayed in the virtual shooting preview interface.

[0168] Optionally, the RF unit 901 is further used to send a third image to the second device so that the third image is displayed in the shooting preview interface of the second device; wherein the third image is a preset image.

[0169] Optionally, the processor 910 is further configured to determine whether the virtual shooting preview interface includes a first user, where the first user is a user wearing the first device;

[0170] The display unit 906 is further specifically configured to display a virtual character image of the first user in the virtual shooting preview interface when the first user is included in the virtual shooting preview interface.

[0171] It should be understood that in the embodiment of the present application, the input unit 904 may include a graphics processor (Graphics Processing Unit, GPU) 941 and a microphone 942, and the graphics processor 941 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 906 may include a display panel 9061, and the display panel 9061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 907 includes a touch panel 9071 and at least one of other input devices 9072. The touch panel 9071 is also called a touch screen. The touch panel 9071 may include two parts: a touch detection device and a touch controller. Other input devices 9072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0172] The memory 909 can be used to store software programs and various data. The memory 909 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 909 may include a volatile memory or a non-volatile memory, or the memory 909 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 909 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0173] The processor 910 may include one or more processing units; optionally, the processor 910 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 910.

[0174] Alternatively, if Fig.10 As shown, the embodiment of the present application also provides a second device 1000, including a processor 1001 and a memory 1002, and the memory 1102 stores a program or instruction that can be executed on the processor 1001. When the program or instruction is executed by the processor 1001, the various steps of the above-mentioned photographing method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0175] Fig.11 A schematic diagram of the hardware structure of a second device for implementing an embodiment of the present application.

[0176] The second device 1100 includes: a radio frequency unit 1101, a network module 1102, an audio output unit 1103, an input unit 1104, a sensor 1105, a display unit 1106, a user input unit 1107, an interface unit 1208, a memory 1109, a processor 1110 and other components.

[0177] Those skilled in the art will appreciate that the second device 1100 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.11 The second device structure shown in the figure does not constitute a limitation on the second device. The second device may include more or fewer components than shown in the figure, or a combination of certain components, or a different arrangement of components, which will not be described in detail here.

[0178] Optionally, the second device 1100 is communicatively connected with the first device, and the first device can display a virtual display interface; a virtual screen of the second device is displayed in the virtual display interface of the first device, and the virtual screen includes a virtual shooting preview interface;

[0179] The radio frequency unit 1101 is used to receive a first input from a user on the second device; and in response to the first input, send the first input to the first device.

[0180] Optionally, when a shooting preview interface is displayed on the second device, the RF unit 1101 is also used to receive a second image sent by the first device and display the second image in the shooting preview interface; the second image is an image displayed in the virtual shooting preview interface.

[0181] Optionally, when a shooting preview interface is displayed on the second device, the RF unit 1101 is further used to receive a third image sent by the first device and display the third image in the shooting preview interface; wherein the third image is a preset image.

[0182] Optionally, the processor 1110 is configured to, when the first input is used to trigger the execution of a photographing operation instruction, perform a photographing operation in response to the first input, and delete image data collected by the camera.

[0183] Optionally, the processor 1110 is used to receive a first image sent by the first device when the first input is used to trigger the execution of a photo operation instruction, where the first image is generated after the first device performs a photo operation on the virtual shooting preview interface; and save the first image.

[0184] It should be understood that in the embodiment of the present application, the input unit 1104 may include a graphics processor (Graphics Processing Unit, GPU) 1141 and a microphone 1142, and the graphics processor 1141 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1106 may include a display panel 11061, and the display panel 11061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1107 includes a touch panel 11071 and at least one of other input devices 11072. The touch panel 11071 is also called a touch screen. The touch panel 11071 may include two parts: a touch detection device and a touch controller. Other input devices 11072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0185] The memory 1109 can be used to store software programs and various data. The memory 1109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1109 may include a volatile memory or a non-volatile memory, or the memory 1109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0186] The processor 1110 may include one or more processing units; optionally, the processor 1110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1110.

[0187] The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned photographing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0188] The processor is the processor in the first device and the second device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0189] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned photographing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0190] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0191] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned photographing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0192] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0193] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0194] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A photographing method, characterized in that: Applied to a first device, the first device can display a virtual display interface, the first device is communicatively connected with a second device, and the method includes: Displaying a virtual screen of the second device in the virtual display interface, wherein the virtual screen includes a virtual shooting preview interface; Sending a second image to the second device so that the second image is displayed in the shooting preview interface of the second device; wherein the second image is an image displayed in the virtual shooting preview interface; Obtaining a first input from a user on the second device; According to the first input, a corresponding operation instruction is executed on the virtual shooting preview interface.

2. The photographing method according to claim 1, characterized in that: The executing a corresponding operation instruction on the virtual shooting preview interface according to the first input includes: Acquire a relative position of an operation position of the first input on the second device; Determining a corresponding operation instruction on the virtual shooting preview interface according to a relative position of an operation position of the first input on the second device; Execute corresponding operation instructions on the virtual shooting preview interface.

3. The photographing method according to claim 1, characterized in that: Before displaying the virtual screen of the second device in the virtual display interface, the method further includes: The virtual image of the second device is displayed in the virtual display interface by using a synchronous positioning and map construction SLAM algorithm.

4. The photographing method according to claim 1, characterized in that: In the case where the first input is used to trigger the execution of a photographing operation instruction, executing a corresponding operation instruction on the virtual photographing preview interface according to the first input includes: According to the first input, performing a photo taking operation on the virtual shooting preview interface to generate a first image; The method further comprises: The first image is sent to the second device.

5. The photographing method according to claim 1, characterized in that: After the virtual screen of the second device is displayed in the virtual display interface, the method further includes: Sending a third image to the second device so that the third image is displayed in the shooting preview interface of the second device; wherein the third image is a preset image.

6. The photographing method according to claim 1, characterized in that: Displaying a virtual shooting preview interface of the second device in the virtual display interface includes: Determining whether the virtual shooting preview interface includes a first user, where the first user is a user wearing the first device; In a case where the first user is included in the virtual shooting preview interface, a virtual character image of the first user is displayed in the virtual shooting preview interface.

7. A photographing method, characterized in that: Applied to a second device, the second device is communicatively connected to a first device, the first device can display a virtual display interface, a virtual screen of the second device is displayed in the virtual display interface of the first device, the virtual screen includes a virtual shooting preview interface, and the method includes: receiving a first input from a user on the second device; In response to the first input, sending the first input to the first device, so that the first device executes a corresponding operation instruction on the virtual shooting preview interface according to the first input; Wherein, when a shooting preview interface is displayed on the second device, the method further includes: A second image sent by the first device is received, and the second image is displayed in the shooting preview interface; the second image is the image displayed in the virtual shooting preview interface.

8. The photographing method according to claim 7, characterized in that: When a shooting preview interface is displayed on the second device, the method further includes: Receive a third image sent by the first device, and display the third image in the shooting preview interface; wherein the third image is a preset image.

9. The photographing method according to claim 7, characterized in that: The method further comprises: In the case where the first input is used to trigger the execution of a photographing operation instruction, the photographing operation is performed in response to the first input, and image data collected by the camera is deleted.

10. The photographing method according to claim 7, characterized in that: The method further comprises: In a case where the first input is used to trigger a photographing operation instruction, receiving a first image sent by the first device, where the first image is generated after the first device performs a photographing operation on the virtual shooting preview interface; The first image is saved.

11. A photographing device, characterized in that: Applied to a first device, the first device can display a virtual display interface, the first device is communicatively connected with a second device, and the apparatus includes: A first display module, configured to display a virtual screen of the second device in the virtual display interface, wherein the virtual screen includes a virtual shooting preview interface; A second sending module, used for sending a second image to a second device, so that the second image is displayed in a shooting preview interface of the second device; wherein the second image is an image displayed in the virtual shooting preview interface; An acquisition module, used to acquire a first input of a user on the second device; A processing module is used to execute corresponding operation instructions on the virtual shooting preview interface according to the first input.

12. A photographing device, characterized in that: Applied to a second device, the second device is communicatively connected to a first device, the first device can display a virtual display interface, a virtual screen of the second device is displayed in the virtual display interface of the first device, the virtual screen includes a virtual shooting preview interface, and the apparatus includes: A first receiving module, configured to receive a first input from a user on the second device; A first response module, configured to send the first input to the first device in response to the first input, so that the first device executes a corresponding operation instruction on the virtual shooting preview interface according to the first input; The second receiving module is used to receive the second image sent by the first device and display the second image in the shooting preview interface; the second image is the image displayed in the virtual shooting preview interface.

13. An electronic device, characterized in that: It includes a processor and a memory, the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the photographing method as described in any one of claims 1 to 6, or the steps of the photographing method as described in any one of claims 7 to 10 are implemented.

Images