Virtual shooting control method, medium and mobile terminal

Abstract

A virtual shooting control method, a medium and a mobile terminal, wherein the method is applied to a virtual shooting control service running in a mobile terminal, wherein the mobile terminal and at least one processing device running the virtual shooting service are connected to the same wireless local area network; the method comprises: detecting an operation performed by a user on the mobile terminal; generating a control instruction based on the operation; sending the control instruction to a target virtual shooting service, so that the target virtual shooting service adjusts a shooting picture of a virtual shooting scene based on the control instruction; and the target virtual shooting service is selected from the published virtual shooting services by the mobile terminal after the at least one processing device publishes the virtual shooting service running on the device through the wireless local area network.

Description

Technical Field

[0001] The present disclosure relates to the technical field of virtual shooting, and in particular to a virtual shooting control method, medium and mobile terminal. Background Art

[0002] In a virtual shooting scene, it is necessary to adjust the shooting picture of the virtual shooting scene through the virtual shooting service to obtain the desired virtual shooting effect. In the related art, an electronic device is generally fixedly installed on the back of a display screen, and a virtual shooting service is deployed in the electronic device. When a user adjusts the shooting picture of the virtual shooting scene through the virtual shooting service, the user can only operate the electronic device with the virtual shooting service deployed on the back of the display screen, and the operation flexibility is low. Summary of the invention

[0003] In a first aspect, an embodiment of the present disclosure provides a virtual shooting control method, which is applied to a virtual shooting control service running in a mobile terminal, wherein the mobile terminal and at least one processing device running the virtual shooting service are connected to the same wireless local area network; the method comprises: detecting an operation performed by a user on the mobile terminal; generating a control instruction based on the operation; sending the control instruction to a target virtual shooting service, so that the target virtual shooting service adjusts a shooting picture of a virtual shooting scene based on the control instruction; the target virtual shooting service is selected by the mobile terminal from the published virtual shooting services after the at least one processing device publishes the virtual shooting service running on the device through the wireless local area network.

[0004] In a second aspect, an embodiment of the present disclosure provides a virtual shooting control device, which is applied to a virtual shooting control service running in a mobile terminal, and the mobile terminal and at least one processing device running the virtual shooting service are connected to the same wireless local area network; the device includes: a detection module, which is used to detect an operation performed by a user on the mobile terminal; a generation module, which is used to generate a control instruction based on the operation; a sending module, which is used to send the control instruction to a target virtual shooting service, so that the target virtual shooting service adjusts the shooting picture of the virtual shooting scene based on the control instruction; the target virtual shooting service is selected by the mobile terminal from the published virtual shooting services after the at least one processing device publishes the virtual shooting service running on the device through the wireless local area network.

[0005] In a third aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method described in any embodiment of the present disclosure.

[0006] In a fourth aspect, an embodiment of the present disclosure provides a mobile terminal, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in any embodiment of the present disclosure when executing the program.

[0007] In the disclosed embodiment, a virtual shooting control service is deployed in a mobile terminal, and the mobile terminal and at least one processing device running the virtual shooting service are connected to the same wireless local area network. The user can perform operations on the mobile terminal, so that the virtual shooting control service running in the mobile terminal generates a control instruction, and sends it to the target virtual shooting service to adjust the shooting picture of the virtual shooting scene. Since the mobile terminal is easy to carry and move, the user does not need to operate at a fixed position, which improves the operational flexibility in the process of adjusting the shooting picture.

[0008] It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The drawings herein are incorporated into the specification and constitute a part of the present disclosure. These drawings illustrate embodiments consistent with the present disclosure and are used to illustrate the technical solutions of the present disclosure together with the specification.

[0010] Figure 1 It is a schematic diagram of an application scenario of an embodiment of the present disclosure.

[0011] Figure 2 It is a schematic diagram of the shooting picture adjustment process in the related art.

[0012] Figure 3 It is a schematic diagram of the shooting picture adjustment process of an embodiment of the present disclosure.

[0013] Figure 4 4 is a flowchart of a virtual shooting control method according to an embodiment of the present disclosure.

[0014] Figure 5 Schematic diagram of operational state and inoperable state control components according to an embodiment of the present disclosure.

[0015] Figure 6 4 is a schematic diagram of an interface for selecting a historical virtual photography service according to an embodiment of the present disclosure.

[0016] Figure 7 It is a schematic diagram of the process of sending control instructions to the master service and the slave service according to an embodiment of the present disclosure.

[0017] Figure 8 It is a schematic diagram of the process of setting the master service and the slave service according to an embodiment of the present disclosure.

[0018] Fig. 9It is a schematic diagram of an editing interface of a control instruction corresponding to a combination control of an embodiment of the present disclosure.

[0019] Fig.10 It is a schematic diagram of the control instructions of the embodiment of the present disclosure.

[0020] Fig.11 is a block diagram of a virtual shooting control device according to an embodiment of the present disclosure.

[0021] Fig.12 It is a schematic diagram of the hardware structure of the mobile terminal of the embodiment of the present disclosure. DETAILED DESCRIPTION

[0022] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0023] The terms used in this disclosure are only for the purpose of describing specific embodiments and are not intended to limit the disclosure. The singular forms of "a", "said" and "the" used in this disclosure and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items. In addition, the term "at least one" herein means any combination of at least two of any one or more of a plurality of.

[0024] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0025] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present disclosure and to make the above-mentioned purposes, features and advantages of the embodiments of the present disclosure more obvious and understandable, the technical solutions in the embodiments of the present disclosure are further described in detail below in conjunction with the accompanying drawings.

[0026] Virtual shooting uses computer graphics and digital synthesis technology to create virtual scenes, virtual characters, virtual props and other digital assets in the computer, and then synthesize them with the actual shooting objects (such as real scenes, actors, etc.) to achieve realistic visual effects. Figure 1 A schematic diagram of an application scenario according to an embodiment of the present disclosure is shown, such as Figure 1 As shown, the virtual shooting system includes a processing device 01 , a display screen 02 and a camera 03 .

[0027] A virtual shooting service can be deployed in the processing device 01 to adjust the shooting picture of the virtual shooting scene (i.e., the display picture of the display screen 02). For example, the type of digital assets displayed on the display screen 02 can be switched, the rendering effect of the digital assets on the display screen 02 can be adjusted, and various parameters that affect the shooting picture during the virtual shooting process can be calibrated.

[0028] Display screen 02 can be used to display digital assets. Figure 1 As shown, the number of display screens 02 is 3. For the convenience of distinction, each display screen is recorded as display screen 021, display screen 022 and display screen 023. The display screens (021, 022, 023) can display digital assets independently or in conjunction. Among them, the display screen 02 used in the virtual shooting system can be a physical screen, which can be a type of LED display screen, liquid crystal display screen, etc., and can be a curved screen or a flat screen. It should be understood that those skilled in the art can customize the type, quantity, size, resolution, installation location, etc. of the physical screen in the virtual shooting system according to actual needs, and the embodiments of the present disclosure are not limited to this.

[0029] The camera 03 can collect images of the virtual shooting scene including the display screen 02 to obtain a shooting picture of the virtual shooting scene. The virtual shooting scene can also include the actual shooting object, so the shooting picture obtained by the camera 03 can include both the digital assets displayed on the display screen 02 and the actual shooting object.

[0030] The size of the display screen 02 is usually large. In the virtual shooting scene, there is not enough space to place the processing device 01 in front of the display screen 02. If the processing device 01 is placed on the side of the display screen 02, the shooting picture obtained by the camera 03 may include the processing device 01, affecting the viewing effect of the shooting picture. Therefore, the processing device 01 is usually fixedly installed on the back of the display screen 02. When the user adjusts the virtual shooting scene, he can only operate the electronic device deployed with the virtual shooting service on the back of the display screen 02, resulting in low operational flexibility.

[0031] In addition, see Figure 2, when the user is on the back of the display screen 02, he cannot visually observe the display effect of the display screen 02. Therefore, it is usually necessary for the front-stage user (the user in front of the display screen 02) and the behind-the-scenes user (the user behind the display screen 02) to cooperate with each other to adjust the shooting picture. Specifically, the front-stage user can observe the display effect of the digital assets on the display screen 02 and communicate with the behind-the-scenes user through an intercom. In some cases, the front-stage personnel also need to receive adjustment instructions issued by roles such as the director and the director of photography to adjust the shooting picture, and inform the behind-the-scenes user of the received adjustment instructions through the intercom. The behind-the-scenes user controls the processing device 01 according to the communication results, thereby adjusting the shooting picture. The above method has high labor costs and low control efficiency.

[0032] Based on this, the present disclosure provides a virtual shooting control method, see Figure 3 , the method is applied to a virtual shooting control service running in a mobile terminal 04, and the mobile terminal 04 is connected to the same wireless local area network as at least one processing device 01 running the virtual shooting service. In this embodiment, the mobile terminal 04 may be a portable electronic device, such as a mobile phone, a tablet computer, a laptop computer, etc. Portable electronic devices are convenient to carry and move, so users do not need to operate at a fixed position, but can send a control instruction to the virtual shooting service deployed on the processing device 01 through the virtual shooting control service deployed on the mobile terminal 04 at any position of the virtual shooting scene, so that the virtual shooting service responds to the control instruction to adjust the shooting picture of the virtual shooting scene. The above method improves the operational flexibility in the process of adjusting the shooting picture, and because the user can carry the mobile terminal 04 to the front of the display screen 02, it is convenient to observe the display effect of the display screen 02, and can directly adjust the virtual shooting scene based on the observed display effect, without the need for the front-stage user to communicate with the back-stage user to adjust the virtual shooting scene. Therefore, the above method effectively improves the efficiency of adjusting the shooting picture and reduces the labor cost.

[0033] Combine the following Figure 1 , Figure 3 and Figure 4 , an embodiment of the virtual shooting control method is specifically described. The virtual shooting control method of the embodiment of the present disclosure includes:

[0034] Step S1: Detecting the operation performed by the user on the mobile terminal 04;

[0035] Step S2: Generate control instructions based on the operation;

[0036] Step S3: Send the control instruction to the target virtual shooting service so that the target virtual shooting service adjusts the shooting picture of the virtual shooting scene based on the control instruction; after at least one processing device publishes the virtual shooting service running on the device through the wireless local area network, the target virtual shooting service is selected from the published virtual shooting services through the mobile terminal.

[0037] In step S1, the user can perform an operation on the mobile terminal 04, and the above operation can be detected by the detection component on the mobile terminal 04. For example, in the case where the mobile terminal 04 includes a display interface, the operation can be a touch screen operation performed on the display interface. Specifically, the display interface can include at least one control component, and each control component is used to send different control instructions. The user's execution operation on the mobile terminal 04 can be a selection operation of a target control component in at least one control component. Accordingly, the detection component can include a capacitor.

[0038] In other examples, the mobile terminal 04 may further include one or more physical control components, and the user's operation on the mobile terminal 04 may be an operation performed on the physical control component in one or more ways such as clicking, sliding, rotating, etc. The operation on the physical control component may be detected by a corresponding detection component, and examples are not given here one by one.

[0039] In some embodiments, the operation performed by the user on the mobile terminal 04 is an operation within the control authority of the current login account of the virtual shooting control service. The control authority is used to define the type of control instructions that the virtual shooting control service can send. In other words, only when the current login account has a certain control authority can the user send the corresponding control instruction through the virtual shooting control service on the mobile terminal 04. If the current login account does not have a certain control authority, the user is prohibited from sending the corresponding control instruction through the virtual shooting control service on the mobile terminal 04. In this way, the operational security in the process of adjusting the shooting picture is improved.

[0040] The user can log in to the pre-registered account on the mobile terminal 04. After successful login, the virtual shooting control service can obtain the control authority of the current login account. Different accounts can have the same or different control authorities, and the control authorities of some accounts can partially overlap. For example, account 1 has control authority A1, account 2 has control authorities A1 and A2, and account 3 and account 4 both have control authority A3.

[0041] The control authority of an account can be assigned when registering the account. For example, the type of role to which the account belongs can be obtained, and different control authorities can be assigned to accounts of different roles. The roles may include but are not limited to directors, lighting technicians, makeup artists, and / or directors of photography. In this way, the orderliness of sending instructions during the adjustment of the shooting picture is improved, different control authorities are assigned to different roles, and conflicts when different roles send the same control instructions are reduced.

[0042] In some embodiments, an account may include a main account and at least one sub-account subordinate to the main account, and the control authority allocated to the sub-account may be a subset of the control authority allocated to the main account. Optionally, the main account may manage the control authority of each sub-account, including adding authority, reducing authority, changing the authority type, and / or setting the effective time of the authority.

[0043] In an embodiment where the display interface of the mobile terminal 04 includes at least one control component and different control components correspond to different control instructions, a first control component in an operable state among the at least one control component can be determined based on the control authority of the current login account, and the first control component can be displayed on the display interface of the mobile terminal 04. The first control component can be selected by the user to generate a corresponding control instruction. Figure 5 As shown, the display interface includes four control components, namely component 1, component 2, component 3 and component 4, wherein component 1 and component 3 are the first control components in an operable state, and the user can select at least one of the two control components to generate a control instruction corresponding to the selected control component. As shown in the figure, the user selects component 1, so the control instruction corresponding to component 1 can be generated.

[0044] Furthermore, a second control component in an inoperable state in at least one control component may be determined based on the control authority of the current login account, and the second control component may be displayed on the display interface. Figure 5 Component 2 and component 4 are second control components in an inoperable state. The user cannot operate component 2 and component 4 when logging in to the current login account, and thus cannot generate control instructions corresponding to component 2 and control instructions corresponding to component 4.

[0045] As shown in the figure, the first control component and the second control component can be displayed on the display interface through different visual features, so that the user can intuitively distinguish the first control component from the second control component. For example, the first control component and the second control component are displayed as control components of different colors. For another example, a graphic indicating "prohibited operation" can be added to the second control component, indicating that the control component cannot be operated.

[0046] In step S2, the virtual shooting control service can generate a control instruction based on the operation. Assuming that the above operation is a selection operation of a target control component in at least one control component, a control instruction corresponding to the target control component can be generated in this step. For example, if the target control component is a control component for implementing space calibration, the control instruction is a space calibration instruction, which is used to calibrate the position of the virtual camera relative to the virtual scene and the position of the camera 03 relative to the actual shooting scene. For another example, if the target control component is a control component for implementing color calibration, the control instruction is a color calibration instruction, which is used to calibrate the color of the display screen on the display screen 02 and the color of the shooting screen of the camera 03.

[0047] In step S3, the virtual shooting control service may send a control instruction to the target virtual shooting service. The target virtual shooting service may be a virtual shooting service that is pre-published through a wireless local area network. Specifically, the processing device 01 may publish a service to a virtual shooting service running on the device through a wireless local area network. After the mobile terminal 04 is connected to the wireless local area network, it may obtain various virtual shooting services that have been published to the wireless local area network, and display a list of various virtual shooting services on a display interface. The user may select one or more virtual shooting services from the list as target virtual shooting services.

[0048] After selecting the target virtual shooting service, the virtual shooting control service can establish a connection with the target virtual shooting service based on the wireless local area network (for example, a TCP long connection), and the virtual shooting control service can send the control instruction to the target virtual shooting service through the connection. After receiving the control instruction, the target virtual shooting service can adjust the shooting picture of the virtual shooting scene based on the control instruction.

[0049] In some embodiments, the mobile terminal 04 and the processing device 01 may not be connected to the same wireless local area network, but the wireless local area network connected to the processing device 01 is a wireless local area network that the mobile terminal 04 has connected to in the past, so the information of the wireless local area network has been saved in the mobile terminal 04. In the traditional way, the user needs to first switch the wireless local area network connected to the mobile terminal 04 to the wireless local area network connected to the processing device 01, and then obtain the target virtual shooting service published through the wireless local area network. The above method is relatively cumbersome to operate. In order to simplify the user operation, a list of historical virtual shooting services can be displayed on the display interface of the mobile terminal 04. Among them, the historical virtual shooting service is a virtual shooting service selected from the historically published virtual shooting services by the mobile terminal 04. In response to receiving a selection instruction for the historical virtual shooting service in the list, the first wireless local area network to which the mobile terminal 04 is connected when the historical virtual shooting service is selected is determined, and the connection information of the first wireless local area network is stored in the mobile terminal 04. If the mobile terminal 04 is not currently connected to the first wireless local area network, the mobile terminal 04 is controlled to connect to the first wireless local area network based on the connection information of the first wireless local area network, and after the connection is successful, the historical virtual shooting service is determined as the target virtual shooting service.

[0050] For example, see Figure 6 , the mobile terminal 04 is connected to the wireless local area network X at time T1, and after connecting to the wireless local area network X, the virtual photography service U is selected as the target virtual photography service. However, at time T2 after time T1, the mobile terminal 04 is not connected to the wireless local area network X, but is connected to the wireless local area network Y. Among the virtual photography services released by the wireless local area network Y, there are only the virtual photography service V and the virtual photography service K, but the user still expects to select the virtual photography service U as the target virtual photography service. In order to quickly select the virtual photography service U as the target virtual photography service, a list of historical virtual photography services may be displayed on the display interface of the mobile terminal 04. In this embodiment, the list of historical virtual photography services includes the virtual photography service U. The virtual photography service U and the information of the wireless local area network X to which the mobile terminal 04 is connected when the virtual photography service U is selected as the target virtual photography service may be associated and stored in advance in the mobile terminal 04. After the user selects the virtual photography service U in the list of historical virtual photography services, the mobile terminal 04 can be controlled to access the wireless local area network X based on the information of the wireless local area network X stored in association with the virtual photography service U, and after the connection is successful, the virtual photography service U is determined as the target virtual photography service.

[0051] Furthermore, if the mobile terminal 04 does not enable the function of connecting to the wireless LAN when the user selects the virtual shooting service U in the list of historical virtual shooting services, the mobile terminal 04 can be controlled to enable the function of connecting to the wireless LAN through the virtual shooting control service, and then the mobile terminal 04 can be controlled to access the wireless LAN X based on the information of the wireless LAN X stored in association with the virtual shooting service U, and after the connection is successful, the virtual shooting service U is determined as the target virtual shooting service. In this way, the user does not need to manually enable the function of connecting to the wireless LAN for the mobile terminal 04, which further simplifies the user operation.

[0052] Furthermore, if the mobile terminal 04 cannot be successfully controlled to access the wireless LAN X due to changes in the wireless LAN information, network failure, etc., a prompt message can also be displayed on the display interface of the mobile terminal 04. After obtaining the prompt message, the user can manually access the mobile terminal 04 to the wireless LAN X.

[0053] In some embodiments, see Figure 7 ,The virtual shooting scene includes multiple display screens 02, for example, Figure 1 The display screen 021, display screen 022 and display screen 023 are shown. It can be understood that this is only an exemplary description, and the number and relative positions of display screens in actual applications are not limited to this. Among them, multiple display screens (021, 022, 023) can be located at different positions of the virtual shooting scene, for example, display screen 021 is located above the virtual shooting scene, display screen 022 is located on the left side of the virtual shooting scene, display screen 023 is located on the right side of the virtual shooting scene, and so on. Multiple display screens (021, 022, 023) can correspond to multiple virtual shooting services one by one. For example, display screen 021 corresponds to virtual shooting service 1, display screen 022 corresponds to virtual shooting service 2, display screen 023 corresponds to virtual shooting service 3, and so on. Multiple virtual shooting services may include master services and slave services. Generally, the number of master services is 1, and the number of slave services may be greater than or equal to 1. As shown in the figure, service 1 can be the master service, and service 2 and service 3 can be slave services. In order to simplify communication, the virtual shooting control service may send control instructions only to the main service (i.e., service 1), and service 1 may forward the control instructions sent by the virtual shooting control service to the slave services (i.e., service 2 and service 3). Therefore, if the target virtual shooting service includes the main service, the virtual shooting control service directly sends the control instructions to the main service. If the target virtual shooting service includes the slave service, the virtual shooting control service may send the control instructions to the main service, so that the main service forwards the control instructions to the slave service.

[0054] A list of multiple virtual photography services can be displayed on the display interface of the mobile terminal 04, and a main service and a secondary service selected by a user from the list of multiple virtual photography services can be obtained. Figure 8 , assuming that the list of virtual shooting services displayed on the display interface includes service 1, service 2, and service 3, the user selects service 1 in the list, so that service 1 can be set as the main service, and service 2 and service 3 that the user has not selected can be automatically set as the slave service. Furthermore, the main service and the slave service can be identified on the display interface through identification information (as shown in the figure "main" and "slave"), so that the user can distinguish the main service and the slave service more intuitively.

[0055] In some embodiments, in addition to the mobile terminal 04, other electronic devices are connected to the same wireless local area network as the processing device 01. Therefore, the virtual shooting service can not only receive the control instructions sent by the virtual shooting control service deployed on the mobile terminal 04, but also receive the control instructions sent by the virtual shooting control service deployed in other electronic devices, and the current login account of the virtual shooting control service in the other electronic devices and the current login account of the virtual shooting control service in the mobile terminal 04 have the control authority to send the same control instruction. In this case, after the virtual shooting control service in the mobile terminal 04 sends the control instruction to the target virtual shooting service, the prompt information that the control instruction has been sent can be sent to the virtual shooting control service in the other electronic device. After the virtual shooting control service in the other electronic device sends the control instruction to the target virtual shooting service, the prompt information that the control instruction has been sent by the virtual shooting control service in the other electronic device can be received. In this way, the repeated sending of the same control instruction can be reduced.

[0056] In some embodiments, the target virtual shooting service can also send the shooting picture of the virtual shooting scene collected by the camera 03 to the mobile terminal 04, and the mobile terminal 04 can display the shooting picture on its display interface. In step S1, the user can select a target control component from at least one control component based on the shooting picture displayed on the display interface. The selection operation of the target control component is detected, and in step S2, a control instruction can be generated based on the operation, and in step S3, the control instruction is sent to the target virtual shooting service. By displaying the shooting picture on the display interface of the mobile terminal 04, the user can easily observe the adjustment effect of the virtual shooting scene at a position where it is not convenient to observe the display effect of the display screen 02, such as the side, back or top of the display screen 02.

[0057] In other embodiments, only the control component may be displayed on the display interface of the mobile terminal 04 without displaying the shooting screen. The user may carry the mobile terminal 04 in front of the display screen 02 and observe the adjustment effect of the virtual shooting scene by observing the display screen 02.

[0058] In some embodiments, at least one control component includes a combination control, and the combination control corresponds to multiple control instructions. For example, one combination control may correspond to two control instructions, control instruction 1 and control instruction 2. If the operation in step S1 is a selection operation on the combination control, the multiple control instructions corresponding to the combination control may be sent to the target virtual shooting service. In this way, the user only needs to operate one combination control to send multiple control instructions, and there is no need to operate multiple control components to send multiple control instructions, which reduces the complexity of the operation and improves the operation efficiency. Following the previous embodiment, in the case where the combination control corresponds to two control instructions, control instruction 1 and control instruction 2, if the operation in step S1 is a selection operation on the combination control, control instruction 1 and control instruction 2 may be sent to the target virtual shooting service separately, or control instruction 1 and control instruction 2 may be packaged into one control instruction and sent to the target virtual shooting service.

[0059] The multiple control instructions corresponding to the combined control may be the default multiple control instructions, for example, the multiple control instructions may include the multiple control instructions with the highest historical sending frequency. Alternatively, the multiple control instructions corresponding to the combined control may be edited by the user. In the latter case, the user's editing operation on the multiple control instructions corresponding to the combined control may be detected, and if detected, the multiple control instructions corresponding to the combined control are edited in response to the editing operation, and after the editing is completed, the multiple control instructions corresponding to the combined control are stored.

[0060] See also Fig. 9 , an editing interface of the control instructions corresponding to the combined control can be displayed on the display interface of the mobile terminal 04. The user can add new control instructions through the Add control on the editing interface (as shown by the box including the character "Add" in the figure), and can also delete the added control instructions through the Delete control on the editing interface (as shown by the box including the character "Delete" in the figure). After the editing is completed, the user can complete the editing by operating the Confirm control on the editing interface (as shown by the box including the character "Confirm" in the figure), so as to determine the control instructions added on the editing interface as multiple control instructions corresponding to the combined control.

[0061] See also Fig.10Through the above-mentioned virtual shooting control method, it is possible to send a variety of control instructions, thereby realizing the adjustment of multiple dimensions of the shooting picture, including but not limited to: shooting picture monitoring, virtual fusion, frame rate optimization, upper screen control, screen zoom, virtual combination, space calibration, color calibration, delay calibration, asset management, screen model management, switching levels, post-processing, animation playback, adjusting lights and other dimensions, in part or all. In the related art, the adjustment functions of the above dimensions are often scattered in multiple services (such as virtual shooting service 1 and virtual shooting service 2 in the figure), which is not convenient for user operation. The disclosed embodiment integrates the control functions of the adjustment functions of each dimension into the virtual shooting control service deployed on the mobile terminal 04, so that the user can control various adjustment functions through one service, which improves the user's operation convenience. The adjustment functions of the two dimensions of virtual fusion and frame rate optimization are described in detail below.

[0062] In some embodiments, if the display interface of the mobile terminal 04 is also used to display the shooting picture of the virtual shooting scene sent by the target virtual shooting service, the operation in step S1 may include a selection operation of the pixel area in the shooting picture. Specifically, the first pixel area and the second pixel area selected by the user from the shooting picture can be obtained, the first pixel area is the pixel area where the virtual scene in the virtual shooting scene is located (for example, the pixel area corresponding to the display screen of the display screen 02), and the second pixel area is the pixel area where the real scene in the virtual shooting scene is located (for example, the pixel area outside the display screen of the display screen 02, and the pixel area in the display screen of the display screen 02 that is blocked by the actual shooting object). On this basis, the control instruction generated in step S2 can be a fusion instruction generated based on the first pixel area and the second pixel area, and the fusion instruction is used to fuse the first pixel area and the second pixel area. The above process is called virtual fusion, and the fusion here can be, for example, color or other aspects of fusion.

[0063] In the related art, the transition between the virtual scene and the real scene in the virtual shooting scene is not natural enough. In this embodiment, by fusing the first pixel area and the second pixel area, the virtual scene and the real scene can be naturally transitioned, thereby improving the realism of the shooting picture.

[0064] In some embodiments, the operation in step S1 includes a selection operation of rendering optimization items for the display screen on the display screen 02, and the selection operation is used to select at least one target rendering optimization item from the candidate rendering optimization items. Among them, the target rendering optimization item includes a rendering optimization item for the shadow area in the shooting screen and / or a rendering optimization item for the background area in the shooting screen. By using the rendering optimization items for the shadow area and / or the background area as the target rendering optimization item, the rendering effect of the shadow area and / or the background area can be simplified, thereby reducing the resources consumed when rendering the shadow area and / or the background area. In step S2, the target rendering optimization item selected by the selection operation can be obtained, and an optimization instruction for the virtual scene is generated based on the target rendering optimization item, so that the virtual shooting service renders the display screen to the display screen 02 based on the target rendering optimization item in the optimization instruction.

[0065] In the related art, the rendering of the captured image is relatively time-consuming. This embodiment can reduce the time consumption in the rendering process by selecting the target rendering optimization item. In addition, since the shadow area and the background area are usually not the areas that users pay attention to, the rendering effect of these areas is optimized, which has little impact on the display effect of the captured image.

[0066] In some embodiments, if the control instruction fails to be sent, a prompt message can be output on the display interface of the mobile terminal 04, so that the user can intuitively know that the control instruction fails to be sent. Furthermore, in the case of a control instruction failure to be sent, the control instruction can be automatically resent, and if the number of resends reaches the upper limit of the number of resends, a prompt message is output on the display interface.

[0067] See also Fig.11 The present disclosure also provides a virtual shooting control device, which is applied to a virtual shooting control service running in a mobile terminal, wherein the mobile terminal and at least one processing device running the virtual shooting service are connected to the same wireless local area network; the device comprises:

[0068] A detection module 110, configured to detect an operation performed by a user on the mobile terminal;

[0069] A generating module 120, configured to generate a control instruction based on the operation;

[0070] The sending module 130 is used to send the control instruction to the target virtual shooting service so that the target virtual shooting service adjusts the shooting picture of the virtual shooting scene based on the control instruction; the target virtual shooting service is selected by the mobile terminal from the published virtual shooting services after the at least one processing device publishes the virtual shooting service running on the device through the wireless local area network.

[0071] The functions or modules included in the device provided in the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation thereof can refer to the description of the above method embodiments, and will not be repeated here for the sake of brevity.

[0072] The present disclosure further provides a mobile terminal 04, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the virtual shooting control method of any embodiment of the present disclosure when executing the computer program.

[0073] Fig.12 FIG. 4 shows a hardware structure diagram of the mobile terminal 04. Fig.12 At the hardware level, the mobile terminal 04 includes a processor 041, an internal bus 042, a network interface 043, a memory 044, and a non-volatile memory 045, and may also include hardware required for other services. The processor 041 reads the corresponding computer program from the non-volatile memory 045 into the memory 044 and then runs it to achieve the following: Figure 4 The virtual shooting control method shown.

[0074] The present disclosure also provides a computer-readable storage medium having computer instructions stored thereon, and when the computer instructions are executed by a processor, the addressing method described in any embodiment of the present disclosure is implemented. The computer-readable storage medium may be a phase change memory (PRAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), other types of random access memory (RAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a flash memory or other memory technology, a compact disc read-only memory (CD-ROM), a digital versatile disc (DVD) or other optical storage, a magnetic cassette, a magnetic tape magnetic disk storage or other magnetic storage device or any other non-transmission medium, which can be used to store information that can be accessed by a computing device.

[0075] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the embodiments of the present disclosure can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the embodiments of the present disclosure is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., including several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present disclosure or some parts of the embodiments.

[0076] The systems, devices, modules or units described in the above embodiments may be implemented by computer devices or entities, or by products with certain functions. A typical implementation device is a computer, which may be in the form of a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, a game console, a tablet computer, a wearable device or a combination of any of these devices.

[0077] Each embodiment in the present disclosure is described in a progressive manner, and the same and similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described above is merely schematic, wherein the modules described as separate components may or may not be physically separated, and the functions of each module can be implemented in the same one or more software and / or hardware when implementing the embodiment of the present disclosure. It is also possible to select some or all of the modules according to actual needs to achieve the purpose of the embodiment. A person of ordinary skill in the art can understand and implement it without paying creative labor.

[0078] The above is only a specific implementation of the embodiment of the present disclosure. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the embodiment of the present disclosure. These improvements and modifications should also be regarded as the protection scope of the embodiment of the present disclosure.

Claims

1. A virtual photography control method, the method being applied to a virtual photography control service running in a mobile terminal, wherein the mobile terminal and at least one processing device running the virtual photography service are connected to the same wireless local area network; the method comprising: Detecting an operation performed by a user on the mobile terminal; generating a control instruction based on the operation; Sending the control instruction to a target virtual shooting service, so that the target virtual shooting service adjusts the shooting picture of the virtual shooting scene based on the control instruction; The target virtual photography service is selected by the mobile terminal from the published virtual photography services after the at least one processing device publishes the virtual photography service running on the device through the wireless local area network; The processing device is fixedly mounted on the back of a display screen, and the display screen is used to display the captured image; The operation is an operation within the control authority scope of the current login account of the virtual shooting control service; the processing device is also connected to the same wireless local area network as other electronic devices, the other electronic devices are equipped with a virtual shooting control service, and the current login account of the virtual shooting control service in the mobile terminal and the current login account of the virtual shooting control service in the other electronic devices have control authority to send the same control instruction; The method further comprises: After the virtual shooting control service in the mobile terminal sends the control instruction to the target virtual shooting service, prompt information that the control instruction has been sent is sent to the virtual shooting control service in other electronic devices.

2. The method according to claim 1, wherein the display interface of the mobile terminal includes at least one control component, and different control components correspond to different control instructions; the operation is a selection operation of a target control component among the at least one control component; and sending the control instruction to the target virtual shooting service comprises: The control instruction corresponding to the target control component is sent to the target virtual shooting service.

3. According to the method of claim 2, the display interface is also used to display the shooting picture of the virtual shooting scene sent by the target virtual shooting service; the target control component is selected by the user from the at least one control component based on the shooting picture.

4. The method according to claim 2, wherein the at least one control component comprises a combination control, and the combination control corresponds to a plurality of control instructions; and sending the control instructions to the target virtual shooting service comprises: If the operation is a selection operation on the combined control, a plurality of control instructions corresponding to the combined control are sent to a target virtual shooting service.

5. The method according to claim 4, further comprising: In response to detecting an editing operation on the multiple control instructions corresponding to the combined control, editing the multiple control instructions corresponding to the combined control; After the editing is completed, the multiple control instructions corresponding to the combined control are stored.

6. The method according to claim 1, wherein the display interface of the mobile terminal is further used to display a shooting picture of the virtual shooting scene sent by the target virtual shooting service; the operation comprises a selection operation of a pixel area in the shooting picture; the virtual shooting scene comprises a virtual scene and a real scene; and the generating of the control instruction based on the operation comprises: Acquire a first pixel area and a second pixel area selected by a user from the shooting picture, wherein the first pixel area is a pixel area where the virtual scene is located, and the second pixel area is a pixel area where the real scene is located; A fusion instruction is generated based on the first pixel region and the second pixel region, where the fusion instruction is used to fuse the first pixel region and the second pixel region.

7. The method according to claim 6, wherein the virtual shooting scene includes a display screen, and the operation includes a selection operation of a rendering optimization item of a display screen on the display screen; and the generating of a control instruction based on the operation includes: Obtaining the target rendering optimization item selected by the selection operation; The target rendering optimization item includes a rendering optimization item for a shadow area in the captured image and / or a rendering optimization item for a background area in the captured image; An optimization instruction for the virtual scene is generated based on the target rendering optimization item, so that the virtual shooting service renders the display screen on the display screen based on the target rendering optimization item in the optimization instruction.

8. The method according to claim 1, wherein the virtual shooting scene comprises a plurality of display screens, the plurality of display screens correspond one-to-one to a plurality of virtual shooting services, and the plurality of virtual shooting services comprise a master service and a slave service; The sending the control instruction to the target virtual shooting service includes: If the target virtual shooting service includes the main service, sending the control instruction to the main service; If the target virtual shooting service includes the slave service, the control instruction is sent to the master service, so that the master service forwards the control instruction to the slave service.

9. The method according to claim 1, wherein the display interface of the mobile terminal includes at least one control component, different control components correspond to different control instructions, and the operation is a selection operation of the at least one control component; the method further comprises: Determine a first control component in an operable state among the at least one control component based on the control authority of the current login account; Displaying the first control component on the display interface, wherein the first control component can be selected by the user to generate a corresponding control instruction; or Determine, based on the control authority of the current login account, a first control component in an operable state and a second control component in an inoperable state among the at least one control component; The first control component and the second control component are displayed on the display interface.

10. The method according to claim 1, wherein the control authority of the current login account is assigned when the current login account is registered.

11. The method according to claim 1, further comprising: Receive prompt information sent by the virtual shooting control service in other electronic devices, indicating that the control instruction has been sent.

12. The method according to claim 1, further comprising: Displaying a list of historical virtual photography services on a display interface of the mobile terminal, the historical virtual photography services being virtual photography services selected by the mobile terminal from virtual photography services historically released; In response to receiving a selection instruction for a historical virtual photography service in the list, determining a first wireless local area network to which the mobile terminal is connected when the historical virtual photography service is selected; connection information of the first wireless local area network is stored in the mobile terminal; If the mobile terminal is not currently connected to the first wireless local area network, the mobile terminal is controlled to connect to the first wireless local area network based on the connection information of the first wireless local area network, and after the connection is successful, the historical virtual shooting service is determined as the target virtual shooting service.

13. A computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.

14. A mobile terminal, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method according to any one of claims 1 to 12 when executing the computer program.

Images