Remote scene surveying method and device for virtual scene
By using remote location scouting methods and devices, and displaying virtual scene content using electronic devices, the high cost and low efficiency of on-site scouting in virtual shooting are solved, enabling efficient virtual scene construction and communication.
Patent Information
- Application Number
- CN202411218805.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2025-11-04
- Estimated Expiration
- 2044-08-30
AI Technical Summary
During virtual filming, the cost of on-site reconnaissance of virtual scenes is high and the communication efficiency is low, which affects the overall filming efficiency and cost.
A remote scene exploration method and device are provided, which displays virtual scene content on a screen through electronic devices, and supports users to perform operations such as scene selection, view adjustment, screen recording, and screenshotting remotely, thereby realizing remote exploration of virtual scenes.
It reduces transportation and communication costs associated with on-site surveys, improves communication efficiency, allows users to provide precise feedback, and simplifies the process of building virtual scenarios.
Smart Images

Figure CN119179411B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of virtual shooting, and in particular, to a remote scene investigation method and device for a virtual scene. BACKGROUND
[0002] Virtual production is an advanced technology used in the process of film production, television production, game development or other visual media creation, which combines real-time computer graphics, motion capture, real-time rendering and traditional shooting techniques. Virtual production shoots content in a pre-built virtual scene, using high-performance computers to generate high-quality images and animations in real time, allowing directors and production teams to see the final results immediately. How to reduce the cost and improve the efficiency of virtual production is a technical problem to be solved at present. SUMMARY
[0003] Therefore, the present disclosure provides a remote scene investigation method and device for a virtual scene.
[0004] According to an aspect of the present disclosure, a remote scene investigation method for a virtual scene is provided, applied to an electronic device, and the method comprises:
[0005] In response to a detected scene display operation, displaying scene content that can be shot at a shooting angle of a target virtual scene;
[0006] In response to an adjustment operation for the shooting angle, displaying scene content corresponding to the current shooting angle in the target virtual scene.
[0007] In a possible implementation, the method further comprises:
[0008] In response to a detected remote scene investigation request, displaying a scene selection prompt, wherein the scene selection prompt comprises introduction information of each to-be-investigated virtual scene that has been completed;
[0009] In response to a detected scene selection operation, displaying a scene confirmation prompt, wherein the scene confirmation prompt comprises introduction information of a target virtual scene determined from the to-be-investigated virtual scenes according to the scene selection operation, and determining that the scene display operation is detected if a confirmation operation for the scene confirmation prompt is detected.
[0010] In a possible implementation, the method further comprises:
[0011] In the process of displaying the scene content, in response to a virtual screen switching operation, displaying the scene content in a selected virtual screen.
[0012] In a possible implementation, the method further comprises:
[0013] In the process of displaying the scene content, in response to a detected screen recording operation, the currently displayed scene content is recorded, and a scene recording formed by the recording is stored.
[0014] In a possible implementation, the method further includes:
[0015] In the process of displaying the scene content, in response to a detected screenshot operation, the currently displayed scene content is screenshotted, and a scene screenshot formed by the screenshotting is stored.
[0016] In a possible implementation, the method further includes:
[0017] In the process of displaying the scene content, a displacement control and / or a view angle switching control are displayed;
[0018] In response to an adjustment operation on the shooting view angle, scene content corresponding to a current shooting view angle in the target virtual scene is displayed, including at least one of the following:
[0019] According to a detected first operation on the displacement control, a shooting view angle is moved at a preset displacement speed in a direction corresponding to the first operation, and scene content corresponding to a current shooting view angle is displayed;
[0020] According to a detected second operation on the view angle switching control, a shooting view angle is switched at a preset switching speed in a direction corresponding to the second operation, and scene content corresponding to a current shooting view angle is displayed.
[0021] In a possible implementation, the method further includes:
[0022] In the process of displaying the scene content, in response to a detected file query operation, a file list is displayed;
[0023] The file list displays description information of each stored scene file, the scene file including a scene recording and / or a scene screenshot, and the description information including at least one of a name, a type, and a size of the scene file.
[0024] In a possible implementation, the method further includes:
[0025] In the process of displaying the scene content, in response to a detected setting operation, the displacement speed and / or the switching speed are adjusted.
[0026] According to another aspect of the present disclosure, a remote scene exploration device for a virtual scene is provided, applied to an electronic device, and the device includes:
[0027] The content display module is configured to display, in response to the detected scene display operation, scene content that can be captured by the shooting view of the target virtual scene.
[0028] The display adjustment module is configured to display, in response to an adjustment operation for the shooting view, scene content corresponding to the current shooting view in the target virtual scene.
[0029] In a possible implementation, the apparatus further includes:
[0030] The scene selection prompt display module is configured to display, in response to a detected remote scene exploration request, a scene selection prompt including introduction information of each to-be-explored virtual scene that has been built.
[0031] The scene selection determination module is configured to display, in response to a detected scene selection operation, a scene confirmation prompt including introduction information of a target virtual scene determined from the to-be-explored virtual scenes according to the scene selection operation, and determine that the scene display operation is detected if a confirmation operation for the scene confirmation prompt is detected.
[0032] In a possible implementation, the apparatus further includes:
[0033] The virtual screen display module is configured to display, in response to a virtual screen switching operation, the scene content in a selected virtual screen during display of the scene content.
[0034] In a possible implementation, the apparatus further includes:
[0035] The screen recording module is configured to record, in response to a detected screen recording operation, the scene content currently displayed, and store a scene screen recording formed by the recording.
[0036] In a possible implementation, the apparatus further includes:
[0037] The screenshot module is configured to take, in response to a detected screenshot operation, a screenshot of the scene content currently displayed, and store a scene screenshot formed by the taking.
[0038] In a possible implementation, the apparatus further includes:
[0039] The control display module is configured to display, during display of the scene content, a displacement control and / or a view switching control.
[0040] The display adjustment module is configured to display, in response to an adjustment operation for the shooting view, scene content corresponding to the current shooting view in the target virtual scene, including at least one of the following:
[0041] According to a first operation detected for the displacement control, moving the shooting angle in a direction corresponding to the first operation at a preset displacement speed, and displaying scene content corresponding to the current shooting angle;
[0042] According to a second operation detected for the angle switching control, switching the shooting angle in a direction corresponding to the second operation at a preset switching speed, and displaying scene content corresponding to the current shooting angle.
[0043] In a possible implementation, the apparatus further includes:
[0044] a list display module configured to, in the process of displaying the scene content, display a file list in response to a detected file query operation.
[0045] In the file list, description information of each stored scene file is displayed, the scene file includes a scene recording and / or a scene screenshot, and the description information includes at least one of a name, a type, and a size of the scene file.
[0046] In a possible implementation, the apparatus further includes:
[0047] a speed setting module configured to, in the process of displaying the scene content, adjust the displacement speed and / or the switching speed in response to a detected setting operation.
[0048] According to another aspect of the present disclosure, an electronic device is provided, including a processor, and a memory for storing processor-executable instructions, wherein the processor is configured to implement the above method when executing the instructions stored in the memory.
[0049] According to another aspect of the present disclosure, a non-volatile computer-readable storage medium having computer program instructions stored thereon is provided, wherein the computer program instructions are executed by a processor to implement the above method.
[0050] According to another aspect of the present disclosure, a computer program product is provided, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, when the computer-readable code is run in a processor of an electronic device, the processor in the electronic device executes the above method.
[0051] The method and device for remote scene investigation of a virtual scene provided by the embodiments of the present disclosure. The scene content of a constructed virtual scene can be displayed on the display screen of an electronic device in response to the operation of a user, so that the user can use the electronic device to realize remote scene investigation of the virtual scene, without going to the shooting site of the virtual scene, thereby saving the actual transportation cost required for on-site scene investigation. Moreover, since the remote scene investigation can be realized, the user can accurately propose modification suggestions and demand schemes based on the display, thereby reducing the communication cost and understanding error compared with on-site scene investigation, and significantly improving the communication efficiency.
[0052] Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the drawings. BRIEF DESCRIPTION OF DRAWINGS
[0053] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments, features, and aspects of the present disclosure and serve to explain the principles of the present disclosure.
[0054] Figure 1 An application schematic diagram of a method for remote scene investigation of a virtual scene according to an embodiment of the present disclosure is shown.
[0055] Figures 2-8 A flow schematic diagram of a method for remote scene investigation of a virtual scene according to an embodiment of the present disclosure is shown.
[0056] Figure 9 A block diagram of a device 800 for remote scene investigation of a virtual scene according to an exemplary embodiment is shown. DETAILED DESCRIPTION
[0057] Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in the drawings represent the same or similar elements having the same or similar functions. Although various aspects of the embodiments are shown in the drawings, the drawings are not necessarily drawn to scale unless specifically stated.
[0058] The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any implementation described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other implementations.
[0059] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following detailed description. It should be understood by those skilled in the art that the present disclosure can also be implemented without some specific details. In some examples, methods, means, elements and circuits that are well known to those skilled in the art are not described in detail in order to highlight the main idea of the present disclosure.
[0060] Virtual shooting usually displays a virtual scene on a display screen, and a real scene and actors are located in front of the display screen, and a shooting device is used to shoot the virtual scene on the display screen and the real scene and actors in front of the display screen together to obtain a picture required by a film or television play or a game. The virtual scene is relative to the real scene, and refers to a scene displayed on the display screen, which can be a 2D or 3D digital scene constructed by computer vision or other related technologies, including environment, building, articles and other contents to be displayed, or can be a pre-shot picture, video and the like. In related technologies, in order to ensure the normal progress of virtual shooting, the virtual scene usually needs to be constructed before shooting. In order to ensure that the final shooting product meets the required effect, the related creative team needs to conduct on-site investigation on the virtual scene that has been initially constructed before shooting, and provide modification suggestions. Then, the scene construction personnel modify the virtual scene according to the modification suggestions, and finally complete the construction of the virtual scene through a series of on-site investigation and modification. In this process, on-site investigation of the virtual scene and provision of modification suggestions result in high cost of traffic, manpower and communication, low communication efficiency, and thus the cost and efficiency of the entire virtual shooting are affected.
[0061] To solve the above technical problems, the remote scene investigation method and device for a virtual scene provided by the embodiments of the present disclosure can be applied to an electronic device with a display screen, such as a tablet computer, a desktop computer, a mobile phone and other terminal devices, as shown in the figure. The method can respond to the operation of a user to display the scene content of a constructed virtual scene on the display screen of the electronic device, so that the user can realize remote scene investigation of the virtual scene by using the electronic device, without going to the shooting site of the virtual scene, thereby saving the actual traffic cost required by on-site scene investigation. Moreover, since remote scene investigation can be realized, the user can accurately provide modification suggestions and demand schemes based on the display, thereby reducing the communication cost and understanding error compared with on-site scene investigation, and significantly improving the communication efficiency. Figure 1 The remote scene investigation method for a virtual scene is schematically described below.
[0062] Figures 2-8 As shown in the figure, the electronic device displays a remote scene investigation prompt for the user, and displays a start control (such as the "select scene" control shown in the figure) of remote scene investigation in the remote scene investigation prompt.
[0063] As shown in the figure, the electronic device displays a remote scene investigation prompt for the user, and displays a start control (such as the "select scene" control shown in the figure) of remote scene investigation in the remote scene investigation prompt. Figure 2 Figure 2 In a case where a triggering operation on the start control is detected, it is determined that a remote scene investigation request is detected.
[0064] In this embodiment, for different virtual shooting tasks, a corresponding task feature picture can be set, and the task feature picture is used as a remote reconnaissance prompt and a prompt background of various subsequent prompts for the user, that is, the control prompt background and various prompts are synchronously displayed, such as Figures 2-4 As shown in the display prompt, the prompt background is also displayed. The task feature picture can be a picture that can represent the characteristics of the virtual shooting task, such as a shooting scene picture of the main virtual scene, and the present disclosure does not limit this. The virtual shooting task can be a shooting task for a certain film and television work, a shooting task for a certain scene in a film and television work, a shooting task for a certain shooting location, etc.
[0065] In this embodiment, the electronic device can also first display a virtual shooting task interface in the display screen, display a list of different virtual shooting tasks in the virtual shooting task interface, and display the remote reconnaissance prompt and the corresponding prompt background corresponding to the target virtual shooting task selected by the user according to the selection operation of the user, as shown in Figure 2 For example, the user selects a virtual shooting task for a certain scene in a certain film in the virtual shooting task list displayed in the virtual shooting task interface, and the interface can be switched to Figure 2 that is, the task feature picture corresponding to the virtual shooting task is displayed, for example, a representative picture of the virtual scene of the scene, and a start control of remote reconnaissance is displayed.
[0066] As shown in Figure 3 , the electronic device displays the scene selection prompt for the user when it is determined that the remote reconnaissance request is detected, as shown in Figure 3 The scene selection prompt is used to remind the user to select a target virtual scene. The scene selection prompt includes introduction information of each to-be-investigated virtual scene that has been completed. The introduction information can be information for introducing the corresponding to-be-investigated virtual scene, such as a thumbnail of each to-be-investigated virtual scene, a scene name, a geographical location of the scene, a category of the scene, etc., and the present disclosure does not limit this. The user can determine to understand different to-be-investigated virtual scenes based on the introduction information.
[0067] In this embodiment, each to-be-investigated virtual scene can be a virtual scene constructed according to the virtual scene construction requirement of the target virtual shooting task, and each target virtual shooting task can include one or more to-be-investigated virtual scenes. After completing the construction of the to-be-investigated virtual scene or during the construction, the scene construction personnel can send the related data of the to-be-investigated virtual scene to the electronic device of the related user or to the server, so that the related user can directly obtain the related data of the to-be-investigated virtual scene from the server through the electronic device or with the help of the electronic device, and then the electronic device can display the scene selection prompt for the user.
[0068] As shown in Figure 3As shown, in the process of displaying the scene selection prompt for the user, if the electronic device detects a scene selection operation for a to-be-searched virtual scene, the electronic device determines the selected target virtual scene from the to-be-searched virtual scene, and can determine the to-be-searched virtual scene corresponding to the scene selection operation as the target virtual scene. In some embodiments, as shown in Figure 3 As shown, the scene selection operation can be a click, double-click, swipe, or other operation on the introduction information such as the thumbnail of the to-be-searched virtual scene, and the present disclosure does not limit the scene selection operation. In some embodiments, the selected target virtual scene in the to-be-searched virtual scene can be highlighted in the scene selection prompt for the user, and at least one introduction information of the target virtual scene can be highlighted, such as highlighting, bolding, flashing, or adding a border, to highlight the target virtual scene from other to-be-searched virtual scenes that are not selected by the user. The present disclosure does not limit the implementation of the highlighting.
[0069] As shown in Figure 3 The electronic device can also display a confirmation control and a cancel control in the scene selection prompt, and in the case where the electronic device detects a triggering operation such as a click on the confirmation control in the scene selection prompt, the electronic device displays a Figure 4 As shown in Figure 2 The electronic device cancels the display of the scene selection prompt, and displays the remote scene search prompt to the user again.
[0070] As shown in Figure 4 In the process of displaying the scene confirmation prompt, the electronic device can further display the introduction information of the target virtual scene in the confirmation prompt, so that the user can determine which target virtual scene is selected based on the introduction information displayed in the confirmation prompt, and remind the user to confirm the target virtual scene or reselect the virtual scene. In some embodiments, as shown in Figure 4 The electronic device can also display a start scene search control and a reselect control in the scene confirmation prompt.
[0071] In the case where the electronic device detects a triggering operation such as a click on the reselect control, the electronic device ends the display of the confirmation prompt and displays the Figure 3 As shown in
[0072] In the case where the electronic device detects a triggering operation such as a click on the start scene search control, the electronic device can determine that the user has completed the selection and confirmation of the target virtual scene, and determines that a confirmation operation is detected on the scene confirmation prompt, and further determines that a scene display operation is detected, and can display the scene content that can be photographed in the target virtual scene in the shooting angle of the target virtual scene for the user. Figure 5 As shown in
[0073] In another possible implementation, the remote scene survey request for the determined target virtual scene in the detected scene selection operation can also be considered as being detected, that is, after the user selects the target virtual scene, the electronic device can directly display the scene content that can be photographed by photographing at the photographing angle of the target virtual scene, as shown in Figure 5 The application does not limit the specific method of triggering the remote scene survey request.
[0074] In this embodiment, the target virtual scene can have at least one photographing angle, which refers to the included angle between the photographing device and the display screen. The scene content photographed at different photographing angles in the target virtual scene is different. The electronic device can display the scene content that can be photographed by photographing at a preset photographing angle in the photographing angle of the target virtual scene in response to the scene display operation. The preset photographing angle can be any one of the at least one photographing angle of the target virtual scene, a main photographing angle in the at least one photographing angle, etc., which are not limited by the application.
[0075] In one example, a virtual display screen (i.e., a digital model of the display screen, also referred to as a virtual screen) and a virtual photographing device (i.e., a digital model of the photographing device) can be constructed, the picture of the target virtual scene is projected in the virtual display screen to simulate the picture of the target virtual scene displayed on the physical display screen, the photographing angle between the virtual photographing device and the virtual display screen is adjusted to obtain a preset photographing angle, and then the picture projected in the virtual display screen is projected into the photographing picture of the virtual photographing device according to the parameters and positional relationship of the virtual display screen and the virtual photographing device, that is, the scene content that can be photographed by photographing at the preset photographing angle is obtained. The parameters of the virtual display screen and the virtual photographing device (such as the size and shape of the display screen, the internal and external parameters of the photographing device, etc.) can be consistent with the actual physical display screen and physical photographing device, so that the picture seen by the user on the electronic device is consistent with the picture photographed by the physical photographing device in the actual scene survey.
[0076] In this embodiment, the electronic device displays the scene content that can be photographed by photographing at the photographing angle of the target virtual scene to the user, as shown in Figure 5 During the process of displaying the scene content that can be photographed by photographing at the photographing angle of the target virtual scene to the user, the electronic device can display the scene content corresponding to the current photographing angle in the target virtual scene in response to the adjustment operation for the photographing angle. Thus, the user can remotely view the content that can be photographed by photographing at each photographing angle of the target virtual scene by using the electronic device, and understand the current creation situation of the target virtual scene.
[0077] In some embodiments, as shown in Figure 5 During the process of displaying the scene content, the displacement control (such as Figure 5a "displacement" control (e.g., in the lower left corner) and / or a perspective switching control (e.g., in the lower right corner). The displacement control and the perspective switching control can include a plurality of directional controls, such as Figure 5 as shown, the directional controls can include four directional controls, i.e., left, right, up, and down. If a triggering operation of the left, right, up, or down control of the displacement control is detected, the shooting perspective can be moved left, right, up, or down. The shooting perspective movement triggered by the displacement control can be continuous movement. If a triggering operation of the left, right, up, or down control of the perspective switching control is detected, the shooting perspective can be switched from the current shooting perspective to the next shooting perspective left, right, up, or down. The shooting perspective switching triggered by the perspective switching control can be non-continuous perspective switching, such as switching between a plurality of preset perspectives. Figure 5
[0078] as shown, the electronic device, in response to the adjustment operation of the shooting perspective, displays the scene content corresponding to the current shooting perspective in the target virtual scene, can include: Figure 5
[0079] According to the detected first operation of the displacement control, the shooting perspective is moved in the direction corresponding to the first operation at a preset displacement speed, and the scene content corresponding to the current shooting perspective is displayed. The first operation can be a triggering operation of the left, right, up, or down control of the displacement control.
[0080] According to the detected second operation of the perspective switching control, the shooting perspective is switched in the direction corresponding to the second operation at a preset switching speed, and the scene content corresponding to the current shooting perspective is displayed. The second operation can be a triggering operation of the left, right, up, or down control of the perspective switching control. The switching speed is the speed of switching from the current shooting perspective to the next shooting perspective.
[0081] In this way, the shooting perspective between the shooting device and the display screen is adjusted to display the actual shooting view when shooting at different shooting perspectives, achieving a real scene effect. Users can see the same scene content through the electronic device as when shooting at different shooting positions with the shooting device.
[0082] In some embodiments, the display perspective of the target virtual scene may differ under different shooting angles. The display perspective refers to the angle from which the virtual scene is displayed on the screen. For example, for a virtual scene obtained through 3D modeling, it can display various external or internal views in 360 degrees, such as the front, back, and side views of a 3D object. Some objects, like buildings, can also display different internal views. Therefore, during the change of shooting angle, if it is determined that the display perspective of the target virtual scene under the next shooting angle is different from the current display perspective, the step of displaying the scene content of the target virtual scene corresponding to the current shooting angle in response to the adjustment operation of the shooting angle may include: displaying the scene content of the target virtual scene that matches the current shooting angle, and the scene content that can be captured by shooting from the current shooting angle. In this way, for the same target virtual scene, scene content with a display perspective matching the shooting angle can be displayed to the user, eliminating the need for the user to manually adjust the display perspective of the target virtual scene under a specific shooting angle, simplifying user operation and improving the efficiency of remote location scouting.
[0083] In some embodiments, only the display perspective of the target virtual scene can be adjusted, responding to user operations and displaying the scene content that can be captured by shooting from the display perspective of the target virtual scene. The scene content can also be changed based on the shooting perspective and the display perspective separately; that is, the shooting perspective and the display perspective can be independent of each other and adjusted independently. The adjustment of the display perspective can also be achieved using adjustment controls similar to the aforementioned displacement controls or perspective switching controls.
[0084] In some embodiments, such as Figure 5 As shown, the electronic device can also display related controls needed for remote scene exploration during the display of the scene content. These related controls can include screenshot controls, screen recording controls, virtual screen controls, file controls, settings controls, back controls, etc. When the electronic device detects a click or other triggering operation on a related control, it can execute the corresponding operation for that triggered control, which will be explained below.
[0085] In some embodiments, such as Figure 5 As shown, during the display of the scene content, the electronic device responds to a virtual screen switching operation and displays the scene content in the selected virtual screen. The virtual screen can include various types, each with a preset shape, size, and display position within the target virtual scene. In some embodiments, the virtual screen switching operation can include a trigger operation on a virtual screen control. A virtual screen switch can be performed each time a virtual screen switching operation is detected, until all virtual screen switches are completed and the process returns to normal. Figure 5The image shows the scene content in the state without a virtual screen. It can also display selectable virtual screens to the user after detecting a trigger operation on the virtual screen control, and then display the scene content in the selected virtual screen according to the user's choice. The virtual screen can correspond to the display screen in the real-world shooting scene, meaning it has the same shape, size, and position, allowing the user to see the actual effect of the virtual scene displayed on a real-world display screen.
[0086] In some embodiments, such as Figure 5 As shown, during the display of the scene content, the electronic device responds to the detected screen recording operation by recording the currently displayed scene content and storing the recorded scene screen recording.
[0087] The screen recording operation can be a trigger operation on a screen recording control. After detecting the screen recording operation, the electronic device can, as follows: Figure 6 The scene content continues to be displayed, and simultaneously, displacement controls, view switching controls, and screen recording stop controls are displayed above the scene content (such as...). Figure 6 The "Click to stop screen recording" control shown) and the recorded duration of the already recorded scene screen recording (e.g., Figure 6 The 00:32:23 shown indicates that the recorded screen recording duration is 32 minutes and 23 seconds. During recording, the electronic device can respond to the first operation of the displacement control and / or the second operation of the viewpoint switching control, moving and / or switching the viewpoint. The implementation method is described above and will not be repeated here. This allows users to continuously adjust the scene content while recording during remote location scouting using the electronic device. This facilitates recording and review, ensuring users retain the screen recording of the target virtual scene and can further provide suggestions for modification and improvement based on the recording. The screen recording can also serve as a reference for camera position changes during actual on-site shooting.
[0088] During screen recording, the electronic device can respond to a trigger operation on the screen recording stop control, stop the recording, and display a name input prompt so that the user can enter a name for the recording. Then, when it is determined that the user needs to save the recording, the currently recorded scene is stored, and a description of the scene is generated. This description includes information such as the user-inputted or automatically generated name, type (e.g., screen recording), size, and duration, which describes the scene. This disclosure does not impose any limitations on this. The description may also include information related to the displacement or switching of the shooting perspective, such as the direction and magnitude of the displacement, the switching shooting perspective, and the switching order, as a reference for actual shooting.
[0089] In some embodiments, such as Figure 5As shown, during the process of displaying the scene content, the electronic device responds to the detected screenshot operation by taking a screenshot of the currently displayed scene content and stores the scene screenshot formed by the screenshot.
[0090] The screenshot operation may include triggering operations on the screenshot control. After obtaining a screenshot, the electronic device can display a name input prompt to the user, allowing the user to respond to the prompt and enter a name for the screenshot. Then, when it is determined that the user needs to save the screenshot, the currently obtained scene screenshot is stored, and a description of the scene screenshot is generated. The description information includes information describing the scene screenshot, such as the name entered by the user or automatically generated, type (e.g., screenshot), size, and duration; this disclosure does not impose limitations on this. The description information may also include the shooting angle corresponding to the screenshot, as a reference for actual shooting.
[0091] In some embodiments, such as Figure 5 As shown, during the process of displaying the scene content, the electronic device responds to the detected file query operation and displays, as shown in the image. Figure 7 The file list shown includes descriptions of stored scene files, which may include screen recordings and / or screenshots. The descriptions displayed in the file list may include at least one of the scene file's name, type, and size. In some embodiments, it may be as follows... Figure 7 The file list can be displayed directly above the scene content in the form of a pop-up window, or the scene content can be displayed at the end, and the file list can be displayed directly on the prompt background. This disclosure does not restrict this.
[0092] Among them, such as Figure 7 As shown, the electronic device can also display detail controls and cancel controls in the file list. If a triggering action such as a click on the cancel control in the file list is detected, the file list display can end, and the system can continue displaying the file list to the user. Figure 5 The scene content is shown. If a triggering operation such as clicking on the details control in the file list is detected, more detailed or richer descriptive information for each scene file can be displayed in the file list; or, if it is determined that the user has selected any scene file in the file list, the selected scene file can be displayed to the user, such as playing a saved scene screen recording; or, the folder containing each scene file can be opened and displayed.
[0093] In some embodiments, such as Figure 5 As shown, during the process of displaying the scene content, the electronic device responds to detected setting operations, such as... Figure 8The displacement speed and / or the switching speed are adjusted as shown. The setting operation may include triggering operations such as clicking the setting control, which is not limited in this disclosure.
[0094] Among them, electronic devices detect targeting Figure 5 When the settings control shown is triggered, it can further demonstrate to the user. Figure 8 The setup prompt shown is displayed in the setup prompt. Figure 8 The speed adjustment component shown includes a slider, a speed scale bar, a speed display bar, and an initial value control. If the electronic device detects a sliding operation on the slider for displacement speed or switching speed, it can adjust the position of the slider in the speed scale bar in real time based on the sliding operation, and display the displacement speed or switching speed set by the user's sliding operation. The displacement speed scale bar displays the ratio between the current displacement speed and the maximum achievable displacement speed, while the switching speed scale bar displays the ratio between the current switching speed and the maximum achievable switching speed. If the electronic device detects a trigger operation on the initial value control for displacement speed or switching speed, it can adjust the displacement speed or switching speed corresponding to the triggered initial value control to the initial preset value and synchronously update the corresponding speed scale bar.
[0095] In some embodiments, it can be as follows Figure 8 The settings prompt can be displayed directly above the scene content in the form of a pop-up window, or the scene content can be displayed at the end, and the settings prompt can be displayed directly on the prompt background. This disclosure does not restrict this.
[0096] In this embodiment, during the process of displaying the scene content, the electronic device responds to the detected [target / objective]. Figure 5 Clicking the return control shown can end the display of "the scene content that can be captured from the current target virtual scene's shooting perspective" and restore the display to the user. Figure 3 The scene selection prompts shown allow users to reselect the target virtual scene.
[0097] This disclosure also provides a remote scene exploration device for virtual scenes, applied to electronic devices, the device comprising:
[0098] The content display module is used to respond to the detected scene display operation and display the scene content that can be captured from the shooting perspective of the target virtual scene;
[0099] The display adjustment module is used to respond to the adjustment operation for the shooting angle and display the scene content of the target virtual scene corresponding to the current shooting angle.
[0100] In a possible implementation, the apparatus further includes:
[0101] The scene selection prompt display module is configured to, in response to the detected remote scene exploration request, display a scene selection prompt including introduction information of each virtual scene to be explored that has been built;
[0102] The scene selection determination module is configured to, in response to the detected scene selection operation, display a scene confirmation prompt including introduction information of a target virtual scene determined from the virtual scenes to be explored according to the scene selection operation, and determine that the scene display operation is detected if a confirmation operation on the scene confirmation prompt is detected.
[0103] In a possible implementation, the apparatus further includes:
[0104] The virtual screen display module is configured to, in the process of displaying the scene content, display the scene content in the selected virtual screen in response to a virtual screen switching operation.
[0105] In a possible implementation, the apparatus further includes:
[0106] The screen recording module is configured to, in the process of displaying the scene content, record the currently displayed scene content and store a scene screen recording formed by the recording in response to a detected screen recording operation.
[0107] In a possible implementation, the apparatus further includes:
[0108] The screenshot module is configured to, in the process of displaying the scene content, take a screenshot of the currently displayed scene content and store a scene screenshot formed by the screenshot in response to a detected screenshot operation.
[0109] In a possible implementation, the apparatus further includes:
[0110] The control display module is configured to, in the process of displaying the scene content, display a displacement control and / or a view angle switching control.
[0111] In response to the adjustment operation on the shooting view angle, the scene content corresponding to the current shooting view angle in the target virtual scene is displayed, including at least one of the following:
[0112] According to the detected first operation on the displacement control, the shooting view angle is moved at a preset displacement speed in a direction corresponding to the first operation, and the scene content corresponding to the current shooting view angle is displayed.
[0113] According to a second operation detected for the view angle switching control, a shooting view angle is switched in a preset switching speed towards a direction corresponding to the second operation, and scene content corresponding to the current shooting view angle is displayed.
[0114] In a possible implementation, the apparatus further includes:
[0115] a list display module configured to, in the process of displaying the scene content, display a file list in response to a detected file query operation.
[0116] The file list displays description information of each stored scene file, the scene file including a scene screen recording and / or a scene screenshot, and the description information including at least one of a name, a type, and a size of the scene file.
[0117] In a possible implementation, the apparatus further includes:
[0118] a speed setting module configured to, in the process of displaying the scene content, adjust the displacement speed and / or the switching speed in response to a detected setting operation.
[0119] In some embodiments, the apparatus provided by the embodiments of the present disclosure has functions or includes modules that can be used to perform the methods described in the above method embodiments, and the specific implementation can refer to the description of the above method embodiments. For brevity, they will not be described here.
[0120] It should be noted that although the above embodiments are introduced as examples for the remote scene exploration method and apparatus for the virtual scene, those skilled in the art can understand that the present disclosure should not be limited thereto. In fact, the user can flexibly set each step and module according to personal preferences and / or actual application scenarios, as long as the technical solutions of the present disclosure are implemented.
[0121] The embodiments of the present disclosure also propose a computer-readable storage medium having computer program instructions stored thereon, the computer program instructions being executed by a processor to implement the above method. The computer-readable storage medium can be a volatile or non-volatile computer-readable storage medium.
[0122] The embodiments of the present disclosure also propose an electronic device, including a processor, a memory for storing processor-executable instructions, and wherein the processor is configured to implement the above method when executing the instructions stored in the memory.
[0123] The embodiments of the present disclosure also provide a computer program product, including computer-readable code or a non-volatile computer-readable storage medium carrying computer-readable code, when the computer-readable code is run in a processor of an electronic device, the processor in the electronic device executes the above method.
[0124] Figure 9 is a block diagram of an apparatus 800 for remote recon for a virtual scene according to an exemplary embodiment. The apparatus 800 can be a mobile phone, a computer, a digital broadcast terminal, a message receiver, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc. electronic device, for example.
[0125] Referring to Figure 9 The apparatus 800 can include one or more of the following components: a processing component 802, a memory component 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814 and a communication component 816.
[0126] The processing component 802 usually controls overall operations of the apparatus 800, such as operations associated with displaying, making phone calls, data communications, camera operations and recording operations. The processing component 802 can include one or more processors 820 to execute instructions to complete all or part of steps of the methods described above. In addition, the processing component 802 can include one or more modules to facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
[0127] The memory component 804 is configured to store various types of data to support operations of the apparatus 800. Examples of these data include instructions for any application or methods operating on the apparatus 800, contact data, phonebook data, messages, pictures, videos, etc. The memory component 804 can be implemented by any type of volatile or non-volatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.
[0128] The power supply component 806 provides power for various components of the apparatus 800. The power supply component 806 can include a power supply management system, one or more power supplies, and other components associated with generating, managing and distributing power for the apparatus 800.
[0129] The multimedia component 808 includes a screen providing an output interface between the device 800 and a user. In some embodiments, the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors for sensing a touch, a slide and a gesture on the touch panel. The touch sensor can not only sense a boundary of a touching or a sliding action, but also detect duration and pressure related to the touching or sliding action. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data.
[0130] The audio component 810 is configured to output and / or input an audio signal. For example, the audio component 810 includes a microphone (MIC) configured to receive an external audio signal when the device 800 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 further includes a speaker for outputting an audio signal.
[0131] The input / output interface 812 provides an interface between the processing component 802 and peripheral interface modules, which can be a keypad, a click wheel, buttons, and the like. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.
[0132] The sensor component 814 includes one or more sensors for providing status assessments of various aspects of the device 800. For example, the sensor component 814 can detect an open / closed position of the device 800, relative positioning of components, such as a display and a keypad of the device 800, a change of position of the device 800 or a component of the device 800, presence or absence of user contact with the device 800, a change in orientation of the device 800 or acceleration / deceleration of the device 800, and a temperature change of the device 800, among a plethora of other examples. The sensor component 814 can include an orientation sensor, an acceleration sensor, a proximity sensor, a gesture sensor, a gravity sensor, a biometric sensor, a temperature sensor, a humidity sensor, and an illuminance sensor, among a plethora of other examples.
[0133] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives broadcast signals or broadcast-related information from external broadcast management systems via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) techniques, infrared data association (IrDA) techniques, ultra-wideband (UWB) techniques, Bluetooth (BT) techniques, and other techniques.
[0134] In an exemplary embodiment, the device 800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components, for performing the above-described methods.
[0135] In an exemplary embodiment, a non-transitory computer-readable storage medium, such as the memory 804 including computer program instructions, is also provided, which can be executed by the processor 820 of the device 800 to complete the above-described methods.
[0136] The present disclosure can be a system, a method, and / or a computer program product. The computer program product can include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present disclosure.
[0137] The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium can be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium include the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or punched tape, a magnetically encoded device such as magnetic strip cards, an optically encoded device such as a compact disc (CD) or DVD, and / or any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
[0138] Computer readable program instructions described herein can be downloaded to respective computing / processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and / or a wireless network. The network can comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and / or edge servers. A network adapter card or network interface in each computing / processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing / processing device.
[0139] Computer readable program instructions for carrying out operations of the present disclosure can be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions can execute entirely on the user's computing / processing device, partly on the user's computing / processing device, as a stand-alone software package, partly on the user's computing / processing device and partly on a remote computing / processing device or entirely on the remote computing / processing device or server. In the latter scenario, the remote computing / processing device can be connected to the user's computing / processing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computing / processing device, for example, through the Internet using an Internet Service Provider. In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) can execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present disclosure.
[0140] The computer readable program instructions can also be loaded onto a computing / processing device, other programmable data processing apparatus, or other device to cause a series of operations to be performed on the computing / processing device, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computing / processing device, other programmable apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0141] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can be a computer- readable storage medium having no data storage cycles that change state. The instructions can be executed by one or more processors of a computer, to cause a series of operational elements or steps to be performed on the computer to produce a computer implemented process. Such instructions can also be stored and / or executed by other computer-readable media. Computer-readable media storing the computer readable instructions can include computers, processors, or other programmable data processing apparatuses capable of receiving, storing, and / or executing instructions.
[0142] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational elements or steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer, other programmable elements, or other
[0143] The flow diagrams and the block diagrams in the drawings are presented to illustrate the architecture, functionality, and operations of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flow diagrams and the block diagrams can represent a module, a segment, or a portion of instructions, which comprises one or more executable instructions for implementing the specified logical functions ("instructions"). In some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flow diagrams, and combinations of blocks in the block diagrams and / or flow diagrams, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and
[0144] Embodiments of the present disclosure have been described above, and the description is intended to be illustrative of the embodiments and not exhaustive, and is not limited to the embodiments disclosed. Numerous modifications and adaptations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The choice of words in this document is intended to best explain the principles of the embodiments, practical application, or improvement over the technology in the market, or to enable other ordinary skilled in the art to understand the embodiments disclosed herein.
Claims
1. A method for remote reconnoitring a virtual scene, characterized in that, The method is applied to an electronic device for receiving relevant data of each to-be-investigated virtual scene built by a scene builder for a user to determine a target virtual scene from each to-be-investigated virtual scene that has been built, and is used for a user of a main creative team to remotely view a target virtual scene built by a scene builder before virtual shooting in the target virtual scene, and the method comprises the following steps of: in response to a detected scene display operation, displaying scene content that can be shot at a shooting angle of the target virtual scene for the user, the scene content being consistent with a picture shot by a physical shooting device in a real scene, the scene content being obtained by projecting a picture of a virtual display screen into a shooting picture of a virtual camera device, parameters of the virtual display screen and the virtual camera device being consistent with parameters of a physical display screen and a physical camera device; in response to an adjustment operation for the shooting angle, displaying scene content corresponding to a current shooting angle in the target virtual scene for the user; the method further comprises the following steps of: in response to an adjustment operation for the shooting angle, displaying scene content corresponding to a current shooting angle in the target virtual scene for the user, comprising at least one of the following: according to a detected first operation for the displacement control, moving the shooting angle at a preset displacement speed in a direction corresponding to the first operation, and displaying scene content corresponding to the current shooting angle; according to a detected second operation for the view angle switching control, switching the shooting angle at a preset switching speed in a direction corresponding to the second operation, and displaying scene content corresponding to the current shooting angle.
2. The method of claim 1, wherein, the method further comprises the following steps of: in response to a detected remote scene investigation request, displaying a scene selection prompt, the scene selection prompt comprising introduction information of each to-be-investigated virtual scene that has been built; in response to a detected scene selection operation, displaying a scene confirmation prompt, and determining that the scene display operation is detected if a confirmation operation for the scene confirmation prompt is detected, the scene confirmation prompt comprising introduction information of a target virtual scene determined from the to-be-investigated virtual scenes according to the scene selection operation.
3. The method of claim 1, wherein, the method further comprises the following steps of: in the process of displaying the scene content, in response to a virtual screen switching operation, displaying the scene content in a selected virtual screen.
4. The method of claim 1, wherein, the method further comprises the following steps of: in the process of displaying the scene content, in response to a detected screen recording operation, recording the scene content currently displayed, and storing a scene screen recording formed by the recording.
5. The method of claim 1, wherein, the method further comprises the following steps of: in the process of displaying the scene content, in response to a detected screen capture operation, capturing the scene content currently displayed, and storing a scene screenshot formed by the capturing.
6. The method of claim 1, wherein, the method further comprises the following steps of: in the process of displaying the scene content, in response to a detected file query operation, displaying a file list. The file list displays description information of each stored scene file, the scene file including a scene recording and / or a scene screenshot, and the description information including at least one of a name, a type, and a size of the scene file.
7. The method of claim 1, wherein, The method further includes: During display of the scene content, adjusting the displacement speed and / or the switching speed in response to a detected setting operation.
8. A remote reconnoitering device for a virtual scene, characterized in that, The electronic device is configured to receive data of each to-be-checked virtual scene built by a scene builder for a user to determine a target virtual scene from the built to-be-checked virtual scenes, and the device is configured to allow a user of a main creative team to remotely view the target virtual scene before virtual shooting using the target virtual scene built by the scene builder, and the device includes: a content display module configured to display, for the user, scene content that can be captured by shooting from a shooting angle of the target virtual scene in response to a detected scene display operation, the scene content being consistent with a physical shooting picture captured by a physical shooting device during a real scene shooting, the scene content being obtained by projecting a picture of a virtual display screen into a shooting picture of a virtual shooting device, parameters of the virtual display screen and the virtual shooting device being consistent with those of a physical display screen and a physical shooting device; a display adjustment module configured to display, for the user, scene content corresponding to a current shooting angle of the target virtual scene in response to an adjustment operation on the shooting angle; the device further includes a control display module configured to display a displacement control and / or a shooting angle switching control during display of the scene content; wherein, in response to the adjustment operation on the shooting angle, the scene content corresponding to the current shooting angle of the target virtual scene is displayed, including at least one of the following: in response to a first operation on the displacement control, moving the shooting angle at a preset displacement speed in a direction corresponding to the first operation, and displaying scene content corresponding to the current shooting angle; in response to a second operation on the shooting angle switching control, switching the shooting angle at a preset switching speed in a direction corresponding to the second operation, and displaying scene content corresponding to the current shooting angle.
9. An electronic device, comprising: include: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the method of any one of claims 1 to 7 when executing the instructions stored in the memory.
10. A non-transitory computer readable storage medium having stored thereon computer program instructions, wherein, The computer program instructions, when executed by the processor, implement the method of any one of claims 1 to 7.
Citation Information
Patent Citations
Virtual scene processing method and device, electronic equipment and storage medium
CN116301530A
Collaborative shooting system, method and equipment
CN116506727A