Object editing method and device, electronic equipment and storage medium

Abstract

The invention provides an object editing method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a real scene through mobile equipment, and introducing at least one virtual object into the real scene; in response to any editing operation of selecting operation, moving operation, rotating operation and zooming operation executed by a user on the virtual object, an editing module is displayed on the virtual object in an overlapping mode, and the editing module is used for interacting with the user to edit the virtual object. The editing module is further used for providing any one or combination of a first editing tool, a second editing tool and a transformation style to support editing operation on the virtual object. By means of the object editing method, a user can conveniently edit and adjust the virtual object, and the editing experience and operation flexibility of the user are enhanced.

Description

Technical Field

[0001] The present application relates to the field of augmented reality technology, and in particular to an object editing method, device, electronic device and storage medium. Background Art

[0002] With the rapid development of augmented reality (AR) and virtual reality (VR) technologies, users are increasingly demanding the ability to interact with virtual objects on mobile devices. In order to achieve better user experience and interactive effects, in these application scenarios, editing virtual objects becomes essential to adjust their position and posture in the real scene. By editing, virtual objects can be better integrated into the real environment, interact with real objects, or display better effects.

[0003] However, the software for editing virtual objects on mobile devices is usually not intuitive and easy to use. These software have complex interfaces and cumbersome operation processes, making them difficult for non-professionals to use. This causes many ordinary users to encounter difficulties when editing virtual objects and cannot easily adjust the position, posture or other attributes of virtual objects. Summary of the invention

[0004] The present application provides an object editing method, device, electronic device and storage medium to solve the problems existing in the existing editing of virtual objects, provide a more intuitive, user-friendly interface and simplified operation mode, so that users can easily edit virtual objects and improve user experience and interaction effects.

[0005] In a first aspect, the present application provides an object editing method, which is applied to a mobile device, and the object editing method comprises:

[0006] Acquire a real scene through the mobile device, and introduce at least one virtual object into the real scene;

[0007] In response to the user performing any editing operation of selecting, moving, rotating and scaling the virtual object, an editing module is superimposed and displayed on the virtual object, and the editing module is used to interact with the user to edit the virtual object. The editing module is also used to provide any one of a first editing tool, a second editing tool and a transformation style or a combination thereof to support the editing operation on the virtual object.

[0008] In one embodiment of the present application, the first editing tool includes at least one single axis, the second editing tool includes an operating ring, and the first editing tool and the second editing tool are located on the periphery of the virtual object.

[0009] In an embodiment of the present application, in response to the user performing the selection operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object includes:

[0010] Displaying at least one virtual object on the real scene;

[0011] In response to a user's operation of selecting any one of the virtual objects, the editing module superimposed on the any one of the virtual objects is displayed so that the virtual object is in a selected state.

[0012] In an embodiment of the present application, in response to the user performing the move operation on the virtual object, the step of superimposing an editing module on the virtual object includes:

[0013] In response to the user selecting and moving a single axis of the first editing tool, the single axis is highlighted and the transformation style is replaced with a moving style, and the unselected single axis in the first editing tool and the second editing tool are hidden so that the virtual object can move along the direction of the single axis.

[0014] In an embodiment of the present application, in response to the user performing the move operation on the virtual object, the step of superimposing an editing module on the virtual object further includes:

[0015] In response to a long press and move operation by the user on the input device of the mobile device, the user is allowed to move the virtual object in any direction, the transformation style is replaced with an arbitrary direction movement style, and the first editing tool and the second editing tool are hidden.

[0016] In an embodiment of the present application, in response to the user performing the rotation operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object includes:

[0017] In response to the user selecting the second editing tool and moving it along the operation ring, the second editing tool is highlighted and the transformation style is replaced with a rotation style, and the first editing tool is hidden, so that the virtual object can be rotated.

[0018] In one embodiment of the present application, in response to the user selecting and moving the rotation style, the user is allowed to rotate the virtual object in any direction, and the transformation style is highlighted and the first editing tool and the second editing tool are hidden.

[0019] In an embodiment of the present application, in response to the user performing the zoom operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object includes:

[0020] In response to the user selecting and moving the second editing tool, the transformation style is replaced with a scaling style and the first editing tool is hidden, so that the virtual object can be scaled, and the scaling operation includes moving toward the virtual object to zoom in and moving away from the virtual object to zoom in.

[0021] In an embodiment of the present application, in response to the user performing the zoom operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object further includes:

[0022] In response to a user performing a two-finger pinch or spread operation on an input device of the mobile device, the transformation style is replaced with a zoom style and the first editing tool and the second editing tool are hidden, so that the virtual object can be zoomed.

[0023] In a second aspect, the present application further provides an object editing device, applied to a mobile device, the object editing device comprising:

[0024] An acquisition module, used to acquire a real scene through the mobile device and introduce at least one virtual object into the real scene;

[0025] An interaction module is used to display an editing module superimposed on the virtual object in response to the user performing any editing operation of selecting, moving, rotating and scaling the virtual object, the editing module is used to interact with the user to edit the virtual object, and the editing module is also used to provide any one of a first editing tool, a second editing tool and a transformation style or a combination thereof to support the editing operation of the virtual object.

[0026] In a third aspect, the present application further provides an electronic device, which is used to execute the object editing method described in any one of the first aspects above.

[0027] In a fourth aspect, the present application further provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the object editing method as described in any one of the above-mentioned first aspects are implemented.

[0028] The present application provides an object editing method, device, electronic device and storage medium, which obtains a real scene through a mobile device (such as a smart phone or tablet computer) and introduces at least one virtual object into the real scene. When the user performs a selection operation, a move operation, a rotation operation or a zoom operation, the system responds and displays an editing module superimposed on the selected virtual object. The editing module interacts with the user so that the user can edit the selected virtual object. The present application uses the camera of the mobile device and the superposition of the virtual object to edit and operate the virtual object in the real scene. The user can directly interact with the virtual object through the mobile device to achieve a more intuitive and flexible editing experience, and adjust and transform the position, size and direction of the virtual object as needed. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the present application or the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0030] Figure 1 is a flow chart of the object editing method provided by the present application;

[0031] Figure 2 is a schematic diagram of the editing module provided by this application;

[0032] Figure 3A This is one of the schematic diagrams of the selection operation provided in the first embodiment of the present application;

[0033] Figure 3B This is the second schematic diagram of the selection operation provided in the first embodiment of the present application;

[0034] Figure 4A This is one of the schematic diagrams of the mobile operation provided in the second embodiment of the present application;

[0035] Figure 4B This is the second schematic diagram of the mobile operation provided in the second embodiment of the present application;

[0036] Figure 5A This is one of the schematic diagrams of the rotation operation provided in the third embodiment of the present application;

[0037] Figure 5B This is the second schematic diagram of the rotation operation provided in the third embodiment of the present application;

[0038] Fig. 6A This is one of the schematic diagrams of the zoom operation provided in the fourth embodiment of the present application;

[0039] Figure 6B This is the second schematic diagram of the zoom operation provided in the fourth embodiment of the present application;

[0040] Figure 7 is a schematic diagram of an object editing device provided by the present application;

[0041] Figure 8 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the drawings in this application. Obviously, the described embodiments are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0043] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein.

[0044] In order to solve the problems existing in the existing editing of virtual objects, the present invention provides an object editing method, device and object editing device based on a mobile terminal, which provides an intuitive user interface on a mobile device, displays real scenes and virtual objects, and provides a visual editing environment for users. By responding to user operations and superimposing and displaying an editing module on a selected virtual object, the user can directly edit the virtual object. The editing module interacts with the user and can provide various intuitive editing tools and operation methods, such as selection, movement, rotation and scaling, so that the user can easily edit the virtual object. The object editing method described in the present application provides a convenient and fast editing experience and operational flexibility, and enhances the user's editing ability of virtual objects. It enables ordinary users to easily edit and adjust virtual objects on mobile devices to enhance the user's editing experience and operational flexibility. .

[0045] Combine the following Figure 1-Figure 8 The object editing method, device and object editing device of the present invention are described.

[0046] Please refer to Figure 1 , Figure 1 : is a flow chart of an object editing method provided by the present application. An object editing method, applied to a mobile device, comprises:

[0047] Step 101: acquiring a real scene through the mobile device, and introducing at least one virtual object into the real scene.

[0048] Specifically, mobile devices, such as smart phones, tablet computers or smart head-mounted devices, can capture real scenes of the real world, that is, real pictures or images, through their cameras. Users can introduce virtual objects into the real scene through application functions on mobile devices, such as controls, buttons, etc. Virtual objects can be content in the form of two-dimensional / three-dimensional models, images, text, graffiti, geometric shapes, videos, audios, hyperlinks, applets, forms, PDF files, office documents, sensor information, etc. Introducing at least one virtual object means that multiple virtual objects can be added to the real scene at the same time. These virtual objects can interact with the real environment, such as occluding relationships with objects, providing operational feedback to users, etc.

[0049] Therefore, a view of a real scene is obtained through a mobile device, and virtual objects are introduced into the real scene, so that they echo and interact with actual objects in the real scene, and provide users with an augmented reality experience.

[0050] Step 102, in response to the user performing any editing operation of selecting, moving, rotating and scaling the virtual object, an editing module is superimposed and displayed on the virtual object, the editing module is used to interact with the user to edit the virtual object, and the editing module is also used to provide any one of a first editing tool, a second editing tool and a transformation style or a combination thereof to support the editing operation of the virtual object.

[0051] That is, when the user performs operations such as selecting, moving, rotating or scaling a virtual object, the system responds and displays an editing module superimposed on the selected virtual object. The editing module is used to interact with the user so that the user can edit the selected virtual object.

[0052] Specifically, the selection operation means that the user can select the virtual object by clicking, touching, pressing a button, speaking, or making a gesture. The move operation means that the user can move the position of the selected virtual object by using the tools or gestures in the editing module. The rotation operation means that the user can rotate the selected virtual object to change its direction or angle by using the tools or gestures in the editing module. The zoom operation means that the user can adjust the size of the selected virtual object by using the tools or gestures in the editing module.

[0053] For example, when a user selects a virtual object, a visual identifier (such as a border, a mark, etc.) is added to the virtual object to prompt the user that the object has been selected.

[0054] For example, the user can select (such as by touching, clicking, etc.) a moving tool in the editing module, and then directly move the selected virtual object on the input device of the mobile device to change the position of the selected virtual object. The position can also be precisely adjusted by numerical input.

[0055] For example, the user can select (such as touching, clicking, etc.) a zoom tool in the editing module, and then adjust the size of the selected virtual object by moving the zoom tool, or when the virtual object is selected, directly perform gesture operations (such as pinching or expanding with two fingers) to adjust the size of the selected virtual object.

[0056] Therefore, through this design, users can interact with virtual objects by selecting, moving, rotating or scaling, and edit the virtual objects through the editing module. This makes it easy to adjust the position, posture, size and other attributes of the virtual objects in the real scene to meet the needs of users and editing purposes.

[0057] For example, please refer to Figure 2 , Figure 2 Schematic diagram of the editing module provided by the present application. The first editing tool includes at least one single axis, the second editing tool includes an operation ring, and the first editing tool and the second editing tool are located at the periphery of the virtual object.

[0058] Specifically, the transformation style refers to a style or logo inside a virtual object, which is used to indicate the current transformation operation mode of the virtual object. Preferably, the transformation style is located at the center of the virtual object. For example, it can be an icon or indicator that indicates movement, rotation, scaling or other transformation operations. The operation ring refers to a border or frame located on the periphery of the transformation style, which is used to surround the virtual object and provide operable interface elements so that the user can perform editing operations such as selection and movement. The single axis is a tool for axial movement operations (such as up and down, left and right, front and back) to determine the position of the virtual object in three-dimensional space. It can be a straight line or axis that provides movement in two opposite directions, such as up and down, left and right, or front and back.

[0059] Therefore, in the editing module, the transformation style is located inside the virtual object to indicate the current transformation mode; the operation ring is located outside the transformation style to provide an operable interface element; the single axis is a functional element used to indicate movement in a specific direction. This design allows users to more conveniently select, adjust, and transform virtual objects through the editing module.

[0060] In summary, the above steps 101 and 102 solve the problem of how to allow users to edit virtual objects in real scenes, so as to solve the problem that conventional editing methods are not intuitive, flexible or convenient. The object editing method described in this application is applied on a mobile device, by combining real scenes with virtual objects and providing an intuitive editing module, so that users can easily edit, adjust and operate virtual objects, thereby enhancing the editing experience and effect.

[0061] The above steps 101 to 102 are described below in conjunction with specific embodiments.

[0062] Example 1: Select Operation

[0063] Exemplarily, in the above step 102, in response to the user performing the selection operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object includes:

[0064] Step 1021: display at least one virtual object on the real scene.

[0065] For some examples, please refer to Figure 3A , Figure 3A This is one of the schematic diagrams of the selection operation provided in Example 1 of the present application. Figure 3A The following operation effects are shown:

[0066] At least one virtual object is introduced into a real scene, and the real scene can be a scene or environment of the real world captured by the camera of a mobile device, that is, a real picture. A virtual object can be a virtual element created by computer generation, drawing or projection, such as a two-dimensional / three-dimensional model, image, text, graffiti, geometric shape, video, audio, hyperlink, applet, form, PDF file, office document, sensor information, etc. Among them, introducing at least one virtual object into a real scene can be to add a virtual object to the real scene manually, or it can be that a virtual object already exists in the real scene, and the introduction is to display the virtual object, etc. In the object editing method described in the present application, the mobile device will superimpose the real scene and the virtual object, so that the user can see the real scene and the virtual object on the screen of the mobile device at the same time. Among them, at least one virtual object means that multiple virtual objects can be added to the real scene, and these virtual objects can be displayed in various forms in the real scene and interact with the real environment.

[0067] Therefore, at least one virtual object is introduced into the real scene through the mobile device, so that the user can simultaneously observe the superposition of the real world and the virtual object on the mobile device, providing an augmented reality experience.

[0068] Step 1022: In response to the user selecting any one of the virtual objects, displaying the editing module superimposed on the any one of the virtual objects, so that the virtual object is in a selected state.

[0069] For some examples, please refer to Figure 3B , Figure 3B This is the second schematic diagram of the selection operation provided in Example 1 of the present application. Figure 3B The following operation effects are shown:

[0070] When the user touches any virtual object, the system displays the editing module and overlays the editing module on the selected virtual object to make it selected.

[0071] Specifically, in the object editing method described in the present application, a user can select a virtual object by touching it. For example, a user uses a mobile phone to shoot a real scene, and a virtual object is superimposed and displayed in the real scene. The user selects the virtual object by touching the position of the virtual object on the mobile phone display screen. When the user selects any virtual object, the system responds and displays an editing module. The editing module is superimposed on the touched virtual object to provide an interface and control elements for editing operations. In this way, the selected virtual object is in a selected state, indicating that the user has selected it and can further edit and operate it.

[0072] Therefore, by touching a virtual object, the user can select the virtual object and trigger the system to display an editing module superimposed on the selected virtual object. Such a design can facilitate the user to edit the selected virtual object and provide an intuitive interface and tools to operate the selected virtual object.

[0073] The following embodiments 2 to 4 are based on Figure 3B The moving operation, rotating operation and scaling operation performed in the selected state are shown.

[0074] Example 2: Mobile Operation

[0075] Exemplarily, in the above step 102, in response to the user performing the move operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object includes:

[0076] Step 1031, in response to the user selecting and moving a single axis of the first editing tool, the single axis is highlighted and the transformation style is replaced with a moving style, and the unselected single axis in the first editing tool and the second editing tool are hidden so that the virtual object can move along the direction of the single axis.

[0077] For some examples, please refer to Figure 4A , Figure 4AThis is one of the schematic diagrams of the mobile operation provided in Example 2 of the present application. Figure 4A The following operation effects are shown:

[0078] When the user selects and moves a single axis in the first editing tool, the system will highlight the single axis and replace the transformation style with the movement style. At the same time, the system will hide the unselected single axis in the first editing tool and the second editing tool, so that the virtual object can be moved along the direction of the single axis.

[0079] Specifically, in the editing module, at least one single axis can be three mutually perpendicular single axes, each single axis represents a specific axial direction (for example, representing up and down, left and right, front and back directions, respectively), which can be used to indicate the moving direction of the virtual object. The user can edit the position of the virtual object by moving the single axis, thereby providing a more flexible and free editing method. When the virtual object is in a selected state, when the user selects (such as touching) a single axis in the first editing tool, the system will detect the operation and highlight the single axis to reflect that the user has selected the axis. At the same time, the system will replace the transformation style with the moving style, indicating that the next operation will be to move the virtual object. For example, the user selects the virtual object by touching the position of the virtual object on the mobile phone display screen, and then the user touches a single axis in the first editing tool to select the single axis. The user does not lift the finger and moves the position of the finger on the display screen to move the virtual object along the direction of the single axis. In order to provide a clearer editing interface, the system will hide the unselected single axis in the first editing tool and the second editing tool, allowing the user to focus on the movement operation along the selected single axis direction. In this way, the user can move the virtual object by moving or moving along the direction of the single axis.

[0080] Therefore, when the user selects and moves a single axis in the first editing tool, the system will give corresponding feedback, that is, highlight the single axis and replace the style, hide the unselected single axis in the first editing tool and the second editing tool, so that the user can easily move the virtual object in the selected single axis direction. This design provides a more intuitive and convenient way to control and operate the translation or movement of virtual objects.

[0081] As another implementation of the moving operation, in the above step 102, in response to the user performing the moving operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object includes:

[0082] Step 1032, in response to the user's long press and move operation on the input device of the mobile device, the user is allowed to move the virtual object in any direction, and the transformation style is replaced with an arbitrary direction movement style and the first editing tool and the second editing tool are hidden.

[0083] For some examples, please refer to Figure 4B , Figure 4B This is the second schematic diagram of the mobile operation provided in Example 2 of the present application. Figure 4B The following operation effects are shown:

[0084] When the virtual object is in the selected state, when the user long presses (i.e., does not lift the finger) on the input device (such as the display screen, touchpad, etc.) of the mobile device and moves, the system will respond and allow the user to move the virtual object in any direction. For example, the user selects the virtual object by touching the position of the virtual object on the mobile phone display screen, and then the user does not lift the finger and moves the position of the finger on the display screen to move the virtual object in any direction. At the same time, the system will replace the transformation style with the arbitrary direction movement style, and hide the first editing tool and the second editing tool.

[0085] Specifically, when the user long presses and moves on the input device of the mobile device, the system detects this operation. The system responds and allows the user to move the virtual object in any direction in the virtual scene, that is, to change its position in the real scene. In order to indicate that the current operation is movement rather than other types of transformations (such as rotation or scaling), the system replaces the transformation style with the corresponding movement style, which is displayed as a movement effect on the user's visual interface. At the same time, in order to reduce visual interference and provide a larger editing area, the system hides the first editing tool and the second editing tool so that the user can perform movement operations more freely.

[0086] Therefore, when the user long presses and moves on the input device of the mobile device, the system allows the user to move the virtual object in any direction in the real scene, and reflects the moving operation through corresponding style and interface adjustments. At the same time, in order to provide a better user experience, the system hides elements such as the first editing tool and the second editing tool so that the user has a larger operating space and a more intuitive mobile experience.

[0087] Example 3: Rotation Operation

[0088] Exemplarily, in the above step 102, in response to the user performing a rotation operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object includes:

[0089] Step 1041, in response to the user selecting the second editing tool and moving it along the operation ring, highlighting the second editing tool and replacing the transformation style with a rotation style, and hiding the first editing tool so that the virtual object can be rotated.

[0090] For some examples, please refer to Figure 5A , Figure 5AThis is one of the schematic diagrams of the rotation operation provided in Example 3 of the present application. Figure 5A The following operation effects are shown:

[0091] When the user selects the second editing tool and moves along the operation ring, the system will highlight the second editing tool and replace the transformation style with the rotation style. At the same time, the system will hide the first editing tool so that the user can rotate the virtual object.

[0092] Specifically, in the editing module, the second editing tool is used to control different operations of the virtual object, such as scaling, rotation, etc. When the virtual object is in a selected state, when the user selects (such as touching) the second editing tool and moves along the operation ring, the system will detect this operation and highlight the selected second editing tool to indicate that the user has selected the second editing tool. For example, the user selects the virtual object by touching the position of the virtual object in the mobile phone display screen, and then the user touches the operation ring in the second editing tool to select the operation ring. The user does not lift the finger and moves the position of the finger in the operation ring (the finger moves along the circumference of the operation ring) to achieve the rotation of the virtual object in the two-dimensional plane. At the same time, the system will replace the transformation style with the rotation style, indicating that the next operation will be to rotate the virtual object. In order to provide a clearer editing interface, the system will hide the first editing tool so that the user can focus on the rotation operation. Through this operation mode, the user can rotate the virtual object in the left and right directions in the two-dimensional plane.

[0093] Therefore, when the user selects the second editing tool and moves along the operation circle, the system will give corresponding feedback, highlighting the selection of the second editing tool and replacing the transformation style with the rotation style. At the same time, in order to provide a better user experience, the system will hide other unselected first editing tools so that the user can more conveniently perform the rotation operation of the virtual object. This design provides an intuitive and convenient way to control and operate the rotation transformation of the virtual object.

[0094] It should be noted that the above step 1041 describes a rotation method of a two-dimensional virtual image, that is, when the user selects the second editing tool and moves along the operation ring, the system will highlight the second editing tool, change the transformation style to the rotation style, and hide the first editing tool. In this way, the user can more conveniently perform the rotation operation of the virtual object.

[0095] Exemplarily, as another implementation of the rotation operation, in the above step 102, in response to the user performing a rotation operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object further includes:

[0096] Step 1042, in response to the user selecting the change style and moving the operation, allowing the user to rotate the virtual object in any direction, and highlighting the change style and hiding the first editing tool and the second editing tool.

[0097] For some examples, please refer to Figure 5B , Figure 5B This is the second schematic diagram of the rotation operation provided in Example 3 of the present application. Figure 5B The following operation effects are shown:

[0098] When the user selects a transformation style and moves it, the system highlights the transformation style and hides the first editing tool and the second editing tool.

[0099] Specifically, when the virtual object is in a selected state, when the user selects (such as touching) the transformation style and moves it, for example, the user selects the virtual object by touching the position of the virtual object on the mobile phone display screen, and then the user touches the transformation style to select the transformation style. The user does not lift his finger and moves the position of his finger on the display screen to achieve the rotation of the virtual object in any direction in the three-dimensional plane. The system will highlight the transformation style to remind the user that the current operation mode has been changed to the transformation mode. In order to provide a clearer interface and a larger operation space, the system will hide the first editing tool and the second editing tool so that the user can focus on the transformation operation without being disturbed by other elements. Through this operation method, the user can rotate the virtual object in any direction in the three-dimensional plane.

[0100] Therefore, when the user selects a transformation style and moves it, the system will highlight the transformation style, allowing the user to rotate the virtual object in any direction. At the same time, in order to simplify the interface and provide a better operating experience, the system will hide the first editing tool and the second editing tool so that the user can focus on performing different types of transformation operations. This design enables users to control and operate virtual objects more intuitively and flexibly, and provides clear interface feedback.

[0101] It should be noted that the above step 1042 describes a rotation operation mode for a virtual object, that is, when the user selects a transformation style and moves, the system allows the user to rotate the virtual object in any direction in the three-dimensional space. At the same time, the selected transformation style will be highlighted to remind the user of the current operation. In order to provide a clearer editing interface, the system will hide the first editing tool and the second editing tool. In this way, the user can rotate the three-dimensional virtual image more flexibly and focus on the required editing operation.

[0102] Example 4: Zoom operation

[0103] Exemplarily, in the above step 102, in response to the user performing a zoom operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object includes:

[0104] Step 1051, in response to the user selecting and moving the second editing tool, the transformation style is replaced with a scaling style and the first editing tool is hidden, so that the virtual object can be scaled, and the scaling operation includes moving toward the virtual object to zoom in and moving away from the virtual object to zoom in.

[0105] For some examples, please refer to Fig. 6A , Fig. 6A This is one of the schematic diagrams of the zoom operation provided in Example 4 of the present application. Fig. 6A The following operation effects are shown:

[0106] When the user selects and moves the second editing tool, the system replaces the transformation style with the scaling style and hides the first editing tool so that the user can scale the virtual object.

[0107] Specifically, the second editing tool can be used to perform different types of operations on the virtual object, such as rotation and scaling. When the user selects the second editing tool and moves it, the system replaces the transformation style with the scaling style to indicate that the next operation will be to scale the virtual object. For example, the user selects the virtual object by touching the position of the virtual object in the mobile phone display screen, and then the user touches the second editing tool to select the second editing tool. At this time, the user's finger falls on the operation ring of the second editing tool, and the user does not lift the finger and moves the finger in the direction of the virtual object or away from the virtual object to achieve the scaling of the virtual object. At the same time, in order to provide a clearer editing interface, the system hides the first editing tool to avoid interfering with the user's scaling operation. Through this operation mode, the user can scale the virtual object. If the user moves the second editing tool in the direction of the virtual object, that is, moves inward, a zoom-out operation will be performed. Conversely, if the user moves the second editing tool away from the direction of the virtual object, a zoom-in operation will be performed.

[0108] The zoom style can increase the user's perception and intuitive understanding of the zoom operation, and the user can make precise zoom adjustments to meet the size requirements of the virtual object. The display zoom style provides a visual way to show that the zoom operation can be performed, so that the user knows that the current tool is used for zooming and provides an intuitive interactive interface.

[0109] Therefore, when the user selects and moves the second editing tool, the system will respond accordingly, switch the transformation style to the zoom style, and hide the first editing tool. The purpose of this design is to allow users to easily zoom in and out of virtual objects while providing a simpler and more centralized editing interface. Users can adjust the size of virtual objects by moving the second editing tool to achieve a zoom effect.

[0110] As another implementation of the zoom operation, in the above step 102, in response to the user performing a zoom operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object includes:

[0111] Step 1052, in response to a two-finger pinch or spread operation performed by the user on the input device of the mobile device, the transformation style is replaced with a zoom style and the first editing tool and the second editing tool are hidden, so that the virtual object can be zoomed.

[0112] For some examples, please refer to Figure 6B , Figure 6B This is the second schematic diagram of the zoom operation provided in Example 4 of the present application. Figure 6B The following operation effects are shown:

[0113] When the user performs a two-finger pinch or spread operation on the input device of the mobile device, the system replaces the transformation style with the zoom style and hides the first editing tool and the second editing tool so that the user can perform a zoom operation on the virtual object.

[0114] Specifically, pinching or spreading with two fingers is a touch gesture, and the user can use two fingers to pinch or spread the display screen to achieve a zoom effect. When the system detects that the user performs a pinching or spreading operation with two fingers, the system will process this operation accordingly. The system will replace the transformation style with the scaling style, indicating that the next operation will be to scale the virtual object. For example, the user selects the virtual object by touching the position of the virtual object on the display screen of the mobile phone, and then the user touches the display screen with two fingers and performs a pinching or spreading action to achieve the scaling of the virtual object. At the same time, in order to provide a clearer editing interface, the system will hide the first editing tool and the second editing tool to avoid interfering with the user's gesture operation. Through this operation mode, the user can scale the virtual object. If the user performs a pinching operation with two fingers, a zooming operation will be performed. Conversely, if the user performs a spreading operation with two fingers, a zooming operation will be performed.

[0115] Therefore, when the user performs a pinch or spread operation on the input device of the mobile device, the system will give corresponding feedback, switch the transformation style to the zoom style, and hide the first editing tool and the second editing tool. This design allows the user to conveniently perform zoom operations on the virtual object while providing a more concise and centralized editing interface. The user can adjust the size of the virtual object by pinching or spreading the two fingers to achieve a zoom effect.

[0116] In summary, the selection, movement, rotation and scaling operations on mobile devices can be achieved through user interaction and system response and transformation. These operations allow users to more flexibly locate, adjust or manipulate virtual objects in real scenes, and provide a more intuitive and convenient interface and operation method.

[0117] The object editing device provided by the present invention is described below. The object editing device described below and the object editing device interaction method described above can be referenced to each other.

[0118] In some embodiments of this application, please refer to Figure 7 , Figure 7 Schematic diagram of the object editing device provided by the present application. The present application also provides an object editing device, which is applied to a mobile device. The object editing device 700 includes an augmented reality module 701 and an interaction module 702 .

[0119] Exemplarily, the user interface module 701 is used to acquire a real scene through the mobile device and introduce at least one virtual object into the real scene.

[0120] Exemplarily, the interaction module 702 is used to display an editing module superimposed on the virtual object in response to the user performing any editing operation of selecting, moving, rotating and scaling the virtual object, and the editing module is used to interact with the user to edit the virtual object. The editing module is also used to provide any one or a combination of a first editing tool, a second editing tool and a transformation style to support editing operations on the virtual object.

[0121] Exemplarily, the first editing tool includes at least one single axis, the second editing tool includes an operating ring, and the first editing tool and the second editing tool are located on the periphery of the virtual object.

[0122] Exemplarily, the interaction module 702 is further used for:

[0123] Displaying at least one virtual object on the real scene;

[0124] In response to a user selecting the any virtual object, the editing module superimposed on the any virtual object is displayed so that the virtual object is in a selected state.

[0125] Exemplarily, the interaction module 702 is further used for:

[0126] In response to the user selecting and moving a single axis of the first editing tool, the single axis is highlighted and the transformation style is replaced with a movement style, and the second editing tool is hidden so that the virtual object can move along the direction of the single axis.

[0127] Exemplarily, the interaction module 702 is further used for:

[0128] In response to a long press and move operation by the user on the input device of the mobile device, the user is allowed to move the virtual object in any direction, the transformation style is replaced with an arbitrary direction movement style, and the first editing tool and the second editing tool are hidden.

[0129] Exemplarily, the interaction module 702 is further used for:

[0130] In response to the user selecting the second editing tool and moving it along the operation ring, the second editing tool is highlighted and the transformation style is replaced with a rotation style, and the first editing tool is hidden, so that the virtual object can be rotated.

[0131] Exemplarily, the interaction module 702 is further used for:

[0132] In response to the user's operation of selecting and moving the transformation style, the user is allowed to rotate the virtual object in any direction, and the transformation style is highlighted and the first editing tool and the second editing tool are hidden.

[0133] Exemplarily, the interaction module 702 is further used for:

[0134] In response to the user selecting and moving the second editing tool, the transformation style is replaced with a scaling style and the first editing tool is hidden, so that the virtual object can be scaled, and the scaling operation includes moving toward the virtual object to zoom in and moving away from the virtual object to zoom in.

[0135] Exemplarily, the interaction module 702 is further used for:

[0136] In response to a two-finger pinch or spread operation performed by a user on an input device of the mobile device, the transformation style is replaced with a zoom style and the first editing tool and the second editing tool are hidden, so that the virtual object can be zoomed.

[0137] It should be noted here that the above-mentioned object editing method provided in the embodiment of the present application can implement all the method steps implemented in the above-mentioned device embodiment, and can achieve the same technical effect. The parts and beneficial effects of this embodiment that are the same as those in the device embodiment will not be described in detail here.

[0138] Please refer to Figure 8 , Figure 8 8 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, and the electronic device may include: a processor (Processor) 810, a communication interface (Communications Interface) 820, a memory (Memory) 830 and a communication bus 840, wherein the processor 810, the communication interface 820, and the memory 830 communicate with each other through the communication bus 840. The processor 810 can call the logic instructions in the memory 830 to execute the object editing method.

[0139] In addition, the logic instructions in the above-mentioned memory 830 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art, and the computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk.

[0140] On the other hand, the present application also provides a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute the object editing methods provided by the above methods.

[0141] On the other hand, the present application also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which is implemented when the computer program is executed by a processor to execute the above-mentioned object editing methods.

[0142] The embodiments of the present application provide an electronic device, a computer program product, and a processor-readable storage medium, on which the computer program stored enables the processor to implement all the method steps implemented in the above-mentioned method embodiments and to achieve the same technical effects. The parts and beneficial effects of this embodiment that are the same as those in the method embodiments will not be described in detail herein.

[0143] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0144] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0145] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. An object editing method, characterized in that: Applied to a mobile device, the object editing method includes: Acquire a real scene through the mobile device, and introduce at least one virtual object into the real scene; In response to the user performing any editing operation of selecting, moving, rotating and scaling the virtual object, an editing module is superimposed and displayed on the virtual object, and the editing module is used to interact with the user to edit the virtual object. The editing module is also used to provide any one of a first editing tool, a second editing tool and a transformation style or a combination thereof to support the editing operation on the virtual object.

2. The object editing method according to claim 1, characterized in that: The first editing tool includes at least one single axis, the second editing tool includes an operating ring, and the first editing tool and the second editing tool are located at the periphery of the virtual object.

3. The object editing method according to claim 2, characterized in that: In response to the user performing the selection operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object comprises: Displaying at least one virtual object on the real scene; In response to a user's operation of selecting any one of the virtual objects, the editing module superimposed on the any one of the virtual objects is displayed so that the virtual object is in a selected state.

4. The object editing method according to claim 3, characterized in that: In response to the user performing the moving operation on the virtual object, the step of superimposing an editing module on the virtual object comprises: In response to the user selecting and moving a single axis of the first editing tool, the single axis is highlighted and the transformation style is replaced with a moving style, and the unselected single axis in the first editing tool and the second editing tool are hidden so that the virtual object can move along the direction of the single axis.

5. The object editing method according to claim 3, characterized in that: In response to the user performing the moving operation on the virtual object, the step of superimposing an editing module on the virtual object further comprises: In response to a user's long press and move operation on the input device of the mobile device, the user is allowed to move the virtual object in any direction, the transformation style is replaced with an arbitrary direction movement style, and the first editing tool and the second editing tool are hidden.

6. The object editing method according to claim 3, characterized in that: In response to the user performing the rotation operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object comprises: In response to the user selecting the second editing tool and moving it along the operation ring, the second editing tool is highlighted and the transformation style is replaced with a rotation style, and the first editing tool is hidden, so that the virtual object can be rotated.

7. The object editing method according to claim 3, characterized in that: In response to the user performing the rotation operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object comprises: In response to the user selecting the transformation style and moving the style, the user is allowed to rotate the virtual object in any direction, and the transformation style is highlighted and the first editing tool and the second editing tool are hidden.

8. The object editing method according to claim 3, characterized in that: In response to the user performing the zooming operation on the virtual object, the step of superimposing and displaying an editing module on the virtual object comprises: In response to the user selecting and moving the second editing tool, the transformation style is replaced with a scaling style and the first editing tool is hidden, so that the virtual object can be scaled, and the scaling operation includes moving toward the virtual object to zoom in and moving away from the virtual object to zoom in.

9. The object editing method according to claim 3, characterized in that: In response to the user performing the zooming operation on the virtual object, the step of overlaying and displaying an editing module on the virtual object further comprises: In response to a user performing a two-finger pinch or spread operation on an input device of the mobile device, the transformation style is replaced with a zoom style and the first editing tool and the second editing tool are hidden, so that the virtual object can be zoomed.

10. An object editing device, characterized in that: Applied to a mobile device, the object editing device comprises: An augmented reality module, used to acquire a real scene through the mobile device and introduce at least one virtual object into the real scene; An interaction module is used to display an editing module superimposed on the virtual object in response to the user performing any editing operation of selecting, moving, rotating and scaling the virtual object, the editing module is used to interact with the user to edit the virtual object, and the editing module is also used to provide any one of a first editing tool, a second editing tool and a transformation style or a combination thereof to support the editing operation of the virtual object.

11. An electronic device, characterized in that: The electronic device is used to execute the object editing method described in any one of claims 1 to 9 above.

12. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the object editing method according to any one of claims 1 to 9 are implemented.

Images