Method, apparatus and storage medium for obtaining and displaying material pictures of a scene model

By scaling game object material images based on relative size relationships in the scene, the method addresses the lack of spatial awareness in game applications, enhancing user accuracy and experience.

CN113384892BActive Publication Date: 2025-07-15TENCENT DIGITAL TIANJIN
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011186786.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-10-29
Publication Date
2025-07-15
Estimated Expiration
2040-10-29

AI Technical Summary

Technical Problem

In the prior art, the material pictures of game objects lack spatial effect presentation, which leads to users being unable to accurately perceive the size difference of objects, affecting the accuracy and experience of user selection.

Method used

By obtaining the model picture of the target object in the target scene and scaling according to the relative size relationship between the objects, a material picture with a sense of space is generated to ensure that the area size occupied by the object in the material picture is consistent with its actual size.

Benefits of technology

Improves the user's perceived accuracy of object size, improves the accuracy of user's object selection and gaming experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113384892B_ABST
    Figure CN113384892B_ABST
Patent Text Reader

Abstract

The present application discloses a method, apparatus, and storage medium for obtaining and displaying material pictures of a scene model, which relates to the field of computer technology. The method includes: obtaining a model picture obtained according to an object model corresponding to a target object in a target scene; wherein, the area size occupied by the target object in the corresponding model picture is the same as the area size occupied by other objects in their respective corresponding model pictures in the target scene; according to the relative size relationship between the model size of the target object and the model sizes of each object in the target scene, scaling the area size occupied by the target object in the model picture to obtain a material picture of the target object. In this way, the sizes of the objects in the material pictures of objects with different sizes obtained by this method are different, so that when displaying, the sense of space between the size objects can be better expressed, and then the user can more accurately select the object of the size they need, improving the accuracy of user object selection.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and provides a method, an apparatus, and a storage medium for obtaining and displaying material pictures of a scene model. Background Art

[0002] Currently, many game applications involve simulated scenes composed of game objects. For example, dress-up games involve dress-up scenes formed by combinations of various game objects, or simulation business games involve simulated business scenes formed by combinations of game objects. For each game object displayed in the game interface, it is modeled and the model is presented at a specific position in the game scene to present the final game scene picture. During the game process, users can often choose to add game objects to the game scene or replace the game objects in the game scene. Then, a corresponding game object selection interface can be presented through the user's operation. In this interface, each game object is usually presented in the form of a material picture.

[0003] However, currently, there is a lack of presentation of the sense of space effect of game objects when displaying the material pictures of game objects. As a result, users cannot perceive the spatial attributes of each game object. When adding them to the game scene, it is very likely that the expected effect cannot be achieved, which brings difficulties to the user's game object selection and reduces the user experience. Summary of the Invention

[0004] Embodiments of the present application provide a method, an apparatus, and a storage medium for obtaining and displaying material pictures of a scene model, which are used to enhance the sense of space of the material pictures and improve the accuracy of user object selection.

[0005] On the one hand, a method for obtaining a material picture of a scene model is provided. The method includes:

[0006] Obtaining a model picture obtained according to an object model corresponding to a target object in a target scene; wherein, the area size occupied by the target object in the corresponding model picture is the same as the area size occupied by other objects in their respective corresponding model pictures in the target scene;

[0007] Scaling the area size occupied by the target object in the model picture according to the relative size relationship between the model size of the target object and the model sizes of the objects in the target scene to obtain the material picture of the target object.

[0008] Optionally, before obtaining the model picture obtained according to the object model corresponding to the target object in the target scene, the method further includes:

[0009] Determine the object selected in the target scene according to the selection operation performed on the item selection interface, and determine the selected object as the target object.

[0010] On the one hand, a method for displaying a material picture obtained based on the above method is provided. The method includes:

[0011] In response to a trigger operation on the target object in the target scene displayed for the target application, obtain the model material information of the target object, where the model material information includes the material picture of the target object;

[0012] Display the material picture of the target object.

[0013] On the one hand, a device for obtaining a material picture of a scene model is provided. The device includes:

[0014] A model picture acquisition unit, configured to acquire a model picture obtained from the object model corresponding to the target object in the target scene; wherein, the area size occupied by the target object in the corresponding model picture is the same as the area sizes occupied by other objects in the target scene in their respective corresponding model pictures;

[0015] An adaptation unit, configured to scale the area size occupied by the target object in the model picture according to the relative size relationship between the model size of the target object and the model sizes of the objects in the target scene, so as to obtain the material picture of the target object.

[0016] Optionally, the model picture acquisition unit is configured to:

[0017] Hide other objects in the target scene except the target object;

[0018] Determine the relative position relationship between the target object and the viewfinder of the target scene according to the model data of the target object; the viewfinder is the picture boundary set for acquiring the model pictures of the objects in the target scene;

[0019] Adjust the position of the target object according to the relative position relationship, so that the projection of the target object on the plane where the viewfinder is located is located in the set area of the viewfinder;

[0020] Acquire the model picture of the target object after the position adjustment.

[0021] Optionally, the model picture acquisition unit is configured to:

[0022] Determine the model center point of the target object according to the model reference point and model boundary point of the target object in the model data;

[0023] Determine whether the center point of the model is located on the central axis of the viewfinder;

[0024] When it is determined that the center point of the model is located on the central axis of the viewfinder, determine a position adjustment strategy according to the projection of the target object on the plane where the viewfinder is located, and perform position adjustment of the target object according to the position adjustment strategy.

[0025] Optionally, the model image acquisition unit is used for:

[0026] Perform position adjustment on the target object according to the model reference point of the target object and the coordinate system reference point of the target scene in the model data, so that the model reference point coincides with the coordinate system reference point;

[0027] Determine the center point of the model of the target object according to the model reference point and the edge points of the target object after movement.

[0028] Optionally, the model image acquisition unit is used for:

[0029] When the center point of the model is not located on the central axis of the viewfinder, perform position adjustment on the target object according to the center point of the model and the central axis of the viewfinder, so that the center point of the model is located on the central axis of the viewfinder;

[0030] Determine a position adjustment strategy according to the projection of the target object after the position adjustment on the plane where the viewfinder is located, and perform position adjustment of the target object according to the position adjustment strategy.

[0031] Optionally, the model image acquisition unit is used for:

[0032] Determine the distance between the edge of the projection and the viewfinder;

[0033] Determine the adjustment distance of the target object along the central axis of the viewfinder according to the mapping relationship between the distance and the adjustment distance along the central axis of the viewfinder;

[0034] Perform position adjustment on the target object along the central axis of the viewfinder according to the adjustment distance.

[0035] Optionally, the model image acquisition unit is used for:

[0036] Perform at least one position adjustment on the target object according to a set adjustment step size until the projection of the target object after adjustment is located in a set area of the viewfinder; wherein, each position adjustment process includes the following steps:

[0037] Determine the adjustment direction of the target object according to the determination result of whether the projection of the target object on the plane where the viewfinder is located is completely located in the set area of the viewfinder;

[0038] Perform position adjustment on the target object along the adjustment direction according to the adjustment step size;

[0039] Determine whether the projection of the adjusted target object on the plane where the viewfinder is located is within the set area of the viewfinder;

[0040] If it is determined that the projection of the adjusted target object on the plane where the viewfinder is located is within the set area of the viewfinder, the position adjustment ends; or, if it is determined that the projection of the adjusted target object on the plane where the viewfinder is located is not within the set area of the viewfinder, then enter the next position adjustment process.

[0041] Optionally, the adaptation unit is configured to:

[0042] Determine the size gradient level of the model size of the target object in the target scene; the size gradient level is positively correlated with the model sizes of the objects included in the target scene;

[0043] Scale the area size occupied by the target object in the model picture according to the size gradient level to obtain the material picture of the target object; wherein, the area sizes occupied by the objects included in the target scene in the material picture are positively correlated with the size gradient level.

[0044] Optionally, the adaptation unit is configured to:

[0045] Determine the area size occupied by the target object in the material picture according to the size gradient level, wherein the area size occupied by the target object in the material picture is positively correlated with the size gradient level;

[0046] Scale the area size occupied by the target object in the model picture to the area size occupied by the target object in the material picture;

[0047] Add a set material template to the model picture to obtain the material picture.

[0048] Optionally, the adaptation unit is configured to:

[0049] When the target object includes one object, perform size equivalent conversion on the maximum size of the one object, and determine the size gradient level of the target object according to the converted equivalent size; or,

[0050] When the target object includes multiple objects, perform dimensional equivalent conversion on the maximum dimension of the object combination formed by the multiple objects, and determine the dimensional gradient level of the target object according to the converted equivalent dimension.

[0051] Optionally, the device further includes an object selection unit for:

[0052] Determine the object selected in the target scene according to the selection operation performed on the item selection interface, and determine the selected object as the target object.

[0053] On the one hand, a display device for material pictures is provided, and the device includes:

[0054] A material information acquisition unit for acquiring the model material information of the target object in response to a trigger operation on the target object in the target scene displayed for the target application, where the model material information includes the material picture of the target object;

[0055] A display unit for displaying the material picture of the target object.

[0056] On the one hand, a computer device is provided, including a memory, a processor, and a computer program stored on the memory and executable by the processor. When the processor executes the computer program, the steps of any of the above methods are implemented.

[0057] On the one hand, a computer storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the steps of any of the above methods are implemented.

[0058] On the one hand, a computer program product or a computer program is provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the steps of any of the above methods.

[0059] In the embodiments of the present application, in the model pictures of each object obtained, the areas occupied by each object are of the same size. Then, according to the relative size relationship between the model size of the target object and the model sizes of other objects in the target scene, the area size occupied by the target object in the model picture is scaled to obtain the material picture of the target object. In this way, after adjusting the area sizes occupied by each object according to the relative size relationship between the objects, the sizes of the objects in the material pictures of objects of different sizes are different. Therefore, when displaying the material pictures, the sense of space between objects of different sizes can be better expressed, assisting the user to perceive the actual size of each object. Furthermore, the user can more accurately select the object of the size they need, improving the accuracy of the user's object selection. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the drawings required for use in the description of the embodiments or related technologies. Obviously, the drawings in the following description are only those of the embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained according to the provided drawings without creative efforts.

[0061] Figure 1 Schematic diagram of a scene provided by an embodiment of the present application;

[0062] Figure 2 Schematic diagram of the interface for displaying the material picture in the related technology provided by an embodiment of the present application;

[0063] Figure 3 Schematic diagram of the scene provided by an embodiment of the present application;

[0064] Figure 4 Flow chart of the method for obtaining the material picture of the scene model provided by an embodiment of the present application;

[0065] Figures 5a - 5b Schematic diagram of the comparison of the material pictures provided by an embodiment of the present application;

[0066] Figure 6 Schematic diagram of the size gradient level provided by an embodiment of the present application;

[0067] Figures 7a - 7c Schematic diagram of the maximum size provided by an embodiment of the present application;

[0068] Figure 8 Flow chart of the sense of space adaptation provided by an embodiment of the present application;

[0069] Figure 9 Schematic diagram of the sense of space adaptation taking scaling and filling the blank as an example provided by an embodiment of the present application;

[0070] Figure 10 Schematic diagram of the setting page for obtaining material pictures provided by the embodiment of the present application;

[0071] Figure 11 Schematic diagram of the process for obtaining model pictures provided by the embodiment of the present application;

[0072] Figure 12 Schematic diagram of the position of the imaginary camera provided by the embodiment of the present application;

[0073] Figure 13 Schematic diagram of the model coordinate points provided by the embodiment of the present application;

[0074] Figure 14 Schematic diagram of the process of the obtaining process of model pictures provided by the embodiment of the present application;

[0075] Figures 15a - 15e Schematic diagram of the imaging of the viewfinder provided by the embodiment of the present application;

[0076] Figure 16 Schematic diagram of the process of the method for displaying material pictures provided by the embodiment of the present application;

[0077] Figures 17a - 17b Schematic diagram of the interface for displaying material pictures provided by the embodiment of the present application

[0078] Figure 18 Schematic diagram of a structure of a device for obtaining material pictures of a scene model provided by the embodiment of the present application;

[0079] Figure 19 Schematic diagram of a structure of a device for displaying material pictures provided by the embodiment of the present application;

[0080] Figure 20 Schematic diagram of a structure of a computer device provided by the embodiment of the present application. Detailed implementation manners

[0081] To make the objectives, technical solutions and advantages of the present application clearer and more understandable, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application. Without conflict, the embodiments in the present application and the features in the embodiments may be combined with each other arbitrarily. And although the logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order from that here.

[0082] To facilitate the understanding of the technical solutions provided by the embodiments of the present application, some key terms used in the embodiments of the present application are explained here:

[0083] Objects and scenes: Multiple objects can form a scene in an application. An object can be an item in the scene or the scene environment, etc. For example, when the scene is an indoor simulation scene composed of multiple objects, the object can be the house structure in the indoor simulation scene, such as a wall, or the indoor furniture in the indoor simulation scene, such as a sofa or a bed, as well as the decorations in the indoor simulation scene, such as a vase or fresh flowers, etc. Or, when the scene is a simulated farm scene composed of multiple objects, the object can be the crops, plants, animals or farm environmental objects in the simulated farm scene. Or, when the scene is a dressing scene in a dressing game, the object can be the dressed character and dressing items in the dressing scene, such as clothes or accessories, etc.

[0084] The scene can include the game scene in a game application or other applications, and can also include the personal display homepage scene in a social application. Of course, it can also be any other scene composed of multiple objects.

[0085] As Figure 1 shown, it is a schematic diagram of a scene. This scene is an indoor simulation scene. In the scene, there are multiple objects required for indoor simulation, such as a coffee table, a TV cabinet, a TV, a vase, a toy car, and a potted plant, etc.

[0086] Object model: An object usually corresponds to an object model. The model of the entire scene can be obtained by assembling the object models of multiple objects in the scene. When displaying the scene, the object models of the objects involved in this scene are displayed. The object model in the embodiments of the present application generally refers to a three-dimensional (3D) model.

[0087] Model picture: A picture directly obtained based on the model of each object. For a scene, it can be understood as a picture obtained by taking pictures of one or more objects with a hypothetical camera with a fixed position.

[0088] Material picture: A material picture obtained after image processing based on the model picture. The material picture can be displayed on the scene page in the application. The image processing involved here mainly involves scaling the objects in the picture so that the sizes of objects of different sizes can be perceived by the user when displayed.

[0089] Viewing frame: The viewing frame is the picture boundary set for obtaining the model pictures of the objects in the target scene, which can be understood as the viewing frame of the hypothetical camera. The viewing frame is usually set to a fixed size. When the position of the hypothetical camera is fixed, the position of the viewing frame is also fixed.

[0090] At present, the content in game applications is becoming increasingly rich. However, when presenting the material images of game objects, the sense of spatial effect of the game objects is lacking. For example, Figure 2 As shown, it is a schematic diagram of the interface for presenting material images in a scene in the related art. Among them, in the scene, there are 3 objects with heights of H1, H2, and H3 respectively. When placed in the scene, the size differences between the objects can be clearly perceived. However, in the related art, when presenting the material images of each object, they are all presented as pictures of a fixed size. The originally smaller object will be enlarged to be the same size as the material images of other objects. For example, Figure 2 As shown, the original size differences of the 3 objects are very large, but the size differences cannot be perceived based on the corresponding material images. The material images of each object lack the presentation of the sense of spatial effect. Then, when the user selects an object, it will mislead the user. For example, for an object that is originally very large, because the user is not clear about the spatial attributes of the object and only feels that the size presented in the material image is very small, after the user selects and places it in the scene, it is found that this is an object with a very large size, resulting in a result that does not match the expectation and making the user experience poor.

[0091] In addition, in the related art, when obtaining the material images of each object in the scene, usually, the designer needs to take out a single object in the scene, adjust the positions of each coordinate axis to make the object model in the desired position, then export a photo, and then perform post-processing. The process of separating an object from the large scene is rather cumbersome and time-consuming. And the number of objects in a scene is large. Each object needs to be photographed independently and undergo certain post-processing operations to obtain a material image, and the workload is extremely huge. Moreover, it is very difficult for manual adjustment to make the positions and angles of each object exactly the same, resulting in possible differences in the angles of the exported pictures and poor visual effects.

[0092] Considering that the process of obtaining the material images of each object is similar, a programmatic picture acquisition process can be used to replace the manual process. And after implementing the programmatic process, it is also possible to realize the automated batch acquisition of the model pictures of objects in one or more scenes, thus solving the problems of cumbersome operation and poor visual effects brought by manual operation. In addition, considering that the main reason why the material images in the related art cannot present a sense of space to the user is that the relative size relationship of the objects is ignored in the related art. Therefore, the relative size relationship between the objects in the scene can be used to perform post-processing on the obtained model pictures, so that the finally obtained material images present a certain sense of spatial effect to the user.

[0093] In view of this, an embodiment of the present application provides a method for obtaining material images of a scene model. In this method, model images of each object are automatically obtained, and the area sizes occupied by each object in the model images are the same. Then, according to the relative size relationship between the model size of the target object and the model sizes of each object in the target scene, the area size occupied by the target object in the model image is scaled to obtain the material image of the target object. In this way, after adjusting the area sizes occupied by each object according to the relative size relationship between each object, the sizes of the objects in the material images of objects with different sizes are different. Therefore, when the material images are displayed, the sense of space between objects with different sizes is better expressed, assisting the user in perceiving the actual size of each object. Furthermore, the user can more accurately select the object of the size they need, improving the accuracy of user object selection.

[0094] In addition, in an embodiment of the present application, a viewfinder can be set for obtaining the model images of each object. The position of the viewfinder is fixed. Then, according to the original positions of each object and the relative position relationship with the viewfinder, the positions of each object are adjusted so that when each object meets the acquisition requirements of the model image, the corresponding model image is obtained. In this way, through the automatic acquisition of model images, the cumbersome operations during the acquisition of model images can be reduced, and the acquisition efficiency of model images can be improved.

[0095] After introducing the design concept of the embodiment of the present application, the following briefly introduces the application scenarios applicable to the technical solution of the embodiment of the present application. It should be noted that the application scenarios described below are only used to illustrate the embodiment of the present application rather than to limit it. In the specific implementation process, the technical solution provided by the embodiment of the present application can be flexibly applied according to actual needs.

[0096] The solution provided by the embodiment of the present application can be applied to most scenarios involving 3D models, especially applicable to game scenarios in game applications and personal home page scenarios in social applications. As Figure 3 shown, a scene schematic diagram provided by an embodiment of the present application is shown. In this scene, there are a material image acquisition device 21, a server 22, and a user terminal 23.

[0097] Among them, the material image acquisition device 21 is a computer device with certain processing capabilities, such as a personal computer (PC), a laptop, or a server, etc. The server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms, but is not limited thereto.

[0098] The material image acquisition device 21 may include one or more processors 211, a memory 212, an I / O interface 213 for interacting with other devices, etc. In addition, the material image acquisition device 21 may also be configured with a display 214 to facilitate visual interaction for the designers of the material images, such as adjusting the acquired material images. Of course, the material image acquisition device 21 may also be configured with a database, which can be used to store data such as model data, model images, and material images involved in the solution provided in the embodiments of the present application. Among them, program instructions for the method of acquiring material images of the scene model provided in the embodiments of the present application may be stored in the memory 212 of the material image acquisition device 21. When these program instructions are executed by the processor 211, they can be used to implement the steps of the method of acquiring material images of the scene model provided in the embodiments of the present application to acquire the material images of each object in the scene.

[0099] After the material image acquisition device 21 finishes acquiring the material images, the acquired material images can be uploaded to the server 22 to publish the successfully acquired material images. The server 22 may be the background server of a game application or a social application.

[0100] An application corresponding to the server 22 is installed in the user terminal 23. The user can open the scene display page through this application. In the scene display page, under a certain trigger condition, the corresponding object's material image can be obtained from the server and displayed.

[0101] Taking a game application as an example, the user can operate on the position where an object needs to be added in the game scene. For example, in an indoor simulation scene, if a decoration needs to be added, then the user can select the position to be added. In response to this operation, the application can pull the material image of the corresponding decoration, and the user can then select the decoration they like according to the material image and add it to the selected position.

[0102] The material image acquisition device 21, the server 22, and the user terminal 23 can be directly or indirectly communicatively connected through one or more networks 24. The network 24 can be a wired network or a wireless network. For example, the wireless network can be a mobile cellular network or a Wireless-Fidelity (WIFI) network. Of course, it can also be other possible networks, and the embodiments of the present application do not limit this.

[0103] Of course, the method provided in the embodiments of the present application is not limited to Figure 3 the application scenarios shown, and can also be used in other possible application scenarios, which are not limited in the embodiments of the present application. For Figure 3The functions that can be achieved by each device in the application scenario shown will be described together in the subsequent method embodiments, and will not be elaborated here for now. Next, the technology related to the embodiments of the present application will be briefly introduced.

[0104] Artificial Intelligence (AI) is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a way similar to human intelligence. Artificial intelligence also studies the design principles and implementation methods of various intelligent machines to enable the machines to have the functions of perception, reasoning, and decision-making.

[0105] Artificial intelligence technology is an interdisciplinary subject with a wide range of fields, including both hardware-level and software-level technologies. The basic technologies of artificial intelligence generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, and mechatronics. The software technologies of artificial intelligence mainly include several major directions such as computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0106] Computer Vision Technology (CV) Computer vision is a science that studies how to enable machines to "see". Further, it refers to using cameras and computers to replace human eyes to perform machine vision such as target recognition, tracking, and measurement on targets, and further perform graphic processing to make the images processed by the computer more suitable for human eyes to observe or be transmitted to instruments for detection. As a scientific discipline, computer vision studies related theories and technologies and attempts to establish an artificial intelligence system that can obtain information from images or multi-dimensional data. Computer vision technology usually includes technologies such as image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, and also includes common biometric recognition technologies such as face recognition and fingerprint recognition.

[0107] With the research and progress of artificial intelligence technology, artificial intelligence technology has been studied and applied in many fields. For example, common ones include smart homes, smart wearable devices, virtual assistants, smart speakers, smart marketing, driverless, autonomous driving, drones, robots, smart healthcare, smart customer service, etc. It is believed that with the development of technology, artificial intelligence technology will be applied in more fields and play an increasingly important role.

[0108] The solution provided by the embodiments of this application relates to technologies such as image processing in artificial intelligence, and will be specifically described through the content of subsequent embodiments.

[0109] Please refer to Figure 4 , which is a schematic flowchart of the method for obtaining material pictures of the scenario model provided by the embodiments of this application. This method can be executed through Figure 3 the material picture acquisition 21 therein, and the process of this method is introduced as follows.

[0110] Step 401: Obtain a model picture obtained according to the object model corresponding to the target object in the target scenario.

[0111] In the embodiments of this application, the model picture can be obtained according to the object models of each object in the selected target scenario, or can be obtained in advance, that is, the model picture has been obtained in advance according to the object models of each object in the scenario and read from the set storage path. The set storage path can include a local storage path and a cloud storage path.

[0112] Specifically, as Figure 1 shown, since the number of items in the target scenario is relatively large, when obtaining the model picture, it can be obtained in a certain order. The order can be set in advance. For example, it can be sorted according to the distance from a certain object as the starting point to obtain the corresponding model picture, or since the target scenario has a corresponding object list, the model pictures of each object can also be obtained in the order in the object list one by one.

[0113] The process of obtaining the model picture according to the object model corresponding to the target object in the target scenario will be specifically introduced later, so it will not be elaborated too much here.

[0114] Step 402: Scale the area size occupied by the target object in the model picture according to the model size of the target object and the relative size relationship between the model sizes of each object in the target scenario to obtain the material picture of the target object.

[0115] In the embodiments of this application, in the obtained model pictures of each object, the area size occupied by each object in the corresponding model picture is the same. In order to enable the user to perceive the size of the object in the material picture to a certain extent when viewing the material picture and improve the consistency between the actual effect and the expected effect after the user selects the object, a spatial sense adaptation solution is introduced to make the material pictures look like they have a spatial proportional sense and provide an auxiliary role for the user to make a selection.

[0116] In specific applications, the relative size relationships between objects in the target scenario can be utilized, that is, according to the relative size relationships between objects in the target scenario, the size of the area occupied by the target object in the obtained model picture is scaled, so that the finally obtained material picture presents a certain sense of spatial effect for the user.

[0117] In a possible implementation manner, in order to significantly highlight the relative size relationships of each object, it can be made that the model size of the object is positively correlated with the size of the area occupied in the material picture, that is, the larger the model size of the object, the larger the size of the area it occupies in the material picture.

[0118] Such as Figure 5a shown, it is a comparison schematic diagram of material pictures of multiple objects. Among them, the sizes of objects A to D in the target scenario are successively Ha > Hb > Hc > Hd, then the sizes of the areas they occupy in the corresponding material pictures decrease successively, as Figure 5a shown in, the size relationships between each object can be intuitively perceived according to the material pictures of each object. Of course, Figure 5a in the material picture shown, each object is flush with the bottom of the material picture, and in actual applications, it is not limited to placing the object at the bottom, and it can also be placed in the middle, or be flush with the top, left, right, etc.

[0119] In another possible implementation manner, considering that there may be objects with large size differences in the target scenario, if the larger the model size of the object, the larger the size of the area it occupies in the material picture, then an object with a very small model size can only occupy a very small position in the material picture, making it possible that the object cannot be recognized as what kind of object, and it will also bring a bad user experience to the user. Therefore, the size gradient levels can also be set according to the relative size relationships between objects. One size gradient level can correspond to a certain interval of model sizes, and the size gradient level is positively correlated with the model sizes of each object included in the target scenario, that is, the larger the model size, the higher the corresponding size gradient level. In this way, after obtaining the model picture of the target object in the target scenario, the size gradient level of the model size of the target object in the target scenario can be determined, and then the size of the area occupied by the target object in the model picture is scaled according to the size gradient level to obtain the material picture of the target object. The sizes of the areas occupied by each object included in the target scenario in the material picture are positively correlated with the size gradient level, that is, the higher the size gradient level, the larger the size of the area occupied by the object in the material picture. In this way, while enabling the material picture to reflect the sense of space between objects, the situation where very small objects cannot be recognized can also be avoided.

[0120] Such as Figure 5b shown, it is a schematic diagram of the material picture obtained according to the size gradient level. Among them, compared with Figure 5aCompared with the corresponding method, since C and D belong to the same size gradient level, they occupy the same area in the material image, avoiding the situation where Figure 5a the size of object D in Figure 5a is very small and the user cannot intuitively identify the object.

[0121] Specifically, the size gradient levels can be uniformly set according to the existing model, or specific size gradient levels can be set according to specific scenarios. In this way, for a target scenario, the size relationship between the objects in the scenario can be better reflected.

[0122] In the embodiments of the present application, each size gradient level corresponds to a size of the area occupied in the material image. After determining the size gradient level of the model size of the target object in the target scenario, the size of the area occupied by the target object in the material image can be determined accordingly. Furthermore, the size of the area occupied by the target object in the model image can be scaled to the size of the area occupied in the material image, and then a set material template can be added to the model image to obtain the material image.

[0123] As Figure 6 shown, it is a schematic diagram of the size gradient levels of a scenario. Among them, according to the relative size relationship between the objects in the scenario, 3 size gradient levels are set, namely Figure 6 P1, P2 and P3 shown in Figure 6 . Each size gradient level corresponds to a size of the area occupied in the material image. As Figure 6 shown, the size of the area occupied by the size gradient level P1 in the material image is 200x200, the size of the area occupied by the size gradient level P2 in the material image is 310x310, and the size of the area occupied by the size gradient level P3 in the material image is 400x400. If it is determined that the size gradient level corresponding to a certain object is P1 according to the model size of the object, then it can be determined that the size of the area occupied by the object in the material image is 200x200. Furthermore, the object in the model image can be scaled to 200x200 and the selected material template can be applied to obtain the material image.

[0124] In the embodiments of the present application, to facilitate measuring the size gradient level corresponding to the target object, size equivalent conversion can be performed according to the model size of the target object, and then the size gradient level of the target object can be determined according to the equivalent size after the size equivalent conversion. As Figure 6 shown, the size gradient levels divided according to the equivalent size.

[0125] Specifically, the target object in the embodiments of the present application can be one or multiple, and the specific quantity can be set during specific implementation. Among them, when the target object only includes one object, the maximum size of the one object is converted into a size equivalent, and the size gradient level of the target object is determined according to the converted equivalent size. Of course, in actual use, other size data can also be used for size equivalent calculation, such as the volume or the maximum cross-sectional area of the target object, etc., and the embodiments of the present application do not limit this.

[0126] Among them, the maximum size can be the maximum side length of an object, or it can also be the maximum diagonal length. As Figure 7a and Figure 7b shown, they are schematic diagrams of the maximum sizes corresponding to two objects respectively. In Figure 7a , the height H of the object is greater than the length L, then the H of the object is the maximum size. While in Figure 7b , the height H of the object is less than the length L, then the L of the object is the maximum size.

[0127] Or, when the target object includes multiple objects, the maximum size of the object combination composed of multiple objects is converted into a size equivalent, and the size gradient level of the target object is determined according to the converted equivalent size. As Figure 7c shown, it is a schematic diagram of the maximum size of the object combination. Among them, Figure 7c is an object combination composed of a vase and a coffee table. When determining the maximum size of the object combination, it is necessary to calculate the object combination as a whole. As Figure 7c shown, the height H of the object combination is from the top of the vase to the bottom of the coffee table. And according to what is shown in Figure 7c , it can be known that the L of the object combination is greater than H. Therefore, the maximum size of the object combination is L.

[0128] After determining the maximum size of the target object, the size equivalent conversion can be performed on the maximum size. The size equivalent conversion means mapping the size to a certain scale unit. As Figure 6 shown, the equivalent size range corresponding to the size gradient level P1 is [0, 6], the equivalent size range corresponding to the size gradient level P2 is (6, 12], and the equivalent size range corresponding to the size gradient level P3 is (12, +∞). Of course, the specific values can be set according to the actual situation.

[0129] In the embodiments of the present application, after determining the area size occupied by the target object in the material picture, the object in the model picture will be scaled to the corresponding size, and a material template will be added to obtain the material picture. Among them, the material template is a pre-set template. For example, it can add blanks to the remaining content after scaling, or add borders or patterns to the content after scaling, etc.

[0130] The following uses a specific example to introduce the above-mentioned process of spatial sense adaptation. As Figure 8 shown, it is a schematic diagram of the process of spatial sense adaptation. In this example, the size of the model picture is predefined as 400x400, and the size of the material picture is also 400x400. The size gradient level P1 is for small item types, and the corresponding equivalent size range is [0, 6]. The size of the content picture in the corresponding material picture is 200x200. The size gradient level P2 is for medium item types, and the corresponding equivalent size range is (6, 12]. The size of the content picture in the corresponding material picture is 310x310. The size gradient level P3 is for large item types, and the corresponding equivalent size range is (12, +∞]. The size of the content picture in the corresponding material picture is 400x400. After scaling the model picture, the remaining part is filled with blanks. Among them, the content picture refers to the local picture corresponding to the area of the target object in the material picture.

[0131] Step 801: Obtain the model picture of the target object.

[0132] Step 802: Determine whether the equivalent size corresponding to the model size of the target object is less than or equal to 6.

[0133] Step 803: If the equivalent size is less than or equal to 6, scale the target object in the model picture to 200x200, and fill the edge part with blanks.

[0134] Step 804: If the equivalent size is greater than 6, determine whether the equivalent size corresponding to the target object is less than or equal to 12.

[0135] Step 805: If the equivalent size is less than or equal to 12, scale the target object in the model picture to 310x310, and fill the edge part with blanks.

[0136] Step 806: If the equivalent size is greater than 12, directly output the model picture as the material picture.

[0137] In the embodiment of the present application, after obtaining the model picture, it is also possible to perform certain image processing on the model picture and then scale the model picture to obtain the material picture. The image processing can, for example, include cropping the model picture so that the top edge of the target object in the cropped picture. Of course, it can also include other image processing, and the embodiment of the present application does not limit this.

[0138] The above process is the process of obtaining the material picture for one target object. However, by traversing all target objects in the scene, that is, performing the above process on all objects in the scene, the material pictures of all objects in the scene can be obtained.

[0139] As Figure 9 shown, it is a schematic diagram of spatial sense adaptation taking scaling and filling with blanks as an example. Among them,Figure 9 If the size gradient level of object A is P1, the scaling ratio is 100%, that is, no scaling is required and it can be directly output as a material image of 400x400; if the size gradient level of object B is P2, the model image of object B is scaled to 310x310 and the edge part is filled with blanks to obtain a material image of 400x400; if the size gradient level of object C is P3, the model image of object C is scaled to 200x200 and the edge part is filled with blanks to obtain a material image of 400x400.

[0140] In the embodiments of the present application, in the specific implementation process, image processing is usually performed in a graphics processing software, such as Unity. Then, the process of obtaining the material image can be called and executed in the image processing software in the form of a functional plug-in to implement the above process. For the convenience of designers, an object selection function can also be provided to designers. After an object is selected, the selected object can be used as the target object. As Figure 10 shown, it is a schematic diagram of the setting page for obtaining the material image. In this setting page, settings can be made for setting items such as the storage path, the imaginary camera selected for obtaining the model image, the shooting background, and the target object, etc.

[0141] Next, the process of obtaining the model image will be introduced. As Figure 11 shown, it is a schematic diagram of the process for obtaining the model image.

[0142] Step 1101: Hide other objects in the target scene except the target object.

[0143] In the embodiments of the present application, since the target scene may include multiple objects, and when obtaining the model image of the target object, only the currently required target object needs to be displayed. Then, other objects in the target scene except the target object can be hidden.

[0144] Specifically, in the image processing software, the hide command of the image processing software can be called to hide the objects that need to be hidden.

[0145] Step 1102: Determine the relative position relationship between the target object and the viewfinder of the target scene according to the model data of the target object.

[0146] In the embodiments of the present application, since there may be many objects in the target scene, and in order to be able to collect model images of all objects in the target scene, the viewfinder is usually set at a relatively far position. And after hiding other objects, the model image of the target object obtained through the viewfinder may not be in the best position. Therefore, the relative position relationship between the target object and the viewfinder is judged to determine whether to perform position adjustment and how to perform position adjustment.

[0147] Among them, the viewfinder is the picture boundary set for obtaining the model pictures of each object in the target scene. It can also be understood that when obtaining the model pictures of the target scene, a virtual camera is placed at a specific position in the target scene, and then each object is photographed through this virtual camera to obtain the corresponding model pictures.

[0148] Among them, the model reference point is the base point when the target object is modeled, and the coordinate system reference point is the base point of the world coordinate system of the target scene. The world coordinate system is a fixed coordinate system, so the coordinate system reference point is fixed, while the model reference point changes as the object model moves. For the convenience of subsequent adjustment, the virtual camera can be placed at the reverse position of the target scene relative to the coordinate system reference point. As Figure 12 shown, the virtual camera and the object model of the target scene are located on both sides of the coordinate system reference point O, and in order to facilitate the adjustment of the object position, the optical axis of the virtual camera can pass through the coordinate system reference point O.

[0149] In order to reduce the workload of subsequent position adjustment, the position of the target object can be adjusted first according to the model reference point of the target object and the coordinate system reference point of the target scene in the model data. That is to say, the target object can be moved from the model reference point to the coordinate system reference point first so that the model reference point coincides with the coordinate system reference point. In this way, most of the content of the target object can be located on the view-finding route of the virtual camera.

[0150] In the embodiments of the present application, generally speaking, it is necessary to make the model center point of the object model located on the central axis of the viewfinder, that is, the model center point of the object model is located on the optical axis of the virtual camera. In this way, the imaging of the target object in the viewfinder is located at the center of the viewfinder. However, there may be a situation where the model center point of the object model does not coincide with the model reference point. Therefore, it is necessary to recalculate the model center point of the target object.

[0151] Specifically, the model center point of the target object can be determined according to the model reference point and the model boundary point of the target object in the model data. Among them, after the position of the target object is adjusted according to the model reference point of the target object and the coordinate system reference point of the target scene in the model data, the model center point of the target object is determined by the model reference point and the edge point of the moved target object. If the position of the target object is not adjusted according to the model reference point of the target object and the coordinate system reference point of the target scene in the model data, then the model center point of the target object is determined according to the model reference point and the edge point in the original model data.

[0152] Among them, the model center point can be calculated through the following formula:

[0153]

[0154] Among them, as Figure 13 shown, P0 and P1 are the diagonal points in the object model of the target object, T is the model reference point, and O is the coordinate system reference point.

[0155] Furthermore, the relative position relationship with the viewfinder can be determined according to the model center point, that is, it is determined whether the model center point is located on the central axis of the viewfinder.

[0156] Step 1103: Adjust the position of the target object according to the relative position relationship, so that the projection of the target object on the plane where the viewfinder is located is within the set area of the viewfinder.

[0157] Specifically, when the model center point is located on the central axis of the viewfinder, the position adjustment strategy can be determined according to the projection of the target object on the plane where the viewfinder is located, and the position of the target object can be adjusted according to the position adjustment strategy.

[0158] If the model center point is not located on the central axis of the viewfinder, the position of the target object needs to be adjusted according to the model center point and the central axis of the viewfinder, so that after the model center point is located on the central axis of the viewfinder, the position adjustment strategy is determined for position adjustment.

[0159] Specifically, when the model center point is located on the central axis of the viewfinder, the center point of the projection of the target object on the plane where the viewfinder is located coincides with the center point of the viewfinder. Therefore, only by adjusting the position of the target object along the central axis can the size of the projection of the target object on the plane where the viewfinder is located be adjusted, so that the projection of the target object on the plane where the viewfinder is located is within the set area of the viewfinder.

[0160] In the specific implementation process, the set area can include the complete area of the viewfinder. Then, in the model picture obtained by shooting, the top edge of the target object is located in the model picture. Of course, the set area can also be other areas of different sizes or positions, which can be specifically set according to requirements. For example, when it is necessary to match a certain material template, the set area can be set at the position where the target object is filled in the material template.

[0161] Next, mainly taking the model picture of the top edge as an example for introduction.

[0162] In a possible implementation, a mapping relationship can be set in advance between the distance between the edge of the projection and the viewfinder frame and the adjustment distance along the central axis direction of the viewfinder frame. Then, after determining the distance between the edge of the projection and the viewfinder frame, according to the mapping relationship, the adjustment distance of the target object along the central axis direction of the viewfinder frame can be determined, and then the position of the target object can be adjusted along the central axis direction of the viewfinder frame according to the adjustment distance. For example, if the projection of the current target object on the plane where the viewfinder frame is located is not completely within the viewfinder frame, the distance between the edge of the projection of the target object on the plane where the viewfinder frame is located and the viewfinder frame is A, and the corresponding adjustment distance is B. Then, the target object can be moved a distance B along the central axis direction of the viewfinder frame. If the projection of the current target object on the plane where the viewfinder frame is located is completely within the viewfinder frame and the distance between the edge and the viewfinder frame is -A, and the corresponding adjustment distance is -B, then the target object can be moved a distance -B along the central axis direction. Here, the positive and negative values represent the direction of movement along the central axis of the viewfinder frame.

[0163] In another possible implementation, the position of the target object can be adjusted at least once according to the set adjustment step size, and the projection position of the target object on the plane where the viewfinder frame is located after each trial adjustment is judged until the projection of the adjusted target object on the plane where the viewfinder frame is located is within the set area of the viewfinder frame.

[0164] Among them, each position adjustment process includes the following steps:

[0165] According to the determination result of whether the projection of the target object on the plane where the viewfinder frame is located is completely within the set area of the viewfinder frame, the adjustment direction of the target object is determined. For example, if the projection of the current target object on the plane where the viewfinder frame is located is not completely within the viewfinder frame, then the target object needs to be reduced, that is, the target object needs to be moved away from the imaginary camera. If the projection of the current target object on the plane where the viewfinder frame is located is completely within the viewfinder frame and there is a distance between the edge and the viewfinder frame, then the target object needs to be enlarged, that is, the target object needs to be moved closer to the imaginary camera.

[0166] After determining the moving direction, the position of the target object can be adjusted along the adjustment direction according to the adjustment step size. After the adjustment, it is determined whether the projection of the adjusted target object on the plane where the viewfinder frame is located is within the set area of the viewfinder frame. If it is determined that the projection of the adjusted target object on the plane where the viewfinder frame is located is within the set area of the viewfinder frame, the position adjustment ends; or, if it is determined that the projection of the adjusted target object on the plane where the viewfinder frame is located is not within the set area of the viewfinder frame, the next adjustment process is entered until the projection of the finally adjusted target object on the plane where the viewfinder frame is located is within the set area of the viewfinder frame.

[0167] In the embodiments of the present application, it should be noted that the adjustment of the position of the target object is essentially a process of coordinate value mapping. For example, when moving the target object along the central axis of the viewfinder, it is actually adding an offset vector to the position data of the target object before movement, such as coordinates, to obtain the position data of the target object after movement. And on the image processing software, it can be reflected as the target object moving in the direction and distance pointed by this offset vector.

[0168] Step 1104: Obtain the model image of the target object after position adjustment.

[0169] After completing the position adjustment of the target object, the model image of the target object can be captured. Here, the capture is essentially a process of data acquisition. A corresponding model image can be generated according to the current position data of the target object and the texture data, etc. On the image processing software, it can be presented as a process of obtaining a model image of the target object by a hypothetical camera.

[0170] Next, taking the target object as object B as an example, the process of obtaining the above-mentioned model image will be introduced. As Figure 14 shown, it is a schematic flow chart of the process of obtaining the model image.

[0171] Step 1401: Hide other objects in the target scene except object B.

[0172] As Figure 15a shown, after hiding other objects, object B is very small in the viewfinder imaging based on the current position of object B. Therefore, the position of object B needs to be adjusted. The near section and the far section are the limit positions for the movement of object B. Only when it is located between the near section and the far section can the model image of object B be normally captured. When it is located outside the near section or the far section, the model image of object B cannot be captured.

[0173] Step 1402: Move object B to the coordinate system reference point.

[0174] Here, taking the model reference point of object B not being at the model center point but being the bottom endpoint of object B as an example, after moving to the coordinate system reference point, as Figure 15b shown, then the hypothetical camera can only capture the lower half model of object B. Therefore, the position of object B needs to be further adjusted.

[0175] Step 1403: Calculate the model center point of the current object B.

[0176] Step 1404: Move object B from the model center point to the coordinate system reference point.

[0177] After moving object B from the center point of the model to the reference point of the coordinate system, it is necessary to determine whether the imaging of object B in the viewfinder meets the requirements. Here, specifically, taking the requirement that the top edge of the object needs to be located in the viewfinder as an example, that is, the imaging in the viewfinder actually needs to be a full-frame picture. According to the actual situation, there may be three cases here. That is, if the imaging in the viewfinder just meets the requirements, then the model picture of object B can be directly captured. If the imaging in the viewfinder does not meet the requirements, there may be two cases. One is that the imaging of object B in the viewfinder is incomplete, or the top edge of object B is not at the top in the viewfinder. As Figure 15c shown, it is the case where the top edge of object B is not at the top in the viewfinder. For these two cases, subsequent adjustments are required.

[0178] Step 1405: Scale object B until the top edge of the projection of object B in the viewfinder is located in the viewfinder.

[0179] Specifically, the scaling here does not refer to directly scaling the model size of object B, but adjusting the position of object B on the optical axis path of the imaginary camera. When object B is adjusted away from the imaginary camera, it is equivalent to shrinking object B. Correspondingly, the imaging of object B in the viewfinder will also shrink. When object B is adjusted closer to the imaginary camera, it is equivalent to enlarging object B. Correspondingly, the imaging of object B in the viewfinder will also enlarge.

[0180] Specifically, through the projection algorithm from the model to the viewfinder, the projection coordinates of the object model in the viewfinder can be obtained, so as to determine whether the imaging of the object model in the viewfinder meets the requirements and the adjustment direction when it does not meet the requirements.

[0181] In the specific implementation process, object B can be scaled according to a certain scaling ratio until the imaging of the adjusted object model in the viewfinder meets the requirements. Among them, the scaling ratio can be 99% and 101%. When the scaling ratio is 99%, object B is moved 1% of the corresponding distance along the direction away from the camera optical axis. When the scaling ratio is 101%, object B is moved 1% of the corresponding distance along the direction close to the camera optical axis.

[0182] As Figure 15d and Figure 15e shown, it is the change diagram of the imaging in the viewfinder. When the imaging of the object model in the viewfinder is incomplete, object B can be gradually moved along the direction away from the camera optical axis until the imaging of the object model in the viewfinder meets the requirements. When the top edge of the object model is not at the top in the viewfinder, object B can be gradually moved along the direction close to the camera optical axis until the imaging of the object model in the viewfinder meets the requirements.

[0183] Based on the same inventive concept, the embodiment of the present application also provides a method for displaying the material picture obtained based on the above process. Please refer toFigure 16 , which is a schematic flow chart of a method for displaying material pictures.

[0184] Step 1601: In response to a triggering operation on a target object in a target scene displayed for a target application, obtain model material information of the target object.

[0185] In the embodiments of the present application, the model material information may include a material picture of the target object, and may also include relevant information of the target object, such as name or price, etc.

[0186] The triggering operation may be an operation of the user. For example, after the user enters the target scene interface, it can be considered that the display of the material picture is triggered. Or, when the user operates on a specific area in the scene, it can be considered that the display of the material picture is triggered, and then the corresponding model material information can be read from the local or pulled from the background server, and the display is performed based on the model material information.

[0187] Step 1602: Display the material picture of the target object.

[0188] As Figure 17a shown, it is a schematic diagram of a material picture display interface. Among them, based on the triggering operation, it can jump to the material picture display interface, and then display the corresponding model material information in the material picture display interface.

[0189] As Figure 17b shown, it is a schematic diagram of another material picture display interface. Among them, based on the triggering operation, the corresponding model material information can be displayed on the target scene interface.

[0190] Based on the same inventive concept, the embodiments of the present application also provide a device 180 for obtaining a material picture of a scene model. The device includes:

[0191] A model picture acquisition unit 1801, configured to obtain a model picture obtained according to an object model corresponding to a target object in a target scene; wherein, the area size occupied by the target object in the corresponding model picture is the same as the area size occupied by other objects in the target scene in their respective corresponding model pictures;

[0192] An adaptation unit 1802, configured to scale the area size occupied by the target object in the model picture according to the relative size relationship between the model size of the target object and the model sizes of each object in the target scene, so as to obtain a material picture of the target object.

[0193] Optionally, the model picture acquisition unit 1801 is configured to:

[0194] Hide other objects in the target scene except the target object;

[0195] Determine the relative position relationship between the target object and the viewfinder of the target scene according to the model data of the target object; the viewfinder is the picture boundary set for obtaining the model pictures of each object in the target scene;

[0196] Adjust the position of the target object according to the relative position relationship, so that the projection of the target object on the plane where the viewfinder is located is within the set area of the viewfinder;

[0197] Obtain the model picture of the target object after position adjustment.

[0198] Optionally, the model picture acquisition unit 1801 is used for:

[0199] Determine the model center point of the target object according to the model reference point and the model boundary point of the target object in the model data;

[0200] Determine whether the model center point is on the central axis of the viewfinder;

[0201] When it is determined that the model center point is on the central axis of the viewfinder, determine the position adjustment strategy according to the projection of the target object on the plane where the viewfinder is located, and perform position adjustment on the target object according to the position adjustment strategy.

[0202] Optionally, the model picture acquisition unit 1801 is used for:

[0203] Adjust the position of the target object according to the model reference point of the target object in the model data and the coordinate system reference point of the target scene, so that the model reference point coincides with the coordinate system reference point;

[0204] Determine the model center point of the target object according to the model reference point and the edge points of the target object after movement.

[0205] Optionally, the model picture acquisition unit 1801 is used for:

[0206] When the model center point is not on the central axis of the viewfinder, adjust the position of the target object according to the model center point and the central axis of the viewfinder, so that the model center point is on the central axis of the viewfinder;

[0207] Determine the position adjustment strategy according to the projection of the target object after position adjustment on the plane where the viewfinder is located, and perform position adjustment on the target object according to the position adjustment strategy.

[0208] Optionally, the model picture acquisition unit 1801 is used for:

[0209] Determine the distance between the edge of the projection and the viewfinder;

[0210] Determine the adjustment distance of the target object along the central axis direction of the viewfinder according to the mapping relationship between the spacing and the adjustment distance along the central axis direction of the viewfinder;

[0211] Adjust the position of the target object along the central axis direction of the viewfinder according to the adjustment distance.

[0212] Optionally, the model image acquisition unit 1801 is used for:

[0213] Perform at least one position adjustment on the target object according to the set adjustment step size until the projection of the adjusted target object on the plane where the viewfinder is located is within the set area of the viewfinder; wherein, each position adjustment process includes the following steps:

[0214] Determine the adjustment direction of the target object according to the determination result of whether the projection of the target object on the plane where the viewfinder is located is completely within the set area of the viewfinder;

[0215] Adjust the position of the target object along the adjustment direction according to the adjustment step size;

[0216] Determine whether the projection of the adjusted target object on the plane where the viewfinder is located is within the set area of the viewfinder;

[0217] If it is determined that the projection of the adjusted target object on the plane where the viewfinder is located is within the set area of the viewfinder, the position adjustment ends; or, if it is determined that the projection of the adjusted target object on the plane where the viewfinder is located is not within the set area of the viewfinder, then enter the next position adjustment process.

[0218] Optionally, the adaptation unit 1802 is used for:

[0219] Determine the size gradient level of the model size of the target object in the target scene; the size gradient level is positively correlated with the model sizes of the objects included in the target scene;

[0220] Scale the area size occupied by the target object in the model image according to the size gradient level to obtain the material image of the target object; wherein, the area sizes occupied by the objects included in the target scene in the material image are positively correlated with the size gradient level.

[0221] Optionally, the adaptation unit 1802 is used for:

[0222] Determine the area size occupied by the target object in the material image according to the size gradient level, wherein the area size occupied by the target object in the material image is positively correlated with the size gradient level;

[0223] Scale the area size occupied by the target object in the model image to the area size occupied in the material image;

[0224] Add a set material template to the model picture to obtain a material picture.

[0225] Optionally, an adaptation unit 1802 is used for:

[0226] When the target object includes one object, perform size equivalent conversion on the maximum size of the one object, and determine the size gradient level of the target object according to the converted equivalent size; or,

[0227] When the target object includes multiple objects, perform size equivalent conversion on the maximum size of the object combination formed by the multiple objects, and determine the size gradient level of the target object according to the converted equivalent size.

[0228] Optionally, the device further includes an object selection unit 1803 for:

[0229] Determine the selected object in the target scene according to the selection operation performed on the item selection interface, and determine the selected object as the target object.

[0230] The device can be used to execute Figures 3 - 15e The method shown in the embodiments shown, therefore, for the functions that can be realized by each functional module of the device, reference can be made to Figures 4 - 15e The description of the embodiments shown, which will not be elaborated here. Since the object selection unit 1803 is not an essential functional unit, it is shown in dotted lines in Figure 18 this figure.

[0231] Based on the same inventive concept, an embodiment of the present application also provides a display device 190 for a material picture, and the device includes:

[0232] A material information acquisition unit 1901, configured to acquire model material information of a target object in response to a trigger operation performed on the target object in a target scene displayed for a target application, where the model material information includes a material picture of the target object;

[0233] A display unit 1902, configured to display the material picture of the target object.

[0234] The device can be used to execute Figures 16 - 17b The method shown in the embodiments shown, therefore, for the functions that can be realized by each functional module of the device, reference can be made to Figures 16 - 17b The description of the embodiments shown, which will not be elaborated here.

[0235] Please refer to Figure 20 , based on the same technical concept, an embodiment of the present application also provides a computer device 200, which may include a memory 2001 and a processor 2002.

[0236] A memory 2001 for storing a computer program executed by a processor 2002. The memory 2001 may mainly include a program storage area and a data storage area. Among them, the program storage area may store an operating system, application programs required for at least one function, etc.; the data storage area may store data created according to the use of the computer device, etc. The processor 2002 may be a central processing unit (CPU), or a digital processing unit, etc. In the embodiments of the present application, the specific connection medium between the above-mentioned memory 2001 and the processor 2002 is not limited. In the embodiments of the present application Figure 20 it is connected between the memory 2001 and the processor 2002 through a bus 2003. The bus 2003 is represented by a thick line in Figure 20 and the connection manners between other components are only for illustrative purposes and are not to be taken as limitations. The bus 2003 may be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, Figure 20 only a thick line is used to represent it in, but it does not mean that there is only one bus or one type of bus.

[0237] The memory 2001 may be a volatile memory, such as a random-access memory (RAM); the memory 2001 may also be a non-volatile memory, such as a read-only memory, a flash memory, a hard disk drive (HDD), or a solid-state drive (SSD), or the memory 2001 is any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 2001 may be a combination of the above-mentioned memories.

[0238] The processor 2002 is used to execute the method executed by the device in the embodiments shown in Figures 4 - 15e or Figures 16 - 17b when calling the computer program stored in the memory 2001.

[0239] In some possible implementation manners, each aspect of the method provided in the present application may also be implemented in the form of a program product, which includes program code. When the program product runs on a computer device, the program code is used to cause the computer device to execute the steps in the methods according to various exemplary implementation manners of the present application described above in this specification. For example, the computer device may execute the method executed by the device in the embodiments shown in Figures 4 - 15e or Figures 16 - 17b The method executed by the device in the shown embodiment.

[0240] The program product may employ any combination of one or more readable media. The readable media may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0241] Although the preferred embodiments of the present application have been described, additional changes and modifications can be made to these embodiments by those skilled in the art once they learn the basic inventive concept. Therefore, the appended claims are intended to be construed to include the preferred embodiments as well as all changes and modifications that fall within the scope of the present application.

[0242] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these modifications and variations.

Claims

1. A method for obtaining material pictures of a scene model, characterized in that, The method includes: Determining whether the model center point of the object model corresponding to the target object in the target scene is located on the central axis of the viewfinder, where the viewfinder is the picture boundary set for obtaining the model pictures of each object in the target scene; If the model center point is located on the central axis, determining a position adjustment strategy according to the projection of the target object on the plane where the viewfinder is located, and performing position adjustment of the target object according to the position adjustment strategy so that the projection is located in the set area of the viewfinder; Obtaining the model picture of the target object after position adjustment; wherein, the area size occupied by the target object in the corresponding model picture is the same as the area sizes occupied by other objects in the target scene in their respective corresponding model pictures; Scaling the area size occupied by the target object in the model picture according to the relative size relationship between the model size of the target object and the model sizes of each object in the target scene to obtain the material picture of the target object.

2. The method according to claim 1, wherein, Before obtaining the model picture of the target object after position adjustment, the method further includes: Hiding other objects in the target scene except the target object.

3. The method according to claim 2, wherein Before determining whether the model center point of the object model corresponding to the target object in the target scene is located on the central axis of the viewfinder, the method further includes: Determining the model center point of the target object according to the model reference point and the model boundary point of the target object in the model data of the target object.

4. The method according to claim 3, wherein Before determining the model center point of the target object according to the model reference point and the model boundary point of the target object in the model data, the method further includes: Performing position adjustment on the target object according to the model reference point of the target object in the model data and the coordinate system reference point of the target scene so that the model reference point coincides with the coordinate system reference point; Then the determining the model center point of the target object according to the model reference point and the edge point of the target object in the model data includes: Determining the model center point of the target object according to the model reference point and the edge point of the target object after movement.

5. The method according to claim 1, characterized in that, If the model center point is not located on the central axis of the viewfinder, the method further includes: Performing position adjustment on the target object according to the model center point and the central axis of the viewfinder so that the model center point is located on the central axis of the viewfinder; Determining a position adjustment strategy according to the projection of the target object after position adjustment on the plane where the viewfinder is located, and performing position adjustment of the target object according to the position adjustment strategy.

6. The method according to claim 3, wherein Determining a position adjustment strategy according to the projection of the target object on the plane where the viewfinder is located, and performing position adjustment of the target object according to the position adjustment strategy includes: Determining the distance between the edge of the projection and the viewfinder; Determining the adjustment distance of the target object along the central axis of the viewfinder according to the mapping relationship between the distance and the adjustment distance along the central axis direction of the viewfinder; Adjust the position of the target object along the central axis direction of the viewfinder according to the adjusted distance.

7. The method according to claim 3, wherein Determine a position adjustment strategy based on the projection of the target object on the plane where the viewfinder is located, and perform position adjustment of the target object according to the position adjustment strategy, including: Perform at least one position adjustment on the target object according to a set adjustment step size until the projection of the adjusted target object on the plane where the viewfinder is located is within a set area of the viewfinder; wherein, each position adjustment process includes the following steps: Determine the adjustment direction of the target object according to the determination result of whether the projection of the target object on the plane where the viewfinder is located is completely within the set area of the viewfinder; Perform position adjustment on the target object along the adjustment direction according to the adjustment step size; Determine whether the projection of the adjusted target object on the plane where the viewfinder is located is within the set area of the viewfinder; If it is determined that the projection of the adjusted target object on the plane where the viewfinder is located is within the set area of the viewfinder, the position adjustment ends; or, if it is determined that the projection of the adjusted target object on the plane where the viewfinder is located is not within the set area of the viewfinder, then enter the next position adjustment process.

8. The method according to claim 1, characterized in that Scale the area size occupied by the target object in the model picture according to the relative size relationship between the model size of the target object and the model sizes of each object in the target scene, to obtain a material picture of the target object, including: Determine the size gradient level of the model size of the target object in the target scene; the size gradient level is positively correlated with the model sizes of each object included in the target scene; Scale the area size occupied by the target object in the model picture according to the size gradient level to obtain a material picture of the target object; wherein, the area sizes occupied by each object included in the target scene in the material picture are positively correlated with the size gradient level.

9. The method according to claim 8, wherein Scale the area size occupied by the target object in the model picture according to the size gradient level to obtain a material picture of the target object, including: Determine the area size occupied by the target object in the material picture according to the size gradient level, wherein the area size occupied by the target object in the material picture is positively correlated with the size gradient level; Scale the area size occupied by the target object in the model picture to the area size occupied by the target object in the material picture; Add a set material template to the model picture to obtain the material picture.

10. The method according to claim 9, characterized in that, The determination of the size gradient level of the model size of the target object in the target scene includes: When the target object includes one object, perform size equivalent conversion on the maximum size of the one object, and determine the size gradient level of the target object according to the converted equivalent size; or, When the target object includes multiple objects, perform size equivalent conversion on the maximum size of the object combination formed by the multiple objects, and determine the size gradient level of the target object according to the converted equivalent size.

11. A method for displaying a material picture obtained by the method according to any one of claims 1 to 10, characterized in that, The method includes: In response to a trigger operation on a target object in a target scene displayed for a target application, obtain model material information of the target object, where the model material information includes a material picture of the target object; Display the material picture of the target object.

12. An apparatus for obtaining a material picture of a scene model, characterized in that, The device includes: A model picture acquisition unit, configured to determine whether the model center point of the object model corresponding to the target object in the target scene is located on the central axis of the viewfinder, where the viewfinder is a picture boundary set for acquiring model pictures of each object in the target scene; if the model center point is located on the central axis, determine a position adjustment strategy according to the projection of the target object on the plane where the viewfinder is located, and perform position adjustment on the target object according to the position adjustment strategy so that the projection is located in a set area of the viewfinder; obtain a model picture of the target object after position adjustment; where the area size occupied by the target object in the corresponding model picture is the same as the area sizes occupied by other objects in the target scene in their respective corresponding model pictures; An adaptation unit, configured to scale the area size occupied by the target object in the model picture according to the relative size relationship between the model size of the target object and the model sizes of each object in the target scene, so as to obtain a material picture of the target object.

13. A display device for material pictures, characterized in that, The device includes: A material information acquisition unit, configured to, in response to a trigger operation on a target object in a target scene displayed for a target application, obtain model material information of the target object, where the model material information includes a material picture of the target object; the material picture is obtained by the method according to any one of claims 1 to 10; A display unit, configured to display the material picture of the target object.

14. A computer device, including a memory, a processor, and a computer program stored on the memory and executable by the processor, characterized in that When the processor executes the computer program, the steps of the method according to any one of claims 1 to 10 or 11 are implemented.

15. A computer storage medium, on which computer program instructions are stored, characterized in that When the computer program instructions are executed by a processor, the steps of the method according to any one of claims 1 to 10 or 11 are implemented.

Citation Information

Patent Citations

  • Generating and displaying an actual sized interactive object

    CN107111998A

  • Image obtaining method and image obtaining apparatus

    CN107197156A