Information generation method and apparatus, device, computer readable medium and program product

By generating information about mapping relationships between the distance of the image acquisition device and the proportion of the object's viewing angle, the problem of low image acquisition efficiency in shooting irregular object models is solved, and efficient and accurate image acquisition is achieved.

WO2025130676A1PCT designated stage expired Publication Date: 2025-06-26BEIJING WODONG TIANJUN INFORMATION TECH CO LTD +1

Patent Information

Application Number
PCT/CN2024/137756
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-21
Filing Date
2024-12-09
Publication Date
2025-06-26

AI Technical Summary

Technical Problem

The prior art is difficult to effectively realize the proportion of object perspectives and image acquisition at various angles in shooting irregular object models, and the image acquisition project is large and the manpower and material resources are consumed too much.

Method used

By acquiring the rendering scene information and device parameter information of the image acquisition device, the three-dimensional object model is placed at the target position of the rendering scene space, the model marking point position and model size information surrounding the three-dimensional model are determined, and the mapping relationship information is generated that characterizes the distance of the image acquisition device and the proportion of the object's viewing angle.

Benefits of technology

The relationship between the proportion of the object's perspective and the placement distance of the image acquisition device is realized, which reduces the engineering quantity and manpower and material consumption of image acquisition, and improves the efficiency and quality of image acquisition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024137756_26062025_PF_FP_ABST
    Figure CN2024137756_26062025_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed in embodiments of the present disclosure are an information generation method and apparatus, a device, a computer readable medium and a program product. One specific embodiment of the method comprises: acquiring rendering scenario information and apparatus parameter information; placing a three-dimensional article model at a target position in a corresponding rendering scenario space; determining a model mark point position and model size information; and on the basis of the apparatus parameter information, the model mark point position and the model size information, generating relationship information representing a mapping relationship between an image acquisition apparatus distance and an article viewing angle proportion, wherein the image acquisition apparatus distance is a position distance between an apparatus position corresponding to an image acquisition apparatus and a model position corresponding to the three-dimensional article model.
Need to check novelty before this filing date? Find Prior Art

Description

Information generation method, apparatus, device, computer-readable medium, and program product

[0001] This application claims priority to Chinese patent application No. 202311774510.X filed on December 21, 2023, the contents of which are incorporated herein by reference. Technical Field

[0002] Embodiments of the present disclosure relate to the field of computer technology, and more particularly to information generation methods, devices, equipment, computer-readable media, and program products. Background Art

[0003] With the continuous development of various industries, the diverse display of detailed images of target items has become an urgent need. The method commonly used to generate image sequences corresponding to target items is to scale the corresponding object model to fit the screen.

[0004] However, the inventors have discovered that when the above method is used to generate an image sequence, the following technical problems often occur:

[0005] When photographing irregular object models, it is difficult to effectively capture images of the object model at all angles and in accordance with the object's viewing angle. Furthermore, the image acquisition process is labor-intensive and consumes excessive manpower and material resources.

[0006] The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art. Summary of the Invention

[0007] The content of this disclosure is used to briefly introduce concepts that will be described in detail in the detailed description section below. The content of this disclosure is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0008] Some embodiments of the present disclosure provide information generation methods, apparatuses, devices, computer-readable media, and program products.

[0009] In a first aspect, some embodiments of the present disclosure provide an information generation method, including: obtaining rendering scene information and device parameter information corresponding to an image acquisition device; placing a three-dimensional object model to be imaged at a target position in the rendering scene space corresponding to the above-mentioned rendering scene information; determining the model marker point position and model size information corresponding to an outer enclosing three-dimensional model, wherein the above-mentioned outer enclosing three-dimensional model is a three-dimensional model that surrounds the above-mentioned three-dimensional object model and whose model position is at the above-mentioned target position; generating relationship information representing the mapping relationship between the image acquisition device distance and the object perspective ratio based on the above-mentioned device parameter information, the above-mentioned model marker point position and the above-mentioned model size information, wherein the above-mentioned image acquisition device distance is the position distance between the device position corresponding to the above-mentioned image acquisition device and the model position corresponding to the above-mentioned three-dimensional object model.

[0010] Optionally, the above-mentioned relationship information characterizing the mapping relationship between the distance of the image acquisition device and the object perspective ratio is generated based on the above-mentioned device parameter information, the above-mentioned model marker point position and the above-mentioned model size information, including: determining the first full-perspective display position for the above-mentioned outer three-dimensional model based on the above-mentioned device parameter information, the above-mentioned model marker point position and the above-mentioned model size information; adjusting the device position corresponding to the above-mentioned image acquisition device according to the above-mentioned first full-perspective display position to obtain the second full-perspective display position for the above-mentioned three-dimensional object model; generating the above-mentioned relationship information based on the above-mentioned second full-perspective display position and the model position corresponding to the above-mentioned three-dimensional object model.

[0011] In a second aspect, some embodiments of the present disclosure provide an information generating device, including: a first acquisition unit, configured to acquire rendering scene information and device parameter information corresponding to an image acquisition device; a first placement unit, configured to place a three-dimensional object model to be imaged at a target position in the rendering scene space corresponding to the above-mentioned rendering scene information; a first determination unit, configured to determine the model marker point position and model size information corresponding to an outer enclosing three-dimensional model, wherein the above-mentioned outer enclosing three-dimensional model is a three-dimensional model that surrounds the above-mentioned three-dimensional object model and whose model position is at the above-mentioned target position; a generation unit, configured to generate relationship information characterizing the mapping relationship between the image acquisition device distance and the object perspective ratio based on the above-mentioned device parameter information, the above-mentioned model marker point position and the above-mentioned model size information, wherein the above-mentioned image acquisition device distance is the position distance between the device position corresponding to the above-mentioned image acquisition device and the model position corresponding to the above-mentioned three-dimensional object model.

[0012] Optionally, the generation unit can be configured to: determine the first full-view display position for the above-mentioned outer three-dimensional model based on the above-mentioned device parameter information, the above-mentioned model marker point position and the above-mentioned model size information; adjust the device position corresponding to the above-mentioned image acquisition device according to the above-mentioned first full-view display position to obtain the second full-view display position for the above-mentioned three-dimensional object model; generate the above-mentioned relationship information based on the above-mentioned second full-view display position and the model position corresponding to the above-mentioned three-dimensional object model.

[0013] In a third aspect, some embodiments of the present disclosure provide an image sequence generation method, including: obtaining pre-generated relationship information and preset object perspective ratio for an image acquisition device; determining a device placement position corresponding to the image acquisition device based on the above relationship information and the above preset object perspective ratio; placing the image acquisition device at the above device placement position in the rendering scene space corresponding to the rendering scene information; in response to determining that the placement of the image acquisition device is completed, using the image acquisition device to acquire an image sequence for a three-dimensional object model.

[0014] Optionally, the above-mentioned use of the above-mentioned image acquisition device to obtain an image sequence for the three-dimensional object model includes: determining the distance of the image acquisition device based on the above-mentioned relationship information and the above-mentioned preset object perspective ratio; determining at least one object model shooting angle corresponding to the above-mentioned three-dimensional object model; with the above-mentioned three-dimensional object model as the center and the above-mentioned image acquisition device distance as the radius, controlling the above-mentioned image acquisition device to shoot the above-mentioned three-dimensional object model at the above-mentioned at least one object model shooting angle to obtain the above-mentioned image sequence.

[0015] Optionally, the method further includes: fine-tuning the object perspective ratio of each image in the image sequence to obtain an adjusted image sequence; and generating object display resources corresponding to the target display form based on the adjusted image sequence.

[0016] In a fourth aspect, some embodiments of the present disclosure provide an image sequence generating device, comprising: a second acquisition unit, configured to acquire pre-generated relationship information and preset object perspective ratio for the image acquisition device; a second determination unit, configured to determine the device placement position corresponding to the image acquisition device based on the above-mentioned relationship information and the above-mentioned preset object perspective ratio; a second placement unit, configured to place the image acquisition device at the above-mentioned device placement position in the rendering scene space corresponding to the rendering scene information; and a third acquisition unit, configured to acquire an image sequence for a three-dimensional object model using the image acquisition device in response to determining that the placement of the image acquisition device is completed.

[0017] Optionally, the third acquisition unit can be configured to: determine the distance of the image acquisition device based on the above-mentioned relationship information and the above-mentioned preset object perspective ratio; determine at least one object model shooting angle corresponding to the above-mentioned three-dimensional object model; with the above-mentioned three-dimensional object model as the center and the above-mentioned image acquisition device distance as the radius, control the above-mentioned image acquisition device to shoot the above-mentioned three-dimensional object model at the above-mentioned at least one object model shooting angle to obtain the above-mentioned image sequence.

[0018] Optionally, the apparatus further comprises: fine-tuning the object viewing angle ratio of each image in the image sequence to obtain an adjusted image sequence; and generating object display resources corresponding to the target display form according to the adjusted image sequence.

[0019] In a fifth aspect, some embodiments of the present disclosure provide an electronic device comprising: one or more processors; a storage device on which one or more programs are stored, and when the one or more programs are executed by one or more processors, the one or more processors implement the method described in any one of the implementation methods in the first and third aspects.

[0020] In a sixth aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method described in any one of the implementation modes of the first and third aspects is implemented.

[0021] In a seventh aspect, some embodiments of the present disclosure provide a computer program product, including a computer program, which, when executed by a processor, implements the method described in any one of the implementation modes of the first and third aspects above. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0023] FIG1 is a schematic diagram of an application scenario of an information generation method according to some embodiments of the present disclosure;

[0024] FIG2 is a flow chart of some embodiments of the information generation method according to the present disclosure;

[0025] FIG3 is a flow chart of other embodiments of the information generating method according to the present disclosure;

[0026] FIG4 is a flowchart of some embodiments of an image sequence generation method according to the present disclosure;

[0027] FIG5 is a schematic structural diagram of some embodiments of an information generating device according to the present disclosure;

[0028] FIG6 is a schematic structural diagram of some embodiments of an image sequence generating device according to the present disclosure;

[0029] FIG7 is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION

[0030] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0031] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure may be combined with each other.

[0032] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0033] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0034] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0035] Before performing operations such as the collection, storage, and use of the information involved in this disclosure (such as rendering scene information and information related to three-dimensional object models), relevant organizations or individuals must fulfill their obligations, including conducting information security impact assessments, fulfilling their obligations to inform information subjects, and obtaining prior authorization and consent from information subjects.

[0036] The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0037] FIG1 is a schematic diagram of an application scenario of an information generation method according to some embodiments of the present disclosure.

[0038] In the application scenario of Figure 1 , electronic device 101 can first obtain rendering scene information 102 and device parameter information 104 corresponding to image acquisition device 103. In this application scenario, device parameter information 104 may include device parameter information 1041, device parameter information 1042, and device parameter information 1043. Device parameter information 1041 may include "FOV parameter: 80." Device parameter information 1042 may include "Near parameter: 20." Device parameter information 1043 may include "Far parameter: 30." Then, electronic device 101 may place the 3D object model 107 to be imaged at target location 106 in the rendering scene space 105 corresponding to the rendering scene information 102. Furthermore, electronic device 101 may determine model marker locations 109 and model size information 110 corresponding to the surrounding 3D model 108. The surrounding 3D model 108 is a 3D model that surrounds the 3D object model 107 and is located at the target location 106. In this application scenario, the model landmark position 109 may be "model landmark position: (20, 3, 54)." The model size information 110 may be "model length: 20; model width: 39; model height: 23." Finally, the electronic device 101 may generate relationship information 111 representing the mapping relationship between the image acquisition device distance and the object viewport ratio based on the device parameter information 104, the model landmark position 109, and the model size information 110. The image acquisition device distance is the distance between the device position of the image acquisition device 103 and the model position of the three-dimensional object model 107. In this application scenario, the relationship information 111 may include: relationship 1111, relationship 1112, and relationship 1113. Relationship 1111 may be "20~0.6." Relationship 1112 may be "30~0.4." Relationship 1113 may be "40~0.23." Relationship 1111 indicates that an image acquisition device distance of 20 is mapped to an object viewport ratio of 0.6. Relationship 1112 indicates that there is a mapping relationship between an image acquisition device distance of 30 and an object view angle ratio of 0.4. Relationship 1113 indicates that there is a mapping relationship between an image acquisition device distance of 40 and an object view angle ratio of 0.23.

[0039] It should be noted that the electronic device 101 can be hardware or software. When the electronic device is hardware, it can be implemented as a distributed cluster consisting of multiple servers or terminal devices, or it can be implemented as a single server or a single terminal device. When the electronic device is embodied as software, it can be installed in the hardware devices listed above. It can be implemented as multiple software or software modules for providing distributed services, for example, or it can be implemented as a single software or software module. No specific limitation is made here.

[0040] It should be understood that the number of electronic devices in FIG1 is merely illustrative and any number of electronic devices may be provided according to implementation requirements.

[0041] 2, a process 200 of some embodiments of the information generation method according to the present disclosure is shown. The information generation method includes the following steps:

[0042] Step 201: Obtain rendering scene information and device parameter information corresponding to an image acquisition device.

[0043] In some embodiments, the execution entity of the above-described information generation method (e.g., the electronic device 101 shown in FIG. 1 ) can obtain rendering scene information and device parameter information corresponding to the image acquisition device via a wired or wireless connection. The rendering scene information may be scene information for the background rendering scene of the three-dimensional object model. That is, the background corresponding to the images in the subsequently acquired image sequence is a certain scene content in the rendering scene. In practice, the scene information may be a unique identifier of the scene. The image acquisition device may be a device that captures images. For example, the image acquisition device may be a camera. The device parameter information may be pre-set parameter information for the image acquisition device. In practice, the device parameter information may be camera parameter information. For example, the device parameter information may include, but is not limited to, at least one of the following: field of view (FOV), near parameter (the distance from the camera at which rendering is performed), far parameter (the distance from the camera at which rendering is terminated), bottom parameter (the upper boundary parameter of the rendering space), and top parameter (the upper boundary parameter of the rendering space). The three-dimensional object model may be a 3D model of the object.

[0044] Step 202: Place the three-dimensional object model to be imaged at a target position in the rendering scene space corresponding to the rendering scene information.

[0045] In some embodiments, the execution entity may place the 3D object model whose image is to be captured at a target location in the rendering scene space corresponding to the rendering scene information. The rendering scene space may be the scene space corresponding to the rendering scene information. The target location may be a spatial point location corresponding to a target spatial point in the rendering scene space. For example, the target location may be the location of an origin in the rendering scene space. Specifically, the origin in the rendering scene space may be pre-set.

[0046] Step 203: Determine the model marker position and model size information corresponding to the outer surrounding three-dimensional model.

[0047] In some embodiments, the execution entity may determine the model marker point position and model size information corresponding to the outer enclosing three-dimensional model. The outer enclosing three-dimensional model is a three-dimensional model that encloses the three-dimensional object model and whose model position is at the target position. The outer enclosing three-dimensional model may be an outer enclosing model of various shapes. The model marker point position may be a position in the outer enclosing three-dimensional model that has a marking purpose. For example, the model marker point position may be the model center point position or the model center of gravity point position. The model size information may be information that characterizes the model size. In practice, the model size information may be model space information. If the outer enclosing three-dimensional model is a spherical three-dimensional model, the model size information may be the radius of the sphere.

[0048] As an example, the execution entity may determine the model landmark point positions and model size information corresponding to the surrounding three-dimensional model by means of point cloud measurement.

[0049] Step 204 : generating relationship information representing a mapping relationship between the image acquisition device distance and the object view angle ratio based on the device parameter information, the model landmark point positions, and the model size information.

[0050] In some embodiments, the execution entity may generate relationship information representing a mapping relationship between the image acquisition device distance and the object viewport ratio based on the device parameter information, the model landmark positions, and the model size information. The image acquisition device distance is the distance between the device position of the image acquisition device and the model position of the three-dimensional object model. The object viewport ratio may be the viewport ratio of the three-dimensional object model in the image.

[0051] As an example, first, the execution entity may input device parameter information, the model marker position, and model size information into the multi-layer serial connection model to generate relationship information.

[0052] The aforementioned embodiments of the present disclosure have the following beneficial effects: Through the information generation methods of some embodiments of the present disclosure, the relationship between the object's viewpoint ratio and the placement distance of the image acquisition device can be accurately and effectively determined. This allows for the subsequent efficient and generative acquisition of corresponding image sequences by flexibly setting the object's viewpoint ratio. Specifically, the inability to effectively acquire the relevant image sequences is due to the inability to effectively capture images of irregular object models at the object's viewpoint ratio and at various angles. Furthermore, the image acquisition process is labor-intensive and consumes excessive manpower and material resources. To address this, the information generation methods of some embodiments of the present disclosure first acquire rendering scene information and device parameter information corresponding to the image acquisition device. The acquired rendering scene information serves as the image background in subsequent image sequences to fully reflect the value of the three-dimensional object model. The acquired device parameter information facilitates the subsequent generation of relationship information. The three-dimensional object model to be imaged is then placed at a target position in the rendering scene space corresponding to the rendering scene information, thereby fixing the position of the three-dimensional object model. This allows for the subsequent efficient generation of corresponding relationship information by moving the image acquisition device. Then, the model marker point locations and model size information corresponding to the surrounding 3D model are determined. The surrounding 3D model is a 3D model that surrounds the 3D object model and is located at the target location. By mapping the 3D object model to the surrounding model, the issue of ineffective determination of the object's viewing angle ratio due to the irregularity of the 3D object model can be effectively resolved. Furthermore, the surrounding 3D model allows for a more accurate subsequent measurement of the correspondence between the 3D object model's corresponding object viewing angle size and the image acquisition device. The determined model marker point locations and model size information also facilitate the subsequent measurement of the correspondence between the 3D object model's corresponding object viewing angle size and the image acquisition device. Finally, based on the device parameter information, the model marker point locations, and the model size information, relationship information representing the mapping between the image acquisition device distance and the object viewing angle ratio can be effectively and accurately generated. The image acquisition device distance is the distance between the device position of the image acquisition device and the model position of the 3D object model. In summary, by setting an outer surrounding three-dimensional model for the three-dimensional object model, as well as the position mapping relationship and image projection relationship between the outer surrounding three-dimensional model and the image acquisition device, the relationship information between the object viewing angle ratio and the placement distance of the image acquisition device can be accurately and effectively determined, so that the corresponding image sequence can be efficiently and generatively acquired by flexibly setting the object viewing angle ratio.

[0053] Further referring to FIG3 , a process 300 of another embodiment of the information generation method according to the present disclosure is shown. The information generation method includes the following steps:

[0054] Step 301: Obtain rendering scene information and device parameter information corresponding to an image acquisition device.

[0055] Step 302: Place the three-dimensional object model to be imaged at a target position in the rendering scene space corresponding to the rendering scene information.

[0056] Step 303: Determine the model marker point positions and model size information corresponding to the outer surrounding three-dimensional model.

[0057] In some embodiments, the specific implementation of steps 301-303 and the technical effects brought about by them can refer to steps 201-203 in the embodiment corresponding to Figure 2, and will not be repeated here.

[0058] Step 304 : Determine a first full-view display position for the outer surrounding three-dimensional model based on the device parameter information, the model marker position, and the model size information.

[0059] In some embodiments, an execution entity (e.g., electronic device 101 shown in FIG. 1 ) may determine a first full-view display position for the outer-surrounding 3D model based on the device parameter information, the model marker locations, and the model size information. The first full-view display position may refer to the placement of the image capture device such that the outer-surrounding 3D model is fully displayed.

[0060] As an example, first, the execution entity may determine the device shooting angle size information based on the device parameter information. Then, model outline information and model position information are generated for the model marker point position and the above-mentioned model size information. The model marker point position may be model position information. The model outline information may be generated based on the model size information. Finally, while maintaining the model position information corresponding to the outer surrounding three-dimensional model unchanged, the image acquisition device is moved so that the model outline corresponding to the outer surrounding three-dimensional model is within the device shooting angle corresponding to the device shooting angle size information, and the device shooting angle can maximize the display of the outer surrounding three-dimensional model, thereby obtaining the position corresponding to the image acquisition device as the first full-view display position.

[0061] As another example, a fully connected layer with at least one constraint condition is obtained. The at least one constraint condition may include: a constraint condition characterizing that the position of the model marker of the outer enclosing three-dimensional model does not change, a constraint condition characterizing that the model contour corresponding to the outer enclosing three-dimensional model is at the device shooting angle corresponding to the device shooting angle size information, and the device shooting angle can maximize the display of the outer enclosing three-dimensional model. The model contour is determined based on the model size information. Then, the above-mentioned device parameter information, the above-mentioned model marker position and the above-mentioned model size information are input into the fully connected layer with at least one constraint condition to output the first full-view display position.

[0062] Step 305 : adjusting the device position corresponding to the image acquisition device according to the first full-view display position to obtain a second full-view display position for the three-dimensional object model.

[0063] In some embodiments, the execution entity may adjust the position of the image capture device based on the first full-view display position to obtain a second full-view display position for the three-dimensional object model. The second full-view display position may be the placement position of the image capture device relative to the three-dimensional object model.

[0064] As an example, the above-mentioned execution entity can instruct the image acquisition device to continue to move the position of the image acquisition device on the basis of the first full-view display position, so that the model outline corresponding to the three-dimensional object model is at the device shooting angle corresponding to the device shooting angle size information, and the device shooting angle can maximize the display of the three-dimensional object model, and obtain the position corresponding to the image acquisition device as the second full-view display position.

[0065] Step 306 : generating the relationship information according to the second full-view display position and the corresponding model position of the three-dimensional object model.

[0066] In some embodiments, the execution entity may generate the relationship information according to the second full-view display position and the corresponding model position of the three-dimensional object model.

[0067] As an example, the execution entity may first instruct the image capture device to continue moving the image capture device from the first full-view display position, such that the model outline corresponding to the 3D object model is within the device's shooting angle corresponding to the device's shooting angle size information, and the device's shooting angle can cover multiple object view ratios, thereby displaying the 3D object model. This results in multiple positions corresponding to the image capture device. The multiple positions are then mapped and associated with the corresponding multiple object view ratios to obtain multiple mapping relationship information. Finally, the multiple mapping relationship information is determined as relationship information.

[0068] As can be seen from FIG3 , compared to the description of some embodiments corresponding to FIG2 , the information generation method process 300 of some embodiments corresponding to FIG3 first determines a first full-view display position for the surrounding three-dimensional model to ensure that, regardless of how the image acquisition device subsequently acquires images, the image acquisition device will not fail to effectively acquire the corresponding image sequence due to irregularities in the model. Then, based on the first full-view display position, the device position corresponding to the image acquisition device is adjusted to obtain a second full-view display position for the three-dimensional object model. Determining the second full-view display position further determines the projection of the three-dimensional object model relative to the image acquisition device, allowing for the subsequent adaptive generation of the corresponding image sequence based on the object's viewing angle. Finally, based on the second full-view display position and the corresponding model position of the three-dimensional object model, the aforementioned relationship information can be accurately generated. In summary, by sequentially determining the first full-view display position and the second full-view display position, the relationship information between the image acquisition device and the three-dimensional object model can be subsequently determined hierarchically and accurately.

[0069] 4, a process 400 of some embodiments of the image sequence generation method according to the present disclosure is shown. The image sequence generation method includes the following steps:

[0070] Step 401: Obtain pre-generated relationship information and preset object view ratio for the image acquisition device.

[0071] In some embodiments, the execution entity of the above-described image sequence generation method (e.g., electronic device 101 shown in FIG1 ) can obtain pre-generated relationship information and a preset object perspective ratio for the image acquisition device via a wired or wireless connection. The preset object perspective ratio can be an object perspective ratio set based on image acquisition requirements. For example, the object perspective ratio can be 0.7.

[0072] Step 402: Determine the device placement position corresponding to the image acquisition device according to the relationship information and the preset object viewing angle ratio.

[0073] In some embodiments, the execution entity may determine the device placement position corresponding to the image acquisition device based on the relationship information and the preset object viewing angle ratio.

[0074] As an example, the execution entity may first determine the distance of the image acquisition device using the relationship information and a preset object viewing angle ratio. Then, based on the image acquisition device distance, a placement trajectory for the image acquisition device is generated. Finally, the device position corresponding to the placement trajectory is determined as the device placement location.

[0075] Step 403: Place the image acquisition device at the device placement position in the rendering scene space corresponding to the rendering scene information.

[0076] In some embodiments, the execution entity may place the image acquisition device at the device placement position in the rendering scene space corresponding to the rendering scene information.

[0077] Step 404 : In response to determining that the image acquisition device has been placed, the image acquisition device is used to acquire an image sequence for the three-dimensional object model.

[0078] In some embodiments, in response to determining that the image acquisition device has been placed, the execution entity may utilize the image acquisition device to acquire an image sequence for the three-dimensional object model.

[0079] As an example, the execution entity may set a shooting interval corresponding to the image acquisition device and instruct the three-dimensional object model to rotate according to a target speed to perform shooting processing on the three-dimensional object model to obtain an image sequence.

[0080] In some optional implementations of some embodiments, the above-mentioned acquisition of an image sequence for a three-dimensional object model using the above-mentioned image acquisition device may include the following steps:

[0081] The first step is to determine the distance of the image acquisition device based on the above relationship information and the above preset object viewing angle ratio.

[0082] As an example, the execution entity may query the image acquisition device distance corresponding to the preset object viewing angle ratio from the relationship information.

[0083] The second step is to determine at least one object model shooting angle corresponding to the three-dimensional object model. The at least one object model shooting angle can be a pre-set angle. The object model shooting angle can be between 0 and 720 degrees. For example, the at least one object model shooting angle includes: an angle of 30 degrees from the horizontal plane and an angle of 50 degrees from the horizontal plane.

[0084] The third step is to control the image acquisition device to shoot the three-dimensional object model at at least one of the object model shooting angles, with the three-dimensional object model as the center and the distance of the image acquisition device as the radius, to obtain the image sequence.

[0085] In some optional implementations of some embodiments, after step 404, the steps further include:

[0086] The first step is to fine-tune the object perspective ratio of each image in the above image sequence to obtain an adjusted image sequence. The object perspective ratio of the image can be adaptively adjusted based on the expected effect of the image.

[0087] As an example, the execution entity may input each image in the image sequence into an image aesthetic adjustment model to generate an adjusted image, thereby obtaining an adjusted image sequence. The image aesthetic adjustment model may be a convolutional neural network model with multiple layers connected in series.

[0088] The second step is to generate item display resources corresponding to the target display format based on the adjusted image sequence. The target display format can be a predetermined display format. In practice, the display format can be one of the following: video display format, animated image display format, or virtual reality (VR) display format. The corresponding item display resources can be one of the following: video display format resources, animated image display format resources, or virtual reality display format resources.

[0089] As an example, the execution subject may generate the item display resources corresponding to the target display format according to the adjusted image sequence and using the corresponding item display resource generation method.

[0090] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the image sequence generation method of some embodiments of the present disclosure, the corresponding image sequence can be obtained efficiently and generatively by flexibly setting the object perspective ratio.

[0091] With further reference to FIG5 , as an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of an information generating device. These device embodiments correspond to the method embodiments shown in FIG2 , and the information generating device can be specifically applied to various electronic devices.

[0092] As shown in FIG5 , an information generating device 500 includes: a first acquiring unit 501, a first placing unit 502, a first determining unit 503, and a generating unit 504. The first acquiring unit 501 is configured to acquire rendering scene information and device parameter information corresponding to an image capturing device; the first placing unit 502 is configured to place a three-dimensional object model to be image captured at a target position in the rendering scene space corresponding to the rendering scene information; the first determining unit 503 is configured to determine the model marker point positions and model size information corresponding to an enclosing three-dimensional model, wherein the enclosing three-dimensional model is a three-dimensional model that surrounds the three-dimensional object model and is located at the target position; and the generating unit 504 is configured to generate relationship information representing a mapping relationship between the image capturing device distance and the object viewport ratio based on the device parameter information, the model marker point positions, and the model size information, wherein the image capturing device distance is the positional distance between the device position corresponding to the image capturing device and the model position corresponding to the three-dimensional object model.

[0093] In some optional implementations of some embodiments, the generation unit 504 can be further configured to: determine the first full-view display position for the above-mentioned outer three-dimensional model based on the above-mentioned device parameter information, the above-mentioned model marker point position and the above-mentioned model size information; adjust the device position corresponding to the above-mentioned image acquisition device based on the above-mentioned first full-view display position to obtain the second full-view display position for the above-mentioned three-dimensional object model; generate the above-mentioned relationship information based on the above-mentioned second full-view display position and the model position corresponding to the above-mentioned three-dimensional object model.

[0094] It is understandable that the units described in the information generating device 500 correspond to the steps in the method described with reference to Figure 2. Therefore, the operations, features, and beneficial effects described above for the method are also applicable to the information generating device 500 and the units included therein, and will not be repeated here.

[0095] Further referring to FIG6 , as an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of an image sequence generating device. These device embodiments correspond to the method embodiments shown in FIG4 , and the image sequence generating device can be specifically applied to various electronic devices.

[0096] As shown in FIG6 , an image sequence generation device 600 includes: a second acquisition unit 601, a second determination unit 602, a second placement unit 603, and a third acquisition unit 604. The second acquisition unit 601 is configured to acquire pre-generated relationship information and preset object view ratios for image acquisition devices; the second determination unit 602 is configured to determine a device placement position corresponding to the image acquisition device based on the relationship information and the preset object view ratios; the second placement unit 603 is configured to place the image acquisition device at the device placement position in the rendering scene space corresponding to the rendering scene information; and the third acquisition unit 604 is configured to, in response to determining that the image acquisition device has been placed, use the image acquisition device to acquire an image sequence for a three-dimensional object model.

[0097] In some optional implementations of some embodiments, the third acquisition unit 604 can be further configured to: determine the distance of the image acquisition device based on the above-mentioned relationship information and the above-mentioned preset object perspective ratio; determine at least one object model shooting angle corresponding to the above-mentioned three-dimensional object model; with the above-mentioned three-dimensional object model as the center and the above-mentioned image acquisition device distance as the radius, control the above-mentioned image acquisition device to shoot the above-mentioned three-dimensional object model at the above-mentioned at least one object model shooting angle to obtain the above-mentioned image sequence.

[0098] In some optional implementations of some embodiments, the image sequence generation apparatus 600 further includes a fine-tuning unit and a resource generation unit (not shown). The fine-tuning unit may be configured to fine-tune the object perspective ratio of each image in the image sequence to generate an adjusted image sequence. The resource generation unit may be configured to generate object display resources corresponding to the target display format based on the adjusted image sequence.

[0099] It is understood that the units described in the image sequence generating device 600 correspond to the steps in the method described with reference to FIG4 . Therefore, the operations, features, and beneficial effects described above with respect to the method are also applicable to the image sequence generating device 600 and the units included therein, and will not be further described here.

[0100] 7, which shows a schematic diagram of an electronic device 700 suitable for implementing some embodiments of the present disclosure (e.g., electronic device 101 in FIG1). The electronic device shown in FIG7 is merely an example and should not limit the functionality or scope of use of the embodiments of the present disclosure.

[0101] As shown in FIG7 , electronic device 700 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 701, which can perform various appropriate actions and processes based on programs stored in a read-only memory 702 or programs loaded from a storage device 708 into a random access memory 703. Random access memory 703 also stores various programs and data required for the operation of electronic device 700. Processing device 701, read-only memory 702, and random access memory 703 are interconnected via a bus 704. An input / output interface 705 is also connected to bus 704.

[0102] Typically, the following devices may be connected to the input / output interface 705: an input device 706 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 707 including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; a storage device 708 including, for example, a magnetic tape, hard disk, etc.; and a communication device 709. The communication device 709 may allow the electronic device 700 to communicate with other devices wirelessly or wired to exchange data. Although FIG7 illustrates an electronic device 700 with various devices, it should be understood that not all illustrated devices are required to be implemented or present. More or fewer devices may alternatively be implemented or present. Each block shown in FIG7 may represent a single device, or may represent multiple devices as needed.

[0103] In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program comprising program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from a network via the communication device 709, or installed from the storage device 708, or installed from the read-only memory 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the method of some embodiments of the present disclosure are performed.

[0104] It should be noted that in some embodiments of the present disclosure, the computer-readable medium described above may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. Computer-readable storage media may include, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or components, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device, or component. Furthermore, in some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. This propagated data signal may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wire, optical cable, RF (radio frequency), or any suitable combination thereof.

[0105] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0106] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device. The computer-readable medium carries one or more programs, and when executed by the electronic device, the electronic device: obtains rendering scene information and device parameter information corresponding to the image acquisition device; places the three-dimensional object model to be imaged at a target position in the rendering scene space corresponding to the rendering scene information; determines the model marker point position and model size information corresponding to the outer surrounding three-dimensional model, wherein the outer surrounding three-dimensional model is a three-dimensional model that surrounds the three-dimensional object model and has a model position at the target position; generates relationship information representing the mapping relationship between the image acquisition device distance and the object perspective ratio based on the device parameter information, the model marker point position, and the model size information, wherein the image acquisition device distance is the position distance between the device position corresponding to the image acquisition device and the model position corresponding to the three-dimensional object model. Obtain pre-generated relationship information and preset object viewing angle ratio for the image acquisition device; determine a device placement position corresponding to the image acquisition device based on the relationship information and the preset object viewing angle ratio; place the image acquisition device at the device placement position in the rendering scene space corresponding to the rendering scene information; in response to determining that the image acquisition device has been placed, use the image acquisition device to acquire an image sequence for the three-dimensional object model.

[0107] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0108] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0109] The units described in some embodiments of the present disclosure may be implemented in software or in hardware. The units described may also be provided in a processor. For example, they may be described as follows: a processor includes a first acquisition unit, a first placement unit, a first determination unit, and a generation unit. The names of these units do not, in some cases, constitute limitations on the units themselves. For example, the first acquisition unit may also be described as a "unit for acquiring rendering scene information and device parameter information corresponding to the image acquisition device."

[0110] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0111] Some embodiments of the present disclosure further provide a computer program product, including a computer program, which implements any of the above-mentioned information generation methods or image sequence generation methods when executed by a processor.

[0112] The above descriptions are merely some preferred embodiments of the present disclosure and illustrate the underlying technical principles. Those skilled in the art should understand that the scope of the invention encompassed by the embodiments of the present disclosure is not limited to technical solutions formed by specific combinations of the aforementioned technical features. It also encompasses other technical solutions formed by any combination of the aforementioned technical features or their equivalents, without departing from the aforementioned inventive concept. For example, a technical solution formed by replacing the aforementioned features with (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure.

Claims

1. A method for generating information, comprising: Acquire rendering scene information and device parameter information corresponding to the image acquisition device; Placing the three-dimensional object model to be imaged at a target position in the rendering scene space corresponding to the rendering scene information; Determine the model marker point position and model size information corresponding to the outer surrounding three-dimensional model, wherein the outer surrounding three-dimensional model is a three-dimensional model surrounding the three-dimensional object model and having a model position at the target position; Relationship information characterizing the mapping relationship between the image acquisition device distance and the object perspective ratio is generated based on the device parameter information, the model landmark point position and the model size information, wherein the image acquisition device distance is the position distance between the device position corresponding to the image acquisition device and the model position corresponding to the three-dimensional object model.

2. The method according to claim 1, wherein: The generating, according to the device parameter information, the model marker point position and the model size information, relationship information representing the mapping relationship between the image acquisition device distance and the object viewing angle ratio includes: Determining a first full-view display position for the outer surrounding three-dimensional model according to the device parameter information, the model marker point position and the model size information; According to the first full-view display position, adjusting the device position corresponding to the image acquisition device to obtain a second full-view display position for the three-dimensional object model; The relationship information is generated according to the second full-view display position and the corresponding model position of the three-dimensional object model.

3. A method for generating an image sequence, comprising: Obtaining pre-generated relationship information and preset object viewing angle ratio for the image acquisition device; Determine a device placement position corresponding to the image acquisition device according to the relationship information and the preset object viewing angle ratio; Placing the image acquisition device at the device placement position in the rendering scene space corresponding to the rendering scene information; In response to determining that the placement of the image acquisition device is complete, the image acquisition device is used to acquire an image sequence for the three-dimensional object model.

4. The method according to claim 3, wherein: The method of using the image acquisition device to acquire an image sequence for the three-dimensional object model includes: Determine the distance of the image acquisition device according to the relationship information and the preset object viewing angle ratio; Determine at least one object model shooting angle corresponding to the three-dimensional object model; With the three-dimensional object model as the center and the distance of the image acquisition device as the radius, the image acquisition device is controlled to photograph the three-dimensional object model at the at least one object model shooting angle to obtain the image sequence.

5. The method according to claim 3, wherein: The method further comprises: Fine-tuning the object perspective ratio for each image in the image sequence to obtain an adjusted image sequence; According to the adjusted image sequence, an item display resource corresponding to the target display form is generated.

6. An information generating device, comprising: A first acquisition unit is configured to acquire rendering scene information and device parameter information corresponding to an image acquisition device; A first placement unit is configured to place the three-dimensional object model to be imaged at a target position in the rendering scene space corresponding to the rendering scene information; A first determining unit is configured to determine the model marker point position and model size information corresponding to the outer surrounding three-dimensional model, wherein the outer surrounding three-dimensional model is a three-dimensional model surrounding the three-dimensional object model and having a model position at the target position; A generating unit is configured to generate relationship information representing a mapping relationship between an image acquisition device distance and an object perspective ratio according to the device parameter information, the model landmark point position and the model size information, wherein the image acquisition device distance is a position distance between a device position corresponding to the image acquisition device and a model position corresponding to the three-dimensional object model.

7. An image sequence generating device, comprising: A second acquisition unit is configured to acquire pre-generated relationship information and preset object view ratio for the image acquisition device; A second determining unit is configured to determine a device placement position corresponding to the image acquisition device according to the relationship information and the preset object viewing angle ratio; A second placement unit is configured to place the image acquisition device at the device placement position in the rendering scene space corresponding to the rendering scene information; The third acquisition unit is configured to acquire an image sequence for the three-dimensional object model using the image acquisition device in response to determining that the image acquisition device has been placed.

8. An electronic device comprising: one or more processors; a storage device having one or more programs stored thereon, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 5.

9. A computer readable medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.

10. A computer program product, comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Three-dimensional scene building method and device

    CN113781628A

  • Article display video determination method and device and storage medium

    CN115965446A

  • Three-dimensional model loading method and device and storage medium

    CN116721197A

  • Image display method and device, equipment and storage medium

    CN116820310A

  • Rapid automatic modeling method and device for cable channel equipment, equipment and medium

    CN117688708A

Cited By

  • Multimedia resource generation method and device, electronic equipment and storage medium

    CN120448564A