A visual data delivery system, a display system and methods of operating the same
Patent Information
- Authority / Receiving Office
- IN · IN
- Patent Type
- Patents
- Current Assignee / Owner
- KONINKLIJKE PHILIPS NV
- Filing Date
- 2024-01-23
- Publication Date
- 2026-07-14
AI Technical Summary
Current visual data delivery systems face inefficiencies in processing and displaying 3D images, as they require significant data storage and processing for 3D models, and lack effective methods for user-controlled 2D image plane adjustments.
A computer-implemented method that processes 3D images to generate 2D image data and 3D models, allowing for efficient data reduction and user-controlled 2D image plane adjustments, enabling seamless display and interaction with 3D content.
This method reduces data processing requirements, enhances display efficiency, and allows users to interactively adjust 2D image planes, improving the visual data delivery and display system's performance and user experience.
Abstract
Description
1. A computer-implemented method of operating a visual data delivery system (3), themethod comprising: processing (901) a sequence of 3-dimensional, 3D, images of a body to generate first 2-dimensional, 2D, image data representing a first sequence of 2D images of the body, wherein the 2D5 images are images of the body in a 2D image plane through the 3D images, and wherein an amount ofdata representing the first 2D image data is less than an amount of data representing the 3D images fromwhich the first 2D image data is generated; sending (903) the first 2D image data to a display system (4) for display of the firstsequence of 2D images of the body by the display system (4);10 processing the sequence of 3D images to generate one or more 3D models representing the body or a part of the bodyfrom the sequence of 3D images, and send the one or more 3D models to the display system (4); or identify a type of body or type of body part shown in the sequence of 3Dimages, and send an indication of the identified type of body or type of body part, or an indication of one15 or more predetermined 3D models corresponding to the identified type of body or type of body part, tothe display system (4); receiving (905) a 2D image plane adjustment indication from the display system (4),wherein the 2D image plane adjustment indication indicates a required rotation and / or translation of the2D image plane;20 processing (907) the sequence of 3D images and / or a further sequence of 3D images togenerate second 2D image data representing a second sequence of 2D images of the body, wherein the 2Dimages in the second sequence of 2D images are images of the body in the rotated and / or translated 2Dimage plane; and sending (909) the second 2D image data to the display system (4) for display of the25 second sequence of 2D images of the body by the display system (4).2. A method as claimed in claim 1, wherein the identified type of body or identified type ofbody part is associated with a predetermined 3D model corresponding to the identified type of body oridentified type of body part stored at the display system (4).303. A method as claimed in any of claims 1-2, wherein the one or more 3D models comprisesan indication of a current orientation and / or current position of the 2D image plane with respect to thebody, and wherein the received 2D image plane adjustment indication is a rotation and / or translation of25the indication of the 2D image plane in the one or more 3D models, or a rotation and / or translation of theone or more 3D models.4. A computer-implemented method of operating a display system (4), the method5 comprising: receiving (1001) first 2-dimensional, 2D, image data representing a first sequence of 2Dimages of a body from a visual data delivery system (3), wherein the 2D images are images of the body ina 2D image plane through 3-dimensional, 3D, images of the body; displaying (1003) the first sequence of 2D images;10 receiving one or more 3D models, and displaying the one or more 3D models for the bodyor a part of the body shown in the first sequence of 2D images; OR receiving an indication of theidentified type of body or type of body part, or an indication of one or more predetermined 3D modelscorresponding to the identified type of body or type of body part, and displaying one or morepredetermined 3D models corresponding to of the identified type of body or type of body part, or the15 indication of one or more predetermined 3D models corresponding to the identified type of body or typeof body part receiving (1005) a user input from a user of the display system, wherein the user inputindicates a required rotation and / or translation of the 2D image plane; sending (1007) a 2D image plane adjustment indication to the visual data delivery system,20 wherein the 2D image plane adjustment indication indicates the required rotation and / or translation of the2D image plane; receiving (1009) second 2D image data representing a second sequence of 2D images ofthe body from the visual data delivery system (3), wherein the second sequence of 2D images are imagesof the body in the rotated and / or translated 2D image plane; and25 displaying (1011)the second sequence of 2D images.5. A method as claimed in claim 4, wherein the user input indicating the required rotationand / or translation of the 2D image plane is received as a user input that rotates and / or translates adisplayed 3D model.306. A computer program product comprising a computer readable medium having computerreadable code embodied therein, the computer readable code being configured such that, on execution bya suitable computer or processor, the computer or processor is caused to perform the method of any of
Claims
claims 1-5.
357. A visual data delivery system (3), the visual data delivery system (3) comprising aprocessing unit (52) and interface circuitry (56), the visual data delivery system (3) configured to:26 process (901), using the processing unit (52), a sequence of 3-dimensional, 3D, images ofa body to generate first 2-dimensional, 2D, image data representing a first sequence of 2D images of thebody, wherein the 2D images are images of the body in a 2D image plane through the 3D images, andwherein an amount of data representing the first 2D image data is less than an amount of data5 representing the 3D images from which the first 2D image data is generated; send (903), via the interface circuitry (56), the first 2D image data to a display system (4)for display of the first sequence of 2D images of the body by the display system (4); process the sequence of 3D images to generate, using the processing unit (52), one or more 3D models representing10 the body or a part of the body from the sequence of 3D images; and send, via the interface circuitry (56),the one or more 3D models to the display system (4); OR identify, using the processing unit (52), a type of body or type of body partshown in the sequence of 3D images; and send, via the interface circuitry (56), an indication of theidentified type of body or type of body part, or an indication of one or more predetermined 3D models15 corresponding to the identified type of body or type of body part, to the display system (4); receive (905), via the interface circuitry (56), a 2D image plane adjustment indicationfrom the display system (4), wherein the 2D image plane adjustment indication indicates a requiredrotation and / or translation of the 2D image plane; process (907), using the processing unit (52), the sequence of 3D images and / or a further20 sequence of 3D images to generate second 2D image data representing a second sequence of 2D imagesof the body, wherein the 2D images in the second sequence of 2D images are images of the body in therotated and / or translated 2D image plane; and send (909), via the interface circuitry (56), the second 2D image data to the displaysystem (4) for display of the second sequence of 2D images of the body by the display system (4).
258. A visual data delivery system (3) as claimed in claim 7, wherein the identified type ofbody or identified type of body part is associated with a predetermined 3D model corresponding to theidentified type of body or identified type of body part stored at the display system (4).30 9. A visual data delivery system (3) as claimed in any of claims 7-8, wherein the one or more 3D models comprises an indication of a current orientationand / or current position of the 2D image plane with respect to the body, and wherein the received 2D image plane adjustment indication is a rotation and / or translationof the indication of the 2D image plane in the one or more 3D models, or a rotation and / or translation of35 the one or more 3D models.
10. A display system (4), the display system (4) comprising a display screen (64) andinterface circuitry (68), wherein the display system (4) is configured to:27receive (1001), via the interface circuitry (68), first 2-dimensional, 2D, image datarepresenting a first sequence of 2D images of a body from a visual data delivery system (3), wherein the2D images are images of the body in a 2D image plane through 3-dimensional, 3D, images of the body;display (1003), using the display screen (64), the first sequence of 2D images;5 receive, via the interface circuitry (68), one or more 3D models to the display system (4),and display, using the display screen (64), the one or more 3D models for the body or a part of the bodyshown in the first sequence of 2D images; OR receive, via the interface circuitry (68), an indication of thecorresponding to the identified type of body or type of body part, to the display system (4), and display,10 using the display screen (64), one or more predetermined 3D models corresponding to of the identifiedcorresponding to the identified type of body or type of body part;receive (1005), via the interface circuitry (68), a user input from a user of the displaysystem (4), wherein the user input indicates a required rotation and / or translation of the 2D image plane;15 send (1007), via the interface circuitry (68), a 2D image plane adjustment indication tothe visual data delivery system (3), wherein the 2D image plane adjustment indication indicates thereceive (1009), via the interface circuitry (68), second 2D image data representing asecond sequence of 2D images of the body from the visual data delivery system (3), wherein the second20 sequence of 2D images are images of the body in the rotated and / or translated 2D image plane; anddisplay (1011), using the display screen (64), the second sequence of 2D images.
11. A display system as claimed in claim 10, wherein the user input indicating the requiredrotation and / or translation of the 2D image plane is received as a user input that rotates and / or translates a25 displayed 3D model.