An imaging device and its interaction method

Abstract

This specification provides an imaging device and its interaction method. The method includes: acquiring an image containing a target object through an image acquisition device; determining projection content based on the image; and controlling at least two projection devices to project onto the target area of ​​the imaging device based on the projection content.

Description

Technical Field

[0001] This specification relates to the field of medical devices, and in particular to an imaging device and its interaction method. Background Technology

[0002] Aperture-type imaging devices, such as magnetic resonance imaging (MRI) or computed tomography (CT) imaging devices, require the patient to be moved into the examination aperture during examination or treatment. Patients with claustrophobia may experience symptoms such as chest tightness, shortness of breath, and palpitations; some children may find it difficult to remain quietly lying flat for extended periods.

[0003] Therefore, it is desirable to provide an imaging device that allows patients to have an immersive interactive experience within the aperture, creating a comfortable and pleasant examination environment for them. Summary of the Invention

[0004] This specification provides, in one aspect, an interactive method for an imaging device including at least two projection devices. The method includes: acquiring an image containing a target object via an image acquisition device; determining projection content based on the image; and controlling the at least two projection devices to project onto a target area of ​​the imaging device based on the projection content.

[0005] In some embodiments, the target area is located on the inner wall of the inspection aperture of the imaging device; determining the projection content based on the image includes: determining feature information of the target object based on the image; determining an interaction mode based on the feature information, the interaction mode including a simple mode and a complex mode; and controlling the at least two projection devices to project onto the target area of ​​the imaging device based on the projection content includes: controlling the at least two projection devices to project a corresponding target interactive interface onto the target area according to the determined interaction mode.

[0006] In some embodiments, determining the projection content based on the image includes: determining feature information of the target object based on the image; and determining the target projection content based on the feature information, wherein the target projection content includes at least one of video, game, and image.

[0007] In some embodiments, determining the projection content based on the image includes: determining eye information of the target object based on the image; determining operation instructions for the target object based on the eye information; and determining the target projection content based on the operation instructions.

[0008] In some embodiments, the method further includes: switching the projection content of the target area based on the operation instruction.

[0009] In some embodiments, the method further includes: determining the location information of the target object based on the image; and determining the location of the target region based on the location information.

[0010] In some embodiments, the method further includes: correcting the projected images of the at least two projection devices in the target area based on the location of the target area.

[0011] Another aspect of this specification provides an imaging device, comprising: a scanner for acquiring scan data of a target object; an image acquisition device for acquiring an image containing the target object; a control module for determining projection content based on the image; and at least two projection devices for projecting onto a target area based on the projection content, the target area being located on the inner wall of the aperture of the scanner.

[0012] In some embodiments, the image acquisition device is mounted directly above the scanner, and / or the at least two projection devices are movably mounted on the scanner.

[0013] Another aspect of this specification provides a computer-readable storage medium that stores computer instructions, which, when executed by a computer, are used to perform the interaction method as described above. Attached Figure Description

[0014] This specification will be further described by way of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not limiting; in these embodiments, the same reference numerals denote the same structures, wherein:

[0015] Figure 1 These are schematic diagrams illustrating application scenarios of exemplary imaging devices according to some embodiments of this specification;

[0016] Figure 2 This is a schematic diagram of the structure of an exemplary interactive system according to some embodiments of this specification;

[0017] Figure 3 This is a flowchart illustrating an exemplary interaction method for an imaging device according to some embodiments of this specification;

[0018] Figure 4 These are schematic diagrams of exemplary interactive interfaces shown according to some embodiments of this specification;

[0019] Figure 5 This is a schematic diagram of an exemplary projection area shown according to some embodiments of this specification;

[0020] Figure 6 This is a schematic diagram of an exemplary projected image according to some embodiments of this specification. Detailed Implementation

[0021] To more clearly illustrate the technical solutions of the embodiments in this specification, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are merely some examples or embodiments of this specification. For those skilled in the art, these drawings can be applied to other similar scenarios without creative effort. Unless obvious from the context or otherwise specified, the same reference numerals in the drawings represent the same structures or operations.

[0022] It should be understood that the terms “system,” “device,” “unit,” and / or “module” used herein are one way to distinguish different components, elements, parts, sections, or assemblies at different levels. However, if other terms can achieve the same purpose, they may be replaced by other expressions.

[0023] Generally, the terms "module," "unit," or "block" as used herein refer to logic embodied in hardware or firmware, or a collection of software instructions. The modules, units, or blocks described herein can be implemented as software and / or hardware and can be stored on any type of non-transitory computer-readable medium or other storage device. In some embodiments, software modules / units / blocks can be compiled and linked into an executable program. It should be understood that software modules can be invoked from other modules / units / blocks or from themselves, and / or can be invoked in response to detected events or interrupts. Software modules / units / blocks configured to execute on a computing device can be provided on computer-readable media (e.g., optical discs, digital video discs, flash drives, magnetic disks, or any other tangible media) or as digital downloads (which may initially be stored in a compressed or installable format and require installation, decompression, or decryption before execution). The software code herein can be stored, in part or in whole, in the storage device of the computing device performing the operation and applied in the operation of the computing device. Software instructions can be embedded in firmware, such as EPROM. It should also be understood that hardware modules / units / blocks may be included in connected logical components, such as gates and flip-flops, and / or may include programmable units, such as programmable gate arrays or processors. The modules / units / blocks or computing device functions described herein may be implemented as software modules / units / blocks, but can be represented in hardware or firmware. Typically, the modules / units / blocks described herein refer to logical modules / units / blocks that can be combined with other modules / units / blocks or divided into submodules / subunits / subblocks, although they are physical organization or storage devices. This description may apply to a system, an engine, or a part thereof.

[0024] It is understood that, unless the context explicitly states otherwise, when a unit, engine, module, or block is referred to as being "on," "connected," or "coupled to" another unit, engine, module, or block, it may be directly on, connected to, coupled to, or communicate with that other unit, engine, module, or block, or there may be intermediate units, engines, modules, or blocks. In this specification, the term "and / or" may include any one or more of the relevant listed items or a combination thereof. In this specification, the term "image" may refer to a 2D image, a 3D image, or a 4D image.

[0025] These and other features, characteristics, functions and operating methods of related structural elements, as well as the assembly and manufacturing economy of components, will become more apparent from the following description of the accompanying drawings, all of which form part of this specification. However, it should be understood that the drawings are for illustrative purposes only and are not intended to limit the scope of this specification. It should also be understood that the drawings are not drawn to scale.

[0026] As indicated in this specification and claims, unless the context clearly indicates otherwise, the words "a," "an," "an," and / or "the" do not specifically refer to the singular and may also include the plural. Generally speaking, the terms "comprising" and "including" only indicate the inclusion of expressly identified steps and elements, which do not constitute an exclusive list, and the method or apparatus may also include other steps or elements.

[0027] Flowcharts are used in this specification to illustrate the operations performed by the system according to embodiments of this specification. The related descriptions are provided to aid in a better understanding of the magnetic resonance imaging method and / or system. It should be understood that preceding or subsequent operations are not necessarily performed precisely in sequence. Instead, steps can be processed in reverse order or simultaneously. Furthermore, other operations can be added to these processes, or one or more steps can be removed from them.

[0028] MRI and CT imaging equipment are important diagnostic tools in modern medicine, aiding in the examination, treatment, and diagnosis of patient diseases. CT scans typically take 3–15 minutes, while MRI scans generally take 15–30 minutes, requiring patients to maintain stable vital signs throughout the procedure. However, the examination environment for MRI and CT scans is relatively harsh for patients, requiring them to lie flat within a small, cramped cylindrical examination port and endure the noise of the machines. Patients with claustrophobia may experience symptoms such as chest tightness, shortness of breath, and palpitations; some children may find it difficult to remain lying still for extended periods. Currently, hospitals use sedatives for these patients, but this can lead to unpredictable side effects.

[0029] This specification proposes an interactive method for aperture-type imaging devices such as MRI or CT equipment. The interactive interface or video footage is projected through a projection device within the examination aperture, and the patient's eye movements and other information are captured by an image acquisition device to achieve interaction, creating a comfortable and pleasant examination environment for the patient.

[0030] Figure 1 This is a schematic diagram illustrating an application scenario of an exemplary imaging device according to some embodiments of this specification.

[0031] like Figure 1 As shown, in some embodiments, scenario 100 may include imaging device 110, processing device 120, terminal device 130, storage device 140, and network 150. In some embodiments, the various components in scenario 100 may be interconnected via network 150 or directly connected without network 150. For example, imaging device 110 and terminal device 130 may be connected via network 150. As another example, imaging device 110 and processing device 120 may be connected via network 150 or directly connected. As yet another example, imaging device 120 and terminal device 130 may be connected via network 150 or directly connected.

[0032] Imaging device 110 can be used to scan a target object or a portion thereof located within its detection area (e.g., inspection aperture 101) and generate an image (e.g., a scan image) relating to the target object or a portion thereof. In some embodiments, the target object can be biological or non-biological. For example, the target object can include a patient, an artificial object, etc. In some embodiments, the target object can include a specific part of the body, such as the head, chest, abdomen, etc., or any combination thereof. In some embodiments, the target object can include a specific organ, such as the heart, esophagus, trachea, bronchi, stomach, gallbladder, small intestine, colon, bladder, ureter, uterus, fallopian tubes, etc., or any combination thereof. In some embodiments, the target object can include a region of interest (ROI), such as a tumor, nodule, etc.

[0033] In some embodiments, the imaging device 110 may include a DSA (Digital Subtraction Angiography) device, a digital radiography (DR) device, a computed radiography (CR) device, a digital fluorescence radiography (DF) device, a CT device, a magnetic resonance imaging device, a mammogram, a C-arm device, etc.

[0034] In some embodiments, the imaging device 110 may include an inspection aperture, an inspection bed, at least two projection devices (e.g., projection devices 104 and 105), an image acquisition device, etc. For more details, please refer to [link to relevant documentation]. Figure 2 The details and related descriptions will not be repeated here.

[0035] Processing device 120 can process data and / or information obtained from imaging device 110, terminal device 130, and / or storage device 140. For example, processing device 120 can analyze and process an image containing a target object obtained by an image acquisition device, determine the projection content, and control the projection device to project onto the target area of ​​imaging device 110 according to the projection content. In some embodiments, processing device 120 can be a single server or a group of servers. The server group can be centralized or distributed. In some embodiments, processing device 120 can be local or remote. For example, processing device 120 can access information and / or data from imaging device 110, terminal device 130, and / or storage device 140 via network 150. As another example, processing device 120 can be directly connected to imaging device 110, terminal device 130, and / or storage device 140 to access information and / or data. In some embodiments, processing device 120 can be implemented on a cloud platform. For example, the cloud platform can include private cloud, public cloud, hybrid cloud, community cloud, distributed cloud, inter-cloud cloud, multi-cloud, etc., or any combination thereof.

[0036] Terminal device 130 may include mobile device 131, tablet computer 132, laptop computer 133, etc., or any combination thereof. In some embodiments, terminal device 130 can interact with other components in scene 100 via network 150. For example, terminal device 130 can send one or more control commands to imaging device 110 via network 150 to control imaging device 110 to scan a target object according to the commands, or to switch the projected content. As another example, terminal device 130 can also receive scanned images of the target object obtained by imaging device 110 via network 150. In some embodiments, mobile device 131 may include smart home devices, wearable devices, mobile devices, virtual reality devices, augmented reality devices, etc., or any combination thereof.

[0037] In some embodiments, terminal device 130 may be part of processing device 120. In some embodiments, terminal device 130 may be integrated with processing device 120 as a control panel for imaging device 110. For example, the user / operator of scenario 100 (e.g., a doctor or nurse) can control the operation of imaging device 110 through this control panel, such as scanning a target object, switching projection content, etc. In some embodiments, processing device 120 may be integrated into imaging device 110. For example, processing device 120 may be part of imaging device 110, used to determine projection content based on images, and to control at least two projection devices to project corresponding content onto a target area.

[0038] Storage device 140 may store data (e.g., interactive interfaces of different modes, music, videos, games, pictures, etc.), instructions, and / or any other information. In some embodiments, storage device 140 may store data acquired from imaging device 110, processing device 120, and / or terminal device 130. For example, storage device 140 may store scanned images of target objects acquired from imaging device 110. In some embodiments, storage device 140 may store data and / or instructions that processing device 120 may execute or use to perform the exemplary methods described herein.

[0039] In some embodiments, storage device 140 may include one or a combination of several of the following: mass storage, removable storage, volatile read-write storage, read-only storage (ROM). In some embodiments, storage device 140 may be implemented using the cloud platform described herein.

[0040] In some embodiments, storage device 140 may be connected to network 150 to communicate with one or more components in scenario 100 (e.g., processing device 120, terminal device 130). One or more components in scenario 100 may read data or instructions from storage device 140 via network 150. In some embodiments, storage device 140 may be part of imaging device 110 or processing device 120, or it may be independent and directly or indirectly connected to imaging device 110 or processing device 120.

[0041] Network 150 may include any suitable network capable of facilitating information and / or data exchange within scenario 100. In some embodiments, one or more components of scenario 100 (e.g., imaging device 110, processing device 120, terminal device 130, storage device 140) may exchange information and / or data with one or more components of scenario 100 via network 150. In some embodiments, network 150 may include one or more of the following: public networks (e.g., the Internet), private networks (e.g., local area networks (LANs), wide area networks (WANs)), wired networks (e.g., Ethernet), wireless networks (e.g., 802.11 networks, Wi-Fi networks), cellular networks (e.g., LTE networks), Frame Relay networks, virtual private networks (VPNs), satellite networks, telephone networks, routers, hubs, server computers, etc. In some embodiments, network 150 may include one or more network access points. For example, network 150 may include wired and / or wireless network access points, such as base stations and / or Internet exchange points, through which one or more components of scenario 100 may connect to network 150 to exchange data and / or information.

[0042] It should be noted that the above description is provided for illustrative purposes only and is not intended to limit the scope of this specification. Various changes and modifications can be made by those skilled in the art based on the content of this specification. Features, structures, methods, and other features of the exemplary embodiments described herein can be combined in various ways to obtain other and / or alternative exemplary embodiments. For example, scenario 100 may also include an image acquisition device for acquiring images within a scanning room. However, these changes and modifications will not depart from the scope of this specification.

[0043] Figure 2 This is a schematic diagram of the structure of an exemplary interactive system according to some embodiments of this specification.

[0044] like Figure 2 As shown, in some embodiments, the interactive system 200 may include an imaging device 110 and a control module 210. The imaging device 110 may include an inspection aperture 101, an inspection bed 102, at least two projection devices (e.g., projection devices 104, 105), and an image acquisition device 106. The control module 210 may have the same or similar structure as the processing device 120.

[0045] The inspection aperture 101 corresponds to the detection area of ​​the imaging device 110. When a target object (e.g., a patient or a part of a patient) is located within the inspection aperture 101, the imaging device 110 can scan the target object to obtain a scanned image of the target object.

[0046] The examination bed 102 can be used to place a target object for scanning. For example, the target object can lie on its back, side, or stomach on the examination bed 102. In some embodiments, the examination bed 102 can be movably positioned in front of the imaging device 110 and parallel to the ground. For example, the examination bed 102 can be moved to enter and exit the examination aperture 101. Alternatively, the examination bed 102 can be moved vertically to adjust the distance between the target object on the examination bed and the scanning center when it enters the examination aperture 101, so as to scan the target object within the detection range. In some embodiments, the examination bed 102 can be a device independent of the imaging device 110.

[0047] As an example only, when the target object 103 needs to undergo a medical examination, the target object 103 can lie flat on the examination table 102. The examination table 102 is then moved to guide the target object 103 into the examination aperture 101, and the position of the examination table 102 is adjusted so that the target object 103 is at the center of the scan. Further, the radiation scanning source of the imaging device 110 can emit a radiation beam (e.g., X-rays) to the target object 103, which is attenuated by the target object 103 and then detected, thereby generating an image signal of the target object 103.

[0048] Projection devices 104 and / or 105 can be used to project onto a target area. The target area can be located on the inner wall of the inspection aperture 101. For example, Figure 2 The target area 107 shown is located above the examination aperture 101. "Above" can refer to a position relative to the ground. In some embodiments, the depth and width of the target area 107 can be set by the user or automatically determined based on patient information. The depth can refer to the distance along the axial direction of the examination aperture 101 (as shown by arrow B in the figure), and the width refers to the distance along the circumference of the examination aperture 101 (as shown by arrow A in the figure). For example, the depth of the target area 107 can be 20 cm, and the width can be two-thirds of the circumference of the examination aperture 101. Furthermore, the imaging device 110 can adjust the size and / or position of the target area 107 in real time according to the shape of the target object and / or its position within the examination aperture 101.

[0049] In some embodiments, the projected content in the target area may include, but is not limited to, videos, images, games, etc. In some embodiments, projection devices 104 and 105 can project an interactive interface (e.g., ...) into the target area 107. Figure 4 The interface shown in the figure demonstrates how a system can determine the target projection content and / or switch the projection content in real time based on user instructions. In some embodiments, the projected images from projection devices 104 and 105 can be stitched together into a complete image. For example... Figure 5As shown, region 503 corresponds to the projection range of projection device 104, and region 501 corresponds to the projection range of projection device 105. Regions 501 and 503 together form the target region 107. Once the target projection content or target interactive interface is determined, the projected image of projection device 104 in region 503 and the projected image of projection device 105 in region 501 can be stitched together to form the complete target projection content or target interactive interface.

[0050] In some embodiments, projection devices 104 or 105 may include projectors using technologies such as CRT (Cathode Ray Tube) projection, LCD projector, DLP (Digital Light Processing) projection, and LCOS (Liquid Crystal on Silicon) projection. In some embodiments, projection devices 104 and 105 may be the same type of projector.

[0051] In some embodiments, projection devices 104 and 105 may be mounted on the inner wall of the inspection aperture 101. For example... Figure 2 As shown, projection devices 104 and 105 can be fixedly mounted on the inner wall of the inspection aperture 101 near the inspection bed 102. Alternatively, projection devices 104 and 105 can be mounted on the inner wall of the inspection aperture 101 via guide rails and move along the axial direction of the inspection aperture 101 (e.g., in the direction indicated by arrow B). In some embodiments, projection devices 104 and 105 can be mounted on the inspection bed 102. For example, projection devices 104 and 105 can be fixed to the two long sides of the inspection bed 102. Alternatively, projection devices 104 and 105 can be mounted on the edge of one side of the inspection bed 102 via a guide structure and move along that side.

[0052] In some embodiments, two or more projection devices may be installed, and the installation positions and / or installation methods of the two or more projection devices may be any combination of the above-mentioned multiple installation positions and installation methods, which are not limited in this specification. In some embodiments, the projection devices may be devices independent of the imaging device 110. For example, projection devices 104 and 105 may be installed on the ground at the location of the imaging device 110.

[0053] Image acquisition device 106 can be used to acquire image information. For example, image acquisition device 106 can capture images containing all and / or part of a target object. In some embodiments, image acquisition device 106 can be mounted on inspection aperture 101. For example, image acquisition device 106 can be fixed, slidably, or rotatably mounted above inspection aperture 101. In some embodiments, the movement of image acquisition device 106 can be controlled based on the position of the target object so that its shooting range can cover the target object. For example, based on the position of the target object on inspection bed 102, image acquisition device 106 can be controlled to rotate a certain angle and / or move a certain distance so that it can capture images of the target object. In some embodiments, image acquisition device 106 may include a camera (e.g., digital camera, analog camera, depth camera, etc.), red-green-blue (RGB) sensor, RGB depth (RGB-D) sensor, or other devices capable of acquiring image data of objects.

[0054] In some embodiments, the image acquisition device 106 can be a device independent of the imaging device 110. For example, the image acquisition device 106 can be fixedly installed on the ceiling, in a corner, or other location within the scanning room. Alternatively, the image acquisition device 106 can be slidably and / or rotatably installed on the ceiling, floor, or other location where the imaging device 110 is located; this specification does not limit this. In some embodiments, two or more image acquisition devices 106 can be installed, and the installation positions and methods of these two or more image acquisition devices can be any combination of the aforementioned installation positions and methods. For example, two image acquisition devices can be respectively installed on the imaging device 110 at positions corresponding to the surface of the examination bed 102.

[0055] In some embodiments, projection devices 104 and 105, and image acquisition device 106, can be connected to the control module 210 in the control room via optical fiber. The control module 210 can determine the projection content based on the image containing the target object acquired by the image acquisition device 106, and control the projection devices 104 and 105 to project the corresponding content onto the target area 107. More details regarding the determination of the projection content can be found in [link to relevant documentation]. Figure 3 This will not be elaborated upon here.

[0056] In some embodiments, the control module 210 can also be used to perform geometric correction on the projected images of the projection devices 104 and 105, so that they present a normal, distortion-free projected image in the target area. For example, the correction method may include three-dimensional reconstruction, two-dimensional image transformation, etc. Exemplarily, such as... Figure 6As shown in the figure, before correction, the projected images of projection devices 104 and 105 in the target area 107 are distorted, as shown in 601. The control module 210 performs projection matrix calibration based on the curved shape of the target area 107, and then uses one of the projection devices 104 and 105 as a reference to perform geometric adjustment on its projected image. The projected image is shown in 603, and the distortion is basically eliminated. The colors of the projection devices 104 and 105 are further corrected so that the brightness of the overlapping area of ​​the projected images of the projection devices 104 and 105 is blended. The corresponding projected image is shown in 605.

[0057] In some embodiments, the control module 210 can determine the location information of the target object based on the image containing the target object acquired by the image acquisition device 106, determine the location of the target area 107 based on the location information, and then correct the projected images of the projection devices 104 and 105 in the target area. In some embodiments, at least two projection devices can be controlled to move based on the location of the target area so that their projection range can cover the target area. For example, the projection devices 104 and 105 can be controlled to rotate by a certain angle and / or move by a certain distance according to the location of the target area.

[0058] It should be noted that the above description of the interactive system 200 is for illustrative purposes only and is not intended to limit the scope of this specification. Various modifications and variations can be made based on this specification by those skilled in the art. However, these changes and modifications do not depart from the scope of this specification. For example, the imaging device 110 described above may include one or more additional modules, such as a storage module for data storage.

[0059] Figure 3 This is a flowchart illustrating an exemplary interaction method for an imaging device according to some embodiments of this specification.

[0060] In some embodiments, process 300 may be executed by imaging device 110 or processing device 120. For example, process 300 may be implemented as instructions (e.g., an application program) and stored in a memory, such as storage device 140, accessible by imaging device 110 or processing device 120. Imaging device 110 or processing device 120 may execute the instructions, and when executing the instructions, may be configured to execute process 300. The operational schematic diagram of process 300 presented below is illustrative. In some embodiments, the process may be accomplished using one or more additional operations not described and / or one or more operations not discussed. Additionally, Figure 3 The sequence of operations shown in the diagram and described below for process 300 is non-restrictive.

[0061] Step 310: Acquire an image containing the target object using an image acquisition device. In some embodiments, step 310 may be performed by a processing device 120.

[0062] In some embodiments, the acquired images may contain all or part of the target object. For example, the acquired images may only include the patient's eyes or head. Alternatively, the acquired images may include the patient's entire body. In some embodiments, the acquired images may be one or more.

[0063] In some embodiments, images of the target object can be acquired continuously or intermittently (e.g., periodically) by an image acquisition device (e.g., image acquisition device 106) before, during, and / or after scanning the target object. For example, image acquisition device 106 can acquire a first image of the target object before scanning and / or a second image of the target object during scanning.

[0064] Step 320: Determine the projected content based on the image. In some embodiments, step 320 may be performed by the processing device 120.

[0065] Projected content can refer to the content contained in the image projected onto the target area. For example, projected content can include various content types such as videos, games, and images, and / or the specific type of the video / game / image.

[0066] In some embodiments, the projection content can be determined based on information about the target object. For example, the processing device 120 can control the projection devices 104 and 105 to project any one of the following: video, game, or image, based on patient information. Alternatively, the processing device 120 can control the projection devices 104 and 105 to project any type of video, such as social science, entertainment, current affairs news, or lifestyle content, based on patient information.

[0067] In some embodiments, feature information of the target object can be determined based on the image, and the target projection content can be determined based on the feature information. Feature information can reflect the individual characteristics of the target object. For example, feature information may include the patient's gender, age, etc. Different types of content can be projected to users of different ages or genders. As an example only, for patients in specific age groups, considering their adaptability and acceptance, videos suitable for their age group can be played based on the patient's feature information. For example, age-appropriate animated short films can be played for children aged 0-14; soothing landscape videos can be played for middle-aged and elderly people over 45 years old. In some embodiments, a trained neural network model (e.g., a trained convolutional neural network) can be used to determine the feature information of the target object based on the image, and the target projection content can be determined based on the feature information. For example, an image containing the target object can be input into a trained convolutional neural network, which analyzes the image to determine the feature information of the target object and outputs corresponding target projection content, such as a landscape video, based on the feature information.

[0068] In some embodiments, the target projection content can be determined based on the patient's medical history. For example, for patients with high pain levels at the scanned area, the target projection content could be short story videos, entertainment news, or funny videos that are easy for viewers to immerse themselves in the story; for patients with no pain or low pain levels at the scanned area, the target projection content could be short social science or educational videos. Furthermore, depending on the scanned area, for patients whose scanned area is below the chest, the target projection content could be a mini-game; for patients whose scanned area is at or above the chest, the target projection content could be a video.

[0069] In some embodiments, the user can choose the projection content before scanning. For example, if the user selects a funny video, the projection devices 104 and 105 can be directly controlled to project the stored funny short video onto the target area 107 after the patient enters the examination aperture 101.

[0070] In some embodiments, the projected content may further include an interactive interface. The interactive interface can provide users with various options, allowing them to access different pages by navigating different options. For example, the interactive interface may include option 1 - game, option 2 - video, and option 3 - picture. After the user selects the corresponding option, the control module 210 controls the projection devices 104 and 105 to play the corresponding internally stored content in the target area 107. In some embodiments, the interactive interface may include multiple pages. For example, after the user selects "Option 2 - video," an interactive interface related to the video type can be further projected, such as option 21 - scenery, option 22 - food, option 23 - technology, option 24 - animals, etc. When the user selects an option on this page, the corresponding type of video can be projected onto the target area via the projection device.

[0071] In some embodiments, the interface may include multiple different interaction modes. For example, the interaction modes may include a simple mode and a complex mode. A simple mode may include only one or more operation buttons of the same type, while a complex mode may include multiple different types of buttons. This is merely an example. Figure 4 As shown, the simple mode interface may include only one or more options 420 for providing different types of projection content; the complex mode interface, in addition to options 420, may also include a return button 410, page up and down buttons 430 and 440, an emergency call button 450, etc. Specifically, the return button 410 returns to the main interface or the previous page, option 420 leads to the next menu or video / image / game projection page, button 430 scrolls up, button 440 scrolls down, and the emergency call button 450 calls a doctor. For example, when a patient feels unwell, they can use button 450 to call a doctor in the control room for a video call, or use button 450 to pause the scan.

[0072] In some embodiments, feature information of the target object can be determined based on the image, and the interaction mode can be determined based on the feature information. Users of different ages or genders can project different interactive interfaces. Further, at least two projection devices can be controlled to project corresponding target interactive interfaces onto the target area according to the determined interaction mode. For example, users aged 60 and above and under 5 years old can project a simple interactive interface, while other users can project a complex interactive interface. In some embodiments, feature information of the target object can be determined using image recognition algorithms. For example, feature information of the target object can be determined by inputting an image into a trained deep learning model. In some embodiments, a trained deep learning model can be directly used to determine the feature information of the target object, and the interaction mode can be determined based on the feature information. For example, the model's input is an image, and its output is the interaction mode.

[0073] In some embodiments, the user can set the interaction mode of the interactive interface before scanning. For example, the doctor can ask the patient whether to use a simple mode or a complex mode before scanning. Based on the patient's choice, when the patient enters the examination aperture 101, the corresponding interactive interface is automatically projected onto the target area.

[0074] In some embodiments, the interaction mode can be determined based on the patient's scanned area. For example, a complex interaction mode can be projected for patients scanning areas other than the head, while a simple interaction mode can be projected for patients scanning the head.

[0075] In some embodiments, upon entering the interactive interface, the next page or specific target projection content can be determined based on the target object's action information. In some embodiments, after entering the interactive interface, an image containing the target object can be acquired again, and the target object's action information can be determined based on the image, thereby determining the specific target projection content based on the action information. For example, the interaction mode can be determined based on a first image, and the action information can be determined based on a second image, where the first image was captured earlier than the second image.

[0076] In some embodiments, eye information of the target object can be determined based on the image, operation instructions of the target object can be determined based on the eye information, and target projection content can be determined based on the operation instructions.

[0077] Eye information may include at least one of eye gaze direction, gaze duration, and eye movement direction. In some embodiments, eye information of a target object in one or more images can be determined. For example, the processing device 120 can identify the patient's eye gaze direction in each image based on multiple images continuously acquired by the image acquisition device, thereby determining the eye movement direction and / or gaze duration. In some embodiments, eye information in an image can be determined using an image recognition algorithm.

[0078] In some embodiments, the operation instructions for the target object can be determined based on eye information in multiple images. For example, the processing device 120 can compare whether the eye gaze direction of the target object is consistent in adjacent frames, determine the shooting time of the two images corresponding to inconsistent directions, and then determine the time the eye gazes in the same direction; if this time exceeds a preset value (e.g., 3 seconds, 5 seconds), then the button selected by the patient at the eye gaze direction is considered the target button, such as a social science video or page down. Furthermore, the content of the next level page corresponding to the target button can be determined as the target projection content.

[0079] Step 330: Based on the projection content, control at least two projection devices to project onto the target area of ​​the imaging device. In some embodiments, step 330 may be performed by the processing device 120.

[0080] After determining the projection content, at least two projection devices can be controlled to project onto the target area of ​​the imaging device. For example, processing device 120 can control at least two projection devices to project a corresponding target interactive interface onto the target area based on a determined interaction mode. Alternatively, processing device 120 can control at least two projection devices to project onto the target area based on a determined target projection content.

[0081] In some embodiments, after projecting specific target content (e.g., video, image, game, etc.) into the target area, the projected content in the target area can be switched based on the target object's operation commands. For example, when the target object's eye movement direction is up, down, left, or right, the next video or image can be projected into the target area 107.

[0082] In some embodiments, head motion information of the target object can be determined based on the image, operation instructions can be determined based on the head motion information, and the projection content of the target area can be switched according to the operation instructions.

[0083] In some embodiments, the location information of the target object can be determined based on the image, and the location of the target area can be determined based on the location information. For example, the processing device 120 can determine the first coordinate position of the target object's eye relative to the examination bed 102 based on the image, and further determine the second coordinate position of the eye relative to the examination aperture 101 based on the position of the examination bed 102 and the first coordinate position of the eye, and determine the position of the target area within the examination aperture 101 based on the second coordinate position. For example, the target area 107 can be located at a position where the eye's line of sight is perpendicular to the inner wall above the examination aperture 101, or at a position where the angle between the perpendicular bisector of the target area and the eye's line of sight is less than a preset angle (such as 1 degree, 2 degrees, 3 degrees, 5 degrees, etc.).

[0084] Furthermore, the projected images of at least two projection devices in the target area can be corrected based on the location of the target area. For example, the processing device 120 can perform geometric correction on the projected images of projection devices 104 and 105 based on the location of the target area, so that the projected images of the two projection devices in the target area can be stitched together to form a complete projection content. The geometric correction of the projected images of the projection devices can be performed in any feasible manner, such as three-dimensional reconstruction methods, and this specification does not limit it.

[0085] It should be noted that the above description of process 300 is for illustrative purposes only and does not limit the scope of this specification. Those skilled in the art can make various modifications and changes to process 300 under the guidance of this specification. However, these modifications and changes remain within the scope of this specification.

[0086] Some embodiments of this specification also provide an imaging device, including: a scanner for acquiring scan data of a target object; an image acquisition device for acquiring an image containing the target object; a control module for determining projection content based on the image; and at least two projection devices for projecting onto a target area based on the projection content.

[0087] Some embodiments of this specification also provide a computer-readable storage medium that stores computer instructions, which, when executed by a computer, are used to perform the interactive method described above (e.g., process 300).

[0088] The beneficial effects that the embodiments of this specification may bring include, but are not limited to: (1) by using at least two projection devices to project images into the examination aperture, patients can have an immersive experience, reduce their fear of claustrophobic environments, and improve scanning efficiency; (2) by acquiring images of the target object through an image acquisition device and determining the interaction mode and / or the type of projection content based on the images, more suitable content can be projected for different patients, improving the user experience of patients in the examination aperture and creating a more comfortable and pleasant examination environment for patients; (3) by corresponding the human eye gaze coordinates with the projected image, patients can perform interactive operations without contact in the examination aperture. It should be noted that different embodiments may produce different beneficial effects. In different embodiments, the beneficial effects that may be produced can be any one or a combination of the above, or any other possible beneficial effects.

[0089] The basic concepts have been described above. Obviously, for those skilled in the art, the detailed disclosure above is merely illustrative and does not constitute a limitation of this specification. Although not explicitly stated herein, those skilled in the art may make various modifications, improvements, and corrections to this specification. Such modifications, improvements, and corrections are suggested in this specification and therefore remain within the spirit and scope of the exemplary embodiments described herein.

[0090] Furthermore, this specification uses specific terms to describe embodiments thereof. For example, "an embodiment," "one embodiment," and / or "some embodiments" refer to a particular feature, structure, or characteristic associated with at least one embodiment of this specification. Therefore, it should be emphasized and noted that references to "an embodiment," "one embodiment," or "an alternative embodiment" in different locations throughout this specification do not necessarily refer to the same embodiment. Moreover, certain features, structures, or characteristics in one or more embodiments of this specification can be appropriately combined.

[0091] Furthermore, unless expressly stated in the claims, the order of processing elements and sequences, the use of numbers and letters, or other names described in this specification are not intended to limit the order of the processes and methods described herein. Although various examples have been discussed in the foregoing disclosure of some embodiments of the invention that are currently considered useful, it should be understood that such details are for illustrative purposes only, and the appended claims are not limited to the disclosed embodiments; rather, the claims are intended to cover all modifications and equivalent combinations that conform to the spirit and scope of the embodiments described herein. For example, while the system components described above can be implemented using hardware devices, they can also be implemented solely using software solutions, such as installing the described system on existing servers or mobile devices.

[0092] Similarly, it should be noted that, in order to simplify the description disclosed herein and thus aid in the understanding of one or more embodiments of the invention, the foregoing description of embodiments in this specification may sometimes combine multiple features into a single embodiment, drawing, or description thereof. However, this method of disclosure does not imply that the subject matter of this specification requires more features than those mentioned in the claims. In fact, the embodiments contain fewer features than all the features of a single embodiment disclosed above.

[0093] In some embodiments, numbers describing the quantity of components and attributes are used. It should be understood that such numbers used in the description of embodiments are modified in some examples with the terms "approximately," "approximately," or "generally." Unless otherwise stated, "approximately," "approximately," or "generally" indicates that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, which may be changed depending on the characteristics required by individual embodiments. In some embodiments, numerical parameters should take into account specified significant digits and employ a general method of digit reservation. Although the numerical ranges and parameters used to confirm their breadth of range in some embodiments of this specification are approximate values, in specific embodiments, such values ​​are set as precisely as feasible.

[0094] For each patent, patent application, patent application publication, and other material, such as articles, books, specifications, publications, and documents, referenced in this specification, the entire contents of which are incorporated herein by reference. This excludes historical application documents that are inconsistent with or conflict with the content of this specification, as well as documents that limit the broadest scope of the claims in this specification (currently or subsequently appended to this specification). It should be noted that in the event of any inconsistency or conflict between the descriptions, definitions, and / or terminology used in the supplementary materials to this specification and the content of this specification, the descriptions, definitions, and / or terminology used in this specification shall prevail.

[0095] Finally, it should be understood that the embodiments described in this specification are merely illustrative of the principles of the embodiments described herein. Other variations may also fall within the scope of this specification. Therefore, alternative configurations of the embodiments described herein are intended to be illustrative rather than limiting, and should be considered consistent with the teachings of this specification. Accordingly, the embodiments described herein are not limited to those explicitly introduced and described herein.

Claims

1. An interactive method for an imaging device, the imaging device comprising at least two projection devices disposed within an inspection aperture of the imaging device, the method comprising: The interaction mode is determined based on the scanned area of ​​the target object; Based on the case information of the target object, determine the interaction content; Based on the position of the target object on the inspection bed, the image acquisition device is controlled to rotate at a certain angle and / or move a certain distance so that its shooting range can cover the target object, so as to acquire an image of the target object located within the inspection aperture through the image acquisition device; Based on the image, the location information of the target object is determined, and based on the location information and the shape of the target object, the size and / or position of the target area on the inner wall of the inspection aperture is determined in real time. Based on the interaction mode and interaction content, the at least two projection devices are controlled to perform collaborative projection on the target area on the inner wall of the inspection aperture of the imaging device, so that the projection content of the at least two projection devices is stitched together to form a complete target projection content or target interactive interface.

2. The method according to claim 1, The interaction modes include simple mode and complex mode; and The step of controlling the at least two projection devices to collaboratively project onto the target area on the inner wall of the inspection aperture of the imaging device based on the interaction mode includes: According to the determined interaction mode, the at least two projection devices are controlled to project collaboratively onto the target area on the inner wall of the inspection aperture, so that the projection content of the at least two projection devices is stitched together to form a complete target interactive interface.

3. The method according to claim 1, further comprising: Determine the feature information of the target object based on the image; The target projection content is determined based on the feature information, and the target projection content includes at least one of video, game, and image.

4. The method according to claim 1, further comprising: Based on the image, eye information of the target object is determined, and the eye information includes at least one of eye gaze direction, gaze duration, and eye movement direction; Based on the eye information, determine the operation instructions for the target object; Based on the operation instructions, the target projection content is determined.

5. The method according to claim 4, further comprising: Based on the operation command, switch the projection content of the target area.

6. The method according to claim 1, further comprising: Based on the updated position of the target area, the projected images of the at least two projection devices in the target area are corrected.

7. An imaging device, comprising: A scanner is used to acquire scanned data of a target object; An image acquisition device for acquiring an image of a target object located within the aperture of the scanner; Control module, used for The interaction mode is determined based on the scanned portion of the target object; Based on the case information of the target object, determine the interaction content; Based on the position of the target object on the examination bed, the image acquisition device is controlled to rotate at a certain angle and / or move a certain distance so that its shooting range can cover the target object, so as to obtain an image of the target object; as well as Based on the image, the location information of the target object is determined, and based on the location information and the shape of the target object, the size and / or position of the target area on the inner wall of the aperture is determined in real time. as well as At least two projection devices are used to collaboratively project onto a target area on the inner wall of the scanner aperture based on the interaction mode and interaction content, so that the projection content of the at least two projection devices is stitched together to form a complete target projection content or target interactive interface.

8. The device according to claim 7, wherein the at least two projection devices are movably mounted on the scanner.

9. A computer-readable storage medium storing computer instructions that, when executed by a computer, perform the method as described in any one of claims 1 to 6.

Images