Information processing method and device, electronic equipment and storage medium

Abstract

The invention provides an information processing method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a target section image, and obtaining target body data in the target section image according to the physiological feature information in the target section image; acquiring a plurality of video frames in a source video corresponding to the target body data according to the target body data and key feature information corresponding to the target section image; and generating a target video according to the plurality of video frames. The video can be automatically generated, a user does not need to manually search, and the diagnosis efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of information processing technology, and in particular to an information processing method, device, electronic device, and computer-readable storage medium. Background Art

[0002] With the development of AI imaging technology, image scanning has become a common auxiliary diagnosis and treatment method in modern medical diagnosis and treatment. Medical imaging can provide doctors with more and more intuitive internal information of the human body, thereby speeding up the doctor's diagnosis of the patient's condition.

[0003] In the prior art, doctors generally manually search for the video stream where the lesion is located to perform lesion analysis.

[0004] However, this manual search method is very inefficient. Summary of the Invention

[0005] The embodiments of the present application provide an information processing method, apparatus, electronic device, and computer-readable storage medium, which are intended to automatically generate videos without the need for manual searching by users, thereby improving diagnostic efficiency.

[0006] In a first aspect, an embodiment of the present application provides an information processing method, comprising:

[0007] Acquire a target section image, and acquire target volume data in the target section image based on physiological characteristic information in the target section image;

[0008] Acquire multiple video frames in a source video corresponding to the target volume data according to key feature information corresponding to the target volume data and the target section image;

[0009] A target video is generated according to the multiple video frames.

[0010] Optionally, the key feature information corresponding to the volume data includes a coordinate mapping relationship between the volume data and the source video;

[0011] The step of obtaining a plurality of video frames in a source video corresponding to the target volume data based on key feature information corresponding to the target volume data and the target section image includes:

[0012] Acquiring coordinate information of the target volume data in the target section image;

[0013] According to the coordinate mapping relationship between the volume data and the source video and the coordinate information, a plurality of video frames corresponding to the target volume data in the source video are obtained.

[0014] Optionally, acquiring the target section image includes:

[0015] In response to the slice selection operation, multiple target slice images within the specified slice range are acquired, and / or

[0016] In response to the angle selection operation of the section, a target section image within a specified angle range is acquired from the complete section image.

[0017] Optionally, acquiring target volume data in the target section image according to physiological feature information in the target section image includes:

[0018] In response to an interactive operation on the target section image, acquiring interactive information corresponding to the interactive operation, wherein the interactive information includes any one of lesion measurement information and lesion sign viewing information of the lesion in the target section image;

[0019] The target volume data in the target section image is acquired according to the interaction information and the physiological characteristic information in the target section image.

[0020] Optionally, after generating a target video according to the plurality of video frames, the method further includes:

[0021] determining a target lesion area in the target video corresponding to the interaction information according to lesion features of the lesion in the target video;

[0022] The target lesion area is marked according to a preset identifier and then displayed.

[0023] Optionally, generating a target video according to the multiple video frames includes:

[0024] Acquire, from the plurality of video frames, a plurality of target video frames having display quality higher than a preset quality threshold according to display characteristic parameters of the lesions in the plurality of video frames;

[0025] According to the temporal relationship between the multiple video frames, the multiple target video frames are spliced ​​together to generate a target video.

[0026] Optionally, the section image may be determined by:

[0027] In response to the slice construction operation, volume data is obtained from a sequence of medical images corresponding to the source video;

[0028] A cross-sectional image is constructed based on the target volume data.

[0029] In a second aspect, an embodiment of the present application provides an information processing device, including:

[0030] a first acquisition module, configured to acquire a target section image, and acquire target volume data in the target section image and key feature information corresponding to the target volume data based on physiological feature information in the target section image;

[0031] A second acquisition module is configured to acquire, based on the target volume data and the key feature information, a plurality of video frames in a source video corresponding to the target volume data;

[0032] A generation module is used to generate a target video according to the multiple video frames.

[0033] In a third aspect, an embodiment of the present application provides an electronic device comprising a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps of the above-mentioned information processing method.

[0034] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps of the above-mentioned information processing method.

[0035] Beneficial effects of the embodiments of the present application: In the embodiments of the present application, the medical device can obtain the target cross-sectional image, and obtain the target volume data in the target cross-sectional image based on the physiological characteristic information in the target cross-sectional image, and then obtain multiple video frames in the source video corresponding to the target cross-sectional image based on the target volume data and the key characteristic information corresponding to the target volume data, and then generate the target video based on the multiple video frames. It can be seen that compared with the prior art that requires the user to manually search for the video stream where the lesion is located, the present application can automatically determine the multiple video frames in the source video corresponding to the cross-sectional image based on the volume data in the cross-sectional image and the key characteristic information corresponding to the cross-sectional image, and generate the target video, realizing the backtracking from the cross-sectional image to the source video stream, without the need for the user to manually search for the video stream, effectively assisting the user in lesion analysis, and improving the diagnostic efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0037] Figure 1 This is a schematic diagram of the first information processing flow provided in the embodiments of the present application;

[0038] Figure 2 A schematic diagram of video retracing is provided in an embodiment of the present application;

[0039] Figure 3 This is a schematic diagram of the second information processing flow provided in an embodiment of the present application;

[0040] Figure 4 is a schematic diagram of the structure of an information processing device provided in an embodiment of the present application;

[0041] Figure 5 It is a structural diagram of the electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0042] The following will provide a clear and complete description of the technical solutions in the embodiments of this application, in conjunction with the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of this application, and not all of them. Based on the embodiments of this application, all other embodiments derived by persons skilled in the art without inventive effort are within the scope of protection of this application. Furthermore, it should be understood that the specific embodiments described herein are intended only to illustrate and explain this application and are not intended to limit this application. In this application, unless otherwise indicated, directional terms such as "upper" and "lower" generally refer to the upper and lower sides of the device in actual use or operation, specifically the directions in the drawings; while "inner" and "outer" refer to the outline of the device. Furthermore, in the description of the embodiments of this application, the terms "first" and "second" are used solely to distinguish descriptions and should not be construed as indicating or implying relative importance. Therefore, features defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of the embodiments of this application, "multiple" means two or more, unless otherwise specifically defined.

[0043] Combined with the above background technology description of this application, with the development of AI imaging technology, image scanning has become a common auxiliary diagnosis and treatment method in modern medical diagnosis and treatment. Medical imaging can provide doctors with more and more intuitive internal information of the human body, thereby speeding up the doctor's diagnosis of the patient's condition.

[0044] Ultrasound scanning is a commonly used scanning method in hospitals. It can produce complete video images, allowing for analysis of lesions in the patient's target area. However, due to factors such as scanning force, angle, and position, ultrasound scans cannot fully display all cross-sections of physiological tissue or lesions. Therefore, doctors still need to review the entire scan video for lesion analysis.

[0045] However, in the prior art, doctors can manually search for multiple video frames containing lesions, but this manual search method is very inefficient.

[0046] If the system automatically pushes video frames containing lesion images to doctors, this direct push method cannot accurately predict the lesion images required by doctors, which will also lead to low lesion analysis efficiency and affect diagnostic efficiency.

[0047] Therefore, in order to solve the above problems, the present application proposes an information processing method, device, electronic device, computer-readable storage medium and computer program product, which aims to find information of concern to doctors from any constructed section, reversely associate the source video according to the information of concern, and thus find the source video frame corresponding to the information of concern, and display the information in the source video to the doctor or perform subsequent processing.

[0048] In a specific embodiment, Figure 1 As shown, the information processing method in this application can be applied to medical equipment, which can include diagnostic equipment such as ultrasound scanning equipment, CT scanners, and endoscopes. The information processing method can include the following steps:

[0049] S10, acquiring a target section image, and acquiring target volume data in the target section image and key feature information corresponding to the target volume data based on physiological feature information in the target section image;

[0050] In this embodiment, the target section image may be a section image specified by the user, or may be a section image automatically identified by the medical device and containing a lesion.

[0051] Furthermore, the target section image can be the original section image obtained by ultrasonic scanning of the corresponding area of ​​the patient, or it can be a new section image reconstructed based on the original section image. The specific process of reconstructing the new section image from the original section image can refer to the implementation method of generating a three-dimensional model through computer processing of two-dimensional section images (such as CT, MRI, etc.) in the existing technology, and no specific limitation is made to this.

[0052] The physiological characteristic information in the target section image can include tissue structure characteristics, pathological characteristics, functional characteristics, etc.

[0053] On this basis, the medical device can obtain the target volume data in the target section image and the key feature information corresponding to the target volume data based on the physiological feature information in the target section image.

[0054] The target volume data in this embodiment may include location information of the lesion, size information of the lesion, morphological characteristics of the lesion, characteristics of surrounding tissues of the lesion, etc., which are not listed one by one.

[0055] S20, acquiring a plurality of video frames in a source video corresponding to the target volume data based on key feature information corresponding to the target volume data and the target section image;

[0056] It should be noted that, in this embodiment, the key feature information may specifically be a coordinate mapping relationship between the volume data and the source video, that is, the coordinate mapping relationship may be used to indicate in which specific video frame of the source video the volume data is located.

[0057] On this basis, the medical device can obtain multiple video frames in the source video corresponding to the target volume data based on the key feature information corresponding to the target volume data and the target section image.

[0058] It is understandable that if Figure 2 As shown, in this embodiment, the source video can be reversely associated with the target volume data to provide doctors with more comprehensive medical auxiliary information, so that doctors do not need to manually search for the source video containing the lesion one by one, effectively improving the efficiency of diagnosis and analysis.

[0059] S30: Generate a target video according to the multiple video frames.

[0060] In this embodiment, after the medical device acquires multiple video frames corresponding to the target section image, it can generate a target video based on the multiple video frames.

[0061] Specifically, for example, the medical device can sort the extracted multiple video frames in chronological order to ensure that the generated target video can reflect the dynamic changes of the target body data, and splice the sorted video frames into a continuous video stream in chronological order. During the splicing process, video encoding technology (such as H.264, H.265, etc.) can be used to optimize the storage and transmission of the video, and the spliced ​​video stream can be formatted into the target video to ensure that it complies with the standard video format (such as MP4, AVI, etc.) to facilitate playback and analysis on different medical devices and platforms.

[0062] Therefore, in the embodiment of the present application, the medical device can obtain the target cross-sectional image, and obtain the target volume data in the target cross-sectional image based on the physiological characteristic information in the target cross-sectional image, and then obtain multiple video frames in the source video corresponding to the target cross-sectional image based on the target volume data and the key characteristic information corresponding to the target volume data, and then generate the target video based on the multiple video frames. It can be seen that compared to the prior art that requires the user to manually search for the video stream where the lesion is located, this embodiment can automatically determine the multiple video frames in the source video corresponding to the cross-sectional image based on the volume data in the cross-sectional image and the key characteristic information corresponding to the cross-sectional image, and generate the target video, realizing the backtracking from the cross-sectional image to the source video stream, without the need for the user to manually search for the video stream, effectively assisting the user in lesion analysis, and improving diagnostic efficiency.

[0063] In one embodiment, in the above S20, "according to the key feature information corresponding to the target volume data and the target section image, a plurality of video frames in the source video corresponding to the target volume data are obtained", such as Figure 3 As shown, this may include:

[0064] S201, obtaining coordinate information of the target volume data in the target section image;

[0065] S202 : Acquire multiple video frames corresponding to the target volume data in the source video according to a coordinate mapping relationship between the volume data and the source video and the coordinate information.

[0066] It should be noted that, in this embodiment, the coordinate mapping relationship between the volume data and the source video may be determined in the following manner:

[0067] For each video frame, a relative relationship sequence can be established based on the posture information of the probe corresponding to the medical device. The relative relationship sequence is used to map the medical image of each video frame to a spatial position. In this way, the coordinate mapping relationship can be determined based on the relative relationship sequence.

[0068] Among them, the posture information of the probe can be determined based on its built-in IMU sensor, or it can be detected by the visual sensor corresponding to the medical device, or it can be determined by the mechanical scanning module inside the probe, or based on the posture information of the robotic arm that controls the probe. There is no specific limitation on this.

[0069] In combination with the above description, in this embodiment, the key feature information may specifically be a coordinate mapping relationship between the volume data and the source video, that is, the coordinate mapping relationship may be used to indicate in which specific video frame of the source video the volume data is located.

[0070] On this basis, the medical device can obtain the coordinate information of the target volume data in the target section image, and then obtain multiple video frames corresponding to the target volume data in the source video based on the coordinate mapping relationship between the volume data and the source video and the above coordinate information.

[0071] Specifically, for example, the coordinate mapping relationship between the volume data and the source video can be established through the following steps: (1) Time synchronization: ensure that the target section image and the source video are synchronized in time, that is, a certain moment in the target section image corresponds to a certain frame in the source video; (2) Spatial mapping: based on the coordinate information of the volume data in the target section image, determine its corresponding position in the source video, which can be achieved through spatial transformation algorithms (such as affine transformation, perspective transformation, etc.).

[0072] In this way, this embodiment achieves dynamic analysis of the target volume data by obtaining the coordinate information of the target volume data in the target section image and extracting the corresponding multiple video frames from the source video using the coordinate mapping relationship, thereby providing more comprehensive data support for medical diagnosis and treatment.

[0073] In one embodiment, in the above S10, “obtaining a target cross-sectional image” may include:

[0074] S101, in response to a slice selection operation, obtaining multiple target slice images within a specified slice range, and / or,

[0075] S102 , in response to the angle selection operation for the section, obtaining a target section image within a specified angle range from the complete section image.

[0076] It should be noted that this embodiment may provide a user interface to allow the user to interactively select a slice range of interest. For example, the user may specify a slice range by dragging a slider, entering a value, or drawing an area.

[0077] On this basis, the medical device determines the specified section range according to the user's operation. The section range can be multiple continuous sections or a few specific sections. There is no limitation on this. For example, the 10th to 20th section images are extracted from the complete image data set.

[0078] In this way, the medical device can extract multiple target section images within a specified section range from the complete image data set. These images can be generated from three-dimensional volume data through a slicing algorithm, or selected from pre-processed two-dimensional section images, without specific limitations.

[0079] In addition, in this embodiment, in response to the user's operation of selecting the angle of the section, a target section image within a specified angle range can be acquired from the complete section image.

[0080] Specifically, for example, the user operation interface in this embodiment can allow the user to select the section angle that the user is interested in through interactive operations. For example, the user can specify the section angle through a rotation operation, inputting an angle value, or selecting a preset angle.

[0081] In this way, the medical device can determine the specified section angle range based on the user's operation, where the angle range can be a single angle or a continuous angle range. For example, the target section image within the range of 0 degrees to 45 degrees can be extracted from the complete section image.

[0082] Similarly, medical devices can extract target slice images within a specified angle range from the complete slice image. These images can be generated from 3D volume data using a rotation algorithm or selected from pre-processed 2D slice images.

[0083] Through the above approach, this application can dynamically acquire target section images within a specified range or angle by responding to the user's section selection and angle selection operations, thereby improving the flexibility and interactivity of image analysis. This method not only provides the specific section images required by the user, but also dynamically adjusts them according to the user's needs, providing more comprehensive data support for medical diagnosis and treatment.

[0084] In one embodiment, in the above S10, “acquiring target volume data in the target section image according to the physiological characteristic information in the target section image” may include:

[0085] S103, in response to the interactive operation on the target section image, obtaining interactive information corresponding to the interactive operation, wherein the interactive information includes any one of lesion measurement information and lesion sign viewing information of the lesion in the target section image;

[0086] S104: Acquire target volume data in the target section image according to the interaction information and the physiological characteristic information in the target section image.

[0087] In this embodiment, the user is allowed to perform interactive operations on the target section image, such as measuring the size of the lesion, viewing the signs of the lesion, etc.

[0088] Medical devices can identify user interaction operations through the user operation interface, such as clicking, dragging, inputting, etc., and obtain corresponding interaction information based on the user's interaction operations.

[0089] The interaction information may include the following two types:

[0090] Lesion measurement information: When the user measures a lesion, the measured parameters such as the length, width, area, and volume of the lesion are recorded.

[0091] Lesion sign viewing information: When a user views the signs of a lesion, the viewed features are recorded, such as the lesion's boundary, internal structure, density, signal strength, etc.

[0092] In this way, the medical device can extract the target physiological characteristic information related to the lesion and required by the doctor from the target section image based on the interactive information and physiological characteristic information, such as the location, size, shape, density, signal strength, etc. of the lesion, and then determine the specific position of the target volume data in the target section image based on the target physiological characteristic information.

[0093] For example, based on the lesion size and position information measured by the user, the center coordinates and boundary coordinates of the lesion are located, and the target volume data is extracted from the target section image, so that the extracted target volume data can include the two-dimensional section image, three-dimensional volume data, etc. of the lesion for further analysis and processing.

[0094] In this way, the present application can dynamically acquire multiple video frames related to the lesion by responding to the user's interactive operations on the target section image, thereby realizing dynamic analysis of the lesion, accurately predicting the doctor's true intention, meeting the doctor's needs, and providing the medical auxiliary information required by the doctor.

[0095] In one embodiment, after the above S30 of “generating a target view according to the plurality of video frames”, the following steps may also be included:

[0096] S40, determining a target lesion region in the target video corresponding to the interaction information according to lesion features of the lesion in the target video;

[0097] S50: Mark the target lesion area according to a preset mark and then display it.

[0098] In this embodiment, the medical device can extract characteristic information of the lesion from the target video, such as the size, shape, density, signal strength, boundary characteristics, etc. of the lesion, and match the lesion characteristics in the target video corresponding to the interactive information based on the interactive information provided by the user (such as lesion measurement information, lesion sign viewing information, etc.).

[0099] The matching results can then be used to determine the target lesion area in the target video that corresponds to the interactive information. For example, the specific location and range of the lesion in the target video can be determined based on the lesion size and location information measured by the user.

[0100] It can be understood that the preset marker in this embodiment can be used to mark the target lesion area in the target video, wherein the preset marker can be a color mark, a bounding box, a text annotation, etc.

[0101] In this way, the medical device marks and displays the target lesion area according to the preset identification. For example, the lesion area is marked with a red bounding box, or a text annotation is added to the lesion area. In the target video, the lesion area is marked with a red bounding box, and the text annotation "lesion area" is added to the lesion area.

[0102] The present invention determines the target lesion area according to the lesion characteristics and marks and displays it, reminding the doctor to focus on the area and assisting the doctor in lesion analysis.

[0103] In one embodiment, in the above S30, “generating a target video according to the plurality of video frames” may include:

[0104] S301, acquiring a plurality of target video frames having display quality higher than a preset quality threshold from the plurality of video frames based on display characteristic parameters of lesions in the plurality of video frames;

[0105] S302 : splicing the plurality of target video frames according to a temporal relationship between the plurality of video frames to generate a target video.

[0106] In this embodiment, the medical device can extract characteristic display parameters of the lesion from multiple video frames, such as lesion clarity, contrast, and brightness. Furthermore, an image clarity-based evaluation algorithm can be used to assess the display quality of each video frame. For example, edge strength and noise level can be calculated for each video frame.

[0107] It is worth noting that in this embodiment, a preset quality threshold can be set, such as a clarity threshold of 0.8 (range 0 to 1) and a contrast threshold of 0.6, so that the medical device can filter out multiple target video frames with display quality higher than the preset quality threshold from multiple video frames based on the quality assessment results. For example, video frames with a clarity greater than 0.8 and a contrast greater than 0.6 can be filtered out.

[0108] Furthermore, the timing relationship between multiple target video frames can be determined based on the timestamps of the video frames, and the H.264 video encoding technology can be used to splice the multiple target video frames into a continuous video stream in chronological order. The spliced ​​video stream is then formatted into a target video in MP4 format to ensure that it can be played and analyzed on different medical devices and platforms.

[0109] It can be seen that the present application provides a method for screening high-quality video frames from multiple video frames and generating target videos. Through flexible display feature parameter extraction and efficient video frame splicing technology, dynamic analysis and visualization of lesions are realized, which has important clinical application value.

[0110] In one embodiment, the method for determining the cross-sectional image in the present application may include:

[0111] S60, in response to the slice construction operation, obtaining volume data from the serial medical images corresponding to the source video;

[0112] S70: Constructing a cross-sectional image based on the volume data.

[0113] In this embodiment, the user is allowed to initiate a section construction request through interactive operations. For example, the user can define the required section by selecting a specific section direction, angle, or position.

[0114] Medical devices can identify the user's slice construction operations through the user interface, such as clicking, dragging, and entering parameters, and extract volume data from the serial medical images corresponding to the source video based on the user's slice construction operations.

[0115] Among them, serial medical images can be three-dimensional volume data (such as CT, MRI, etc.) or a series of two-dimensional cross-sectional images, and volume data can include data of areas of interest such as lesions, organs, and tissues.

[0116] Then, the cross-sectional image construction algorithm can be used to generate the required cross-sectional images based on the target volume data.

[0117] Specifically, for example, based on the user's slice construction operation, the slice's direction, angle, and position are determined and mapped to the coordinate system of the sequential medical image. Within the sequential medical image, pixel values ​​on the slice are generated using a data interpolation algorithm (such as linear interpolation or bicubic interpolation), and the interpolated pixel values ​​are then combined to form a complete slice image. The slice image can be a two-dimensional image or a slice view of three-dimensional volume data.

[0118] It is understandable that in this embodiment, the constructed cross-sectional image can be displayed in the user operation interface, and the user can view and analyze the cross-sectional image through interactive operations. For example, the user can adjust the angle, position or zoom ratio of the cross-sectional image to obtain the best visual effect.

[0119] This embodiment also provides an information processing device, which can be integrated into a terminal medical device, for example, Figure 4 As shown, the information processing device may include:

[0120] The first acquisition module 1001 is used to acquire a target section image and acquire target volume data in the target section image based on physiological characteristic information in the target section image;

[0121] The second acquisition module 1002 is configured to acquire a plurality of video frames in a source video corresponding to the target volume data based on key feature information corresponding to the target volume data and the target section image;

[0122] The generating module 1002 is configured to generate a target video according to the plurality of video frames.

[0123] Optionally, the key feature information corresponding to the volume data includes a coordinate mapping relationship between the volume data and the source video;

[0124] The second acquisition module 1002 is further configured to:

[0125] Acquiring coordinate information of the target volume data in the target section image;

[0126] According to the coordinate mapping relationship between the volume data and the source video and the coordinate information, a plurality of video frames corresponding to the target volume data in the source video are obtained.

[0127] Optionally, the first acquisition module 1001 is further configured to:

[0128] In response to the slice selection operation, multiple target slice images within the specified slice range are acquired, and / or

[0129] In response to the angle selection operation of the section, a target section image within a specified angle range is acquired from the complete section image.

[0130] Optionally, the first acquisition module 1001 is further configured to:

[0131] In response to an interactive operation on the target section image, acquiring interactive information corresponding to the interactive operation, wherein the interactive information includes any one of lesion measurement information and lesion sign viewing information of the lesion in the target section image;

[0132] The target volume data in the target section image is acquired according to the interaction information and the physiological characteristic information in the target section image.

[0133] Optionally, the information processing device in this application further includes:

[0134] a determination module, configured to determine a target lesion area in the target video corresponding to the interaction information based on lesion features of the lesion in the target video;

[0135] The display module is used to mark the target lesion area according to a preset mark and then display it.

[0136] Optionally, the generating module is further configured to:

[0137] Acquire, from the plurality of video frames, a plurality of target video frames having display quality higher than a preset quality threshold according to display characteristic parameters of the lesions in the plurality of video frames;

[0138] According to the temporal relationship between the multiple video frames, the multiple target video frames are spliced ​​together to generate a target video.

[0139] Optionally, the information processing device in this application further includes:

[0140] A volume data acquisition module, configured to respond to a slice construction operation and acquire volume data from a sequence of medical images corresponding to the source video;

[0141] The construction module is used to construct a section image according to the target volume data.

[0142] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0143] Accordingly, the embodiment of the present application further provides an electronic device, such as Figure 5As shown, Figure 5 Schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 1100 includes a processor 1101 having one or more processing cores, a memory 1102 having one or more computer-readable storage media, and a computer program stored in the memory 1102 and executable on the processor. The processor 1101 is electrically connected to the memory 1102. Those skilled in the art will understand that the vehicle structure shown in the figure does not constitute a limitation of the vehicle, and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0144] The processor 1101 is the control center of the electronic device 1100. It connects the various parts of the entire electronic device 1100 using various interfaces and lines. By running or loading software programs and / or units stored in the memory 1102 and calling data stored in the memory 1102, it executes various functions of the electronic device 1100 and processes data, thereby monitoring the electronic device 1100 as a whole. The processor 1101 can be a processor (Central Processing Unit, CPU), a graphics processing unit (GPU), a network processor (Network Processor, NP), etc., and can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of this application.

[0145] In the embodiment of the present application, the processor 1101 in the electronic device 1100 loads instructions corresponding to one or more application processes into the memory 1102 according to the following steps, and the processor 1101 runs the application stored in the memory 1102 to implement various functions, such as:

[0146] Acquire a target section image, and acquire target volume data in the target section image based on physiological characteristic information in the target section image;

[0147] Acquire multiple video frames in a source video corresponding to the target volume data according to key feature information corresponding to the target volume data and the target section image;

[0148] A target video is generated according to the multiple video frames.

[0149] Optional, such as Figure 5As shown, the electronic device 1100 further includes: a touch screen 1103, a radio frequency circuit 1104, an audio circuit 1105, an input unit 1106, and a power supply 1107. Among them, the processor 1101 is electrically connected to the touch screen 1103, the radio frequency circuit 1104, the audio circuit 1105, the input unit 1106, and the power supply 1107 respectively. Those skilled in the art will understand that Figure 5 The vehicle structure shown in the figure does not constitute a limitation to the vehicle, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0150] The touch display screen 1103 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display screen 1103 may include a display panel and a touch panel. Among them, the display panel can be used to display information input by the user or information provided to the user and various graphical user interfaces of the vehicle, which can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. The touch panel can be used to collect user touch operations on or near it (such as operations performed by the user using any suitable object or accessory such as a finger, stylus, etc. on or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts: a touch display system and a touch controller. Among them, the touch display system detects the user's touch direction, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch display system, converts it into touch point coordinates, and then sends it to the processor 1101, and can receive commands sent by the processor 1101 and execute them. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 1101 to determine the type of touch event. The processor 1101 then provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 1103 to realize input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize input and output functions. That is, the touch display screen 1103 can also be used as part of the input unit 1106 to realize the input function.

[0151] The RF circuit 1104 may be used to transmit and receive RF signals, thereby establishing wireless communication with network devices or other vehicles through wireless communication, and transmitting and receiving signals with network devices or other vehicles.

[0152] Audio circuit 1105 can be used to provide an audio interface between the user and the vehicle through a speaker and microphone. Audio circuit 1105 converts received audio data into electrical signals and transmits them to the speaker, which then converts them into sound signals for output. The microphone, on the other hand, converts collected sound signals into electrical signals, which are received by audio circuit 1105 and converted into audio data. This audio data is then output to processor 1101 for processing, then transmitted via RF circuit 1104 to, for example, another vehicle, or to memory 1102 for further processing. Audio circuit 1105 may also include an earphone jack to allow communication between an external headset and the vehicle.

[0153] The input unit 1106 may be configured to receive input digital, character information, or user feature information (such as fingerprint, iris, or facial information), and to generate keyboard, mouse, joystick, optical, or trackball signal input related to user settings and function control.

[0154] Power supply 1107 is used to supply power to various components of electronic device 1100. Optionally, power supply 1107 can be logically connected to processor 1101 via a power management device, thereby enabling the power management device to manage charging, discharging, and power consumption. Power supply 1107 can also include one or more DC or AC power supplies, a recharging device, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0155] although Figure 5 Not shown, the electronic device 1100 may further include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0156] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0157] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0158] To this end, an embodiment of the present application provides a computer-readable storage medium storing a plurality of computer programs. The computer programs can be loaded by a processor to execute any one of the information processing methods provided in the embodiments of the present application. The computer programs can execute the following steps of the information processing method:

[0159] Acquire a target section image, and acquire target volume data in the target section image based on physiological characteristic information in the target section image;

[0160] Acquire multiple video frames in a source video corresponding to the target volume data according to key feature information corresponding to the target volume data and the target section image;

[0161] A target video is generated according to the multiple video frames.

[0162] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0163] The computer-readable storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0164] Since the computer program stored in the computer-readable storage medium can execute any information processing method provided in the embodiments of the present application, the beneficial effects that can be achieved by any information processing method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0165] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0166] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0167] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0168] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0169] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.

[0170] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0171] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology for information storage. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices, or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media such as modulated communication signals and carrier waves.

[0172] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, "plurality" means two or more, unless otherwise specifically defined.

[0173] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0174] The embodiments, implementation methods and related technical features of the present application can be combined and replaced with each other without conflict.

[0175] The above are merely preferred embodiments of the present application and do not constitute any form of limitation to the present application. However, any simple modifications, equivalent changes, and modifications made to the above embodiments based on the technical essence of the present application without departing from the content of the technical solution of the present application are still within the scope of the technical solution of the present application.

Claims

1. An information processing method, characterized in that: The method comprises: Acquire a target section image, and acquire target volume data in the target section image based on physiological characteristic information in the target section image; Acquire multiple video frames in a source video corresponding to the target volume data according to key feature information corresponding to the target volume data and the target section image; A target video is generated according to the multiple video frames.

2. The information processing method according to claim 1, wherein: The key feature information corresponding to the volume data includes a coordinate mapping relationship between the volume data and the source video; The step of obtaining a plurality of video frames in a source video corresponding to the target volume data based on key feature information corresponding to the target volume data and the target section image includes: Acquiring coordinate information of the target volume data in the target section image; According to the coordinate mapping relationship between the volume data and the source video and the coordinate information, a plurality of video frames corresponding to the target volume data in the source video are obtained.

3. The information processing method according to claim 1, wherein: The step of obtaining the target section image comprises: In response to the slice selection operation, multiple target slice images within the specified slice range are acquired, and / or In response to the angle selection operation of the section, a target section image within a specified angle range is acquired from the complete section image.

4. The information processing method according to claim 1, wherein: The step of acquiring target volume data in the target section image according to the physiological characteristic information in the target section image comprises: In response to an interactive operation on the target section image, acquiring interactive information corresponding to the interactive operation, wherein the interactive information includes any one of lesion measurement information and lesion sign viewing information of the lesion in the target section image; The target volume data in the target section image is acquired according to the interaction information and the physiological characteristic information in the target section image.

5. The information processing method according to claim 4, characterized in that After generating the target video according to the plurality of video frames, the method further includes: determining a target lesion area in the target video corresponding to the interaction information according to lesion features of the lesion in the target video; The target lesion area is marked according to a preset identifier and then displayed.

6. The information processing method according to claim 1, wherein: After generating the target video according to the plurality of video frames, the method includes: Acquire, from the plurality of video frames, a plurality of target video frames having display quality higher than a preset quality threshold according to display characteristic parameters of the lesions in the plurality of video frames; According to the temporal relationship between the multiple video frames, the multiple target video frames are spliced ​​together to generate a target video.

7. The information processing method according to any one of claims 1 to 6, characterized in that: Methods for determining cross-sectional images include: In response to the slice construction operation, volume data is obtained from a sequence of medical images corresponding to the source video; A cross-sectional image is constructed based on the target volume data.

8. An information processing device, characterized in that include: a first acquisition module, configured to acquire a target section image, and acquire target volume data in the target section image and key feature information corresponding to the target volume data based on physiological feature information in the target section image; A second acquisition module is configured to acquire, based on the target volume data and the key feature information, a plurality of video frames in a source video corresponding to the target volume data; A generation module is used to generate a target video according to the multiple video frames.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor is enabled to perform the steps of any one of the methods of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The method comprises a computer program. When the computer program is run on an electronic device, the computer program is used to enable the electronic device to execute the steps of any one of the methods of claims 1 to 7.

Images