A screen interactive display method and device based on elastic waves
By using elastic wave-based screen interactive display method on the medical interaction tablet, detecting and matching elastic wave features to trigger the concentrated display or amplification display function, the problem of cumbersome operation process of application tools in the prior art is solved, and a more efficient user interaction experience is achieved.
Patent Information
- Application Number
- CN202110436273.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-04-22
- Publication Date
- 2025-05-23
- Estimated Expiration
- 2041-04-22
AI Technical Summary
When using application tools, the existing medical interactive tablets have cumbersome operational processes and poor user operation experience.
The screen interactive display method based on elastic waves is adopted, and the focus display or amplification display function of the medical image is directly exposed to the concentrated display or enlarged display function by receiving touch operations, detecting elastic wave characteristics and querying the pre-stored mapping relationship.
It simplifies the process of opening application tools, improves the efficiency of medical image interactive display operations, and optimizes the user's operating experience.
Smart Images

Figure CN114690932B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of human-computer interaction technology, and in particular, to a screen interactive display method and device based on elastic waves. Background Art
[0002] At present, in order to facilitate doctors to view medical images through medical interactive tablets, a sidebar is developed on the medical interactive tablet. The sidebar is equipped with a variety of application tools, and each application tool provides corresponding application functions to assist users in viewing medical images. However, when using the application tool, the user needs to click on the screen to open the sidebar, click and select the corresponding application tool in the sidebar to use the corresponding function. The entire operation process is relatively cumbersome and the user operation experience is poor. Summary of the invention
[0003] The embodiments of the present application provide a screen interactive display method and device based on elastic waves, which can simplify the opening process of application tools and solve the technical problem of complicated operation process of application tools.
[0004] In a first aspect, an embodiment of the present application provides a screen interactive display method based on elastic waves, comprising:
[0005] Receiving a first touch operation on a current medical image display area of the medical interactive tablet, and detecting a first elastic wave feature corresponding to the first touch operation;
[0006] Based on the first elastic wave feature, a pre-stored mapping relationship is queried, wherein the mapping relationship is pre-bound and stored based on the standard elastic wave feature of the touch tool and the corresponding application function, and the application function is a regional spotlight display function or a regional magnification display function, which is used to trigger the corresponding interactive display operation of the medical image;
[0007] Determine whether the first elastic wave feature matches the corresponding standard elastic wave feature, determine the touch position of the first touch operation in response to the first touch operation, and focus or enlarge the corresponding area of the medical image corresponding to the touch position and according to the mapping relationship; determine that the first elastic wave feature does not match the corresponding standard elastic wave feature, determine the first touch feature of the first touch operation, generate and display the corresponding touch handwriting based on the first touch feature, or call the corresponding control to respond to the first touch operation.
[0008] In a second aspect, an embodiment of the present application provides a screen interactive display device based on elastic waves, comprising:
[0009] A detection module, configured to receive a first touch operation on a current medical image display area of the medical interactive tablet, and detect a first elastic wave feature corresponding to the first touch operation;
[0010] A query module, used for querying a pre-stored mapping relationship based on the first elastic wave feature, wherein the mapping relationship is pre-bound and stored based on the standard elastic wave feature of the touch tool and the corresponding application function, wherein the application function is a regional spotlight display function or a regional magnification display function, and is used for triggering a corresponding interactive display operation of the medical image;
[0011] A response module is used to determine whether the first elastic wave feature matches the corresponding standard elastic wave feature, determine the touch position of the first touch operation in response to the first touch operation, and focus or enlarge the corresponding area of the medical image corresponding to the touch position and according to the mapping relationship; determine that the first elastic wave feature does not match the corresponding standard elastic wave feature, determine the first touch feature of the first touch operation, generate and display the corresponding touch handwriting based on the first touch feature, or call the corresponding control to respond to the first touch operation.
[0012] In a third aspect, an embodiment of the present application provides a medical interactive tablet, including:
[0013] memory and one or more processors;
[0014] The memory is used to store one or more programs;
[0015] When the one or more programs are executed by the one or more processors, the one or more processors implement the elastic wave-based screen interactive display method as described in the first aspect.
[0016] In a fourth aspect, an embodiment of the present application provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute the elastic wave-based screen interactive display method as described in the first aspect.
[0017] In an embodiment of the present application, by receiving a first touch operation on the current medical image display area of the medical interactive tablet, a first elastic wave feature corresponding to the first touch operation is detected; based on the first elastic wave feature, a pre-stored mapping relationship is queried. The mapping relationship is pre-bound and stored based on the standard elastic wave feature of the touch tool and the corresponding application function. The application function is an area spotlight display function or an area magnification display function, which is used to trigger the corresponding interactive display operation of the medical image; it is determined that the first elastic wave feature matches the corresponding standard elastic wave feature. In response to the first touch operation, the touch position of the first touch operation is determined, and the corresponding area of the medical image is spotlight displayed or magnified displayed according to the mapping relationship corresponding to the touch position; it is determined that the first elastic wave feature does not match the corresponding standard elastic wave feature, the first touch feature of the first touch operation is determined, and based on the first touch feature, a corresponding touch handwriting is generated for display or a corresponding control is called to respond to the first touch operation. By adopting the above technical means, through the rapid detection and matching of the elastic wave features of the touch tool, the spotlight display and magnification display operations of the medical image can be realized, so as to simplify the startup process of the application function, meet the different interactive display operation requirements of the medical image, improve the efficiency of the interactive display operation, and optimize the user's operation experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 is a flowchart of a screen interactive display method based on elastic waves provided in Embodiment 1 of the present application;
[0019] Figure 2 is a schematic diagram of the initial display of a medical image in Embodiment 1 of the present application;
[0020] Figure 3 is a schematic diagram of the display of touch handwriting in Embodiment 1 of the present application;
[0021] Figure 4 is a schematic diagram of the spotlight display of a medical image in Embodiment 1 of the present application;
[0022] Figure 5 is a schematic diagram of the magnification display of a medical image in Embodiment 1 of the present application;
[0023] Figure 6 is a schematic diagram of the medical interactive tablet exiting the spotlight display and displaying touch handwriting in Embodiment 1 of the present application;
[0024] Figure 7 is a schematic diagram of the medical interactive tablet re-determining the touch position and performing spotlight display in Embodiment 1 of the present application;
[0025] Figure 8 is a schematic diagram of the scaling of the spotlight display area in Embodiment 1 of the present application;
[0026] Fig. 9is a schematic diagram of zoomed display of the enlarged display area in the first embodiment of the present application;
[0027] Fig.10 This is a schematic diagram of displaying a medical record document in Embodiment 1 of the present application;
[0028] Fig.11 This is a flowchart of mapping relationship construction in Example 1 of the present application;
[0029] Fig.12 This is a schematic diagram of mapping relationship binding in Example 1 of the present application;
[0030] Fig.13 This is a schematic diagram of the reconstruction of the mapping relationship in the first embodiment of the present application;
[0031] Fig.14 It is a structural schematic diagram of a screen interactive display device based on elastic waves provided in Example 2 of the present application;
[0032] Fig.15 This is a structural schematic diagram of a medical interactive tablet provided in Example 3 of the present application. DETAILED DESCRIPTION
[0033] In order to make the purpose, technical scheme and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for the convenience of description, only the part related to the present application but not all the contents are shown in the accompanying drawings. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow chart describes each operation (or step) as a sequential process, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. The process can be terminated when its operation is completed, but it can also have additional steps not included in the accompanying drawings. The process can correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
[0034] The present application provides a screen interactive display method based on elastic waves, which aims to trigger the corresponding application function through elastic wave detection and matching, so as to realize simple and efficient interactive display operation of medical images, thereby simplifying the cumbersome process of enabling medical image application functions and optimizing the user interaction experience. Compared with traditional medical interactive tablets, when displaying medical images, users need to find application tools from the sidebar provided on the screen of the medical interactive tablet, and then click to select the application tool to use the corresponding application function. The whole process is relatively complicated. If the application tool to be used is not pre-placed in the sidebar, more interactive operators are required to enable the application function provided by the application tool, and the operation experience is relatively poor. Based on this, a screen interactive display method based on elastic waves is provided in an embodiment of the present application to solve the technical problem of the cumbersome operation process of existing application tools.
[0035] Embodiment 1:
[0036] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only the parts related to the present application, rather than all structures, are shown in the accompanying drawings.
[0037] It should be noted that, in the present application, relational terms such as first and second are only used to distinguish one entity or operation or object from another entity or operation or object, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations or objects. For example, the "first" and "second" of the first touch operation and the second touch operation are used to distinguish the interactive operations of touching the screen cover at two different times. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to the specific circumstances. In addition, in the description of the present application, unless otherwise specified, "multiple" means two or more. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.
[0038] The elastic wave-based screen interactive display method provided in the embodiment of the present application can be executed by an elastic wave-based screen interactive display device, which can be implemented by software and / or hardware, and can be composed of two or more physical entities or one physical entity. For example, the elastic wave-based screen interactive display device can be a computer, tablet, or medical interactive tablet with a touch function or other smart device.
[0039] For ease of understanding, the embodiments are described exemplarily by taking a medical interactive tablet as a screen interactive display device based on elastic waves. Figure 1 A flowchart of a screen interactive display method based on elastic waves provided in the first embodiment of the present application is given, referring to Figure 1 The elastic wave-based screen interactive display method specifically includes:
[0040] S110: Receive a first touch operation on a current medical image display area of a medical interactive tablet, and detect a first elastic wave feature corresponding to the first touch operation.
[0041] Specifically, during the use of the medical interactive tablet, the user realizes human-computer interaction by touching the screen of the medical interactive tablet. After the screen of the medical interactive tablet displays the medical image through relevant human-computer interaction operations, the medical interactive tablet detects the touch operation on the area where the medical image is currently displayed on the screen, and realizes the relevant interactive display operation of the medical image based on the detection and response of the corresponding touch operation. In order to trigger the corresponding application function by touching the medical image with the relevant touch tool, the embodiment of the present application adopts the method of elastic wave feature detection and matching to bind the elastic wave features of different touch tools with the corresponding application function. When the elastic wave feature of the corresponding touch tool is detected, the corresponding application function is triggered to perform the interactive display operation of the current medical image. Among them, when using the medical interactive tablet to view the medical image, the touch operation generated by the contact between the touch tool and the screen cover of the medical interactive tablet is detected, and this touch operation is defined as the first touch operation. The signal feature obtained by converting the elastic wave generated by the first touch operation is the first elastic wave feature. The elastic wave characteristics are detected by the piezoelectric elastic wave sensor of the medical interactive tablet. The piezoelectric elastic wave sensor is arranged at the screen frame or the inner side of the screen cover. It can convert the elastic wave into a voltage signal, and transmit the voltage signal to the IC chip with a temperature compensation circuit through the flexible printed circuit board for amplification and processing, and then convert it into a digital touch signal, which is the corresponding elastic wave characteristic, through the analog-to-digital conversion circuit.
[0042] Furthermore, the medical interactive tablet of the embodiment of the present application can be an integrated device that operates the content displayed on the display screen and realizes human-computer interaction through touch technology, which integrates one or more functions such as a projector, an electronic whiteboard, a curtain, an audio system, a television, and a video conferencing terminal. The display screen includes a screen cover, which is a cover glass set on the surface of the medical interactive flat screen display screen to protect the display screen from being scratched by touch objects. In practical applications, the hardware part of the medical interactive tablet consists of a display screen and an intelligent processing system, which are combined together by an integral structural member and are also supported by a dedicated software system, wherein the display screen has a touch function. In the embodiment, the display screen displays an electronic whiteboard, and the user can touch the display screen with a finger or a stylus, and the intelligent processing system performs corresponding interactive operations according to the touch operation input by the user. Typically, the medical interactive tablet is installed with at least one type of operating system, wherein the operating system includes but is not limited to the Android system, the Linux system, and the Windows system, and the touch operation received by the display screen is processed by the operating system to realize the corresponding human-computer interaction operation. It should be noted that when various touch tools touch the screen cover of the medical interactive tablet (including point touch and slide), elastic waves with corresponding object characteristics will be generated. The elastic wave starts from the contact point between the touch tool and the screen, and propagates around along the screen cover or to the inside of the cover. At this time, the piezoelectric elastic wave sensor located at the screen frame or the inside of the screen cover can convert the physical vibration signal of the elastic wave into a voltage signal, which is transmitted to the IC chip with a temperature compensation circuit through a flexible circuit board for amplification and processing, and converted into a digital touch signal through an analog-to-digital conversion circuit. It can be understood that different touch tools generate different elastic wave signals when touching the screen cover, and the corresponding elastic wave characteristics (i.e., digital touch signals) are also different, so different touch tools can be distinguished by elastic wave characteristics. The elastic wave characteristics are used as input signals, and the identification of the touch tool is output through the machine learning model, and the touch tool corresponding to the elastic wave characteristics is determined by the identification of the touch tool. After the medical interactive tablet obtains the elastic wave characteristics of the touch tool, the elastic wave characteristics are input into the pre-trained machine learning model, and the machine learning model outputs the identification of the touch tool corresponding to the elastic wave characteristics. Correspondingly, the elastic wave characteristics of the touch tool (such as a stylus) are used as the model input signal, and the identification of the touch tool is output through the machine learning model, so that the medical interactive tablet can detect each touch tool.
[0043] More specifically, a detection scheme for touch operation of the embodiment of the present application is provided. In which, the touch operation is detected by combining an optical touch sensor with a piezoelectric elastic wave sensor, the optical touch sensor is used to detect the touch characteristics (such as touch position, click, slide, etc.) of the touch operation, and the piezoelectric elastic wave sensor is used to detect the elastic wave characteristics of the touch operation.
[0044] In the embodiment of the present application, in order to realize the touch function of the screen, optical touch sensors are arranged on both sides of the screen surface. When the touch tool touches the screen cover, the optical touch sensor scans the touch tool through the optical signal to sense the operation of the touch tool on the screen cover. Specifically, the optical touch sensor includes an infrared transmitter and an infrared receiver. The infrared transmitter is used to transmit infrared light, and the infrared receiver is used to receive infrared light. The infrared light densely distributed in different directions forms a beam grid to locate the touch point. Exemplarily, M infrared transmitters are arranged on one side of the horizontal direction of the display screen, and N infrared transmitters are arranged on one side of the vertical direction. Correspondingly, M infrared receivers are arranged on the other side of the horizontal direction, and N infrared receivers are arranged on the other side of the vertical direction. The infrared transmitter transmits infrared light at a certain frequency, and the corresponding infrared receiver receives infrared light at a certain frequency. When the touch tool touches the screen cover, the touch tool will completely or partially block one or more vertical and horizontal infrared lights, and then obtain an M*N infrared light intensity pixel map. First, find a position on the infrared light intensity pixel map that is greater than the first light intensity threshold. The first light intensity threshold represents a real and effective touch, rather than noise or the light intensity measured when the infrared light is half-blocked when an object is close but not completely touched. The real touch position is the touch position when the touch tool contacts the screen cover. Further, find a position in the vicinity of the real touch position that is greater than the second light intensity threshold. The second light intensity threshold is greater than the noise value, which can represent the extension of the real touch area. Mark the position in the vicinity of the real touch position that is greater than the second light intensity threshold as a valid touch area. The area of the touch area is the contact area between the touch tool and the screen cover. When the touch tool moves on the screen cover, multiple frames of continuous infrared light intensity pixel maps record the touch position and contact area of the touch tool on the screen cover. The moving speed of the touch tool on the screen cover can be obtained through the touch position and contact area recorded in the continuous frames. When the touch tool leaves the screen cover, the touch tool's shielding of infrared light becomes smaller. If the touch position in the previous frame of the infrared light intensity pixel map, the relative position in the current infrared light intensity pixel map, and the pixels in the adjacent area do not exceed the third light intensity threshold, then it is determined that the relationship between the touch tool and the screen cover is out of touch, and the third light intensity threshold represents the maximum light intensity when out of touch. It is understandable that when the user touches the screen cover of the display screen with a touch tool, the optical touch sensor installed on the display screen will measure the contact area between the touch tool and the screen cover, the moving speed of the touch tool on the screen cover, and the touch position when the touch tool contacts the screen cover. That is, touch features such as contact area, moving speed, and touch position are all measured by the optical touch sensor.
[0045] On the other hand, when the piezoelectric elastic wave sensor detects the elastic wave feature, it first converts the physical vibration signal of the elastic wave into a voltage signal. The continuous voltage signal will be scanned at a certain frequency f. When its voltage value is greater than the set first voltage threshold V1, the voltage value will be recorded as an effective piezoelectric value higher than the noise, otherwise it will be recorded as zero voltage. It should be noted that since the circuit noise will change with the change of temperature, and the coupling coefficient of the piezoelectric material will also change accordingly with the temperature, the voltage threshold can change accordingly with the change of temperature. Further, the continuous recording of K voltage signals is an elastic wave signal segment, and the duration of the elastic wave signal segment is T0 (T0 = K / f). In the elastic wave signal segment, if none of the K signals is greater than the first voltage threshold V1, the intensity of the elastic wave signal segment does not reach the effective touch intensity and it is discarded; otherwise, it is recorded as a valid digital touch signal (i.e., elastic wave feature).
[0046] Furthermore, according to the different characteristic quantities such as the generation time and frequency of the elastic wave characteristic signal, some noise signals can be removed, such as external vibration, internal speaker or frame vibration, and other vibration signals that are not from touch operations. And, combined with the detection information of the optical touch sensor, the time period when the valid signal appears can be determined, and the elastic wave signals in other time periods are all signals caused by non-touch. Removing non-valid touch signals in different time periods is conducive to the identification and judgment of touch tools in subsequent steps.
[0047] Based on the above touch operation detection scheme, when a touch tool touches the screen of the medical interactive tablet, the elastic wave characteristics and touch characteristics of the corresponding touch operation can be detected, and the corresponding human-computer interaction operation can be performed based on the detected touch operation.
[0048] S120. Query a pre-stored mapping relationship based on the first elastic wave feature, wherein the mapping relationship is pre-bound and stored based on the standard elastic wave feature of the touch tool and the corresponding application function, and the application function is a regional spotlight display function or a regional magnification display function, which is used to trigger the corresponding interactive display operation of the medical image.
[0049] The medical interactive tablet can query the pre-stored mapping relationship based on the detected first elastic wave feature, and compare and match the first elastic wave feature. Prior to this, the medical interactive tablet pre-collects the elastic wave feature of the touch tool and defines this elastic wave feature as the standard elastic wave feature. When the first elastic wave feature matches the standard elastic wave feature, it can be determined that the touch object of the current screen is the touch tool corresponding to the pre-stored mapping relationship. By binding the standard elastic wave feature with the corresponding application function, the application function is used to trigger the corresponding interactive display operation of the medical image. It can be understood that if the first elastic wave feature is determined to match the standard elastic wave feature through the mapping relationship query, the application function can be used to control the display of the medical image. In the embodiment of the present application, the application function can be a regional spotlight display function or a regional magnification display function. The regional spotlight display function is used to perform regional spotlight display of the corresponding position of the medical image displayed on the screen, and the regional magnification display function is used to perform regional fee magnification display of the corresponding position of the medical image displayed on the screen. Based on the above application functions, users can view the details of the medical image more specifically when viewing the medical image using the medical interactive tablet.
[0050] It should be noted that, according to the actual interactive display operation needs, the mapping relationship between the standard elastic wave characteristics of various touch tools and multiple application functions can be pre-built. Subsequent users can trigger the corresponding application function based on the mapping relationship by touching the screen with touch tools of different materials.
[0051] Specifically, when constructing the mapping relationship, the medical interactive tablet is touched by the touch tool so that the medical interactive tablet collects the elastic wave characteristics of the touch tool. Further, the collected elastic wave characteristics are set as standard elastic wave characteristics through human-computer interaction, and they are bound and stored corresponding to the application functions, thereby completing the construction of the mapping relationship. Moreover, according to actual needs, the application function or standard elastic wave characteristics in the mapping relationship can be modified through human-computer interaction to adapt to different touch requirements.
[0052] Based on the pre-constructed storage of the above mapping relationship, it is possible to determine whether the currently detected first elastic wave feature matches the standard elastic wave feature through subsequent query of the mapping relationship.
[0053] S130, determining that the first elastic wave feature matches the corresponding standard elastic wave feature, determining the touch position of the first touch operation in response to the first touch operation, and focusing or enlarging the corresponding area of the medical image corresponding to the touch position and according to the mapping relationship; determining that the first elastic wave feature does not match the corresponding standard elastic wave feature, determining the first touch feature of the first touch operation, and generating and displaying a corresponding touch handwriting based on the first touch feature or calling a corresponding control to respond to the first touch operation.
[0054] Based on the query result of the above mapping relationship, it is determined whether the detected first elastic wave matches the standard elastic wave feature. It is understandable that the first elastic wave feature is input into a pre-trained machine learning model. If it is detected that the identifier of the corresponding touch object matches the identifier of the touch tool corresponding to the standard elastic wave feature, the first elastic wave feature matches the standard elastic wave feature. At this time, the application function bound to the standard elastic wave feature is triggered to start according to the mapping relationship, and the relevant interactive display operation of the medical image is performed through the application function, thereby completing the medical image interactive display operation process based on elastic wave feature detection and matching in the embodiment of the present application. It is understandable that during the whole process, the user only needs to use the touch tool to touch the medical image displayed on the medical interactive flat screen to realize the interactive display operation of the corresponding application function. On the other hand, if the standard elastic wave feature matching the first elastic wave feature is not detected through the mapping relationship query, the touch handwriting is generated based on the first touch feature of the first touch operation detected by the optical touch sensor or the corresponding control is called to respond to the touch operation.
[0055] In one embodiment, a corresponding touch tool can also trigger the activation of multiple different application functions. Among them, multiple mapping relationships are constructed by binding the standard elastic wave characteristics and different touch characteristics of the touch tool with various application functions. Subsequently, the touch tool is used to perform different touch operations, and the activation of multiple different application functions corresponding to the mapping relationship can be triggered according to the detected elastic wave characteristics and touch characteristics. For example, based on the different touch characteristics generated by single-clicking the screen and double-clicking the screen, the standard elastic wave characteristics of the same stylus are used to bind the touch characteristics of single-clicking the screen and the regional spotlight display function to construct a mapping relationship, and then the stylus can be used to single-click the medical image display area to perform a spotlight display of the corresponding area. Similarly, another mapping relationship is constructed by binding the standard elastic wave characteristics of the same stylus with the touch characteristics of double-clicking the screen and the regional magnification display function, and then the corresponding area can be magnified by double-clicking the medical image display area with the stylus.
[0056] Exemplarily, when a user uses a medical interactive tablet to view medical images, if a certain application function is needed to enable the medical image to perform a corresponding interactive display operation, based on the pre-stored mapping relationship, the medical image is touched by the touch tool corresponding to the standard elastic wave feature pre-bound to the application function. Correspondingly, after the medical interactive tablet detects that the elastic wave feature corresponding to the touch operation matches the standard elastic wave feature, the pre-bound application function is triggered accordingly, and the application function is used to perform the interactive display operation so that the medical image displays the corresponding interactive display effect. When the user touches the screen with a finger or a pen, the medical interactive tablet performs elastic wave detection and comparison based on the above steps S110 to S130, and after determining that its elastic wave feature does not match the standard elastic wave feature, it detects the touch feature of the current touch operation, and then displays the corresponding touch handwriting on the screen according to the touch track of the touch feature, thereby completing the response to the touch operation.
[0057] In the above, by receiving the first touch operation on the current medical image display area of the medical interactive tablet, the first elastic wave feature corresponding to the first touch operation is detected; based on the first elastic wave feature, a pre-stored mapping relationship is queried, and the mapping relationship is pre-bound and stored based on the standard elastic wave feature of the touch tool and the corresponding application function, and the application function is a regional spotlight display function or a regional magnification display function, which is used to trigger the corresponding interactive display operation of the medical image; it is determined that the first elastic wave feature matches the corresponding standard elastic wave feature, and in response to the first touch operation, the touch position of the first touch operation is determined, and the corresponding area of the medical image is spotlighted or magnified according to the touch position and the mapping relationship; it is determined that the first elastic wave feature does not match the corresponding standard elastic wave feature, and the first touch feature of the first touch operation is determined, and the corresponding touch handwriting is generated and displayed based on the first touch feature or the corresponding control is called to respond to the first touch operation. By adopting the above technical means, the spotlight display and magnification display operations of the medical image can be realized through the rapid detection and matching of the elastic wave feature of the touch tool, so as to simplify the startup process of the application function, meet the different interactive display operation requirements of medical images, improve the efficiency of interactive display operations, and optimize the user's operation experience.
[0058] On the basis of the above-mentioned embodiments, a more specific implementation method of the screen interactive display method based on elastic waves of the embodiments of the present application is provided. Among them, the application functions include regional spotlight display functions and / or regional magnification display functions. It can be understood that the embodiments of the present application trigger the regional spotlight display function and / or regional magnification display function based on the detection and matching of elastic waves, which can meet the display needs of users when using medical interactive screen tablets. The regional spotlight display operation and / or regional magnification display operation of medical images are realized through a single touch operation, so as to meet the different display needs of users for medical images and further optimize the user's operating experience. It should be noted that, according to the actual interactive display needs, the application functions can be various common functions in the medical image display scene. The embodiments of the present application do not impose fixed restrictions on specific application functions, which will not be elaborated here.
[0059] In some embodiments, mapping relationships can also be pre-stored corresponding to application functions such as screenshots, annotations, and collections of medical images, and the above application functions can be triggered subsequently based on elastic wave detection and matching, so that medical images can perform various interactive display operations and adaptively meet various interactive display needs of users.
[0060] For example, refer to Figure 2 , a schematic diagram of the medical image display of an embodiment of the present application is provided. In the initial state, the screen 11 of the medical interactive tablet has not received any touch operation, and the medical image on the screen 11 is displayed in the initial state. Furthermore, a touch pen is used as a touch tool to trigger the regional spotlight display function or the regional magnification display function, and a corresponding mapping relationship is pre-built. The remaining touch tools (such as fingers) for which no mapping relationship has been established can be used to trigger the generation of touch pen traces. For example, Figure 3 As shown, when the medical image display area of the screen 11 is touched by finger 13, the medical interactive tablet does not find the standard elastic wave feature that matches the first elastic wave feature according to the mapping relationship query. At this time, the corresponding touch handwriting is generated and displayed according to the touch feature of finger 13. Correspondingly, if the medical image display area of the screen 11 is touched by a stylus pen, the medical interactive tablet will perform the regional spotlight display function or regional magnification display operation of the corresponding area according to the mapping relationship query. By touching the screen with different objects to perform different interactive operations, the triggering of the corresponding application function can be convenient.
[0061] In some embodiments, different interactive display operations can be performed based on two parts of the same object made of different materials. For example, the stylus tip is used to perform a touch handwriting generation operation, while the stylus head is used to perform a regional spotlight display or regional magnification display operation. By using two parts made of different materials, the tip and the head, to trigger different interactive display operations, multiple interactive display operations can be performed using only one object, and the operation process is relatively convenient, which can further optimize the user's operating experience.
[0062] Specifically, when determining that the first elastic wave feature matches the corresponding standard elastic wave feature and responding to the first touch operation, the embodiment of the present application first determines the touch position of the first touch operation. The touch position is determined based on the above-mentioned optical touch sensor, and the set range of the center is further determined as the display area with the touch position as the center. Then, the selected display area on the medical image is focused or enlarged.
[0063] Furthermore, when it is necessary to focus the corresponding position of the medical image, such as Figure 4 As shown, with the stylus 12 as a touch tool, the elastic wave characteristics of the stylus 12 are pre-set to standard elastic wave characteristics and bound to the regional spotlight display function to build a mapping relationship. The user uses the stylus 12 to touch the corresponding position of the medical image on the screen 11. At this time, the medical interactive tablet detects the touch operation of the stylus 12, detects and matches the elastic wave characteristics of the touch operation based on the above steps S110 to S130, and then responds to the touch operation, triggering the regional spotlight display function based on the pre-stored mapping relationship. According to the touch position of the stylus 12, the display area corresponding to the touch position is spotlighted. At this time, the part of the area outside the display area on the medical image corresponding to the touch area will be displayed in the form of masking, shading, etc., so as to achieve the spotlight display effect of the display area.
[0064] On the other hand, when the corresponding position of the medical image needs to be enlarged and displayed, such as Figure 5 As shown, with the stylus 12 as a touch tool, the elastic wave characteristics of the stylus 12 are pre-set to standard elastic wave characteristics and bound to the regional magnification display function to establish a mapping relationship. The user uses the stylus 12 to touch the corresponding position of the medical image displayed on the screen 11. At this time, the medical interactive tablet detects the touch operation of the stylus 12, detects and matches the elastic wave characteristics of the touch operation based on the above steps S110 to S130, and then responds to the touch operation, triggering the regional magnification display function based on the pre-stored mapping relationship. According to the touch position of the stylus 12, the display area corresponding to the touch position is enlarged and displayed. At this time, the partial area outside the display area on the medical image is displayed in the original display style.
[0065] As described above, through the spotlight display and magnified display operations of medical images, different interactive display operation requirements of medical images can be met, so that the display of medical images can adapt to the viewing requirements of users, and the user's operating experience can be further optimized.
[0066] On the basis of the above-mentioned embodiment, after the medical interactive tablet corresponds to the touch position and performs spotlight display or magnified display on the corresponding area of the medical image according to the mapping relationship, the embodiment of the present application further receives a second touch operation on the current medical image display area, and detects a second elastic wave feature corresponding to the second touch operation;
[0067] Based on the mapping relationship, determine whether the second elastic wave feature matches the corresponding standard elastic wave feature. If so, redetermine the touch position based on the second touch operation, and focus display or enlarge display the corresponding area of the medical image based on the redetermined touch position; if not, exit the current focus display or enlarge display of the corresponding area, determine the second touch feature of the second touch operation, generate and display the corresponding touch handwriting based on the second touch feature, or call the corresponding control to respond to the second touch operation.
[0068] For example, after the medical interactive tablet zooms in on the corresponding area in response to the first touch operation, it performs a corresponding interactive display operation according to the user's second touch operation on the current medical image display area. Figure 6 As shown, when the user touches the medical image display area of the current screen 11 with the finger 13, since the mapping relationship is not established in advance with the elastic wave feature of the finger 13, it is determined that the second elastic wave feature does not match the corresponding standard elastic wave feature. At this time, the medical interactive tablet exits the spotlight display of the previous corresponding area. And the corresponding touch track is generated and displayed through the touch feature of the second touch operation. On the other hand, Figure 7 As shown, when the user touches the medical image display area of the current screen 11 with the stylus 12, the second elastic wave feature is determined to match the corresponding standard elastic wave feature according to the pre-established mapping relationship, and the medical interactive tablet exits the spotlight display of the previous corresponding area. And through the touch position of the second touch operation, the spotlight display operation of the area corresponding to the re-determined touch position is performed.
[0069] As described above, according to the user's real-time touch operation, the spotlight display or enlarged display of the current corresponding area is exited, and according to the second touch operation, the corresponding touch handwriting is generated or the corresponding area is re-determined for regional spotlight display or regional enlarged display, so that the interactive display operation of the medical interactive tablet can adapt to the user's real-time display needs and meet the user's corresponding display needs for medical images.
[0070] Based on the above embodiments, in the embodiments of the present application, after the medical interactive tablet corresponds to the touch position and focuses or enlarges the corresponding area of the medical image according to the mapping relationship, it further responds to the received third touch operation and performs a screenshot operation on the corresponding area of the focused or enlarged display.
[0071] Exemplarily, after the medical interactive tablet zooms in and displays the corresponding area in response to the first touch operation, when a screenshot of the display area needs to be taken, the user uses the stylus 12 to long press the display area. At this time, the medical interactive tablet detects the third touch operation and determines that the third touch operation is a predefined touch operation for the screenshot display area. At this time, in response to the third touch operation, the medical image of the corresponding area is captured and saved.
[0072] As described above, by providing a screenshot operation of the medical image spotlight / magnification display area, it is convenient for users to save medical image observation results, improve the efficiency of medical image viewing and analysis, optimize the medical image viewing efficiency, and correspondingly improve the user's work efficiency.
[0073] On the basis of the above embodiment, the embodiment of the present application further performs zooming display on the display area of the spotlight display or the magnified display. Among them, after the medical interactive tablet responds to the first touch operation and performs the interactive display operation of the corresponding application function according to the mapping relationship, it also includes:
[0074] In response to the received fourth touch operation, a zoom operation is performed on a corresponding area of the focused display or the enlarged display.
[0075] For example, refer to Figure 8 After using the stylus 12 to trigger the regional spotlight display function, when the display area needs to be zoomed in and out, the user touches the screen 11 with the stylus 12 and slides upwards. At this time, the medical interactive tablet detects the touch operation and determines that the touch operation is a predefined touch operation for controlling the display area to be enlarged. At this time, in response to the fourth touch operation, the display area is enlarged. Similarly, the user touches the screen with the stylus and slides downwards. At this time, the medical interactive tablet detects the touch operation and determines that the touch operation is a predefined touch operation for controlling the display area to be reduced. At this time, in response to the fourth touch operation, the display area is reduced.
[0076] On the other hand, refer to Fig. 9After using the stylus 12 to trigger the area zoom display function, when the display area needs to be zoomed in and out, the user touches the screen 11 with the stylus 12 and slides upwards. At this time, the medical interactive tablet detects the touch operation and determines that the touch operation is a predefined touch operation for controlling the zooming in of the display area. At this time, in response to the fourth touch operation, the display area is zoomed in. Similarly, the user touches the screen with the stylus and slides downwards. At this time, the medical interactive tablet detects the touch operation and determines that the touch operation is a predefined touch operation for controlling the zooming out of the display area. At this time, in response to the fourth touch operation, the display area is zoomed out.
[0077] As described above, through the zooming display operation of the focused display area or the enlarged display area of the medical image, the display effect of the focused display area or the enlarged display area can be adapted to the viewing needs of the user, and the user's operating experience can be further optimized.
[0078] In addition, in some embodiments, the display area can also be controlled to be zoomed and displayed through corresponding interactive operations. For example, the pressure value of the stylus touching the display area is detected by a pressure-sensitive pressure sensor, and the size of the display area is adjusted according to the change in pressure. Specifically, the essence of the pressure-sensitive pressure sensor is a piezoresistor, which can cause a change in resistance according to the change in pressure. By applying a constant voltage to the pressure-sensitive sensor, the output current value can be detected, and then the change in the piezoresistor can be obtained, thereby inferring the change in sensor pressure. The piezoresistor is set under the screen cover or at the frame. Due to the superposition of force, multiple pressure sensors can sense pressure information at different positions. Combined with the optical touch sensor, the pressure of each touch point can be inferred. Based on the above-mentioned pressure-sensitive sensor, the pressure value of the second touch operation can be detected, and then the size of the display area is adjusted according to the pressure value and the pre-set zoom size, so as to achieve adaptive adjustment of the display area.
[0079] On the basis of the above embodiment, the embodiment of the present application also displays the medical record document by detecting and matching the elastic wave. Among them, after the medical interactive tablet responds to the first touch operation and performs the interactive display operation of the corresponding application function on the medical image according to the mapping relationship, it also includes:
[0080] A fifth touch operation on the screen is received, and it is determined that the elastic wave feature of the fifth touch operation matches the predefined elastic wave feature. In response to the fifth touch operation, a medical record document pre-bound to the medical image is displayed.
[0081] For example, refer to Fig.10, using finger 13 as a touch tool, predetermine the elastic wave feature of the fifth touch operation generated by finger 13 touching screen 11, set this elastic wave feature as a predefined elastic wave feature, and bind the predefined elastic wave feature with the call-out and display function of the medical record document to build a mapping relationship. Later, when the user views the medical image, if the medical record document corresponding to the medical image needs to be called out, the screen 11 is clicked by finger 13. At this time, the medical interactive tablet detects the fifth touch operation of finger 13, compares and matches the elastic wave feature of the fifth touch operation, determines that the elastic wave feature matches the predefined elastic wave feature, and then triggers the call-out and display function of the medical record document in response to the fifth touch operation. According to the mapping relationship between the medical image and the medical record document, the corresponding medical record document is called out and displayed on the screen.
[0082] As described above, by calling out and displaying the medical record document, the interactive operations for calling out and displaying the medical record document can be reduced, thereby improving the user's work efficiency and interactive operation experience.
[0083] Based on the above embodiments, the present application also provides a specific implementation method for storing mapping relationship binding, wherein, referring to Fig.11 , providing a binding flow chart of a mapping relationship, wherein the mapping relationship is pre-bound and stored based on the standard elastic wave characteristics of the touch tool and the corresponding application function, including:
[0084] S1101 displays a binding interface corresponding to the application function according to the corresponding interactive operation;
[0085] S1102 determines the corresponding standard elastic wave feature based on the touch operation of the touch tool, and binds the corresponding application function with the standard elastic wave feature to establish a mapping relationship.
[0086] Specifically, when the medical interactive tablet pre-builds the mapping relationship, the binding interface is called out through the relevant human-computer interaction operation, and the binding interface of the corresponding application function is selected according to the application function that the user needs to bind. Then, the standard elastic wave features are collected by touching the screen with a touch tool, and bound to the corresponding application function to complete the construction of the mapping relationship.
[0087] For example, Fig.12 As shown, when binding the regional spotlight display function, the binding interface of the regional spotlight display function is called out through relevant interactive operations. At this time, the user touches the screen 11 with the stylus 12, and the medical interactive tablet detects and collects the elastic wave characteristics of the stylus 12, and uses it as the standard elastic wave characteristics and binds it to the regional spotlight display function, thereby completing the construction of the mapping relationship.
[0088] Furthermore, after binding the corresponding application function with the standard elastic wave feature to build a mapping relationship, it also includes:
[0089] A sixth touch operation on the binding interface is received, the elastic wave feature of the sixth touch operation is updated to the standard elastic wave feature, and the mapping relationship is rebuilt by binding with the corresponding application function.
[0090] For example, refer to Fig.13 When the user needs to modify the touch tool bound to the regional spotlight display function, the user calls out the binding interface through interactive operation, and further uses the replacement tool 14 to touch the screen 11 to re-collect the standard elastic wave features. Fig.13 As shown, the mapping relationship is changed by re-collecting the elastic wave characteristics of the replacement tool 14 as the standard elastic wave characteristics and binding it with the regional spotlight display function.
[0091] As described above, through the construction and adaptive modification of mapping relationships, users can use various touch tools and trigger corresponding application functions based on the recognition and matching of elastic waves, reduce the operation process of application function triggering, and implement customized construction and modification of mapping relationships, providing a more convenient and quicker operation method, thereby improving user work efficiency and operation experience.
[0092] Embodiment 2:
[0093] Based on the above embodiments, Fig.14 This is a schematic diagram of the structure of a screen interactive display device based on elastic waves provided in the second embodiment of the present application. Fig.14 The elastic wave-based screen interactive display device provided in this embodiment specifically includes: a detection module 21, a query module 22 and a response module 23.
[0094] The detection module 21 is used for performing a first touch operation on the current medical image display area of the medical interactive tablet, and detecting a first elastic wave feature corresponding to the first touch operation;
[0095] The query module 22 is used to query a pre-stored mapping relationship based on the first elastic wave feature, wherein the mapping relationship is pre-bound and stored based on the standard elastic wave feature of the touch tool and the corresponding application function, wherein the application function is a regional spotlight display function or a regional magnification display function, and is used to trigger a corresponding interactive display operation of the medical image;
[0096] The response module 23 is used to determine whether the first elastic wave feature matches the corresponding standard elastic wave feature, determine the touch position of the first touch operation in response to the first touch operation, and focus or enlarge the corresponding area of the medical image corresponding to the touch position and according to the mapping relationship; determine that the first elastic wave feature does not match the corresponding standard elastic wave feature, determine the first touch feature of the first touch operation, generate and display the corresponding touch handwriting based on the first touch feature, or call the corresponding control to respond to the first touch operation.
[0097] On the basis of the above embodiment, the screen interactive display device based on elastic waves further includes:
[0098] A second detection module, configured to receive a second touch operation on the current medical image display area, and detect a second elastic wave feature corresponding to the second touch operation;
[0099] A second response module is used to determine whether the second elastic wave feature matches the corresponding standard elastic wave feature based on the mapping relationship. If so, the touch position is re-determined based on the second touch operation, and the corresponding area of the medical image is focused or enlarged based on the re-determined touch position; if not, the current focused display or enlarged display of the corresponding area is exited, and the second touch feature of the second touch operation is determined, and the corresponding touch handwriting is generated and displayed based on the second touch feature, or the corresponding control is called to respond to the second touch operation.
[0100] On the basis of the above embodiment, the screen interactive display device based on elastic waves further includes:
[0101] The screenshot module is used to perform a screenshot operation on a corresponding area of the focused display or the enlarged display in response to the received third touch operation.
[0102] On the basis of the above embodiment, the screen interactive display device based on elastic waves further includes:
[0103] The zoom module is used to perform a zoom operation on a corresponding area of the focused display or the enlarged display in response to the received fourth touch operation.
[0104] On the basis of the above embodiment, the screen interactive display device based on elastic waves further includes:
[0105] The display module receives a fifth touch operation on the screen, determines that the elastic wave feature of the fifth touch operation matches the predefined elastic wave feature, and displays the medical record document pre-bound to the medical image in response to the fifth touch operation.
[0106] Based on the above embodiment, the query module 22 includes:
[0107] A binding unit, used to display a binding interface of a corresponding application function according to a corresponding interactive operation;
[0108] A construction unit, configured to determine a corresponding standard elastic wave feature based on a touch operation of a touch tool, and bind the corresponding application function with the standard elastic wave feature to construct a mapping relationship;
[0109] The reconstruction unit is used to receive a sixth touch operation on the binding interface, update the elastic wave characteristics of the sixth touch operation to the standard elastic wave characteristics, and bind and reconstruct the mapping relationship with the corresponding application function.
[0110] In the above, by receiving the first touch operation on the current medical image display area of the medical interactive tablet, the first elastic wave feature corresponding to the first touch operation is detected; based on the first elastic wave feature, a pre-stored mapping relationship is queried, and the mapping relationship is pre-bound and stored based on the standard elastic wave feature of the touch tool and the corresponding application function, and the application function is a regional spotlight display function or a regional magnification display function, which is used to trigger the corresponding interactive display operation of the medical image; it is determined that the first elastic wave feature matches the corresponding standard elastic wave feature, and in response to the first touch operation, the touch position of the first touch operation is determined, and the corresponding area of the medical image is spotlighted or magnified according to the touch position and the mapping relationship; it is determined that the first elastic wave feature does not match the corresponding standard elastic wave feature, and the first touch feature of the first touch operation is determined, and the corresponding touch handwriting is generated and displayed based on the first touch feature or the corresponding control is called to respond to the first touch operation. By adopting the above technical means, the spotlight display and magnification display operations of the medical image can be realized through the rapid detection and matching of the elastic wave feature of the touch tool, so as to simplify the startup process of the application function, meet the different interactive display operation requirements of medical images, improve the efficiency of interactive display operations, and optimize the user's operation experience.
[0111] The elastic wave-based screen interaction display device provided in the second embodiment of the present application can be used to execute the elastic wave-based screen interaction display method provided in the above-mentioned first embodiment, and has corresponding functions and beneficial effects.
[0112] Embodiment three:
[0113] Embodiment 3 of the present application provides a medical interactive tablet, referring to Fig.15The medical interactive tablet includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The number of processors 31 in the medical interactive tablet can be one or more, and the number of memories in the medical interactive tablet can be one or more. The processor 31, memory 32, communication module 33, input device 34, and output device 35 of the medical interactive tablet can be connected via a bus or other means.
[0114] The memory 32, as a computer-readable storage medium, can be used to store software programs, computer executable programs and modules, such as the program instructions / modules corresponding to the screen interactive display method based on elastic waves described in any embodiment of the present application (for example, the detection module, query module and response module in the screen interactive display device based on elastic waves). The memory 32 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the device, etc. In addition, the memory 32 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 32 may further include a memory remotely arranged relative to the processor, and these remote memories may be connected to the device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.
[0115] The communication module 33 is used for data transmission.
[0116] The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, that is, realizes the above-mentioned elastic wave-based screen interactive display method.
[0117] The input device 34 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the device. The output device 35 may include a display device such as a display screen.
[0118] The medical interactive tablet provided above can be used to execute the elastic wave-based screen interactive display method provided in the above-mentioned embodiment 1, and has corresponding functions and beneficial effects.
[0119] Embodiment 4:
[0120] The embodiment of the present application also provides a storage medium containing computer executable instructions, which are used to execute an elastic wave-based screen interactive display method when executed by a computer processor. The elastic wave-based screen interactive display method includes: receiving a first touch operation on a current medical image display area of a medical interactive tablet, and detecting a first elastic wave feature corresponding to the first touch operation; querying a pre-stored mapping relationship based on the first elastic wave feature, wherein the mapping relationship is pre-bound and stored based on a standard elastic wave feature of a touch tool and a corresponding application function, wherein the application function is a regional spotlight display function or a regional magnification display function, and is used to trigger a corresponding interactive display operation of the medical image; determining that the first elastic wave feature matches the corresponding standard elastic wave feature, and in response to the first touch operation, determining a touch position of the first touch operation, and performing spotlight display or magnification display on a corresponding area of the medical image corresponding to the touch position and according to the mapping relationship; determining that the first elastic wave feature does not match the corresponding standard elastic wave feature, determining a first touch feature of the first touch operation, and generating and displaying a corresponding touch handwriting based on the first touch feature or calling a corresponding control to respond to the first touch operation.
[0121] Storage medium - any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media, such as CD-ROM, floppy disk or tape device; computer system memory or random access memory, such as DRAM, DDR RAM, SRAM, EDO RAM, Rambus RAM, etc.; non-volatile memory, such as flash memory, magnetic media (such as hard disk or optical storage); registers or other similar types of memory elements, etc. Storage media may also include other types of memory or combinations thereof. In addition, the storage medium may be located in the first computer system in which the program is executed, or may be located in a different second computer system, which is connected to the first computer system via a network (such as the Internet). The second computer system can provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations (for example, in different computer systems connected by a network). The storage medium may store program instructions (for example, embodied as a computer program) that can be executed by one or more processors.
[0122] Of course, the storage medium containing computer executable instructions provided in an embodiment of the present application, whose computer executable instructions are not limited to the elastic wave-based screen interaction display method as described above, can also execute related operations in the elastic wave-based screen interaction display method provided in any embodiment of the present application.
[0123] The elastic wave-based screen interaction display device, storage medium and medical interactive tablet provided in the above embodiments can execute the elastic wave-based screen interaction display method provided in any embodiment of the present application. For technical details not described in detail in the above embodiments, please refer to the elastic wave-based screen interaction display method provided in any embodiment of the present application.
[0124] The above are only preferred embodiments of the present application and the technical principles used. The present application is not limited to the specific embodiments described herein, and various obvious changes, readjustments and substitutions that can be made by those skilled in the art will not deviate from the scope of protection of the present application. Therefore, although the present application is described in more detail through the above embodiments, the present application is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present application, and the scope of the present application is determined by the scope of the claims.
Claims
1. A screen interactive display method based on elastic waves, It is characterized in that include: Receiving a first touch operation on a current medical image display area of the medical interactive tablet, and detecting a first elastic wave feature corresponding to the first touch operation; Based on the first elastic wave feature, a pre-stored mapping relationship is queried, wherein the mapping relationship is pre-bound and stored based on the standard elastic wave feature of the touch tool and the corresponding application function, and the application function is a regional spotlight display function or a regional magnification display function, which is used to trigger the corresponding interactive display operation of the medical image; Determining that the first elastic wave feature matches the corresponding standard elastic wave feature, determining a touch position of the first touch operation in response to the first touch operation, and performing spotlight display or magnified display on a corresponding area of the medical image corresponding to the touch position and according to the mapping relationship; Determining that the first elastic wave feature does not match the corresponding standard elastic wave feature, determining a first touch feature of the first touch operation, and generating and displaying a corresponding touch handwriting based on the first touch feature or calling a corresponding control to respond to the first touch operation; receiving a second touch operation on the current medical image display area, and detecting a second elastic wave feature corresponding to the second touch operation; Determine, based on the mapping relationship, that the second elastic wave feature matches the corresponding standard elastic wave feature, redetermine the touch position based on the second touch operation, and focus display or enlarge display the corresponding area of the medical image based on the redetermined touch position; determine, based on the mapping relationship, that the second elastic wave feature does not match the corresponding standard elastic wave feature, exit the focus display or enlarge display of the current corresponding area, determine the second touch feature of the second touch operation, generate and display the corresponding touch handwriting based on the second touch feature, or call the corresponding control to respond to the second touch operation.
2. The screen interactive display method based on elastic waves according to claim 1, It is characterized in that After focusing or magnifying the corresponding area of the medical image corresponding to the touch position and according to the mapping relationship, the method further includes: In response to the received third touch operation, a screenshot operation is performed on a corresponding area of the focused display or the enlarged display.
3. The screen interactive display method based on elastic waves according to claim 1, It is characterized in that After focusing or magnifying the corresponding area of the medical image corresponding to the touch position and according to the mapping relationship, the method further includes: In response to the received fourth touch operation, a zoom operation is performed on a corresponding area of the focused display or the enlarged display.
4. The screen interactive display method based on elastic waves according to claim 1, It is characterized in that After focusing or magnifying the corresponding area of the medical image corresponding to the touch position and according to the mapping relationship, the method further includes: A fifth touch operation on the screen is received, and it is determined that the elastic wave feature of the fifth touch operation matches the predefined elastic wave feature. In response to the fifth touch operation, a medical record document pre-bound to the medical image is displayed.
5. The screen interactive display method based on elastic waves according to claim 1, It is characterized in that The mapping relationship is pre-bound and stored based on the standard elastic wave characteristics of the touch tool and the corresponding application function, including: Display the binding interface of the corresponding application function according to the corresponding interactive operation; The corresponding standard elastic wave feature is determined based on the touch operation of the touch tool, and the corresponding application function is bound to the standard elastic wave feature to establish a mapping relationship.
6. The screen interactive display method based on elastic waves according to claim 5, It is characterized in that After binding the corresponding application function with the standard elastic wave feature to establish a mapping relationship, the method further includes: A sixth touch operation on the binding interface is received, the elastic wave feature of the sixth touch operation is updated to the standard elastic wave feature, and the mapping relationship is rebuilt by binding with the corresponding application function.
7. A screen interactive display device based on elastic waves, It is characterized in that include: A detection module, configured to receive a first touch operation on a current medical image display area of the medical interactive tablet, and detect a first elastic wave feature corresponding to the first touch operation; A query module, used for querying a pre-stored mapping relationship based on the first elastic wave feature, wherein the mapping relationship is pre-bound and stored based on the standard elastic wave feature of the touch tool and the corresponding application function, wherein the application function is a regional spotlight display function or a regional magnification display function, and is used for triggering a corresponding interactive display operation of the medical image; A response module, used for determining whether the first elastic wave feature matches the corresponding standard elastic wave feature, determining a touch position of the first touch operation in response to the first touch operation, and performing spotlight display or magnified display on a corresponding area of the medical image corresponding to the touch position and according to the mapping relationship; determining whether the first elastic wave feature does not match the corresponding standard elastic wave feature, determining a first touch feature of the first touch operation, and generating and displaying a corresponding touch handwriting based on the first touch feature or calling a corresponding control to respond to the first touch operation; receiving a second touch operation on the current medical image display area, and detecting a second elastic wave feature corresponding to the second touch operation; Determine, based on the mapping relationship, that the second elastic wave feature matches the corresponding standard elastic wave feature, redetermine the touch position based on the second touch operation, and focus display or enlarge display the corresponding area of the medical image based on the redetermined touch position; determine, based on the mapping relationship, that the second elastic wave feature does not match the corresponding standard elastic wave feature, exit the focus display or enlarge display of the current corresponding area, determine the second touch feature of the second touch operation, generate and display the corresponding touch handwriting based on the second touch feature, or call the corresponding control to respond to the second touch operation.
8. A medical interactive tablet, It is characterized in that include: memory and one or more processors; The memory is used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the elastic wave-based screen interactive display method as described in any one of claims 1-6.
9. A storage medium containing computer executable instructions, It is characterized in that The computer executable instructions are used to execute the elastic wave-based screen interactive display method as described in any one of claims 1-6 when executed by a computer processor.
Citation Information
Patent Citations
Intelligent equipment control method and device
CN110413188A
Handwriting input device, non-transitory recording medium storing computer readable contact body determination program, and contact body determination method
US20160162178A1