Control method, control device, and storage medium for layered time domain files

Abstract

The application relates to a control method and device of a layered time domain file and a storage medium. Based on spatial level attributes and display parameters corresponding to at least two target time domain files, the application determines a target display area of a to-be-displayed sub-file of a target display area in a display interface, and generates a target separation element between adjacent target display areas with spatial correlation. Then, the terminal device displays the corresponding to-be-displayed sub-file and the target separation element in the target display area of the display interface, and adjusts the spatial position of the target separation element and / or the target display area of the display interface when receiving an adjustment operation instruction of the display interface. The range and separation position of the target display area can be flexibly changed according to requirements, local focusing or global adjustment is realized, and the flexibility and convenience of operation are improved. In this way, the efficiency of comparative analysis of multiple layered time domain files can be improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data interaction, in particular to a control method and control device for layered time domain files and a storage medium. BACKGROUND

[0002] A time domain file is a sequence data file with time as the core dimension, and is associated with multiple perspectives and multiple orientations. Referring to the specific content of CN114820575A “Image verification method and device, computer equipment and storage medium”, for example, the three-dimensional target object mentioned in the specification paragraphs

[0043] -

[0044] is a time domain file. As an example, the time domain file can refer to a three-dimensional target object file containing time dimension information. The time domain file can record the dynamic characteristics of the target object at different time points (or time periods), and is also associated with information of multiple perspectives and multiple orientations. In the time dimension, the time domain file contains continuous or discrete time nodes, which can reflect the dynamic changes of the target object over time. In the visual dimension, the time domain data at the same time point can correspond to different observation perspectives, recording the time domain performance of the target object at different observation angles. In the orientation dimension, the time domain data at the same perspective and the same time point can be further associated with different orientations.

[0003] In the fields of engineering monitoring and data analysis, it is often necessary to compare and analyze multiple layered time domain files. Generally, the layered time domain files are compared and analyzed in the form of independent display in multiple split screens or overall superimposed display. Independent display in multiple split screens refers to displaying different time domain files in multiple split screen areas, which can easily lead to the fragmentation of spatial correlation and requires parameter setting for each area, which is tedious. Overall superimposed display refers to superimposing multiple time domain files in the same window and distinguishing different files by color, style, etc. When the data is dense or the characteristics are similar, the superimposed area is prone to occlusion, making it difficult to distinguish independent characteristics. If a local feature needs to be compared, it is easy to produce interference in non-target areas. Therefore, in the traditional way, there is a problem of low efficiency when comparing and analyzing multiple layered time domain files. SUMMARY

[0004] The purpose of the present application is to provide a control method and control device for layered time domain files and a storage medium to solve the problem of low efficiency when comparing and analyzing multiple layered time domain files.

[0005] To achieve the above purpose, the first aspect of the present application provides a control method for layered time domain files, applied to a controller, the controller being in communication with a terminal device, the terminal device including a display interface, and the control method comprising:

[0006] obtaining at least two target time domain files and spatial hierarchy attributes and display parameters corresponding to each of the target time domain files, the display parameters including spatial ranges of to-be-displayed subfiles in the target time domain files;

[0007] determining target display areas of the to-be-displayed subfiles of each of the target time domain files in the display interface based on the spatial hierarchy attributes and the display parameters, and generating target separation elements between adjacent target display areas, wherein there is a spatial correlation between adjacent target display areas;

[0008] controlling the terminal device to display the to-be-displayed subfiles corresponding to each of the target display areas in the target display areas of the display interface respectively, and synchronously display the target separation elements;

[0009] in response to an adjustment operation instruction for the display interface, adjusting spatial positions of the target separation elements and / or the target display areas of the display interface.

[0010] The second aspect of the present application provides a control device of a layered time domain file, applied to a controller, the controller being in communication with a terminal device, the terminal device including a display interface, and the control device including:

[0011] an obtaining module, configured to obtain at least two target time domain files and spatial hierarchy attributes and display parameters corresponding to each of the target time domain files, the display parameters including spatial ranges of to-be-displayed subfiles in the target time domain files;

[0012] a determining module, configured to determine target display areas of the to-be-displayed subfiles of each of the target time domain files in the display interface based on the spatial hierarchy attributes and the display parameters, and generate target separation elements between adjacent target display areas, wherein there is a spatial correlation between adjacent target display areas;

[0013] a display module, configured to control the terminal device to display the to-be-displayed subfiles corresponding to each of the target display areas in the target display areas of the display interface respectively, and synchronously display the target separation elements;

[0014] an adjustment module, configured to, in response to an adjustment operation instruction for the display interface, adjust spatial positions of the target separation elements and / or the to-be-displayed subfiles in the target display areas of the display interface.

[0015] The third aspect of the present application provides a computer readable storage medium, the computer readable storage medium storing a program, the program being loadable by a processor and executable to perform the above-mentioned control method of a layered time domain file.

[0016] The beneficial effects of the present application are:

[0017] The present application determines the target display area of the to-be-displayed sub-file of the target display area based on the spatial level attribute and display parameter corresponding to at least two target time domain files, generates a target separation element between adjacent target display areas with spatial correlation, solves the problem of spatial correlation fragmentation in traditional split screen display, and defines the physical boundary of adjacent target display areas, divides the display interface into independent subspaces, so that the display spaces of different target time domain files are isolated from each other, reduces the situation of pixel overlap and occlusion, and improves the display effect of correlation analysis. Then, the terminal device displays the corresponding to-be-displayed sub-file and the target separation element in the target display area of the display interface, and adjusts the spatial position of the target separation element and / or the target display area of the display interface in the case of receiving an adjustment operation instruction for the display interface, which breaks through the limitations of fixed boundary and hierarchical rigidity in traditional split screen display, and can flexibly change the range and separation position of the target display area according to needs, realize local focusing or global adjustment, and improve the flexibility and convenience of operation. In this way, the efficiency of comparing and analyzing multiple layered time domain files can be improved.

[0018] Other features and advantages of the present application will be described in detail in the following specific embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0019] Figure 1 A schematic diagram of an application scenario of a control method of layered time domain files provided in an embodiment of the present application;

[0020] Figure 2 A flowchart of a control method of layered time domain files provided in an embodiment of the present application;

[0021] Figure 3 A schematic diagram of a display interface provided in an embodiment of the present application;

[0022] Figure 4 A schematic diagram of first gesture information provided in an embodiment of the present application;

[0023] Figure 5 A schematic diagram of second gesture information of a separation element adjustment operation provided in an embodiment of the present application;

[0024] Figure 6 A schematic diagram of second gesture information of a progress bar adjustment operation provided in an embodiment of the present application;

[0025] Figure 7 A schematic diagram of second gesture information of a page turning adjustment operation provided in an embodiment of the present application;

[0026] Figure 8 FIG. 1 is a structural schematic diagram of a control device for a stacked time domain file according to an embodiment of the present application.

[0027] Legend of reference signs

[0028] 1, controller; 2, terminal device; 3, target ring; 4, image acquisition device; 800, control device for a stacked time domain file; 801, acquisition module; 802, determination module; 803, display module; 804, adjustment module. DETAILED DESCRIPTION

[0029] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0030] In the description of the present application, it should be understood that the terms "first", "second" are used only for the purpose of description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include one or more of the features. In the description of the present application, the meaning of "multiple" is two or more, unless otherwise specifically limited. In the present application, the word "exemplary" is used to mean "serving as an example, instance, or illustration". Any embodiment described as "exemplary" in the present application is not necessarily to be construed as preferred or advantageous over other embodiments. In order to enable any person skilled in the art to implement and use the present application, the following description is given. In the following description, details are listed for the purpose of explanation. It should be understood that those skilled in the art can realize the present application without using these specific details. In other examples, well-known structures and processes will not be described in detail to avoid unnecessary details making the description of the present application obscure. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope consistent with the principles and features disclosed in the present application.

[0031] The control method for a stacked time domain file in the embodiments of the present application is applied to a controller. For example, as shown in FIG. 1, the control method for a stacked time domain file in the embodiments of the present application is applied to a controller 1. Figure 1 Figure 1 FIG. 1 is a structural schematic diagram of a control device for a stacked time domain file according to an embodiment of the present application.

[0032] ​In the embodiment of the present application, the target time domain file is a multi-dimensional data set that integrates multi-perspective and multi-directional data with time axis as the main line, and realizes comprehensive recording and multi-dimensional analysis of dynamic changes of the target object by connecting features in different perspectives and directions through the time dimension. The controller 1 is responsible for processing sensor data from the target ring 3 and generating corresponding operation instructions to control the display interface of the terminal device 2 to display the target time domain file.

[0033] The terminal device 2 refers to a device directly interacted by the user, which is used to display the time domain file and execute the operation instruction issued by the user through the target ring 3. For example, a computer, a tablet computer, a smart phone, a virtual reality (VR) wearable device, etc. The target ring 3 refers to a smart device worn on the finger of the user, which is used to capture the hand gesture of the user and generate corresponding sensor data. The target ring usually includes multiple sensors, such as a three-axis accelerometer, a three-axis gyroscope, a capacitive touch sensor, etc.

[0034] As an example, the controller 1 can also communicate with the image acquisition device 4 to acquire real object images, and can be displayed in split screen with the target time domain file of the display interface of the terminal device 2 for the user to make comparative analysis.

[0035] The application scenario of the control method of the layered time domain file in the embodiment of the present application includes the controller 1 used for the method, and the controller 1 can run the computer readable storage medium corresponding to the control method of the layered time domain file to execute the steps of the control method of the layered time domain file.

[0036] It can be understood that, Figure 1 The electronic devices in the application scenario of the control method based on the layered time domain file do not constitute a limitation on the embodiments of the present application, that is, the number and types of devices included in the application scenario of the control method of the layered time domain file, or the number and types of devices included in each electronic device do not affect the overall implementation of the technical solutions in the embodiments of the present application, and can be regarded as equivalent replacements or derivatives of the technical solutions claimed in the embodiments of the present application.

[0037] The controller 1 in the embodiment of the present application can be a standalone device, or a device network or device cluster composed of devices. For example, the controller 1 described in the embodiments of the present application includes but is not limited to a computer, a network host, a single network device, a plurality of network device sets, or a cloud device composed of a plurality of devices. The cloud device is composed of a large number of computers or network devices based on cloud computing.

[0038] Those skilled in the art can understand that, Figure 1The application scenarios shown in the above embodiments are merely one of the application scenarios corresponding to the technical solutions of the present application, and do not constitute a limitation on the application scenarios of the technical solutions of the present application. Other application scenarios can include more or fewer electronic devices, or electronic device network connection relationships, for example Figure 1 Only one electronic device is shown in the above embodiments. It can be understood that the scenario of the control method of the layered time domain file can also include one or more other electronic devices, and the specific number of electronic devices is not limited here. Figure 1 Only one electronic device is shown in the above embodiments. It can be understood that the scenario of the control method of the layered time domain file can also include one or more other electronic devices, and the specific number of electronic devices is not limited here.

[0039] It should be noted that Figure 1 The application scenarios of the control method of the layered time domain file shown in the above embodiments are merely one of the application scenarios corresponding to the technical solutions of the present application, and do not constitute a limitation on the application scenarios of the technical solutions of the present application. The application scenarios of the control method of the layered time domain file described in the embodiments of the present application are for more clearly illustrating the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application.

[0040] Based on the above application scenarios of the control method of the layered time domain file, embodiments of the control method of the layered time domain file are provided. The embodiments will be described in detail below with reference to the accompanying drawings.

[0041] Figure 2 A flowchart of a control method of a layered time domain file provided in the embodiments of the present application is shown in FIG. 2. As shown in FIG. 2, the method can be executed by the controller 1 to perform steps 201-204, which will be described in detail below. Figure 2

[0042] In step 201, at least two target time domain files and a spatial level attribute and a display parameter corresponding to each target time domain file are obtained. The display parameter includes a spatial range of a to-be-displayed sub-file in the target time domain file.

[0043] The target time domain file is a time domain file to be displayed in a layered manner. The spatial level attribute is used to represent the layered priority or the logically associated attribute of the target time domain file. For example, taking a spatial coordinate system as an example, assuming that the plane where the X-axis and the Y-axis of the spatial coordinate system are located is parallel to the plane of the display interface, then the Z-axis coordinate is perpendicular to the display interface. Assuming that the Z-axis coordinate is directed toward the observer, then the larger the Z-axis, the higher the spatial level of the target time domain file. The display parameter is used to represent a parameter set for how the target time domain file is presented, and can include the spatial range of the to-be-displayed sub-file in the target time domain file. The to-be-displayed sub-file is a partial data range that needs to be highlighted and is extracted from the complete target time domain file. By obtaining the spatial level attribute and the display parameter of each target time domain file, display abnormalities caused by inconsistent data formats or missing parameters can be reduced. By predefining the to-be-displayed sub-file, the core area can be focused on, and the initial display interface image can be determined.

[0044] ​In step 202, a target display area of each target time domain file in the display interface is determined based on the spatial hierarchy attribute and the display parameter, and a target separation element is generated between adjacent target display areas, wherein the adjacent target display areas are spatially associated.

[0045] The target display area is a physical area of the display interface allocated to each target sub-file corresponding to the target sub-file. As an example, the spatial range of the target sub-file can be converted into pixel coordinates of the display interface, and then the allocated target display area is determined according to the spatial hierarchy attribute of each target sub-file. For example, the target display area A corresponds to the highest level, and the target display area B corresponds to the second level, so that the display position of each target sub-file in the display interface is determined.

[0046] The target separation element is an identifier for defining adjacent target display areas, for example, a dynamic line, a separation band, and a light and shadow boundary, etc., which has a visual differentiation function. The images of adjacent target display areas have certain correlation in time, logic, or data characteristics, for example, the same characteristics or time axis alignment. A common boundary, i.e., the target separation element, can be generated for adjacent target display areas.

[0047] The conventional separation line for comparing different images is usually a fixed line, and the display parameters such as the display size of the compared images are also fixed values, which cannot be adjusted with the change of the display parameters of the layered time domain file. For example, when the target sub-file of a target time domain file needs to be expanded, the fixed separation line will cause the region to be expanded and overlapped with the adjacent target sub-file or truncated by the separation line, which destroys the integrity of the display. Based on this, the embodiments of the present application can dynamically adjust the target time domain files to be compared according to the needs generated in different scenarios by setting the dynamically adjustable target separation element. For example, if the spatial range of the target sub-file needs to be expanded, the target separation element can move to the right along the common boundary of the adjacent two target time domain files, synchronously adjust the range of the adjacent target sub-file, and ensure the fit of the common boundary.

[0048] In addition, the style of the conventional fixed separation line is uniform, and the comparison of two target time domain files with different correlation indexes is usually based on a relatively fixed visual presentation. The correlation index is an index representing the similarity of the characteristics of the two target time domain files. The style of the target separation element of the embodiments of the present application can be dynamically adjusted according to the correlation index of the two target time domain files, so as to be applicable to different comparison scenarios. For example, a thinner line can be used as the target separation element for two target time domain files with a higher correlation index. Conversely, a thicker line can be used as the target separation element for two target time domain files with a lower correlation index. In this way, the visual effect of the comparison scenario can be improved.

[0049] In step 203, the terminal device is controlled to display each target display region corresponding to a to-be-displayed sub-file in a target display region of the display interface, and synchronously display a target separation element.

[0050] The terminal device can present the to-be-displayed sub-file in the target display region according to the mapping relationship between the to-be-displayed sub-file and the target display region. For example, the controller can send the pixel coordinate range of the to-be-displayed sub-file in the display interface coordinate system and the parameters of the target separation element, generate an image of each target display region based on the pixel coordinate range, and synchronously generate the target separation element. As an example, a double buffering technology can be enabled to reduce visual flicker caused by the asynchronization of display content and the separation element. For example, the drawing can be completed in the background buffer first, and then displayed in the foreground. In this way, it can be ensured that the content seen by the user is aligned with the boundary of the element and the timing is consistent, thereby improving the visual effect.

[0051] In step 204, in response to an adjustment operation instruction for the display interface, the spatial positions of the target separation element and / or the target display region of the display interface are adjusted.

[0052] The adjustment operation instruction can be a control instruction initiated by the user through an interactive device. For example, the adjustment operation instruction can be a control instruction initiated based on a sensor of a target ring, a mouse, a handle, etc. The adjustment operation instruction can be an adjustment of the target separation element, an adjustment of the spatial position based on the target display region, or an adjustment of the spatial positions of the target separation element and the target display region at the same time. For example, the target separation element is dragged for left-right translation, the display size of the target display region is adjusted, and the rotation of the target time domain file of the target display region is controlled, etc. Dynamically adjusting the display interface breaks through the limitation of the fixed layout in the traditional reality, making the operation more flexible and suitable for various contrast scenarios.

[0053] The embodiments of the present application solve the problem of spatial correlation fragmentation in traditional split-screen display, and define the physical boundaries of adjacent target display regions, divide the display interface into independent subspaces, so that the display spaces of different target time domain files are isolated from each other, reducing the situation of pixel overlap and occlusion, and improving the display effect of correlation analysis. By adjusting the spatial positions of the target separation element and / or the target display region of the display interface, the limitations of fixed boundaries and rigid hierarchy in traditional split-screen display are broken, and the range and separation position of the target display region can be flexibly changed according to the needs, realizing local focusing or global adjustment, and improving the flexibility and convenience of operation. In this way, the efficiency of multiple layered time domain files for comparative analysis can be improved.

[0054] In step 201, the spatial level priority of the target time domain file can be determined first to obtain the spatial level attribute corresponding to the target time domain file. Then, based on the range selection instruction, the first coordinate range of the to-be-displayed sub-file of each target time domain file in the spatial coordinate system is determined.

[0055] The spatial level priority of the target time domain file refers to the priority relationship of at least two target time domain files in a certain dimension when they are stacked. Based on the spatial level priority of the target time domain file, the spatial level attribute corresponding to the target time domain file can be determined. For example, taking the Z-axis as the priority judgment, the greater the value of the Z-axis of the target time domain file, the higher the spatial level priority of the target time domain file, and vice versa, the smaller the value of the Z-axis of the target time domain file, the lower the spatial level priority of the target time domain file.

[0056] The range selection instruction is a selection instruction for the range of local data that needs to be displayed as a focus in the target time domain file. For example, a feature area with an X-axis coordinate of 0 to 50 in the target time domain file a, etc. The first coordinate range refers to the three-dimensional boundary of the to-be-displayed sub-file in the spatial coordinate system, for example, (Xmin, Ymin, Zmin) to (Xmax, Ymax, Zmax). The first coordinate range can be used as the basis for subsequent data to determine the position of the to-be-displayed sub-file in the display interface coordinate system. The to-be-displayed sub-file of each target time domain file can be set arbitrarily according to the needs, so in the comparison process, the local display data of each target time domain file can be dynamically changed through the real-time input of the range selection instruction.

[0057] Based on the range selection instruction, the core data of interest is locked, the information redundancy caused by full display is reduced, and the pertinence of data observation is improved. Through the spatial level attribute, the spatial allocation of the target time domain file in the display interface can be optimized, so that the mapping of the to-be-displayed sub-file and the target display area is more flexible and can adapt to various comparison scenarios.

[0058] In step 202, the first coordinate range of the to-be-displayed sub-file can be converted into a second coordinate range in the display interface based on the mapping relationship between the spatial coordinate system and the display interface coordinate system. The first coordinate range is the three-dimensional boundary of the to-be-displayed sub-file in the spatial coordinate system, which is the original data range of the spatial dimension. The second coordinate range is the pixel boundary of the to-be-displayed sub-file in the display interface coordinate system after mapping. Each second coordinate range corresponds to a target display area. The mapping relationship between the spatial coordinate system and the display interface coordinate system can be converted based on a preset conversion rule, for example, origin correspondence, scaling, dimension correspondence, etc. For example, the X-axis of the spatial coordinate system corresponds to the Y-axis of the display interface coordinate system, the Y-axis of the spatial coordinate system corresponds to the X-axis of the display interface coordinate system, and the Z-axis is not directly mapped to the coordinate of the display interface coordinate system, but only as a hierarchical parameter. For another example, if the converted second coordinate range exceeds the display interface, the first coordinate range is scaled down to ensure that the target display area falls within the display interface. Through accurate mapping of spatial data and the display interface, the to-be-displayed sub-file can be accurately restored in the display interface, reducing the proportion of distortion.

[0059] Then, the target display area and the spatial hierarchical attribute corresponding to the to-be-displayed sub-file are mapped. The target display area and the spatial hierarchical attribute can be associated, for example, the target display area A is associated with the to-be-displayed sub-file with hierarchical Z=1, and the target display area B is associated with the to-be-displayed sub-file with hierarchical Z=2. The target display area and the hierarchical level of the to-be-displayed sub-file are bound, that is, the target display area and the hierarchical level of the target time domain file are bound. In this way, the display parameters of the target display area in the display interface can be dynamically set based on display requirements. For example, if the target display area A is replaced with the to-be-displayed sub-file associated with hierarchical Z=2, and the target display area is replaced with B associated with the to-be-displayed sub-file with hierarchical Z=1, the positions of the to-be-displayed sub-files in the display interface can be exchanged. For another example, if the target time domain file with hierarchical Z=3 and Z=4 needs to be replaced, only the mapping relationship between the target display area and the spatial hierarchical attribute needs to be adjusted, without the need to replace multiple superimposed target time domain files, improving the efficiency of comparison.

[0060] For each target display area, a plurality of target time domain files are contained. In order to make each target display area focus on the required to-be-displayed sub-file, the transparency of each target time domain file can be set, so that the display of the target time domain file corresponding to the spatial hierarchy attribute having a mapping relationship with the target display area is clearer. Specifically, for each target display area, the transparency of the target time domain file corresponding to the spatial hierarchy attribute having a mapping relationship can be set to a first transparency, and the transparency of the target time domain file corresponding to the spatial hierarchy attribute not having a mapping relationship can be set to a second transparency. The second transparency is greater than the first transparency. For example, the first transparency can be set to 0%, and the second transparency can be set to 100%. In this way, in each target display area, the to-be-displayed sub-file having a mapping relationship can be displayed as the focus, and the visual focus of the core content can be strengthened.

[0061] In the embodiments of the present application, the target separation element can also be generated based on the correlation index of adjacent target display areas. The correlation index can include the overlap rate of the time axis, data similarity, logical correlation, and the like. As an example, for adjacent target time domain files with high correlation, the target separation element can be faded to improve the visual effect. For adjacent target time domain files with low correlation, the display of the target separation element can be enhanced. For example, the higher the correlation, the higher the transparency of the target separation element, and the thinner the line, so as to display more clearly when distinguishing the correlation features. By the style difference of the target separation element, the boundary is weakened when the correlation is high, and the boundary is strengthened when the correlation is low, which can distinguish different target time domain files while retaining the correlation clues.

[0062] Through coordinate mapping, transparency setting based on spatial hierarchy attributes, and target separation element generation based on correlation, accurate conversion of spatial data to display interface is realized. Through dynamic setting of transparency and target separation element, the problems of non-prominent core content, non-intuitive correlation features, and fixed boundary in traditional layer display are solved, so that the display of the layered target time domain file is clearer, and the efficiency and flexibility of multi-file comparison are improved.

[0063] In step 203, a feature enhancement operation can be performed on each to-be-displayed sub-file. The feature enhancement operation includes edge sharpening, contrast adjustment, and target feature points.

[0064] Edge sharpening refers to enhancing the clarity of edge data and reducing blurring. For example, for the continuous curve of the edge of the target time domain file, a convolution operation can be performed to enhance the gray scale change of the curve edge, so that the curve outline is clearer. For discrete data points, edge outlining of the data points can be increased to reduce the outline blurring caused by overlapping of adjacent points.

[0065] Contrast adjustment refers to amplifying visual differences and reducing feature overexposure. For example, based on the dynamic range of the sub-file to be displayed, a histogram equalization algorithm can be used to stretch the grayscale range of low-contrast areas while compressing oversaturation in high-contrast areas. Contrast can also be individually enhanced for anomalous features.

[0066] Target feature point extraction refers to identifying and labeling key data points. As an example, after acquiring multiple stacked target time-domain files, sub-regions of target time-domain files belonging to the same target display area can be compared to identify different features at the same display location. These distinguishing feature points are then highlighted and displayed on the interface. This visually presents the differences between multiple stacked files, providing users with a data foundation for subsequent analysis.

[0067] Then, the sub-file to be displayed is shown in the target display area corresponding to the sub-file, and a label corresponding to the sub-file is generated in the target display area. This label can include the spatial hierarchy attribute of the sub-file. As an example, a second coordinate range corresponding to the sub-file can be determined in the display interface as the target display area, and then the sub-file can be displayed in the target display area. The label is a metadata identifier attached to the target display area, used to visually display the key attributes of the sub-file, such as spatial hierarchy and Z-axis coordinates.

[0068] By enhancing the features of the sub-files to be displayed and then accurately displaying them in the corresponding target display area, and assigning corresponding labels, the key features of the target time-domain file are strengthened and the attributes of the sub-files to be displayed corresponding to each target display area are presented intuitively, thereby improving the efficiency and accuracy of target time-domain file comparison.

[0069] In step 204, if a first operation command for the display interface is detected, the spatial position of the target display area is locked, and the offset of the target separator element is calculated based on the first operation command. The first operation command is an interactive command used to adjust the position of the target separator element individually, changing the boundary of adjacent target areas without changing the spatial position of the target display area. For example, the first operation command can be a left or right swipe operation on the target separator element. The offset of the target separator element is the change in position of the target separator element based on the first operation command, used to quantify the movement distance and direction of the target separator element.

[0070] Then, the target separator element is adjusted according to the offset, changing the spatial range of the sub-files to be displayed corresponding to each target display area. The sum of the spatial ranges of the two sub-files to be displayed adjacent to the target separator element is a set value. This set value remains constant during the adjustment of the target separator element to ensure that the overall display content is not lost or redundant.

[0071] Figure 3 This is a schematic diagram of a display interface provided in an embodiment of this application. Figure 3 As shown, assuming the first operation command is to move the target delimiter element horizontally in the positive X-axis direction (let's say to the right), the adjustment value from the original coordinates to the new coordinates is ΔX. At this point, the spatial range of the sub-files to be displayed on the left can be changed; the X-axis increases by ΔX, while the right side correspondingly decreases by ΔX. In other words, the number of sub-files to be displayed in the target time-domain file on the left increases, while the number of sub-files to be displayed in the target time-domain file on the right decreases, and the total range of the target time-domain files on both the left and right sides remains unchanged. Thus, a range adjustment that increases on one side and decreases on the other can be achieved.

[0072] If a second operation command is detected targeting the display interface, the position and shape of the target separator element are locked, and the spatial displacement of the sub-file to be displayed in the target display area is calculated based on the second operation command. The second operation command is an interactive command that adjusts the spatial state of one or more target temporal files to change the spatial state of the sub-region to be displayed in the target display area, but does not adjust the target separator element. For example, the second operation command could be a drag operation targeting the sub-region to be displayed in the target display area. The spatial displacement of the sub-file to be displayed in the target display area is the change in position of the sub-file based on the second operation command, used to quantify the change in the spatial state of the sub-file in the target display area. Then, the spatial state of the target display area is adjusted according to the spatial displacement. For example, the change in the spatial state of the sub-region to be displayed is calculated based on the pixel distance of the drag to change the spatial state of the sub-region to be displayed in the target display area.

[0073] If a third operation instruction for the display interface is detected, the spatial positions of all target display regions on the display interface are adjusted based on a reference point. The third operation instruction is used to adjust the spatial state of the to-be-displayed sub-file of all target display regions in the display interface as a whole, so as to change the overall layout view, rather than change a single target display region. For example, the third operation instruction can be a two-finger translation operation on a blank area of the display interface. The reference point is a reference point for overall adjustment, such as selecting the center point of the display interface as the reference point for overall adjustment. Then, the relative positions of the target separation element and the adjacent target display region are kept unchanged, and the form of the target separation element is controlled to follow the transformation of the spatial state of the to-be-displayed sub-file. In this way, the user can move all target display regions at one time, for example, rotate the overall target time domain file counterclockwise by 30°, and the like, solving the cumbersome problem of moving target display regions one by one in the traditional method, and improving the adjustment efficiency. The target separation element and the adjacent target display region boundary always fit, ensuring the integrity of the separation region.

[0074] In the embodiment of the present application, the controller can also communicate with the target ring, and therefore, the terminal device can also be controlled based on the target ring. Based on this, in step 104, the gesture information corresponding to the target ring can be determined based on the sensor data of the target ring. The target ring can be built-in with multiple sensors, such as an inertial measurement unit (IMU), a pressure sensor, and a biometric sensor, etc. The gesture information refers to an identifiable gesture action determined based on the sensor data, such as finger sliding, clicking, pinching, etc. The sensor data of the target ring can capture the micro-movement of the finger, filter out the shaking and micro-irregular movement of the hand, and can provide more stable basic data for the identification of gesture information, thereby providing more stable control signals. It should be noted that the determination of the gesture information in the embodiment of the present application is a continuous process. For example, the sensor data of the target ring can be acquired by setting a collection time interval or a collection frequency, and then the gesture information corresponding to the target ring is determined based on the acquired sensor data.

[0075] In order to generate a control signal based on the gesture information to control the operation of the target time domain file, in the embodiment of the present application, a set activation gesture and a set execution gesture can be set in advance. The set activation gesture is a trigger gesture for waking up the terminal device from the standby mode to the target operation mode or switching from one target operation mode to another target operation mode. The set execution gesture is a gesture for controlling the target time domain file to perform a specific operation in the target operation mode. In the trigger scenario, there can be a case that the activation gesture is misjudged as the execution gesture, and the execution gesture is misjudged as the activation gesture. Therefore, the set activation gesture and the set execution gesture can be set as different gestures that do not repeat each other and do not cause mutual mis-triggering.

[0076] As an example, the essence distinction between the setting activation gesture and the setting execution gesture can be achieved by significant difference in physical features, reducing the similarity in the form of the two, and achieving a non-repeated setting mode. For example, the setting activation gesture and the setting execution gesture can be distinguished by action complexity. The setting activation gesture can be designed as a short and simple action, facilitating quick wake-up of the terminal device. The setting execution gesture can be designed as a long and complex action, facilitating determination of a specific intention. For another example, the setting activation gesture and the setting execution gesture can be distinguished by data features of a sensor. For example, the setting activation gesture can be designed as a short high-frequency pulse, and the setting execution gesture can be designed as a continuous smooth change. The setting activation gesture can be designed as an instantaneous high pressure, and the setting execution gesture can be designed as a sustained low pressure.

[0077] As another example, the setting mode for preventing false triggering can be achieved by logical constraints and threshold isolation. For example, the setting activation gesture is effective only in the standby mode, and the setting execution gesture is effective only in the target operation mode, which serves as a logical constraint. For another example, the rotation angle of the setting activation gesture is less than 180°, and the rotation angle of the setting execution gesture is greater than 270°, which serves as threshold isolation and does not interfere with each other. In this way, the situation of false triggering can be reduced.

[0078] Based on the pre-set setting activation gesture and setting execution gesture, the detected gesture information can be determined to determine the control instruction corresponding to the gesture information. In the embodiment of the present application, when the terminal device is in the standby mode, the gesture information can be matched with the setting activation gesture first. If the terminal device is activated and enters the target operation mode, the gesture information can be matched with the setting execution gesture to execute the corresponding operation.

[0079] When the terminal device is in the standby mode, if the first gesture information matching the setting activation gesture is detected, the terminal device is switched from the standby mode to the target operation mode corresponding to the first gesture information.

[0080] The first gesture information is the gesture information matching the setting activation gesture. When the terminal device is in the standby mode, the first gesture information is detected, indicating that the terminal device can be activated at present. In an example, the type of each setting activation gesture can correspond to a target operation mode, and the terminal device can be switched from the standby mode to the target operation mode corresponding to the first gesture information.

[0081] In order to improve the accuracy of gesture verification, in another example, multiple verifications can also be performed based on biological feature data of the wearer (i.e., the user) collected by the target ring and position information of the terminal device, and the terminal device can be switched from the standby mode to the target operation mode after the verification is passed.

[0082] When the terminal device is in the standby mode, it is in a low-power mode. As an example, the low-power monitoring can be started. For example, the target ring can only start a lightweight detection algorithm, filter the environmental noise, and only keep the continuous signals with regular motion, etc.

[0083] When the terminal device is in the target operation mode, if the second gesture information matching the set execution gesture is detected, the target time domain file is controlled based on the second gesture information to generate an adjustment operation instruction corresponding to the second gesture information.

[0084] The second gesture information is gesture information matching the set execution gesture. When the terminal device is in the target operation mode, when the second gesture information is detected, an operation instruction corresponding to the second gesture information can be generated, and then the target time domain file is controlled to perform an operation corresponding to the second gesture information based on the operation instruction.

[0085] In order to improve the safety and rationality of the operation, in an example, the target time domain file can be subjected to permission verification, and only when the biological feature data of the wearer of the target ring matches the feature data of the authorized personnel, the corresponding operation can be performed. In another example, the range of the operation can also be set to control the target time domain file to perform the corresponding operation within a reasonable range. In addition, an emergency termination mechanism can also be set, when an abnormal gesture is detected, all operations are immediately suspended and an abnormal prompt is triggered.

[0086] In the embodiments of the present application, the target time domain file of the display interface of the terminal device can also provide operation confirmation through multi-modal feedback and the target ring when performing the operation. For example, visual feedback of the operation area of the target time domain file, haptic feedback of the differential vibration of the target ring, and auditory feedback of the triggered prompt sound, etc. In this way, the user can more intuitively obtain the operation information.

[0087] The embodiments of the present application identify the gesture information corresponding to the target ring based on the sensor data of the target ring, can capture the micro-movement of the finger, realize fine control of the target time domain file, and can filter out the shaking and micro-irregular movement of the hand, and provide more stable control signals. At the same time, through the two-stage gesture recognition operation of first activation and then execution, the false trigger rate can be significantly reduced, thereby improving the control accuracy and stability of the time domain file.

[0088] In the embodiments of the present application, the first gesture information is a gesture for activating the terminal device, so that the terminal device enters the target operation mode. The following takes two kinds of activation gestures as examples.

[0089] If the gesture information is detected as the finger corresponding to the target ring stretching in a first direction, the terminal device is switched from the standby mode to the target operation mode corresponding to the first gesture information. The first direction is a direction away from the palm.Figure 4 A schematic diagram of a first gesture information provided in an embodiment of the present application is shown in FIG. 2. As shown in FIG. 2, the first gesture information can be that the thumb and the index finger are stretched from a bent state, and the fingertips are directed outward away from the palm, etc. The bent state can be that the angle of the fingers is greater than or equal to 90 degrees, and the stretched state can be that the bending angle of the fingers is less than or equal to 10 degrees, etc. By wearing two target finger rings on the thumb and the index finger of the user, the motion state of the thumb and the index finger can be detected. Figure 4

[0090] If it is detected that the gesture information is that the touch area of the target finger ring receives a touch instruction, the terminal device is switched from the standby mode to a target operation mode corresponding to the first gesture information. The touch area can be set in advance, for example, a ring-shaped capacitive area on the inside of the target finger ring. The touch instruction can be a contact signal of the finger, for example, the capacitive change amount is greater than or equal to a set change amount and the contact time is greater than a set time, etc., which can be determined as the touch instruction.

[0091] By natural gestures such as stretching fingers or touching the target finger ring, the operation steps for waking up the terminal device can be reduced. By recognizing the gestures and matching through multiple parameters, the matching accuracy of the gestures can be improved, and the situation of unintentional action leading to false wake-up can be reduced. It should be noted that the correspondence between the first gesture information and the target operation mode can be set based on requirements, which is not limited herein.

[0092] In an embodiment of the present application, the adjustment operation instruction can include a separation element adjustment operation instruction, a progress bar adjustment operation instruction, and a page turning adjustment operation instruction. The adjustment operation instruction is used to adjust the display state of the target time domain file. For example, the separation element adjustment operation instruction is used to adjust the target separation element, such as left and right moving separation element adjustment. The progress bar adjustment operation instruction is used to adjust the display progress of the target time domain file, such as sliding the time axis forward or backward. The page turning adjustment operation instruction is used to switch the display page of the target display area in the display interface, for example, from displaying A and B to displaying C and D. The following will be illustrated respectively.

[0093] Figure 5 A schematic diagram of a second gesture information of a separation element adjustment operation provided in an embodiment of the present application is shown in FIG. 21. As shown in FIG. 21, the second gesture information can be that the thumb and the index finger are stretched from a bent state, and the fingertips are directed outward away from the palm, etc. The bent state can be that the angle of the fingers is greater than or equal to 90 degrees, and the stretched state can be that the bending angle of the fingers is less than or equal to 10 degrees, etc. By wearing two target finger rings on the thumb and the index finger of the user, the motion state of the thumb and the index finger can be detected. Figure 5 ​As shown, if the gesture information of the target ring is detected as fingers being close together and performing a waving operation in a second direction, a split element adjustment operation instruction is generated based on the second direction. The fingers being close together means that the tips of the fingers corresponding to the target ring are less than a certain distance apart, and the whole is waved in the second direction. The second direction can be set according to the moving direction of the target split element. For example, if the five fingers are close together and waved in the horizontal direction, the target split element is moved according to the waving direction. The mapping relationship between the amplitude of the waving and the target split element can also be set based on requirements. For example, waving 3 cm, the target split element moves 30 pixels.

[0094] Figure 6 A schematic diagram of a second gesture information of a progress bar adjustment operation provided in an embodiment of the present application is shown in FIG. 8. Figure 6 As shown, if the gesture information of the target ring is detected as performing a single-finger sliding operation in a third direction, a progress bar adjustment operation instruction is generated based on the third direction. Single-finger sliding refers to the sliding operation of a finger corresponding to a target ring, and sliding refers to continuous movement with a speed greater than a set speed. The third direction is a preset effective direction of progress bar adjustment, for example, the vertical direction. For example, sliding up corresponds to moving forward in the time axis, and sliding down corresponds to moving backward in the time axis. Each sliding 1 cm corresponds to moving 10 s in the time axis.

[0095] Figure 7 A schematic diagram of a second gesture information of a page turning adjustment operation provided in an embodiment of the present application is shown in FIG. 9. Figure 7 As shown, if the gesture information of the target ring is detected as performing a sequence of finger bending and / or stretching, a page turning adjustment operation instruction is generated based on the sequence of actions. For example, bending the index finger to stretching is equivalent to turning down a page, bending the middle finger to stretching is equivalent to turning up a page, and so on, simulating the click operation of a mouse. The page turning rule can be matched and set based on requirements. Taking a ring as an example, two positions (such as white quadrilateral positions) of the touch area of a single ring on a finger can be clicked, a single ring on a finger can be slid back and forth, or two rings on a finger can be slid back and forth.

[0096] In addition, if the gesture information of the target ring is detected as a multimodal operation, that is, two gestures are detected at the same time or two gestures are continuously detected within a short time, an execution sequence of the adjustment operation instruction is generated according to a set priority. For example, the adjustment of the target split element is prior to the progress bar adjustment, and the progress bar adjustment is prior to the page turning adjustment. In this way, it can be ensured that the operation is effective in a logical order, reduces the situation of gesture conflict, supports the requirements of complex scenes. In addition, the gesture amplitude can be mapped to the adjustment amount, supporting fine adjustment and fast operation, which can take into account different precision requirements, and enhances the scene adaptability of the terminal device.

[0097] In the embodiments of the present application, the terminal device can be a VR wearable device. The VR wearable device can be a device integrating a posture sensor (such as a gyroscope, an accelerometer, and a magnetometer) and a display component (such as a head-mounted display), and can provide an immersive three-dimensional visual environment for the wearer.

[0098] In the embodiments of the present application, in response to a mode selection instruction, a target mode of the target time domain file is first determined, and the target mode can include a synchronous rotation mode and a fixed file mode. The mode selection instruction is an instruction for specifying a display rule of the target time domain file, and can be input through a gesture, a voice, or a key. For example, the wearer can use a mode selection instruction of drawing a circle with both hands as a selection instruction of the synchronous rotation mode, and use a sensor of a target ring to perform a single-hand fixing gesture as a selection instruction of the file fixing mode.

[0099] The synchronous rotation mode refers to that the spatial orientation of the target time domain file is synchronized with the posture of the wearer, and the relative direction with the user's visual angle is kept consistent. The fixed file mode refers to that the spatial position and orientation of the target time domain file are specified, and only the virtual visual angle is adjusted through the posture of the wearer, which can be applied to a large target time domain file, and the wearer can observe the target time domain file from different angles.

[0100] After the target mode of the target time domain file is determined, the posture data of the wearer sent by the VR wearable device can be acquired in real time. For example, the posture parameters of the wearer, such as the pitch angle, the yaw angle, and the roll angle, are collected to reflect the real-time visual angle direction of the user.

[0101] If the target mode is the synchronous rotation mode, a rotation adjustment instruction for the target time domain file is generated based on the posture data. The rotation adjustment instruction is an instruction for changing the orientation of the target time domain file, such as rotating around the X-axis, the Y-axis, or the Z-axis, so that the target time domain file is synchronized with the posture of the wearer.

[0102] If the target mode is the fixed file mode, a visual angle adjustment instruction for the target time domain file is generated based on the posture data. The visual angle adjustment instruction is an instruction for changing the orientation of the user's visual angle, without changing the position and orientation of the target time domain file itself, and only adjusting the range of the target time domain file that the wearer can see.

[0103] The two target modes can meet the scenarios of file synchronization with view angle and file fixed view angle movement respectively, solve the problem that the traditional plane display cannot simulate three-dimensional space interaction, and enhance the spatial perception of the user on the layered time domain file. The synchronous rotation mode can make the target time domain file always in the comfortable area of the user's field of view, and is suitable for dynamic tracking analysis. The fixed file mode is suitable for scenarios that require stable reference, reduces the dizziness caused by the incoordination of the picture and the posture, and is suitable for static observation analysis. Combined with the VR wearable device, the viewing and analysis efficiency of the layered time domain file is improved through the natural posture, the limitations of the traditional display device in three-dimensional space interaction are solved, and the layered time domain file is suitable for complex scenarios.

[0104] Based on the above-mentioned control method of the layered time domain file, the embodiments of the present application can also be applied to the scenario of comparing the real object image with the target time domain file. Through the mechanism of the split screen window, the accurate comparison and deep correlation between the real object and the target time domain file can be realized.

[0105] Specifically, the real object image sent by the image acquisition device is first acquired in real time. Then, a split screen window is established on the display interface of the terminal device, and the real object image and the time domain file are presented side by side to form a comparison view. In this way, the comparison view angle can be presented intuitively, and the traditional mode of separating the real object and the data is broken.

[0106] As an example, the display parameters of the real object image in the split screen window can be adjusted synchronously based on the operation performed on the target time domain file, so that the display states of the real object image and the target time domain file are matched. The display parameters of the split screen window are adjusted synchronously based on the operation of the target time domain file, so that the view angles and operations of the two are synchronized, so that the comparison can be carried out more efficiently, and the subtle differences between the real object and the target time domain file can be enlarged. In this way, the traditional passive comparison can be upgraded to active correlation analysis, and the efficiency of the comparison between the real object and the data is improved.

[0107] Figure 8 A structure diagram of a layered time domain file control device 800 provided in an embodiment of the present application is shown. As shown in the figure, the layered time domain file control device 800 is integrated in a controller 1 of a terminal device 2, the controller 1 communicates with the terminal device 2, the terminal device 2 includes a display interface, and the layered time domain file control device 800 can include an acquisition module 801, a determination module 802, a display module 803, and an adjustment module 804. Figure 8 Figure 1

[0108] ​​The acquisition module 801 is configured to acquire at least two target time domain files and a spatial hierarchy attribute and a display parameter corresponding to each target time domain file, the display parameter including a spatial range of a to-be-displayed sub-file in the target time domain file. The determination module 802 is configured to determine, based on the spatial hierarchy attribute and the display parameter, a target display area of the to-be-displayed sub-file of each target time domain file in a display interface, and generate a target separation element between adjacent target display areas, wherein there is a spatial correlation between the adjacent target display areas. The display module 803 is configured to control the terminal device to display the to-be-displayed sub-file corresponding to each target display area in the target display area of the display interface, and synchronously display the target separation element. The adjustment module 804 is configured to respond to an adjustment operation instruction for the display interface, and adjust the spatial position of the target separation element and / or the to-be-displayed sub-file in the target display area of the display interface.

[0109] In the embodiments of the present application, the acquisition module 801 can include a first acquisition unit and a second acquisition unit. The first acquisition unit is configured to determine a spatial hierarchy priority of the target time domain file, and obtain the spatial hierarchy attribute corresponding to the target time domain file. The second acquisition unit is configured to determine, based on a range selection instruction and the spatial hierarchy attribute, a first coordinate range of the to-be-displayed sub-file in a spatial coordinate system for each target time domain file.

[0110] The determination module 802 can include a conversion unit, a mapping unit, a setting unit, and a separation unit. The conversion unit is configured to convert the first coordinate range of the to-be-displayed sub-file into a second coordinate range in the display interface based on a mapping relationship between the spatial coordinate system and a display interface coordinate system, each second coordinate range corresponding to one of the target display areas. The mapping unit is configured to establish a mapping relationship between the target display area and the spatial hierarchy attribute corresponding to the to-be-displayed sub-file. The setting unit is configured to, for each target display area, set the transparency of the target time domain file corresponding to the spatial hierarchy attribute having the mapping relationship to a first transparency, and set the transparency of the target time domain file corresponding to the spatial hierarchy attribute not having the mapping relationship to a second transparency, the second transparency being greater than the first transparency. The separation unit is configured to generate the target separation element based on a correlation index of adjacent target display areas.

[0111] The display module 803 can include an enhancement unit and a display unit. The enhancement unit is configured to perform feature enhancement operations on each to-be-displayed sub-file, the feature enhancement operations including edge sharpening, contrast adjustment, and target feature points. The display unit is configured to display the to-be-displayed sub-file to the target display area corresponding to the to-be-displayed sub-file, and generate a label corresponding to the to-be-displayed sub-file in the target display area, the label including the spatial hierarchy attribute of the to-be-displayed sub-file.

[0112] The adjusting module 804 can include a first adjusting unit, a second adjusting unit, and a third adjusting unit. The first adjusting unit is configured to, in a case where a first operation instruction for the display interface is detected, lock a spatial position of a target display region, and calculate an offset of a target separation element based on the first operation instruction; adjust the target separation element according to the offset, and change a spatial range of a to-be-displayed sub-file corresponding to each target display region, where a sum of spatial ranges of two to-be-displayed sub-files adjacent to the target separation element is a set value. The second adjusting unit is configured to, in a case where a second operation instruction for the display interface is detected, lock a position and a form of the target separation element, and calculate a spatial displacement of the to-be-displayed sub-file in the target display region based on the second operation instruction; and adjust a spatial state of the to-be-displayed sub-file in the target display region according to the spatial displacement. The third adjusting unit is configured to, in a case where a third operation instruction for the display interface is detected, adjust spatial states of all to-be-displayed sub-files on the display interface with a reference point; keep a relative position of the target separation element and an adjacent target display region unchanged, and control the form of the target separation element to follow a transformation of the spatial state of the to-be-displayed sub-file.

[0113] In the embodiment of the present application, the controller 1 also communicates with the target ring 3, and the adjusting module 804 can further include a determining unit, an activating unit, and an executing unit. The determining unit is configured to determine gesture information corresponding to the target ring based on sensor data of the target ring. The activating unit is configured to, in a case where the terminal device is in a standby mode, if first gesture information matching a set activating gesture is detected, switch the terminal device from the standby mode to a target operation mode corresponding to the first gesture information. The executing unit is configured to, in a case where the terminal device is in the target operation mode, if second gesture information matching a set executing gesture is detected, control the target time domain file to generate an adjusting operation instruction corresponding to the second gesture information based on the second gesture information. The set activating gesture and the set executing gesture are mutually exclusive and do not cause mutual false triggering.

[0114] In the embodiment of the present application, the activating unit is further configured to, if the gesture information is that a finger corresponding to the target ring is stretched in a first direction, switch the terminal device from the standby mode to the target operation mode corresponding to the first gesture information, where the first direction is a direction away from the palm center; or if the gesture information is that a touch region of the target ring receives a touch instruction, switch the terminal device from the standby mode to the target operation mode corresponding to the first gesture information.

[0115] In the embodiments of the present application, the adjustment operation instruction includes a separation element adjustment operation instruction, a progress bar adjustment operation instruction, and a page turning adjustment operation instruction. The execution unit is further configured to: if it is detected that the gesture information of the target ring is that fingers are closed and a waving operation is performed in a second direction, generate the separation element adjustment operation instruction based on the second direction; if it is detected that the gesture information of the target ring is that a single-finger sliding operation is performed in a third direction, generate the progress bar adjustment operation instruction based on the third direction; if it is detected that the gesture information of the target ring is that a sequence action of finger bending and / or stretching is performed, generate the page turning adjustment operation instruction based on the sequence action; and if it is detected that the gesture information of the target ring is a multi-modal operation, generate an execution sequence of the adjustment operation instruction according to a set priority.

[0116] In the embodiments of the present application, the terminal device 2 can be a virtual reality wearable device, and the control apparatus 800 for layering time domain files can further include a selection module, an acquisition module, a first generation module, and a second generation module. The selection module is configured to determine a target mode of a target time domain file in response to a mode selection instruction, the target mode including a synchronous rotation mode and a fixed file mode. The acquisition module is configured to acquire, in real time, posture data of a wearer sent by the virtual reality wearable device. The first generation module is configured to generate, in a case where the target mode is the synchronous rotation mode, a rotation adjustment instruction for the target time domain file based on the posture data. The second generation module is configured to generate, in a case where the target mode is the fixed file mode, a viewing angle adjustment instruction for the target time domain file based on the posture data.

[0117] The embodiments of the present application also provide a computer readable storage medium, which stores a program capable of being loaded by a processor and executing any one of the control methods for layering time domain files.

[0118] Those skilled in the art can understand that all or part of the functions of the various methods in the above embodiments can be implemented in the form of hardware or in the form of a computer program. When all or part of the functions in the above embodiments are implemented in the form of a computer program, the program can be stored in a computer readable storage medium, which can include: a read-only memory, a random access memory, a magnetic disk, an optical disk, a hard disk, and the like. The above functions are implemented by executing the program by a computer. For example, the program is stored in the memory of the device, and when the program in the memory is executed by the processor, the above all or part of the functions are implemented. In addition, when all or part of the functions in the above embodiments are implemented in the form of a computer program, the program can also be stored in a server, another computer, a disk, an optical disk, a flash disk, or a storage medium such as a mobile hard disk, and is downloaded or copied into the memory of the local device, or the system of the local device is updated in version, and when the program in the memory is executed by the processor, the above all or part of the functions in the embodiments are implemented.

[0119] The above application of specific examples to illustrate the present application, is only used to help understand the present application, and not to limit the present application. For the skilled in the art to which the present application belongs, according to the idea of the present application, can make a number of simple deduction, deformation or replacement.

Claims

1. A control method of a layered time domain file, characterized by, The application is applied to a controller in communication with a terminal device including a display interface, and the control method includes: obtaining at least two target time domain files and spatial hierarchy attributes and display parameters corresponding to each target time domain file, the display parameters including a spatial range of a to-be-displayed sub-file in the target time domain file, the target time domain file being a multi-dimensional data set integrating multi-view and multi-direction with a time axis as a main line, the spatial hierarchy attributes being used to represent attributes of a logical correlation or a layering priority of the target time domain file, the spatial hierarchy attributes being related to coordinate axes of a spatial coordinate system, the to-be-displayed sub-file being a partial data range needing to be highlighted and displayed, which is intercepted from a complete target time domain file, and the spatial range being a range of the to-be-displayed sub-file in the spatial coordinate system; determining target display areas of the to-be-displayed sub-file of each target time domain file in the display interface based on the spatial hierarchy attributes and the display parameters, and generating a target separation element between adjacent target display areas, wherein there is a spatial correlation between adjacent target display areas; controlling the terminal device to display the to-be-displayed sub-file corresponding to each target display area in the target display area of the display interface respectively, and synchronously display the target separation element; in response to an adjustment operation instruction for the display interface, adjusting the spatial positions of the target separation element and / or the to-be-displayed sub-file in the target display area of the display interface.

2. The control method according to claim 1, characterized by, The obtaining at least two target time domain files and spatial hierarchy attributes and display parameters corresponding to each target time domain file includes: determining a spatial hierarchy priority of the target time domain file to obtain the spatial hierarchy attributes corresponding to the target time domain file; based on a range selection instruction and the spatial hierarchy attributes, determining a first coordinate range of the to-be-displayed sub-file of each target time domain file in a spatial coordinate system; The determining target display areas of the to-be-displayed sub-file of each target time domain file in the display interface based on the spatial hierarchy attributes and the display parameters, and generating a target separation element between adjacent target display areas, includes: based on a mapping relationship between a spatial coordinate system and a display interface coordinate system, converting the first coordinate range of the to-be-displayed sub-file into a second coordinate range in the display interface, each second coordinate range corresponding to a target display area; establishing a mapping relationship between the target display area and the spatial hierarchy attributes corresponding to the to-be-displayed sub-file; for each target display area, setting the transparency of the target time domain file corresponding to the spatial hierarchy attributes having a mapping relationship to a first transparency, and setting the transparency of the target time domain file corresponding to the spatial hierarchy attributes not having a mapping relationship to a second transparency, the second transparency being greater than the first transparency; based on a correlation index of adjacent target display areas, generating the target separation element.

3. The control method according to claim 1, characterized by, The control of the terminal device to display the sub-file to be displayed corresponding to each target display area on the display interface includes: For each of the sub-files to be displayed, a feature enhancement operation is performed, which includes edge sharpening, contrast adjustment, and target feature point determination. The sub-file to be displayed is displayed in the target display area corresponding to the sub-file to be displayed, and a label corresponding to the sub-file to be displayed is generated in the target display area. The label includes the spatial hierarchy attribute of the sub-file to be displayed.

4. The control method according to claim 1, characterized by, The step of adjusting the spatial position of the target separator element and / or the sub-file to be displayed in the target display area in response to the adjustment operation command for the display interface includes: If a first operation command is detected for the display interface, the spatial position of the target display area is locked, and the offset of the target separating element is calculated based on the first operation command; The target separator element is adjusted according to the offset to change the spatial range of the sub-file to be displayed corresponding to each target display area, wherein the sum of the spatial ranges of the two sub-files to be displayed adjacent to the target separator element is a set value; If a second operation command is detected for the display interface, the position and shape of the target separator element are locked, and the spatial displacement of the sub-file to be displayed in the target display area is calculated based on the second operation command. Adjust the spatial state of the sub-file to be displayed in the target display area according to the spatial displacement; If a third operation command is detected for the display interface, the spatial state of all the sub-files to be displayed on the display interface is adjusted based on the reference point. Keeping the relative position of the target separator element and the adjacent target display area unchanged, the shape of the target separator element is controlled to change according to the spatial state of the sub-file to be displayed.

5. The control method according to claim 1, characterized by, The controller also communicates with the target ring, and the adjustment of the target separator element and / or the spatial position of the sub-file to be displayed in the target display area in response to an adjustment operation command for the display interface includes: The gesture information corresponding to the target ring is determined based on the sensor data of the target ring; When the terminal device is in standby mode, if a first gesture information matching the set activation gesture is detected, the terminal device is switched from standby mode to the target operation mode corresponding to the first gesture information. When the terminal device is in the target operation mode, if a second gesture information matching the set execution gesture is detected, the target time domain file is controlled to generate an adjustment operation instruction corresponding to the second gesture information based on the second gesture information; The activation gesture and the execution gesture are mutually exclusive and will not cause each other to be triggered erroneously.

6. The control method according to claim 5, characterized by If a first gesture information matching the set activation gesture is detected, the terminal device is switched from standby mode to the target operation mode corresponding to the first gesture information, including: If the gesture information of the target finger ring is detected to be a gesture of fingers stretching in a first direction, the terminal device is switched from the standby mode to a target operation mode corresponding to the first gesture information, and the first direction is a direction away from the palm center. If the gesture information of the target finger ring is detected to be a touch instruction received by a touch area of the target finger ring, the terminal device is switched from the standby mode to a target operation mode corresponding to the first gesture information.

7. The control method according to claim 5, characterized by, The adjustment operation instruction includes a separation element adjustment operation instruction, a progress bar adjustment operation instruction, and a page turning adjustment operation instruction. If second gesture information matching the set execution gesture is detected, an adjustment operation instruction corresponding to the second gesture information is generated based on the second gesture information, including: If the gesture information of the target finger ring is detected to be a gesture of fingers stretching in a first direction, the terminal device is switched from the standby mode to a target operation mode corresponding to the first gesture information, and the first direction is a direction away from the palm center. If the gesture information of the target finger ring is detected to be a touch instruction received by a touch area of the target finger ring, the terminal device is switched from the standby mode to a target operation mode corresponding to the first gesture information. If the gesture information of the target finger ring is detected to be a gesture of fingers stretching in a first direction, the terminal device is switched from the standby mode to a target operation mode corresponding to the first gesture information, and the first direction is a direction away from the palm center. If the gesture information of the target finger ring is detected to be a gesture of fingers stretching in a first direction, the terminal device is switched from the standby mode to a target operation mode corresponding to the first gesture information, and the first direction is a direction away from the palm center.

8. The control method according to claim 1, characterized by, The terminal device is a virtual reality wearable device, and the method further includes: In response to a mode selection instruction, determining a target mode of the target time domain file, the target mode including a synchronous rotation mode and a fixed file mode; Real-time acquisition of posture data of a wearer sent by the virtual reality wearable device; If the target mode is the synchronous rotation mode, a rotation adjustment instruction for the target time domain file is generated based on the posture data; If the target mode is the fixed file mode, a viewing angle adjustment instruction for the target time domain file is generated based on the posture data.

9. A control device of a layered time domain file, characterized by comprising: The controller is applied to a terminal device, and the terminal device includes a display interface. The acquisition module is configured to acquire at least two target time domain files, and spatial hierarchy attributes and display parameters corresponding to each target time domain file, the display parameters including a spatial range of a to-be-displayed sub-file in the target time domain file, the target time domain file being a multi-dimensional data set with a time axis as a main line and fusing multi-view and multi-direction, the spatial hierarchy attributes being used to represent attributes of a layering priority or a logical correlation of the target time domain file, the spatial hierarchy attributes being related to coordinate axes of a spatial coordinate system, the to-be-displayed sub-file being a partial data range that needs to be highlighted and displayed, and the spatial range being a range of the to-be-displayed sub-file in the spatial coordinate system. determining, based on the spatial hierarchy attribute and the display parameter, a target display area of the to-be-displayed sub-file of each of the target time-domain files in the display interface, and generating a target separation element between adjacent target display areas, wherein the target display areas are spatially associated with each other; displaying, by the terminal device, the to-be-displayed sub-file corresponding to each target display area in the target display area of the display interface, and synchronously displaying the target separation element; adjusting, in response to an adjustment operation instruction for the display interface, the target separation element of the display interface and / or the spatial position of the to-be-displayed sub-file in the target display area.

10. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a program, and the program can be loaded and executed by the processor to perform the control method of the layered time-domain file according to any one of claims 1 to 8.

Images