A data processing method and related apparatus

Abstract

The application discloses a data processing method and related device, the method comprises: obtaining input instruction description information, extracting instruction intent matched with the instruction description information; wherein the instruction intent comprises at least one of data processing type, display theme, display style and display position; based on the instruction intent, target display data matched with the instruction description information is generated; the data display state of the target display interface is obtained, and based on the data display state and the instruction intent, the target display data is displayed in the target display interface. Through the above manner, the application can improve the efficiency and flexibility of intelligent data processing.

Description

Technical Field

[0001] This application relates to the field of data processing technology, and in particular to a data processing method and related apparatus. Background Technology

[0002] In traditional data visualization applications, data scheduling has long relied on manual operation or fixed-sequence playback, resulting in problems such as slow response, poor flexibility, and high costs for scene adaptation. Existing technologies often use pre-prepared script carousel modes for large-screen content switching, which cannot flexibly adjust the displayed content according to intent requirements.

[0003] Therefore, improving the efficiency and flexibility of data display in the interface has become an urgent problem to be solved. Summary of the Invention

[0004] The main technical problem addressed by this application is to provide a data processing method and related apparatus that can improve the efficiency and flexibility of intelligent data processing.

[0005] To address the aforementioned technical problems, this application provides a data processing method comprising: acquiring input instruction description information and extracting instruction intent matching the instruction description information; wherein the instruction intent includes at least one of data processing type, display theme, display style, and display position; generating target display data matching the instruction description information based on the instruction intent; acquiring the data display state of the target display interface and displaying the target display data within the target display interface based on the data display state and the instruction intent.

[0006] To solve the above-mentioned technical problems, another technical solution adopted in this application is to provide an electronic device, including a memory and a processor coupled to each other, wherein the memory stores program instructions, and the processor is used to execute the program instructions to implement the method mentioned in the above technical solution.

[0007] To solve the above-mentioned technical problems, another technical solution adopted in this application is to provide a computer-readable storage medium having program instructions stored thereon, wherein the program instructions, when executed by a processor, implement the method mentioned in the above-mentioned technical problems.

[0008] The beneficial effects of this application are as follows: Unlike existing technologies, the data processing method proposed in this application obtains only the input instruction description information, which can be the input natural language. By extracting the instruction intent, including at least one of data processing type, display theme, display style, and display position, from the instruction description information, target display data with a high degree of consistency with the input instruction description information is efficiently generated based on the instruction intent. Simultaneously, the display status of the data already displayed in the target display interface is obtained, and the generated target display data is displayed within the target display interface according to the data display status and the instruction intent, which helps to improve the flexibility of data display. Attached Figure Description

[0009] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. Wherein: Figure 1 This is a flowchart illustrating one embodiment of the data processing method of this application; Figure 2 yes Figure 1 The flowchart of step S101 corresponds to another embodiment; Figure 3 yes Figure 1 The flowchart of step S102 corresponds to another embodiment; Figure 4 yes Figure 3 The flowchart of step S302 corresponds to another embodiment; Figure 5 yes Figure 1 The flowchart of step S103 corresponds to another embodiment; Figure 6 This is a schematic diagram of the structure of one embodiment of the electronic device of this application; Figure 7 This is a schematic diagram of one embodiment of the computer-readable storage medium of this application. Detailed Implementation

[0010] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments, and different embodiments can be adaptively combined. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0011] Please see Figure 1 , Figure 1 This is a flowchart illustrating one embodiment of the data processing method of this application, which includes: S101: Obtain the input instruction description information and extract the instruction intent that matches the instruction description information; wherein, the instruction intent includes at least one of data processing type, display theme, display style and display location.

[0012] In one embodiment, instruction description information input by the processing object is obtained. Semantic analysis is performed on the instruction description information to extract at least one of data processing type, display theme, display style, and display location. The extracted information is then used as the instruction intent.

[0013] In some implementation scenarios, the data processing method proposed in this application is implemented using a data processing system, which includes an instruction acquisition module. The instruction acquisition module acquires the instruction text input by the processing object and uses the instruction text as the instruction description information.

[0014] In some implementation scenarios, after obtaining the instruction description information, keyword extraction is performed to extract keyword information that corresponds to at least one of the data processing type, display theme, display style, and display location, and the above keyword information is used as the instruction intent.

[0015] In one embodiment, the implementation process of step S101 may further include: acquiring audio data input to the processing object using the instruction acquisition module, converting the audio data into text data using the instruction acquisition module, and using the converted text data as instruction description information. The specific audio conversion process can refer to existing open-source algorithms and will not be described in detail here.

[0016] In one embodiment, the implementation process of step S101 may further include: obtaining instruction description information input by the processing object, and extracting the instruction intent matching the instruction description information based on the permission level matched by the processing object and the instruction description information. The permission level mentioned above is related to data access permissions.

[0017] In some implementation scenarios, in response to the data processing system being coupled with multiple external acquisition devices and / or data resource libraries, to improve data security, corresponding permission levels are set for different processing objects, and different data access permissions are set according to the permission levels. These data access permissions are used to retrieve corresponding data from the external acquisition devices and / or data resource libraries; the higher the permission level of the processing object, the wider the corresponding data access permission range.

[0018] In a specific application scenario, when the permission level of the object being processed is the highest, the generated instruction intent limits access to all data collected by external acquisition devices and / or all data in the data resource library. Alternatively, when the permission level of the object being processed is low, the generated instruction intent limits access to only some data collected by some external acquisition devices and / or a portion of the data in the data resource library.

[0019] S102: Based on the instruction intent, generate target display data that matches the instruction description information.

[0020] In one embodiment, target display data matching the instruction description information is generated based on the extracted instruction intent.

[0021] In some implementation scenarios, based on the extracted instruction intent, raw data associated with the instruction intent is obtained. This raw data is then processed according to at least one of the data processing type, display theme, display style, and display location specified in the instruction intent. The processed raw data is then used as the target display data. This target display data can be at least one of the following: video, image, table, etc.

[0022] In one embodiment, in response to the instruction acquisition module also acquiring the gesture instruction of the processing object in step S101, the implementation process of step S102 may further include: generating target display data that matches the instruction description information based on the instruction intent and gesture instruction.

[0023] In some implementation scenarios, the target display interface currently shows some reference data. After obtaining the gesture command of the object being processed, the position of each reference data in the target display interface and the gesture command are analyzed to determine the reference data corresponding to the gesture command. The reference data corresponding to the gesture command is used as the raw data, and the raw data is processed according to at least one of the data processing type, display theme, display style, and display position in the command intent. The processed raw data is then used as the target display data.

[0024] S103: Obtain the data display status of the target display interface, and display the target display data within the target display interface based on the data display status and the instruction intent.

[0025] In one embodiment, the data display status of the target display interface is obtained based on the data already displayed within the target display interface. Based on the data display status and the instruction intent, a target area is determined within the target display interface, and the target display data is displayed within that target area.

[0026] In some implementation scenarios, in response to the instruction intent including the display location, and the display location including the area coordinate range within the target display interface, the area within the target display interface corresponding to the area coordinate range is taken as the target area, and the target display data is displayed within the aforementioned target area.

[0027] In one embodiment, in response to the display location in the instruction intent being descriptive text, such as "in the center area of ​​the target display interface" or "in the upper left corner of the target display interface", a matching target area is determined within the target display interface based on the aforementioned descriptive text, and the target display data is displayed within the aforementioned target area.

[0028] The data processing method proposed in this application acquires only the input instruction description information, which can be the input natural language. By extracting the instruction intent from the instruction description information, including at least one of data processing type, display theme, display style, and display location, target display data with a high degree of consistency with the input instruction description information is efficiently generated based on the instruction intent. Simultaneously, the display status of the data already displayed in the target display interface is acquired, and the generated target display data is displayed within the target display interface according to the data display status and the instruction intent, which helps to improve the flexibility of data display.

[0029] Please see Figure 2 , Figure 2 yes Figure 1 The flowchart of step S101 corresponds to another embodiment. Specifically, the implementation process of step S101 includes: S201: Obtain instruction description information input by the processing object; wherein, the instruction description information is determined based on the text or audio input by the processing object, and the instruction description information includes descriptions related to at least one of the following: data processing type, display theme, display style, and display location.

[0030] In one embodiment, the instruction acquisition module in the data processing system acquires the descriptive text input by the processing object, and uses this descriptive text as the instruction description information. Alternatively, the instruction acquisition module acquires the descriptive audio data input by the processing object, converts the descriptive audio data into text data, and uses the converted text data as the instruction description information.

[0031] In some implementation scenarios, the aforementioned instruction description information includes descriptions related to at least one of the following: data processing type, display theme, display style, and display location. For example, if the instruction description information includes: "Display the video stream captured by camera device x between 2 PM and 3 PM yesterday," then "display video stream" is a description related to the data processing type.

[0032] S202: Input the instruction description information into the large language model and use the large language model to generate the instruction intent.

[0033] In one embodiment, the extracted instruction description information is input into a large language model, prompting the large language model to extract key information related to intent from the instruction description information, thereby obtaining the instruction intent extracted by the large language model.

[0034] In some implementation scenarios, the data processing system includes an intent recognition module coupled to the instruction acquisition module, which deploys a large language model. The instruction acquisition module inputs instruction description information into the large language model in the intent recognition module, prompting the large language model to extract key intent-related information from the instruction description information to obtain at least one of the following: data processing type, display theme, display style, and display location.

[0035] In some implementation scenarios, the instruction acquisition module inputs instruction description information to the intent recognition module. The intent recognition module then generates task prompt text based on the instruction description information and a preset task template. The intent recognition module then inputs the task prompt text into a deployed large language model, which performs semantic analysis on the task prompt text and extracts the instruction intent. Specifically, the task prompt text prompts the large language model to extract key intent-related information from the instruction description information to obtain the instruction intent.

[0036] In a specific application scenario, the aforementioned large language model may include, but is not limited to, deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), long short-term memory networks (LSTM), generative pre-trained Transformer models, and generative AI models. No specific restrictions are placed on the specific construction and deployment of the large language model. Furthermore, it should be noted that the specific construction and deployment of the intelligent analysis models mentioned in other embodiments of this application can refer to this embodiment.

[0037] In one embodiment, to improve the accuracy of instruction intent extraction, the implementation process corresponding to step S202 may further include: inputting instruction description information into a large language model, and using the large language model to generate at least one level of intent nodes that match the instruction description information. The multiple levels of matched intent nodes are distributed in a tree structure, and there is a unidirectional dependency relationship between adjacent levels of matched intent nodes. Instruction intent is generated based on all levels of matched intent nodes.

[0038] Specifically, the instruction description information is input into the large language model, and the model is prompted to generate at least one intent node corresponding to the first level based on the instruction description information. The newly generated intent node is taken as the parent node, and the model is prompted to generate the corresponding child node, i.e., the intent node corresponding to the next level, based on the parent node. The above steps for generating the intent node of the next level are repeated until all levels of matching intent nodes are obtained, forming an intent node tree. The large language model is then used to generate text based on the complete intent node tree to obtain the instruction intent that matches the instruction description information. Among them, there is a logical dependency between adjacent levels of intent nodes that have a "parent-child" relationship, that is, the child intent node matched in the next level is generated based on the parent intent node corresponding to the previous level.

[0039] In some implementation scenarios, the multiple levels corresponding to the aforementioned intent node tree sequentially include at least one of the following: processing type constraint level, scene constraint level, spatiotemporal constraint level, entity feature level, quality constraint level, and layout constraint level. The processing type constraint level is used to extract intent nodes related to the data processing type; the scene constraint level, spatiotemporal constraint level, and entity feature level are used to extract data query criteria matching the actual scene based on their corresponding parent intent nodes; the quality constraint level is used to extract the display theme and display style based on its corresponding parent intent nodes; and the layout constraint level is used to extract the display position based on its corresponding parent intent nodes.

[0040] In a specific application scenario, when the instruction description is "I attended a meeting yesterday. Please play the video of target object 001 speaking during the meeting. The video should be clear and displayed in the center of the display interface," the large language model generates a first-level (processing type constraint level) matching intent node, "video playback," based on the instruction description. Based on the first-level matching intent node, a second-level (scene constraint level) intent node, "meeting recording scene," is generated. Furthermore, a third-level (spatiotemporal constraint level) intent node, "yesterday," a fourth-level (entity feature level) intent node, "appearance features of target object 001," a fifth-level (quality constraint level) intent node including "resolution: 4k," "frame rate: 60fps," and "bitrate: high," and a sixth-level (layout constraint level) intent node including "center position of the display interface" are generated. It should be noted that in actual applications, the number of child intent nodes corresponding to the same parent intent node can be multiple.

[0041] The above solution, by deploying a large language model in the intent recognition module, uses the large language model to perform semantic analysis on the instruction description information to extract the instruction intent. This allows the data processing system to no longer be limited to fixed instructions, but to directly generate target display data that matches the instruction description information of the processing object based on natural language, greatly improving the flexibility of data processing.

[0042] Please see Figure 3 , Figure 3 yes Figure 1 The flowchart of step S102 corresponds to another embodiment. Specifically, the implementation process of step S102 includes: S301: In response to the instruction intent including data source description information, use the calling module to obtain the raw data that matches the data source description information.

[0043] In one implementation, when the extracted instruction intent includes data source description information, the original data matching the data source description information is obtained by using the calling module.

[0044] In some implementation scenarios, the data processing system proposed in this application also includes a calling module coupled to the intent recognition module. This calling module is coupled to multiple external acquisition devices and / or a data resource library. When the instruction intent output by the large language model includes data source description information, the calling module is used to obtain the raw data collected by the corresponding external acquisition device; or, the calling module is used to query the data resource library for raw data that matches the aforementioned data source description information.

[0045] In a specific application scenario, when the data source description information included in the instruction intent is "video stream of scene A", the calling module determines that a video stream acquisition device a is set up at scene A, and then uses the video stream acquired in real time by the video stream acquisition device a as the raw data. Alternatively, when the data source description information included in the instruction intent is "video stream of scene A within a historical time period", the calling module determines that a video stream acquisition device a is set up at scene A, and that the historical video streams acquired by the video stream acquisition device a are stored in the corresponding data resource library, and then uses the calling module to retrieve the video stream of scene A within the historical time period from the aforementioned data resource library as the raw data.

[0046] S302: Generate target display data that matches the display theme and style based on the raw data and data processing type.

[0047] In one implementation, the raw data is processed according to the data type in the instruction intent to generate target display data that matches the display theme and display style.

[0048] In some implementation scenarios, the data processing type is used to characterize the category of processing methods performed on the raw data, such as video playback, video brightness adjustment, contrast adjustment, filtering, cropping, and generation of annotation or related information. The display theme is used to characterize the target theme after the raw data has been processed, and the display style is used to characterize the target style after the raw data has been processed. The data processing system also includes a data generation module, which processes the raw data according to the data processing type, display theme, and display style specified in the instruction intent to obtain the target display data.

[0049] In a specific application scenario, when the original data is a video stream, and the data processing type in the instruction intent is "video playback" and the display style is "fresh style," the data generation module processes the original data to reduce its exposure and saturation, etc., to generate target display data that matches the display style and is suitable for video playback. Alternatively, when the original data is a video stream, the data processing type is "video playback," and the display theme is "football," the data generation module adds "football"-related text and / or stickers to the original data to generate target display data that matches the display theme and is suitable for video playback.

[0050] Optionally, in some implementation scenarios, when the instruction intent does not include an explicit display theme and display style, the original theme and style of the original data are used as the default display theme and display style, respectively. Alternatively, when the instruction intent does not include an explicit display style, the display style is adaptively adjusted according to the specific content of the instruction intent; for example, when the instruction intent is to display video stream data over a long period of time, the display style is determined to be lower resolution and / or lower bitrate to improve the video rendering rate.

[0051] The above solution locates the original data according to the instruction intent and processes the original data in conjunction with the instruction intent, thereby generating target display data that highly matches the intent of the processed object. This avoids directly displaying the original data and helps to improve the flexibility of data display.

[0052] Please see Figure 4 , Figure 4 yes Figure 3 The flowchart of step S302 corresponds to another embodiment. In response to the data processing type being trajectory generation and the raw data being the raw video stream, the implementation process of step S302 includes: S401: Generate the movement trajectory of the target object in the target scene based on the original video stream.

[0053] In one implementation, in response to obtaining at least one original video stream containing the target object through a calling module, multiple position points of the target object in the corresponding target scene are determined based on the position of the target object in each original video stream. The calling module then performs trajectory fitting based on the multiple position points corresponding to the target object to generate the movement trajectory of the target object in the target scene.

[0054] In some implementation scenarios, the feature information of the target object is pre-acquired. After the calling module performs target detection based on this feature information until at least one segment of original video stream containing the target object is obtained, the data generation module locates the target object from the original video frames in each original video stream. Based on the target object's position in the original video frames, its location in the actual real-world scene is determined. Trajectory fitting is then performed based on all the obtained location points corresponding to the target object to obtain its movement trajectory in the target scene. The process of target detection based on feature information can refer to existing target detection algorithms and will not be elaborated upon here.

[0055] In a specific application scenario, when the target object is a vehicle, the characteristic information corresponding to the target object is determined based on the vehicle's model, appearance, license plate number, etc. Through the above-described implementation method, multiple raw video streams including the target object are obtained using the calling module. These raw video streams include the video stream captured by acquisition device a at location A, the video stream captured by acquisition device b at location B, and the video stream captured by acquisition device c at location C. Then, the data generation module uses the specific location points of the target object at locations A, B, and C to fit and obtain the movement trajectory.

[0056] In one embodiment, when the data generation module generates a movement trajectory based on the location of the target object in the actual real-world scene, different trajectory segments of the target object are identified.

[0057] Specifically, when generating the movement trajectory, the actual trajectory segment and the predicted trajectory segment are determined, and different labels are used to mark the actual trajectory segment and the predicted trajectory segment.

[0058] In a specific application scenario, when only the actual trajectory segments of the target object, including "location point D - location point E" and "location point G - location point H," are captured from the original video stream, the data generation module predicts the target object's predicted trajectory segment "location point E - location point G" based on the actual route layout in the real-world scene. These three trajectory segments are then merged to obtain the complete movement trajectory of the target object. Furthermore, the actual trajectory segments "location point D - location point E" and "location point G - location point H" are marked with a first color, while the predicted trajectory segment "location point E - location point G" is marked with a second color, with the first color distinguishable from the second color.

[0059] Alternatively, different trajectory segments can be distinguished by text labels. For example, the actual trajectory segments “Location D-Location E” and “Location G-Location H” can be labeled “Actual Trajectory” at the corresponding positions, and the predicted trajectory segment “Location E-Location G” can be labeled “Predicted Trajectory” at the corresponding positions.

[0060] In one implementation, a 3D map corresponding to the target scene where the target object is located within the target time period is obtained based on the original video stream. The movement trajectory of the target object in the 3D map is then generated.

[0061] Specifically, the data generation module locates the target object from the original video frames in each raw video stream, and determines the target object's position in the actual real-world scene based on its position in the original video frames. Based on the target object's corresponding position, a 3D map of the target scene through which the target object moved is constructed, and the target object's movement route is mapped onto the 3D map to obtain the target object's movement trajectory. Generating the target object's movement trajectory in the 3D map helps to recreate the target object's movement scene, while also improving readability and impact in complex environments.

[0062] S402: Obtain the target video stream containing the target object, and generate target display data based on the target video stream and movement trajectory.

[0063] In one embodiment, a target video stream containing the target object is acquired, and the movement trajectory of the target object is added to the corresponding position in the target video stream to generate target display data.

[0064] In some implementation scenarios, the target video stream can be obtained based on multiple original video streams containing the target object. Specifically, all original video streams containing the target object are stitched together in ascending order of timestamps, and the stitched video is overlaid with the motion trajectory to generate target display data.

[0065] In some implementation scenarios, the target video stream can also be a real-time video stream that includes the target object. Specifically, when the movement trajectory of the target object is generated, and the target object is currently within the real-time video stream captured by the acquisition device d, the real-time video stream captured by the acquisition device d is used as the target video stream. The movement trajectory is marked at the corresponding position in the target video stream to generate target display data, which helps the processing personnel to intuitively understand the movement trajectory of the target object over a period of time, as well as the real-time status of the target object at the current moment.

[0066] In one embodiment, in response to the display style including spatial composition constraints, the implementation process of step S402 may further include: obtaining the visual focus region corresponding to each target video frame in the target video stream based on the spatial composition constraints; obtaining the focused video stream based on all visual focus regions corresponding to the target video stream; and generating target display data based on the focused video stream and the movement trajectory.

[0067] Specifically, after acquiring the target video stream including the target object, each target video frame in the target video stream is cropped according to the aforementioned spatial composition constraints to extract the visual focus region matching the spatial composition constraints from each target video frame. Following the original order of the target video frames in the target video stream, all visual focus regions are combined into a focused video stream. This focused video stream is then overlaid with the movement trajectory to generate target display data that highly matches the intent of the object being processed.

[0068] In a specific application scenario, the spatial composition constraint in the display style is "only display the area around the target object." This involves appropriately expanding the area containing the target object in each target video frame, and then cropping the expanded area to the visual focus region. All visual focus regions corresponding to the target video stream are then combined to form a focused video stream.

[0069] The above scheme generates target display data based on the target video stream and movement trajectory of the target object, and summarizes the trajectory on the basis of the original video stream to improve the data expression capability of the generated target display data.

[0070] Please see Figure 5 , Figure 5 yes Figure 1 The flowchart of step S103 corresponds to another embodiment. Specifically, the specific implementation process of step S103 includes: S501: Obtain the data display status within the target display interface; wherein, the data display status is determined based on the reference window within the target display interface used to display different reference data.

[0071] In one embodiment, a reference window already created within the target display interface is detected to obtain the data display status within the target display interface. This reference window is used to display corresponding reference data.

[0072] In some implementation scenarios, the video processing system proposed in this application includes a layout planning module. While generating target display data, the layout planning module determines the data display state based on the size information of a reference window already created within the target display interface. Determining the data display state helps to identify available free areas within the target display interface for data display.

[0073] S502: Based on the data display status and display position, display the target display data within the target display interface.

[0074] In one embodiment, based on the data display status and the display position in the instruction intent, the layout planning module determines the target area within the target display interface and displays the target display data within the target display interface.

[0075] In some implementation scenarios, if the display location within the target display interface is idle, the display location is used as the target location to match the target display data. The target display data is then displayed at the target location on the target display interface.

[0076] Specifically, when no reference window is set in the area corresponding to the display position within the target display interface, the area corresponding to that display position is taken as the target area. A target window is created within the target area, and the display control execution module in the data processing system is used to display the target display data within the target window.

[0077] Optionally, in other implementation scenarios, step S502 further includes: determining associated data related to the target display data from all reference data; determining associated positions matching the target position within the target display interface; and adjusting the positions of each reference window within the target display interface so that the reference window corresponding to the associated data is located at the aforementioned associated position.

[0078] Specifically, after determining the target location for matching the target display data, it is determined whether there is any related data among all the reference data currently displayed in the target display interface. If so, the relevant reference data is used as related data, and the related location adjacent to the target location is determined in the target display interface. The position layout of each reference window in the current target display interface is adjusted, and the reference window corresponding to the related data is moved to the aforementioned related location, so that the processing object can use the related data as a reference to browse the target display data. The aforementioned related data can be determined based on at least one of scene information, spatiotemporal information, and entity feature information.

[0079] In a specific application scenario, the target display data is the video data of the first target object, and the first target object and the second target object are related. In this case, the reference data corresponding to the second target object currently displayed in the target display interface is used as the related data.

[0080] In one embodiment, in response to the display position in the target display interface being occupied, the implementation process of step S502 includes: taking the reference window corresponding to the display position in the target display interface as the target window, and replacing the reference data displayed in the target window with the target display data.

[0081] In some implementation scenarios, when the area corresponding to the display position within the target display interface is occupied by an already created reference window, in order to prioritize the display of the data requested by the processing object, the reference window corresponding to the display position is used as the target window, and the display control execution module is used to display the target display data within the target window.

[0082] Alternatively, adjust the size of at least part of the reference windows within the target display interface, create a target window within the target display interface based on the adjusted reference windows, and display the target display data within the target window.

[0083] In some implementation scenarios, to avoid affecting the reference data already displayed in the target display interface, the layout planning module is used to adjust the size of at least some reference windows so that the area corresponding to the display position is no longer occupied by other reference windows. A target window is created in the area corresponding to the display position within the target display interface, and the display control execution module is used to display the target display data within the target window.

[0084] Optionally, in other implementation scenarios, the process of adjusting the size of some reference windows and creating a target window may further include: obtaining the reference weights corresponding to each reference data within the target display interface, and the target weights corresponding to the target display data. Based on the reference weights and target weights, determining the size relationship between the target window to be created and each reference window. Based on the size relationship, adjusting the size of at least some reference windows, creating the target window within the target display interface, and displaying the target display data within the target window.

[0085] Specifically, for the displayed reference data and the generated target display data, the reference weight corresponding to each reference data point and the target weight corresponding to the target display data are obtained. These reference weights and target weights are quantified based on data importance, business criticality, and the fixed preferences of the processing object. Based on the total number of pixels, reference weights, and target weights of the target display interface, the size relationship between the target window to be created and each reference window is calculated. This size relationship characterizes the size ratio between different windows. Based on this size relationship, the size of some reference windows with low reference weights is reduced to free up display space within the target display interface. After freeing up some display space, a target window matching the target weight of the target display data is created within the target display interface, and the target display data is rendered within the target window. This process ensures that high-weight data receives sufficient display resources, achieving a balanced allocation of display resources for various types of data under limited display resources.

[0086] Alternatively, based on the positions of all reference windows within the target display interface, create a target window in an empty area within the target display interface and display the target display data within the target window.

[0087] In some implementation scenarios, the layout planning module determines whether there is an area within the target display interface that meets the data display conditions based on the positions of all reference windows. If so, a target window is created within the corresponding area, and the display control execution module displays the target data within the target window. The aforementioned data display conditions are related to the area of ​​the free space within the target display interface.

[0088] The above solution greatly improves the flexibility of target data delivery or scheduling by determining the display strategy that matches the target data based on the data display status and display location.

[0089] This application proposes a data processing system comprising an instruction acquisition module, an intent recognition module, a calling module, a data generation module, a layout planning module, and a display and control execution module, all coupled to each other. These modules cooperate to perform the tasks described in the corresponding embodiments, thereby realizing the data processing method corresponding to any embodiment of this application.

[0090] Please see Figure 6 , Figure 6 This is a schematic diagram of one embodiment of the electronic device of this application. The electronic device includes a memory 10 and a processor 20 coupled to each other. The memory 10 stores program instructions, and the processor 20 executes the program instructions to implement the methods mentioned in any of the above embodiments. Specifically, the electronic device includes, but is not limited to, desktop computers, laptops, tablets, servers, etc., and is not limited thereto. In addition, the processor 20 may also be called a CPU (Central Processing Unit). The processor 20 may be an integrated circuit chip with signal processing capabilities. The processor 20 may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The general-purpose processor may be a microprocessor or any conventional processor. In addition, the processor 20 may be implemented by integrated circuit chips.

[0091] Please see Figure 7 , Figure 7This is a schematic diagram of a computer-readable storage medium according to an embodiment of the present application. The computer-readable storage medium 30 stores program instructions 40 that can be executed by a processor. When the program instructions 40 are executed by the processor, they implement the methods mentioned in any of the above embodiments.

[0092] In the several embodiments provided in this application, it should be understood that the disclosed methods and apparatus can be implemented in other ways. For example, the apparatus implementations described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0093] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0094] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0095] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods of various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0096] The above description is merely an embodiment of this application and does not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A data processing method, characterized in that, include: Obtain input instruction description information and extract instruction intent that matches the instruction description information; wherein, the instruction intent includes at least one of data processing type, display theme, display style and display location; Based on the instruction intent, target display data matching the instruction description information is generated; Obtain the data display status of the target display interface, and display the target display data within the target display interface based on the data display status and the instruction intent.

2. The data processing method according to claim 1, characterized in that, The step of acquiring the input instruction description information and extracting the instruction intent that matches the instruction description information includes: Obtain instruction description information input by the processing object; wherein, the instruction description information is determined based on the text or audio input by the processing object, and the instruction description information includes descriptions related to at least one of the data processing type, the display theme, the display style, and the display position; The instruction description information is input into a large language model, and the instruction intent is generated using the large language model.

3. The data processing method according to claim 2, characterized in that, The step of inputting the instruction description information into a large language model and using the large language model to generate the instruction intent includes: The instruction description information is input into the large language model, and the large language model is used to generate at least one level of intent node that matches the instruction description information; wherein, the intent nodes that match multiple levels are distributed in a tree structure, and there is a one-way dependency relationship between the intent nodes that match adjacent levels. The instruction intent is generated based on the intent nodes that match across all levels.

4. The data processing method according to claim 1, characterized in that, The step of generating target display data that matches the instruction description information based on the instruction intent includes: In response to the instruction intent including data source description information, the calling module is used to obtain the raw data that matches the data source description information; Based on the original data and the data processing type, the target display data that matches the display theme and the display style is generated.

5. The data processing method according to claim 4, characterized in that, In response to the data processing type being trajectory generation type, and the raw data being the raw video stream, the step of generating the target display data matching the display theme and the display style based on the raw data and the data processing type includes: Based on the original video stream, generate the movement trajectory of the target object in the target scene; Obtain the target video stream containing the target object, and generate the target display data based on the target video stream and the movement trajectory.

6. The data processing method according to claim 5, characterized in that, The step of generating the movement trajectory of the target object in the target scene based on the original video stream includes: Based on the original video stream, obtain a 3D map corresponding to the target scene where the target object is located within the target time period; Generate the movement trajectory of the target object in the 3D map.

7. The data processing method according to claim 5, characterized in that, The display style includes spatial composition constraints. The step of acquiring the target video stream containing the target object and generating the target display data based on the target video stream and the movement trajectory includes: Based on the spatial composition constraints, the visual focus region corresponding to each target video frame in the target video stream is obtained; Based on all the visual focus regions corresponding to the target video stream, obtain the focused video stream; The target display data is generated based on the focused video stream and the movement trajectory.

8. The data processing method according to claim 1, characterized in that, The step of obtaining the data display status of the target display interface, and displaying the target display data within the target display interface based on the data display status and the instruction intent, includes: Obtain the data display state within the target display interface; wherein, the data display state is determined based on the reference window within the target display interface used to display different reference data; Based on the data display status and the display position, the target display data is displayed within the target display interface.

9. The data processing method according to claim 8, characterized in that, In response to the display position within the target display interface being in an idle state, the step of displaying the target display data within the target display interface based on the data display state and the display position includes: The display location is used as the target location to match the target display data; The target display data is displayed at the target location on the target display interface.

10. The data processing method according to claim 9, characterized in that, After displaying the target display data within the target display interface based on the data display status and the display position, the process includes: Identify relevant data related to the target display data from all the reference data; Within the target display interface, determine the associated position that matches the target position, and adjust the position of each of the reference windows within the target display interface so that the reference window corresponding to the associated data is located at the associated position.

11. The data processing method according to claim 8, characterized in that, In response to the display position within the target display interface being occupied, the step of displaying the target display data within the target display interface based on the data display state and the display position includes: Use the reference window corresponding to the display position within the target display interface as the target window, and replace the reference data displayed in the target window with the target display data; or, Adjust the size of at least a portion of the reference window within the target display interface; based on the sized reference window, create a target window within the target display interface; and display the target display data within the target window; or... Based on the positions of all the reference windows within the target display interface, a target window is created in the free area of ​​the target display interface, and the target display data is displayed within the target window.

12. The data processing method according to claim 11, characterized in that, The step of adjusting the size of at least a portion of the reference window within the target display interface, creating a target window within the target display interface based on the sized reference window, and displaying the target display data within the target window includes: Obtain the reference weights corresponding to each of the reference data within the target display interface, and the target weights corresponding to the target display data; Based on the reference weights and the target weights, the size relationship between the target window to be created and each of the reference windows is determined; Based on the size relationship, the size of at least part of the reference window is adjusted, the target window is created within the target display interface, and the target display data is displayed within the target window.

13. An electronic device, characterized in that, include: A memory and a processor are coupled to each other, the memory storing program instructions, and the processor executing the program instructions to implement the method as described in any one of claims 1-12.

14. A computer-readable storage medium having program instructions stored thereon, characterized in that, When the program instructions are executed by the processor, they implement the method as described in any one of claims 1-12.

Images