Recording marker method and apparatus, recording event display method and apparatus, device

Abstract

Embodiments of the present application relate to a recording marking method and device, a recording event display method and device, and equipment. The method comprises: collecting multimedia data by a data collection module when a recording device is in a target recording scene, the target recording scene including a scene in which the recording device continuously records multimedia for a duration greater than a duration threshold; in response to a triggered marking operation, determining marking information corresponding to target multimedia data; and sending at least part of the multimedia data collected by the data collection module and the marking information to an electronic device, so that the electronic device analyzes the target multimedia data in the at least part of the multimedia data and the marking information according to an event recognition model to obtain first recording event information corresponding to the marking information. The recording device can support portable multimedia data recording, improve the convenience of using the recording device, and improve the accuracy of analyzing the multimedia data recorded by the recording device.

Description

Technical Field

[0001] This application relates to the field of artificial intelligence technology, specifically to a recording and marking method and apparatus, a recording event display method and apparatus, and a device. Background Technology

[0002] Recording devices (such as smart glasses, action cameras, and voice recorders) are widely used in various scenarios, including daily life, sports recording, and meeting recording, due to their convenience and practicality. These devices typically possess the ability to record multimedia data (such as video and audio) and / or perform multimedia data analysis, and also support data synchronization with electronic devices. However, current recording devices exhibit a degree of randomness in the analysis of some multimedia data, leading to low accuracy and poor reliability of the analysis results. Summary of the Invention

[0003] This application discloses a recording marking method and apparatus, a recording event display method and apparatus, and a device. The recording device can support portable multimedia data recording, improve the ease of use of the recording device, and improve the accuracy and reliability of analyzing the multimedia data recorded by the recording device.

[0004] In a first aspect, embodiments of this application disclose a recording and marking method applied to a recording device, the recording device including a data acquisition module; the method includes:

[0005] When the recording device is in the target recording scenario, multimedia data is collected by the data acquisition module. The target recording scenario includes a scenario where the recording device continuously records multimedia for a duration greater than a duration threshold.

[0006] In response to the triggered tagging operation, determine the tagging information corresponding to the target multimedia data to be tagged;

[0007] The data acquisition module collects at least a portion of the multimedia data and the tagging information and sends them to the electronic device, so that the electronic device can analyze the target multimedia data and the tagging information in the at least a portion of the multimedia data through an event recognition model to obtain first recording event information corresponding to the tagging information. The electronic device includes a terminal device and / or a server, and the first recording event information is used to display on the terminal device.

[0008] In this embodiment, the recording device supports recording in the target recording scenario, i.e., it supports long-term continuous recording of multimedia data. During this long-term continuous recording, the user can trigger a marking operation according to their needs. The recording device can then mark the target multimedia data based on the triggered marking operation. The electronic device can use an event recognition model to perform targeted analysis based on the multimedia data collected by the recording device and the marking information corresponding to the marking operation, thereby accurately obtaining the first recording event information corresponding to the marking information. This avoids the situation where the randomness and uncertainty of the artificial intelligence model when analyzing large amounts of multimedia data lead to a mismatch between the output of the artificial intelligence model and the user's expected content. The event recognition model in this embodiment can output the first recording event information expected by the user based on the marking information corresponding to the marking operation triggered by the user, accurately meeting the user's needs and improving the accuracy and reliability of analyzing the multimedia data recorded by the recording device. Furthermore, the recording device supports portable multimedia data recording, improving its ease of use.

[0009] As an optional implementation, the tagging information includes tagging time information; and / or,

[0010] The tagging information includes tag content information.

[0011] In this embodiment, the recording device can provide a basis for time segmentation based on the marked time information to quickly locate and obtain the recording data corresponding to the user's marked time; it can provide guidance for content segmentation based on the marked content information to accurately filter the recording data segments related to the user's marked time; the recording device can better match the recording data corresponding to the user's marked time through the above-mentioned time segmentation or content segmentation.

[0012] As an optional implementation, the tagging information includes tagging time information; the step of determining the tagging information corresponding to the target multimedia data in response to the triggered tagging operation includes:

[0013] Obtain the operation trigger time corresponding to the marking operation;

[0014] The marking time information corresponding to the marked target multimedia data is determined based on the operation time.

[0015] In this embodiment, by obtaining the operation trigger time corresponding to the marking operation and determining the marking time information of the target multimedia data accordingly, the occurrence time of the content that the user is interested in can be accurately recorded, which facilitates the rapid location and review of the multimedia data marked by the user. Especially in long-term continuous recording scenarios, it can improve the retrieval efficiency of the multimedia data marked by the user.

[0016] As an optional implementation, the marker time information is any of the following:

[0017] The marked time information is used to indicate a first time period prior to the operation trigger time;

[0018] The marked time information is used to indicate a second time period after the operation trigger time;

[0019] The marked time information is used to indicate a third time period before the operation trigger time and a fourth time period after the operation trigger time.

[0020] In this implementation, three methods for setting the time information of the operation trigger moment can meet the marking needs of different scenarios by flexibly defining the marking interval range. This allows us to focus on the key content at the moment of operation trigger (such as the starting point of the event), trace the background of the event (the time period before the trigger) or track the subsequent impact (the time period after the trigger), or even capture the whole picture of the event (the combined time period before and after the trigger), thereby completing the marking of complex time ranges and improving the convenience of operation in long recording environments.

[0021] As an optional implementation, the marking operation includes a start marking operation and an end marking operation;

[0022] The marking time information is used to indicate the time period between the first operation trigger time corresponding to the start marking operation and the second operation trigger time corresponding to the end marking operation.

[0023] In this embodiment, by using the time intervals corresponding to the start marking operation and the end marking operation, the recording device can accurately mark the recording content that the user is interested in through two trigger operations. This enables the electronic device to analyze the recording content that the user is truly concerned about, thereby improving the accuracy of analyzing the multimedia data recorded by the recording device.

[0024] As an optional implementation, the tagging information includes tagging content information; the step of determining the tagging information corresponding to the target multimedia data in response to the triggered tagging operation includes:

[0025] The electronic device acquires the multimedia data segment corresponding to the marking operation, identifies the multimedia data segment to obtain recording key information, and uses the recording key information as the marking content information. The marking content information is used by the electronic device to search for multimedia data that matches the recording key information from at least a portion of the multimedia data, and uses it as the target multimedia data for marking.

[0026] In this embodiment, the recording device acquires multimedia data segments corresponding to the marking operation and automatically identifies key recording information within them, using this information as marking content. This achieves intelligent content annotation, allowing users to quickly generate meaningful tags without manual input, thus improving the efficiency and accuracy of multimedia data marking. Simultaneously, based on this key recording information, the electronic device can directly locate and extract target multimedia data from the multimedia data, simplifying the information retrieval process.

[0027] As an optional implementation, the method further includes:

[0028] The multimedia data segment corresponding to the marking operation is obtained, and the multimedia data segment is used as the marking content information. The marking content information is used by the electronic device to identify the multimedia data segment, obtain recording key information, and search for multimedia data that matches the recording key information from at least a portion of the multimedia data based on the recording key information, and use it as the target multimedia data for marking.

[0029] In this embodiment, by directly sending the multimedia data segment corresponding to the marking operation as the marked content information to the electronic device, and using the electronic device to identify the multimedia data segment to extract the recording key information, the accuracy of the extraction of the recording key information can be improved. Furthermore, based on the accurate recording key information, matching content can be searched in the multimedia data as the target multimedia data, which can improve the accuracy and efficiency of the target multimedia data. Especially when processing a large amount of multimedia data, it can enhance the speed of extracting the target multimedia data and reduce the analysis and processing time.

[0030] As an optional implementation, the recorded key information includes at least one of keywords, key sentences, and object information corresponding to the target recording object.

[0031] In this embodiment, the recorded key information may include a variety of information to flexibly describe the marked content information. By recording this key information, the accuracy of identifying target multimedia data can be improved, thereby achieving more accurate event recognition.

[0032] As an optional implementation, the marking information also includes marking time information;

[0033] The marked content information is used by the electronic device to search for multimedia data that matches the recorded key information in the multimedia data corresponding to the marked time information, based on the recorded key information, and to use it as the target multimedia data for marking.

[0034] In this embodiment, by combining the marking time information and the marking content information, the recording device can quickly locate multimedia data that matches the key information to be recorded within a specific time range, thereby quickly and accurately determining the target multimedia data to be marked.

[0035] As an optional implementation, determining the tagging information corresponding to the target multimedia data in response to the triggered tagging operation includes:

[0036] In response to a triggered tagging operation, a target tagging pattern is determined; the target tagging pattern includes a first tagging pattern or a second tagging pattern; the first tagging pattern is a time-based tagging pattern; the second tagging pattern is a content-based tagging pattern.

[0037] Based on the target tagging pattern, determine the tagging information corresponding to the target multimedia data.

[0038] In this implementation, the two different dimensions of tagging information are divided into two tagging modes, which can flexibly select the tagging mode according to the tagging operation, thereby improving the accuracy and efficiency of tagging, meeting the diverse tagging needs in different scenarios, and enhancing the interaction with users.

[0039] As an optional implementation, the first marking pattern corresponds to a first marking operation, and the second marking pattern corresponds to a second marking operation, wherein the first marking operation and the second marking operation are different;

[0040] The process of determining the target marking pattern in response to a triggered marking operation includes:

[0041] If the first marking operation is detected, then in response to the first marking operation, the target marking pattern is determined to be the first marking pattern;

[0042] If the second marking operation is detected, then in response to the second marking operation, the target marking pattern is determined to be the second marking pattern.

[0043] In this embodiment, different marking operations (first marking operation and second marking operation) are assigned to different marking modes (first marking mode and second marking mode) to achieve marking interaction between the recording device and the user.

[0044] As an optional implementation, determining the tagging information corresponding to the target multimedia data in response to the triggered tagging operation includes:

[0045] Receive pattern information sent by the terminal device, the pattern information being used to indicate the target marking pattern;

[0046] Based on the target tagging pattern, determine the tagging information corresponding to the target multimedia data.

[0047] In this embodiment, by setting the target marking mode and synchronizing it with the recording device through the terminal device, the complexity of the recording device can be reduced, allowing the recording device to focus more on marking, thereby improving the marking accuracy and ease of use of the recording device.

[0048] As an optional implementation, the marking operation includes at least one of the following: tapping operation on the recording device, touch operation, control pressing operation, inputting target voice command, and target action operation.

[0049] In this embodiment, the marking operation can include a variety of specific operation methods to mark flexibly, thereby improving the convenience and user experience of the marking operation, while also reducing the possibility of misoperation and ensuring the accuracy and reliability of the marking information.

[0050] As an optional implementation, sending at least a portion of the multimedia data collected by the data acquisition module and the tagging information to the electronic device includes:

[0051] After acquiring the tagging information, the data acquisition module sends at least a portion of the multimedia data and the tagging information to the electronic device.

[0052] In this embodiment, after the recording device completes the acquisition of the tag information, it immediately transmits at least a portion of the collected multimedia data and the corresponding tag information to the electronic device, so that the electronic device receives the tag information and the collected multimedia data simultaneously, thereby analyzing the tag information in a timely manner through the event recognition model to determine the first recording event information corresponding to the tag information.

[0053] As an optional implementation, sending at least a portion of the multimedia data collected by the data acquisition module and the tagging information to the electronic device includes:

[0054] If the preset sending conditions are met, at least a portion of the multimedia data collected by the data acquisition module and the tagging information are sent to the electronic device.

[0055] In this embodiment, the recording device triggers the transmission of multimedia data and tagging information by setting preset transmission conditions, thereby achieving flexible control of data transmission and avoiding unnecessary frequent transmissions that would cause power consumption loss and affect the recording time. At the same time, when the conditions are met, the recording device can deliver multimedia data and tagging information to the electronic device in a timely and reliable manner, thus avoiding the problem of sending a complete long-term recording data to the electronic device at once, which would lead to the recording device and the electronic device being out of sync or the recording device taking too long to analyze the long-term recording data.

[0056] As an optional implementation, the preset transmission conditions include at least one of the following:

[0057] The remaining battery power of the recording device is less than the battery threshold.

[0058] The recording device enters a charging state;

[0059] The duration since the last transmission time has reached the cycle duration, where the last transmission time is the time when the recording device last sent data and tag information to the electronic device;

[0060] Send operation detected.

[0061] In this embodiment, by setting multiple preset transmission conditions, the recording device can reduce power consumption loss caused by unnecessary data transmission in different working scenarios, and can gradually send a large amount of multimedia data collected over a long period of time to the electronic device under preset transmission conditions, thereby improving the accuracy of multimedia data transmission and thus improving the accuracy of analyzing the multimedia data recorded by the recording device.

[0062] As an optional implementation, the at least portion of the multimedia data is further used by the electronic device to analyze the at least portion of the multimedia data to obtain one or more second recording event information.

[0063] In this embodiment, since the recording device performs long-term recording, the recorded content can contain rich content. In addition to the first recording event information corresponding to the marker information, the electronic device will also analyze the multimedia data collected by the data acquisition module of the recording device to generate multiple second recording event information. The multiple second recording event information are not all related to the marker information, which helps the user to clearly understand the events and content recorded by the recording device based on the first recording event information and the multiple second recording event information.

[0064] As an optional implementation, the multimedia data includes one or more of audio data, video data, and image data.

[0065] Secondly, embodiments of this application disclose a method for displaying recorded events, applied to an electronic device; the method includes:

[0066] Displays information about the first recorded event;

[0067] Wherein, the first recording event information is obtained by the electronic device through an event recognition model based on the target multimedia data and tag information in at least a portion of the multimedia data; the at least a portion of the multimedia data is collected by the recording device through its data acquisition module and sent to the electronic device when it is in a target recording scenario; the target recording scenario includes a scenario where the recording device continuously records multimedia for a duration greater than a duration threshold; the tag information is determined by the recording device in response to a triggered tagging operation, and the tag information is used to indicate the target multimedia data being tagged; the electronic device includes the terminal device and / or the server.

[0068] In this embodiment, the electronic device receives multimedia data and tagging information sent by the recording device, and performs targeted analysis on the target multimedia data and tagging information through an event recognition model. This accurately obtains the first recording event information corresponding to the tagging information, avoiding the situation where the output of the artificial intelligence model does not match the user's expected content due to the randomness and uncertainty of the artificial intelligence model when analyzing a large amount of multimedia data. The first recording event information can be output according to the tagging information corresponding to the tagging operation triggered by the user, so that the first recording event information displayed by the terminal device can accurately meet the user's needs, thus improving the accuracy and reliability of analyzing the multimedia data recorded by the recording device.

[0069] As an optional implementation, the method further includes:

[0070] In the display area corresponding to the first recorded event information, a first identifier is displayed. The first identifier is used to indicate that the first recorded event information is the recorded event information corresponding to the marking operation.

[0071] In this embodiment, adding a first identifier to the display area of ​​the first recorded event information can intuitively indicate that the recorded event information is directly related to the user's marking operation, enabling the user to quickly identify and focus on the recorded event information, thereby enhancing the relevance of the recorded event information display.

[0072] As an optional implementation, the method further includes:

[0073] In response to an information viewing operation for the first recorded event information, a recording event page corresponding to the first recorded event information is displayed. The recording event page corresponding to the first recorded event information is used to display the event content corresponding to the first recorded event information, and / or to display the event content of the recorded event associated with the first recorded event information.

[0074] In this embodiment, by responding to the information viewing operation for the first recorded event information and displaying the corresponding recorded event page, the terminal device can not only display the first recorded event information, but also display the specific event content of the first recorded event information and / or the event content of the associated recorded events through page jump, so that the user can fully observe the marked information (information of interest) and related events.

[0075] As an optional implementation, the method further includes:

[0076] In response to a recorded search operation, retrieve the entered search content;

[0077] The multimedia data is searched according to the search content to obtain multimedia data that matches the search content;

[0078] The event recognition model is used to analyze the matched multimedia data to obtain third recording event information, which is then displayed.

[0079] In this embodiment, the terminal device can respond to the recording search operation, reorganize at least a portion of the multimedia data, and perform in-depth analysis of these matching data using an event recognition model to extract and display the third recording event information. Through intelligent analysis (event recognition model), it can help users quickly find the information points they need (search content) from a large amount of multimedia data, improve the efficiency and accuracy of information retrieval, and meet the user's need for rapid retrieval of specific content.

[0080] As an optional implementation, the method further includes:

[0081] In response to the recording and playback operation for the first recorded event information, the multimedia data corresponding to the first recorded event information is played.

[0082] In this embodiment, the terminal device can directly play the target multimedia data corresponding to the user's marked operation based on the recording and playback operation. This allows the user to quickly watch and listen to the target multimedia data segment with just a simple operation, without having to search through lengthy multimedia data. This makes the playback of multimedia data on the terminal device more intuitive, efficient, and accurate.

[0083] As an optional implementation, the method further includes:

[0084] The event recognition model is used to analyze at least a portion of the multimedia data to obtain one or more second recorded event information.

[0085] Display the information of the one or more second recorded events.

[0086] In this embodiment, in addition to displaying the first recording event information corresponding to the marker information, the terminal device will also display multiple second recording event information obtained by comprehensively analyzing at least a portion of the received multimedia data through an event recognition model. This allows the user to obtain the content events contained in at least a portion of the multimedia data recorded by the recording device while obtaining the marker information, thereby displaying more comprehensive information to the user.

[0087] As an optional implementation, the display area corresponding to the first recorded event information is located above the display areas corresponding to the one or more second recorded event information respectively.

[0088] In this embodiment, when the terminal device displays the first recording event information corresponding to the marked information, it displays it above the multiple second recording event information that are not marked, highlighting the first recording event information so that the user can pay more attention to the first recording event information more intuitively.

[0089] As an optional implementation, the method further includes:

[0090] Obtain the start recording time corresponding to the first recording event information, and the start recording time corresponding to the one or more second recording event information respectively;

[0091] The first recording event information and one or more second recording event information are displayed sequentially according to the time order of the start recording time.

[0092] In this embodiment, the terminal device displays the first recorded event information and the second recorded event information in sequence according to the recording time. It can connect the user-marked and electronic device-identified recorded event information through the timeline to construct a relatively complete event development context, enabling users to intuitively perceive the order and correlation of events and improving the logic of information display.

[0093] As an optional implementation, the method further includes:

[0094] The first recorded event information is displayed according to the first display style;

[0095] The one or more second recorded event information are displayed according to a second display style, wherein the first display style is different from the second display style.

[0096] In this embodiment, the terminal device displays the first recorded event information corresponding to the marked information in a way that distinguishes it from other second recorded event information. This visual distinction enhances the importance of the recorded event information actively marked by the user and highlights the first recorded event information.

[0097] As an optional implementation, the recorded event information includes an event theme, the first display style includes a first font style corresponding to the first event theme of the first recorded event information, and the second display style includes a second font style corresponding to the second event theme of the second recorded event information; the first font style is different from the second font style.

[0098] In this embodiment, by setting different font styles for the event topics of the first recorded event information and the second recorded event information, the first recorded event information and the second recorded event information can be visually distinguished. The first recorded event information can be highlighted intuitively through the difference in font style.

[0099] As an optional implementation, the first display style includes a first event image, the second display style includes a second event image, and displaying the first recorded event information according to the first display style includes:

[0100] In the display area corresponding to the first recorded event information, the first event image corresponding to the first recorded event information is displayed;

[0101] The step of displaying the one or more second recorded event information according to the second display style includes:

[0102] In the display area corresponding to each of the second recorded event information, the second event image corresponding to each of the second recorded event information is displayed.

[0103] In this embodiment, the terminal device configures corresponding event images for the first recorded event information (user mark) and the second recorded event information (electronic device identification) respectively, and displays them differently in the corresponding display areas. This allows the first recorded event information to be visually highlighted and emphasized, while also helping the user to quickly understand the content of the recorded event information through images.

[0104] As an optional implementation, the method further includes:

[0105] Analyze the first recorded event information and the one or more second recorded event information, and determine one or more target second recorded event information that is associated with the first recorded event information from the one or more second recorded event information;

[0106] A second identifier is displayed in the display area corresponding to each of the target second recorded event information. The second identifier is used to indicate that the corresponding target second recorded event information is associated with the first recorded event information.

[0107] In this embodiment, the terminal device filters out the target second recorded event information associated with the marking information from the second recorded event information and adds a second identifier to its display area. This enables the visual display of the relationship between the various recorded event information to be displayed intuitively, thereby improving the visibility of the terminal device's display page.

[0108] As an optional implementation, the display styles of the one or more target second recorded event information are different; the display style of the target second recorded event information is determined according to the degree of correlation between the target second recorded event information and the first recorded event information.

[0109] In this embodiment, the terminal device dynamically adjusts its display style according to the degree of correlation between the target second recorded event information and the first recorded event information, which can intuitively reflect the strength of the correlation between the recorded event information with visual gradient, so that users can quickly obtain this correlation relationship.

[0110] As an optional implementation, the method further includes:

[0111] Retrieve historical event recording information;

[0112] Analyze the first recorded event information and the one or more second recorded event information, and their correlation with the historical marked recorded event information, to determine one or more fourth recorded event information associated with the historical marked recorded event information;

[0113] A third identifier is displayed in the display area corresponding to each of the fourth recorded event information, the third identifier being used to indicate that the corresponding fourth recorded event information is associated with the historical marked recorded event information.

[0114] In this embodiment, the terminal device analyzes the potential connections between the first recorded event information, the second recorded event information, and the historical marked recorded event information, and adds a third identifier to the display area of ​​the associated fourth recorded event information. This enables the current recorded event information to be associated with the user's historical marked information, thereby displaying the continuity of the event sequence and facilitating subsequent processing of recorded event information.

[0115] Thirdly, embodiments of this application disclose a recording marker device applied to a recording device, the recording device including a data acquisition module; the device includes:

[0116] The recording module is used to collect multimedia data through the data acquisition module when the recording device is in a target recording scenario, wherein the target recording scenario includes a scenario in which the recording device continuously records multimedia for a duration greater than a duration threshold;

[0117] The tagging module is used to determine the tagging information corresponding to the target multimedia data in response to the triggered tagging operation;

[0118] A sending module is used to send at least a portion of the multimedia data collected by the acquisition module and the tagging information to an electronic device, so that the electronic device can analyze the target multimedia data and the tagging information in the at least a portion of the multimedia data through an event recognition model to obtain first recording event information corresponding to the tagging information. The electronic device includes a terminal device and / or a server, and the first recording event information is used to be displayed on the terminal device.

[0119] In this embodiment, the recording device supports recording in the target recording scenario, i.e., it supports long-term continuous recording of multimedia data. During this long-term continuous recording, the user can trigger a marking operation according to their needs. The recording device can then mark the target multimedia data based on the triggered marking operation. The electronic device can use an event recognition model to perform targeted analysis based on the multimedia data collected by the recording device and the marking information corresponding to the marking operation, thereby accurately obtaining the first recording event information corresponding to the marking information. This avoids the situation where the randomness and uncertainty of the artificial intelligence model when analyzing large amounts of multimedia data lead to a mismatch between the output of the artificial intelligence model and the user's expected content. The event recognition model in this embodiment can output the first recording event information expected by the user based on the marking information corresponding to the marking operation triggered by the user, accurately meeting the user's needs and improving the accuracy and reliability of analyzing the multimedia data recorded by the recording device. Furthermore, the recording device supports portable multimedia data recording, improving its ease of use.

[0120] Fourthly, embodiments of this application disclose a recording event display device, applied to a terminal device; the device includes:

[0121] The display module is used to display the information of the first recorded event;

[0122] Wherein, the first recording event information is obtained by the electronic device through an event recognition model based on the target multimedia data and tag information in at least a portion of the multimedia data; the at least a portion of the multimedia data is collected by the recording device through its data acquisition module and sent to the electronic device when it is in a target recording scenario; the target recording scenario includes a scenario where the recording device continuously records multimedia for a duration greater than a duration threshold; the tag information is determined by the recording device in response to a triggered tagging operation, and the tag information is used to indicate the target multimedia data being tagged; the electronic device includes the terminal device and / or the server.

[0123] In this embodiment, the electronic device receives multimedia data and tagging information sent by the recording device, and performs targeted analysis on the target multimedia data and tagging information through an event recognition model. This accurately obtains the first recording event information corresponding to the tagging information, avoiding the situation where the output of the artificial intelligence model does not match the user's expected content due to the randomness and uncertainty of the artificial intelligence model when analyzing a large amount of multimedia data. The first recording event information can be output according to the tagging information corresponding to the tagging operation triggered by the user, so that the first recording event information displayed by the terminal device can accurately meet the user's needs, improving the accuracy and reliability of analyzing the multimedia data recorded by the recording device.

[0124] Fifthly, embodiments of this application disclose a recording device, including a memory and a processor. The memory stores a computer program, and when the computer program is executed by the processor, the processor causes the processor to implement the method described in any of the embodiments of the first aspect above.

[0125] In a sixth aspect, embodiments of this application disclose a terminal device, including a memory and a processor. The memory stores a computer program, and when the computer program is executed by the processor, the processor causes the processor to implement the method described in any of the embodiments of the second aspect above.

[0126] In a seventh aspect, embodiments of this application disclose a computer-readable storage medium storing a computer program that, when executed by a processor, implements the methods described in any of the above embodiments.

[0127] Eighthly, embodiments of this application disclose a computer program product, including a computer program, wherein when the computer program is executed by a processor, it implements the method described in any of the above embodiments. Attached Figure Description

[0128] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0129] Figure 1A This is an application scenario diagram of a recording device and an electronic device in one embodiment;

[0130] Figure 1B This is an application scenario diagram of the recording device and electronic device in another embodiment;

[0131] Figure 1C This is a structural block diagram of the recording device and electronic device in one embodiment;

[0132] Figure 2 This is a flowchart of a recording marking method applied to a recording device in one embodiment;

[0133] Figure 3 This is a flowchart illustrating the determination of marker information in one embodiment;

[0134] Figure 4 This is a flowchart of a recording marking method applied to a recording device in one embodiment;

[0135] Figure 5 A flowchart of a recording mark method applied to a recording device in another embodiment;

[0136] Figure 6 This is a flowchart of a recording marking method applied to a recording device in yet another embodiment;

[0137] Figure 7A This is a flowchart of a recording event display method applied to a terminal device in one embodiment;

[0138] Figure 7B This is a schematic diagram of the display page of a terminal device in one embodiment;

[0139] Figure 7C This is a schematic diagram of the display page of the terminal device in another embodiment;

[0140] Figure 7D This is a schematic diagram of the display page of the terminal device in yet another embodiment;

[0141] Figure 7E This is a schematic diagram of the display page of the terminal device in another embodiment;

[0142] Figure 8A This is a flowchart of a recording event display method applied to a terminal device in one embodiment;

[0143] Figure 8B This is a schematic diagram of the display page of a terminal device in one embodiment;

[0144] Figure 9A This is a flowchart of a recording event display method applied to a terminal device in one embodiment;

[0145] Figure 9B This is a schematic diagram of the display page of a terminal device in one embodiment;

[0146] Figure 9C This is a schematic diagram of the display page of the terminal device in another embodiment;

[0147] Figure 10A This is a flowchart of a recording event display method applied to a terminal device in one embodiment;

[0148] Figure 10B This is a schematic diagram of the display page of a terminal device in one embodiment;

[0149] Figure 10C This is a schematic diagram of the display page of the terminal device in another embodiment;

[0150] Figure 11A This is a flowchart of a recording event display method applied to a terminal device in one embodiment;

[0151] Figure 11B This is a schematic diagram of the display page of a terminal device in one embodiment;

[0152] Figure 11C This is a schematic diagram of the display page of the terminal device in another embodiment;

[0153] Figure 12A This is a flowchart of a recording event display method applied to a terminal device in one embodiment;

[0154] Figure 12B This is a schematic diagram of the display page of a terminal device in one embodiment;

[0155] Figure 13 This is a block diagram of a recording marker device applied to a recording device in one embodiment;

[0156] Figure 14 This is a block diagram of a recording event display device applied to a terminal device in one embodiment;

[0157] Figure 15 This is a structural block diagram of a recording device in one embodiment;

[0158] Figure 16 This is a structural block diagram of a terminal device in one embodiment. Detailed Implementation

[0159] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0160] It is understood that the terms "first," "second," etc., used in this application may be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish one element from another. For example, without departing from the scope of this application, first recorded event information may be referred to as second recorded event information, and similarly, second recorded event information may be referred to as first recorded event information. First recorded event information and second recorded event information are different recorded event information.

[0161] In related technologies, the interaction between recording devices and users primarily relies on physical buttons or touchscreens. When using physical buttons, the precise pressure required can be problematic in certain scenarios, such as when the user is running, cycling, or has wet hands. Sweat or external environmental factors can affect the pressing action, making it inconvenient or even causing it to malfunction. Similarly, when using a touchscreen, touch malfunctions can occur in humid environments or when the user is wearing gloves, thus impacting the user experience.

[0162] Furthermore, recording devices or electronic devices in related technologies often use AI (Artificial Intelligence) to summarize the recorded content. While AI summarization can be convenient to some extent, it has a degree of randomness. It may summarize based on factors such as the amount and relevance of the recorded content, but this method may not be able to target content that users are particularly interested in. More importantly, users cannot actively interfere with the AI ​​summarization process and results, meaning that the AI ​​summary may not fully meet the user's actual needs.

[0163] This application discloses a recording marking method and apparatus, a recording event display method and apparatus, and a device. The recording device can support portable multimedia data recording, improve the ease of use of the recording device, and improve the accuracy and reliability of analyzing the multimedia data recorded by the recording device.

[0164] Figure 1A This is an application scenario diagram of a recording device and an electronic device in one embodiment. For example... Figure 1AAs shown, the recording tagging method provided in this application embodiment can be applied to the recording device 110, and the recording event display method provided in this application embodiment can be applied to the electronic device 120. A communication connection is established between the recording device 110 and the electronic device 120. The recording device 110 can be wearable, such as a lapel clip, wristband, neckband, or magnetic badge; it can also be portable, such as a box, pen, or pendant. The electronic device 120 may include a terminal device and / or a server.

[0165] Possible communication connection methods include, but are not limited to, Bluetooth, Wi-Fi, NFC (Near Field Communication), and mobile network connections. For example, ... Figure 1A As shown, after the recording device 110 and the electronic device 120 establish a communication connection, the recording device 110 can directly send multimedia data to the electronic device 120; the electronic device 120 can directly receive the multimedia data sent by the recording device 110.

[0166] Optionally, the recording device 110 and the electronic device 120 can also be connected via a network, with data transmission mediated by the cloud. For example, as Figure 1B As shown, the recording device 110 uploads and stores the data to the cloud 140, and then the cloud 140 synchronizes the data to the electronic device 120. The analysis and processing of the data can be performed on the electronic device 120, or it can be analyzed in the cloud 140 and then synchronized to the electronic device 120.

[0167] Optionally, the communication connection between the recording device 110 and the electronic device 120 is flexible. Specifically, the recording device 110 and the electronic device 120 can maintain a continuous connection to ensure the real-time performance and stability of data transmission; alternatively, the connection can be established only before the recording device 110 needs to send multimedia data to the electronic device 120, thereby saving device resources and energy consumption.

[0168] Recording device 110 refers to a device that can be worn on the human body or clothing and has a recording function. Recording device 110 may include, but is not limited to, smartwatches, smart glasses, head-mounted recording devices, and recording devices that can be clipped (or attached) to clothing.

[0169] The recording device 110 may include, but is not limited to, audio recording devices and / or video recording devices. For example, the recording device 110 may be a recording button, a wearable camera, etc. The recording device 110 can support long-term recording.

[0170] Electronic device 120 refers to a device used to receive, process, store, or display multimedia data recorded by recording device 110. Electronic device 120 may include, but is not limited to, mobile phones, computers, cloud servers, and other electronic devices.

[0171] Figure 1C This is a structural block diagram of a recording device and an electronic device in one embodiment. For example... Figure 1C As shown, the recording device 110 may include a data acquisition module 112.

[0172] The data acquisition module 112 is used to record various target objects and related activities in the environment where the user 130 is located, and to collect multimedia data. The data acquisition module 112 may include, but is not limited to, a microphone and / or a camera.

[0173] Specifically, microphones can capture sound signals from the surrounding environment, whether it's conversations, live music performances, or natural sounds like wind and rain; all of these can be converted into electrical signals and recorded by the microphone. Cameras can capture video image information; cameras can include high-definition cameras, wide-angle cameras, or cameras with special functions.

[0174] like Figure 1B As shown, the electronic device 120 may store an event recognition model 122. The event recognition model 122 is an analysis model based on artificial intelligence algorithms. It can use technologies in the fields of machine learning and deep learning to learn and analyze a large number of sample multimedia data of known events, so as to master the characteristic patterns and rules of different events, thereby having the ability to intelligently parse the input multimedia data and judge the event information contained therein.

[0175] The event recognition model 122 can be used to automatically process multimedia data (including audio, video, images, and one or more other forms) collected by the recording device 110 for event recognition. For example, when the recording device 110 records a user's activities for a day, the event recognition model 122 can identify various daily events such as "getting up," "washing up," "eating," "traveling," "working," "exercising," and "resting," and summarize these events to form corresponding recorded event information.

[0176] In some embodiments, the user 130 wears the recording device 110 on their body and activates it, placing the recording device 110 in a target recording scenario for extended periods. Multimedia data is collected via the data acquisition module 112 on the recording device 110. During recording, the user 130 can mark content of interest and / or importance recorded by the recording device 110, allowing the device to mark the recorded multimedia data accordingly. In response to the triggered marking operation, the recording device 110 determines the marking information corresponding to the marked target multimedia data. The recording device 110 then sends at least a portion of the multimedia data collected by the data acquisition module 112, along with the marking information, to the electronic device 120. The electronic device 120 analyzes the target multimedia data and marking information received from the at least a portion of the multimedia data using an event recognition model 122, obtaining first recording event information corresponding to the marking information. This first recording event information is then displayed on a terminal device, allowing the user 130 to directly view the content they have marked (of interest).

[0177] like Figure 2 As shown, in one embodiment, a recording tagging method is provided, which can be applied to the recording device described above. The method may include steps 210 to 230.

[0178] Step 210: When the recording device is in the target recording scene, collect multimedia data through the data acquisition module.

[0179] The target recording scenario refers to a scenario where the recording device continuously records multimedia for a duration exceeding a certain threshold. Target recording scenarios may include, but are not limited to, recording a user's daily activities (such as traveling, attending parties, etc.), user work presentations, course lectures, user exercise (such as running, aerobics, ball sports, etc.), and other scenarios requiring long-term recording.

[0180] Multimedia data refers to a collection of data containing multiple information formats acquired by recording devices through various sensors and acquisition methods in a target recording scenario. Multimedia data includes one or more of the following: audio data, video data, and image data.

[0181] Specifically, multimedia data may include sound signals such as human voices, music, and environmental sound effects, as well as physical quantity information such as temperature and humidity collected by various sensors.

[0182] For example, when a user is traveling, they wear the recording device on their body and turn it on. The recording device collects multimedia data such as video, images, and audio through the data acquisition module to fully record the scenery along the way, interesting human encounters, and local delicacies.

[0183] Step 220: In response to the triggered tagging operation, determine the tagging information corresponding to the target multimedia data to be tagged.

[0184] Tagging refers to specific interactive behaviors between the user and the recording device; it is used to instruct the recording device to tag the currently acquired multimedia data.

[0185] In some embodiments, the marking operation may include at least one of the following: tapping operation on the recording device, touch operation, control pressing operation, inputting target voice command, and target action operation.

[0186] Tapping operations on recording devices refer to the interactive behavior in which a user taps the recording device rhythmically or in a specific manner to convey marking instructions to the recording device. Specifically, tapping operations include at least one of the following: preset tapping number, preset tapping frequency, and preset tapping force.

[0187] For example, when a user records content that is of interest and / or important, the user can tap the recording device a preset number of times, and / or tap the recording device at a specific time interval, and / or tap the recording device with a force greater than or equal to a preset force threshold, in order to trigger a marking operation on the recording device.

[0188] Touch operation refers to using your finger or a dedicated stylus to perform preset actions such as clicking, swiping, and long-pressing on the touchscreen of the recording device, so that the recording device can determine whether the touch is a triggered marker operation based on parameters such as the position, trajectory, and duration of the touch.

[0189] Control pressing operation refers to the preset operation of pressing, rotating, sliding, etc. on specific physical or virtual controls set on the recording device, such as buttons and knobs, which triggers the marking operation.

[0190] The operation of inputting target voice commands refers to the user speaking a specific voice command through the voice recognition function of the recording device. The recording device converts the voice into text and matches it with the preset command. Only when the match is successful is it marked.

[0191] The target action operation refers to using the built-in sensors such as accelerometers and gyroscopes of the recording device to detect specific actions made by the user, such as rapidly shaking the device or making specific gestures. When the matching degree between the action and the preset model reaches a threshold, it is determined to be a triggered marked operation.

[0192] In some embodiments, the target multimedia data to be tagged contains content of interest to the user. During multimedia recording using a recording device, if the user records content of interest and / or importance, and wishes to tag the currently recorded multimedia data, the user will perform a tagging operation on the recording device. This allows the recording device to respond to the triggered tagging operation and determine the tagging information corresponding to the target multimedia data to be tagged, i.e., to determine the content of interest to the user.

[0193] The tagging information corresponding to the target multimedia data refers to the information used to locate or record the target multimedia data such as specific images, videos, and audio.

[0194] Optionally, the tagging information includes tagging time information; and / or, the tagging information includes tagging content information.

[0195] Marking time information refers to information that can clearly identify the time when the marking operation occurred, or accurately locate a specific time point in the target multimedia data.

[0196] Specifically, the time information can be absolute time, such as the year, month, day, hour, minute, and second, like "October 20, 2024, 15:20:35," indicating the actual time the marking operation occurred. The time information can also be relative time, such as the time after the recording device started recording, like "01:15:20," indicating the marking point is at the 1st hour, 15th minute, and 20th second after the recording device started recording.

[0197] The labeled content information refers to information used to describe the content contained in the target multimedia data, or specific multimedia data fragments collected by the data acquisition module.

[0198] Specifically, tag content information can be a short label word. Tag content information can also be a detailed text description. Tag content information can also include specific symbols or technical terms, etc.

[0199] Step 230: At least a portion of the multimedia data and tagging information collected by the data acquisition module are sent to the electronic device, so that the electronic device can analyze the target multimedia data and tagging information in the at least a portion of the multimedia data through the event recognition model to obtain the first recording event information corresponding to the tagging information.

[0200] The first recorded event information refers to information in the target multimedia data related to the recorded event indicated by the marker information. The first recorded event information is used for display on the terminal device. Specifically, if the marker information is a time point, the first recorded event information may be an overview of the event that occurred in the target multimedia data at that time point. For example, if at least part of the multimedia data is a performance at a welcome party, and the marker information is a time point corresponding to the third program, then the first recorded event information may include an overview of the performance content of the third program in the welcome party.

[0201] Optionally, the recorded event information may include, but is not limited to, the event theme (a brief description of the event that occurred in the target multimedia data), time information (specifying the time point or time period in which the event occurred), and related elements (such as the people, objects, and scenes involved).

[0202] In some embodiments, after acquiring the tagging information, the recording device may send at least a portion of the multimedia data collected by the data acquisition module and the tagging information to the electronic device. After receiving the at least a portion of the multimedia data and the tagging information sent by the recording device, the electronic device analyzes the target multimedia data in the at least a portion of the multimedia data according to the tagging information using an event recognition model to obtain first recording event information corresponding to the tagging information, and displays the first recording event information on the terminal device.

[0203] In some embodiments, at least a portion of the multimedia data is further used by the electronic device to analyze the multimedia data to obtain one or more second recording event information. This allows the user to obtain the content events contained in at least a portion of the multimedia data recorded by the recording device while obtaining the tagging information, thereby presenting the user with more comprehensive information.

[0204] Secondary recorded event information is an event-related description generated by an electronic device based on all the content contained in at least part of the multimedia data, without relying on tagging information. One or more secondary recorded event pieces encompass key elements of various events occurring during the recording process, which may include the event's temporal span, spatial distribution, interactive relationships among participants, and the event's development trend. For example, during a user's travels, the video data collected by the recording device through its data acquisition module could yield multiple secondary recorded event pieces that could describe events at various locations.

[0205] Taking an electronic device as an example, the server is communicatively connected to the recording device, and the server is also communicatively connected to the terminal device. When a user encounters content of interest, they trigger the recording device through a marking operation. The recording device responds to this marking operation by marking the current multimedia data, generating marking information, and sending the collected multimedia data and marking information to the server. The server, using an event recognition model, performs event analysis on the received multimedia data based on the received marking information to obtain the first recording event information corresponding to the marking information; the server then sends the first recording event information to the terminal device, which displays the first recording event information.

[0206] Taking an electronic device as an example as the terminal device, the recording device can communicate directly with the terminal device. After generating tag information, the recording device directly sends the collected multimedia data and tag information to the terminal device. The terminal device, based on the event recognition model, performs event analysis on the received multimedia data according to the received tag information to obtain the first recording event information corresponding to the tag information, and displays the first recording event information.

[0207] Taking an electronic device as the terminal device as an example, the recording device and the terminal device are connected through a cloud server. After generating tag information, the recording device sends the collected multimedia data and tag information to the server. The server then forwards the multimedia data and tag information sent by the recording device to the terminal device. The terminal device uses an event recognition model to perform event recognition on the multimedia data based on the tag information sent by the server, obtains the first recording event information corresponding to the tag information, and displays the first recording event information.

[0208] In some embodiments, due to the numerous variables in the actual situation of the target recording scenario, including the physical environment, personnel movement, device distribution, and network infrastructure, parameters such as network connection stability, bandwidth, and latency are dynamically changing. For example, in a scenario where a user is attending a large outdoor music festival and recording video, as the performance progresses, large numbers of audience members gather and disperse, and the load of temporary network base stations in the vicinity fluctuates continuously. The network connection status of the recording device and electronic devices will change due to factors such as changes in personnel density and increased signal interference. Therefore, the recording device can determine the target electronic device based on the network connection status and send at least a portion of the multimedia data and tagging information collected by the data acquisition module to the target electronic device.

[0209] Specifically, when the network connection is stable and bandwidth is sufficient, and multiple electronic devices are available to receive data, the recording device can select any electronic device as the target electronic device; when the network connection is stable or bandwidth can meet the real-time transmission requirements, and the terminal device stores an event recognition model, the recording device can use the terminal device as the target electronic device; when the network connection is unstable or bandwidth is limited, or the terminal device has insufficient processing power to guarantee complete data reception, or the terminal device does not store an event recognition model, the recording device can use the server as the target electronic device.

[0210] For example, taking multimedia data as audio data, the recording device can be a recording device, and its data acquisition module corresponds to the microphone on the recording device. When a user attends a large-scale meeting, they can wear the recording device before the meeting starts and start the recording function. At this time, the data acquisition module, i.e., the microphone, begins to collect audio data. Because the content of a large-scale meeting is very rich and diverse, when artificial intelligence summarizes or records the entire meeting content, due to randomness and uncertainty, the summary or recording results may not be the meeting content that the user is interested in or considers important.

[0211] In this embodiment, during a meeting, if a user hears content they are interested in or consider important, or a speech by a specific person, they can trigger the recording device through a convenient marking operation such as continuous tapping. The recording device responds to this marking operation, marking the current audio data, generating corresponding marking information, and sending the audio data and marking information together to the electronic device. The electronic device, using an event recognition model, performs event analysis on the marked audio data based on the marking information, summarizing and analyzing the audio data that the user is interested in or considers important, and then generating first recording event information that meets the user's needs.

[0212] For example, taking multimedia data as video data, the recording device can be a video camera, and the data acquisition module can be a camera. When a user is traveling long distances, they turn on the video camera to record their journey. Due to numerous unforeseen factors during travel, such as unpredictable weather, last-minute adjustments to itineraries, and unexpected events, the resulting video recording of the entire trip is often cluttered and lacks focus. When artificial intelligence summarizes or extracts key information from this video content, the randomness and uncertainty of the data itself often make it difficult to accurately identify the content that the user is truly interested in or considers important.

[0213] In this embodiment, during travel, when a user sees stunning scenery, encounters interesting people, or experiences a special event, they can trigger a marking function by pressing a specific marking button on the recording device. The recording device responds to this marking operation, marking the currently captured video data, generating corresponding marking information, and sending the video data and marking information to the electronic device. The electronic device uses an event recognition model to analyze the marked video data based on the marking information, organizing and summarizing video clips that the user is interested in or considers important, generating event information for travel-related videos that meets the user's needs, facilitating subsequent review and sharing.

[0214] In this embodiment, the recording device supports recording in the target recording scenario, i.e., it supports long-term continuous recording of multimedia data. During this long-term continuous recording, the user can trigger a marking operation according to their needs. The recording device can then mark the target multimedia data based on the triggered marking operation. The electronic device can use an event recognition model to perform targeted analysis based on the multimedia data collected by the recording device and the marking information corresponding to the marking operation, thereby accurately obtaining the first recording event information corresponding to the marking information. This avoids the situation where the randomness and uncertainty of the artificial intelligence model when analyzing large amounts of multimedia data lead to a mismatch between the output of the artificial intelligence model and the user's expected content. The event recognition model in this embodiment can output the first recording event information expected by the user based on the marking information corresponding to the marking operation triggered by the user, accurately meeting the user's needs and improving the accuracy and reliability of analyzing the multimedia data recorded by the recording device. Furthermore, the recording device supports portable multimedia data recording, improving its ease of use.

[0215] In one embodiment, such as Figure 3 As shown, the steps respond to the triggered tagging operation by determining the tagging information corresponding to the target multimedia data to be tagged, and may also include the following steps 302 to 304.

[0216] Step 302: Obtain the operation trigger time corresponding to the marking operation.

[0217] The operation trigger moment refers to the exact instant when the user performs the marking operation, which is precisely recorded in the system time dimension of the recording device.

[0218] In some embodiments, since the events recorded in the target multimedia data have temporal continuity, i.e., are multimedia data over a period of time, the marking operation can include two operations—a start marking operation and an end marking operation—to clearly define the start and end positions of the events within the multimedia data. By using the time periods corresponding to the start and end marking operations, and through two triggering operations, the recording device can accurately mark the recorded content that the user is interested in. This allows the electronic device to analyze the recorded content that the user is truly concerned with, improving the accuracy of the analysis of the multimedia data recorded by the recording device.

[0219] A start-mark operation refers to a marking action performed by a user to mark the beginning of a specific event or segment in multimedia data. It indicates that the recording device has begun recording multimedia data information associated with that mark. For example, in a video of a sports match, the start-mark operation is the action performed by the user at the moment a player shoots.

[0220] An end-marking operation refers to a marking action performed by a user to mark the end of a specific event or segment in multimedia data. The end-marking operation corresponds to the start-marking operation, together defining a complete range of events or segments. For example, in the aforementioned sports video, the end-marking operation could be the action performed by the user after the player's goal celebration ends; thus, through the start-marking and end-marking operations, the target multimedia data could contain the relevant video segments from the player's shot to the goal celebration.

[0221] Step 304: Determine the marking time information corresponding to the marked target multimedia data based on the operation time.

[0222] In some embodiments, the recording device may determine the marking time information corresponding to the marked target multimedia data based on the operation time and a preset time length.

[0223] In some embodiments, the time information is marked as any of the following:

[0224] The time information is used to indicate the first time period prior to the operation trigger moment;

[0225] The time information is used to indicate a second time period following the moment the operation was triggered.

[0226] The time information is used to indicate the third time period before the operation trigger time and the fourth time period after the operation trigger time;

[0227] The time stamp information is used to indicate the time period between the first operation trigger time corresponding to the start stamping operation and the second operation trigger time corresponding to the end stamping operation.

[0228] Optionally, both the third and fourth time periods can be preset durations. For example, if the preset duration is 5 minutes, then both the third and fourth time periods will be 5 minutes long. Alternatively, the sum of the durations of the third and fourth time periods can be the preset duration; in this case, the specific durations of the third and fourth time periods are not limited. For example, if the preset duration is 5 minutes, the third time period could be 3 minutes long, and the fourth time period could be 2 minutes long; or the third time period could be 1 minute long, and the fourth time period could be 4 minutes long.

[0229] For example, assuming the preset time length is 10 minutes and the time lengths of the above time periods are the same, the marked time information can be 10 minutes before the operation trigger time; or 10 minutes after the operation trigger time; or 10 minutes before the operation trigger time plus 10 minutes after the operation trigger time, for a total of 20 minutes; or 3 minutes before the operation trigger time plus 7 minutes after the operation trigger time, for a total of 10 minutes.

[0230] It should be noted that the duration of each of the above time periods can be equal or different, depending on the actual situation, and no restrictions are imposed here.

[0231] In this embodiment, the recording device obtains the operation trigger time corresponding to the marking operation and determines the marking time information of the target multimedia data accordingly. This enables the device to accurately record the occurrence time of content that the user is interested in, facilitating the rapid location and review of the multimedia data marked by the user. Especially in long-term continuous recording scenarios, this improves the retrieval efficiency of the multimedia data marked by the user.

[0232] like Figure 4 As shown, in one embodiment, a recording tagging method is provided, which can be applied to the recording device described above. The method may include steps 402 to 406.

[0233] Step 402: When the recording device is in the target recording scene, collect multimedia data through the data acquisition module.

[0234] The relevant description of step 402 can be found in the relevant description of step 210 in the above embodiments, and will not be repeated here.

[0235] Step 404: Obtain the multimedia data segment corresponding to the marking operation, identify the multimedia data segment to obtain the recording key information, and use the recording key information as the marking content information.

[0236] The multimedia data segment corresponding to the marking operation refers to a portion of the multimedia data collected by the data acquisition module that is selected (of interest to the user) based on the triggered marking operation.

[0237] For example, in a two-hour video conference, if participants perform two operations (start marking operation and end marking operation) on the time period when a leader is expressing an important point, then the video content within the time period between the start marking operation and the end marking operation is the multimedia data segment corresponding to the marking operation.

[0238] Recording key information refers to information in the multimedia data segment corresponding to the marking operation that can accurately summarize and reflect the core content or important features of the multimedia data segment.

[0239] Optionally, the key information to be recorded includes at least one of keywords, key sentences, and object information corresponding to the target recording object.

[0240] Keywords refer to single words that are representative and key to understanding extracted from multimedia data segments. For example, in a video clip introducing a technology product, keywords could be "smartphone" or "high-definition camera." There is no limit to the number of keywords; that is, a multimedia data segment can have one keyword or multiple keywords.

[0241] A key sentence is a sentence that fully expresses the core meaning of a multimedia data segment. For example, in a video of a player shooting a goal in a sports match, the key sentence could be "Player number ten used a bicycle kick to kick the ball into the opponent's goal."

[0242] The object information corresponding to the target recording object refers to the relevant information of the object of interest in the multimedia data segment. Specifically, the object information corresponding to the target recording object may include, but is not limited to, the target recording object's voice and timbre (voice characteristics and emotional expression), appearance (face, figure, clothing) and other (behavior, scene) in the video data; the target recording object's voice and timbre (voice characteristics, emotional atmosphere) and other (language style, background sound effects) in the audio data; and the target recording object's appearance (overall shape, color matching, detailed features) and other (positional relationship, lighting effects) in the image data.

[0243] For example, in a video clip of a visit to a zoo, the target subject is a lion, and the subject information can include the lion's sounds, appearance, etc.

[0244] In some embodiments, the recording device can convert the speech content in the multimedia data segment corresponding to the marking operation into text using a speech recognition algorithm; and analyze and extract the text using natural language processing technology to obtain key recording information.

[0245] Optionally, the recording device can also use image recognition algorithms to analyze each frame of the multimedia data segment corresponding to the marking operation, identify the target recording object, and retrieve key recording information from a preset database.

[0246] In some embodiments, the marked content information is used by the electronic device to find multimedia data that matches the recorded key information from at least a portion of the multimedia data, based on the recorded key information, and to mark the target multimedia data.

[0247] In some embodiments, the tagging information may include both tagging content information and tagging time information. The recording device may acquire the multimedia data segment corresponding to the tagging operation, identify the multimedia data segment to obtain recording key information, and use the recording key information as tagging content information. The tagging content information is also used by the electronic device to search for multimedia data that matches the recording key information in the multimedia data corresponding to the tagging time information, based on the recording key information, and use it as the target multimedia data for tagging.

[0248] It should be noted that the multimedia data segment corresponding to the tagging operation and the target multimedia data being tagged are not necessarily the same multimedia data. The multimedia data segment corresponding to the tagging operation is a locally targeted multimedia data segment defined by the user through the tagging operation; it is a specific event or detail, with a relatively small and precise scope. The target multimedia data being tagged, on the other hand, is broader and may encompass multiple multimedia data segments.

[0249] For example, in a surveillance video that lasts for several hours, the multimedia data segment corresponding to the tagging operation may only be the footage of an abnormal person appearing within a few minutes; however, the target multimedia data for tagging may be all the video footage of that abnormal person in the surveillance video that lasts for several hours.

[0250] Optionally, the recording device may acquire multimedia data segments corresponding to the marking operation and use these multimedia data segments as marking content information. The marking content information is used by the electronic device to identify the multimedia data segments, obtain key recording information, and, based on this key recording information, search for multimedia data matching the key recording information from at least a portion of the multimedia data, using this as the target multimedia data for marking.

[0251] Step 406: Send at least a portion of the multimedia data and tagged content information collected by the data acquisition module to the electronic device.

[0252] The description of step 406 can be found in the description of step 230 in the above embodiments, and will not be repeated here.

[0253] In some embodiments, after using the recording key information as the marked content information, the recording device sends at least a portion of the multimedia data collected by the data acquisition module, along with the marked content information containing the recording key information, to the electronic device. The electronic device can then, based on the recording key information in the received marked content information, search for multimedia data matching the recording key information from the at least portion of the multimedia data, and use this as the target multimedia data for marking; furthermore, it uses an event recognition model to perform event analysis on the marked target multimedia data to obtain the first recording event information corresponding to the marked content information.

[0254] Specifically, after sending at least a portion of the multimedia data collected by the data acquisition module and the tagged content information containing multimedia data fragments to the electronic device, the electronic device identifies the multimedia data fragments based on the tagged content information to obtain key recording information. Based on the key recording information, it searches for multimedia data matching the key recording information from the at least portion of the multimedia data, using this as the target multimedia data for tagged. Then, through an event recognition model, it performs event analysis on the tagged target multimedia data to obtain the first recording event information corresponding to the tagged content information.

[0255] In this embodiment, the recording device acquires multimedia data segments corresponding to the marking operation and automatically identifies key recording information within them, using this information as marking content information. This achieves intelligent content annotation, allowing users to quickly generate meaningful tags without manual input, thus improving the efficiency and accuracy of multimedia data marking. Simultaneously, the electronic device can directly locate and extract target multimedia data from the multimedia data based on this key recording information.

[0256] like Figure 5 As shown, in one embodiment, a recording tagging method is provided, which can be applied to the recording device described above. The method may include steps 502 to 508.

[0257] Step 502: When the recording device is in the target recording scene, collect multimedia data through the data acquisition module.

[0258] The relevant description of step 502 can be found in the relevant description of step 210 in the above embodiments, and will not be repeated here.

[0259] Step 504: In response to the triggered tagging operation, determine the target tagging pattern.

[0260] In some embodiments, the target tagging pattern may include a first tagging pattern or a second tagging pattern; wherein the first tagging pattern is a time-based tagging pattern; and the second tagging pattern is a content-based tagging pattern. The first tagging pattern corresponds to a first tagging operation, and the second tagging pattern corresponds to a second tagging operation, wherein the first tagging operation and the second tagging operation are different.

[0261] Optionally, when the recording device is in the first marking mode, the marking information corresponding to the marked target multimedia data is marking time information; when the recording device is in the second marking mode, the marking information corresponding to the marked target multimedia data is marking content information.

[0262] Optionally, the first marking pattern may correspond to multiple different first marking operations; the second marking pattern may also correspond to multiple different second marking operations; wherein each first marking operation must be different from each second marking operation.

[0263] For example, the first marking operation may include tapping twice consecutively, tapping at a specific rhythm (e.g., a "fast-slow-fast" rhythm), or tapping at a first force threshold (e.g., 4N (Newton)); the second marking operation may include tapping three times consecutively, tapping at another specific rhythm (e.g., a "slow-fast-slow" rhythm), or tapping at a first force threshold (e.g., 7N (Newton)).

[0264] In some embodiments, the recording device can identify the triggered tagging operation and determine the corresponding tagging mode based on the identification result. Specifically, if the recording device detects a first tagging operation, it determines the target tagging mode as the first tagging mode in response to the first tagging operation; if it detects a second tagging operation, it determines the target tagging mode as the second tagging mode in response to the second tagging operation.

[0265] In some embodiments, the target marking pattern can also be set by an electronic device and synchronized to the recording device. Setting and synchronizing the target marking pattern to the recording device via an electronic device reduces the complexity of the recording device, allowing it to focus more on recording the markings, thereby improving the marking accuracy and ease of use of the recording device.

[0266] Step 506: Determine the tagging information corresponding to the target multimedia data based on the target tagging pattern.

[0267] In some embodiments, the recording device determines, based on the target tagging pattern, that the tagging information corresponding to the target multimedia data being tagged is tagging time information or tagging content information; and determines the tagging time information according to the relevant descriptions of steps 302 to 304 above; or, determines the tagging content information according to the relevant descriptions of step 404 above.

[0268] Specifically, if the target marking mode is the first marking mode, the recording device can determine that the marking information corresponding to the marked target multimedia data is marking time information; if the target marking mode is the second marking mode, the recording device can determine that the marking information corresponding to the marked target multimedia data is marking content information.

[0269] In some embodiments, in addition to determining the target tagging pattern in response to a triggered tagging operation, the recording device may also receive pattern information sent by the terminal device, the pattern information being used to indicate the target tagging pattern; and determine the tagging information corresponding to the target multimedia data to be tagged based on the target tagging pattern.

[0270] Specifically, the terminal device can respond to the user's selection operation on the display page, determine the target marking pattern corresponding to the selection operation, generate pattern information based on the target marking pattern, and send it to the recording device, so that the recording device can determine the marking information corresponding to the target multimedia data based on the target marking pattern in the pattern information.

[0271] Step 508: Send at least a portion of the multimedia data and tagging information collected by the data acquisition module to the electronic device.

[0272] The description of step 508 can be found in the description of step 230 in the above embodiments, and will not be repeated here.

[0273] In this embodiment, the recording device can provide a basis for time segmentation based on the marked time information to quickly locate and obtain the recording data corresponding to the user's marked time; it can provide guidance for content segmentation based on the marked content information to accurately filter the recording data segments related to the user's marked time; the recording device can better match the recording data corresponding to the user's marked time through the above-mentioned time segmentation or content segmentation.

[0274] like Figure 6 As shown, in one embodiment, a recording tagging method is provided, which can be applied to the recording device described above. The method may include steps 602 to 608.

[0275] Step 602: When the recording device is in the target recording scene, collect multimedia data through the data acquisition module.

[0276] Step 604: In response to the triggered tagging operation, determine the tagging information corresponding to the target multimedia data to be tagged.

[0277] The relevant descriptions of steps 602 to 604 can be found in the relevant descriptions of steps 210 to 220 in the above embodiments, and will not be repeated here.

[0278] Step 606: Determine whether the preset sending conditions are met; if the preset sending conditions are met, proceed to step 608; if the preset sending conditions are not met, proceed to step 602.

[0279] In some embodiments, preset transmission conditions include at least one of the following:

[0280] The recording device has less than the battery threshold remaining.

[0281] The recording device is now charging.

[0282] The duration since the last transmission has reached the cycle duration. The last transmission time is the time when the recording device last sent data and tag information to the electronic device.

[0283] Send operation detected.

[0284] Optionally, if the recording device detects that none of the above preset transmission conditions are met, it stores the multimedia data and tag information, continues to collect multimedia data through the data acquisition module, and continues to respond to the triggered new tagging operation to determine the tag information corresponding to the target multimedia data of the new tag; so that when the preset transmission conditions are met again, all the unsent multimedia data and one or more tag information are sent to the electronic device together.

[0285] Step 608: Send at least a portion of the multimedia data and tagging information collected by the data acquisition module to the electronic device.

[0286] In some embodiments, if the preset sending conditions include multiple sending conditions mentioned above, the recording device can send at least a portion of the multimedia data and tagging information collected by the data acquisition module to the electronic device as long as any one of the set sending conditions is met.

[0287] Specifically, when the recording device detects that the remaining battery power is less than a preset battery threshold, it sends at least some multimedia data and tagging information to the electronic device. This prevents data loss due to the recording device running out of power. Simultaneously, timely sending of at least some multimedia data and tagging information reduces the operating burden on the recording device when the battery is low, extending its continuous recording time. For example, the battery threshold could be 5%.

[0288] Specifically, after detecting a charging signal, the recording device enters a charging state and sends at least a portion of the multimedia data and tagging information accumulated in the recording device to the electronic device; this enables the recording device to send data in a timely manner and reduces the energy consumption of the recording device when sending data in a non-charging state.

[0289] Specifically, the recording device starts counting from the moment it last sent at least some multimedia data and tagging information to the electronic device. When the elapsed time reaches a preset period, the recording device periodically sends at least some multimedia data and tagging information to the electronic device. This avoids excessive data accumulation due to prolonged periods without transmission from the recording device, and also facilitates the electronic device's timely acquisition of the latest multimedia data and tagging information. For example, assuming the period is set to one day, and the recording device last sent data at 10:00 AM on Monday, then at 10:00 AM on Tuesday, the recording device will again send at least some multimedia data and tagging information to the electronic device.

[0290] Specifically, the recording device can send at least a portion of multimedia data and tagging information to an electronic device in response to a triggered send operation. Users can trigger preset send operations to prompt the recording device to send stored multimedia data and tagging information to the electronic device, thereby meeting the user's proactive needs and improving the flexibility and controllability of data transmission. For example, a user can request the recording device to send data and tagging information by "tapping it four times consecutively."

[0291] The description of step 608 can be found in the description of step 230 in the above embodiments, and will not be repeated here.

[0292] In this embodiment, the recording device triggers the transmission of multimedia data and tagging information by setting preset transmission conditions, thereby achieving flexible control of data transmission and avoiding unnecessary frequent transmissions that could cause power consumption loss and affect the recording duration. At the same time, when the conditions are met, the recording device can deliver multimedia data and tagging information to the electronic device in a timely and reliable manner, thus avoiding the problem of sending a complete long-term recording data to the electronic device at once, which could lead to the recording device and the electronic device being out of sync or the recording device taking too long to analyze the long-term recording data.

[0293] like Figure 7A As shown, in another embodiment, a method for displaying recorded events is provided, which can be applied to the aforementioned terminal device. This method may include the following step 702.

[0294] Step 702: Display the first recorded event information.

[0295] The first recording event information is obtained by the electronic device through an event recognition model based on the target multimedia data and tag information in at least a portion of the multimedia data; the at least a portion of the multimedia data is collected by the recording device through its data acquisition module and sent to the electronic device when it is in the target recording scenario; the target recording scenario includes scenarios where the recording device continuously records multimedia for a duration greater than a duration threshold; the tag information is determined by the recording device in response to a triggered tagging operation, and the tag information is used to indicate the target multimedia data being tagged; the electronic device includes a terminal device and / or a server.

[0296] At least a portion of the multimedia data is collected by the recording device through the data acquisition module when it is in the target recording scenario; the target recording scenario refers to a scenario in which the recording device continuously records multimedia for a duration greater than a duration threshold; the tagging information is determined by the recording device in response to a triggered tagging operation, and the tagging information is used to indicate the target multimedia data being tagged.

[0297] In some embodiments, a user may carry a recording device that is communicatively connected to an electronic device and determine that the recording device will perform long-term multimedia recording; during the process of acquiring multimedia data through a data acquisition module, the recording device, in response to a marking operation triggered by the user, determines the marking information corresponding to the target multimedia data and sends at least a portion of the multimedia data and the marking information to the electronic device; the electronic device receives at least a portion of the multimedia data and the marking information for further analysis.

[0298] Specifically, the relevant description of the recording device acquiring at least some multimedia data and tagging information can be found in the relevant description of steps 210 to 230 in the above embodiments, and will not be repeated here.

[0299] Event recognition models can automatically identify and process events in multimedia data based on artificial intelligence algorithms.

[0300] Specifically, the tagging information can be used to assist the event recognition model in quickly locating the target multimedia data in at least a portion of the multimedia data; the tagging information can also provide the event recognition model with semantic clues about the target multimedia data.

[0301] For example, in a football match, a user uses a recording device to continuously collect multimedia data such as video and audio. Through a tagging operation, the recording device marks multiple key time points, such as the opening whistle, the moment of a goal, and the moment of a foul, as marker information. Simultaneously, video data containing exciting attacking moments is used as target multimedia data. The recording device sends the recorded multimedia data and the tagging information to an electronic device. The electronic device uses an event recognition model to analyze the target video data marked as the moment of a goal. The event recognition model identifies the target player's movements and the position of the football through image recognition, combined with features such as the cheers of the audience in the audio, to obtain first recorded event information containing the player's performance in the football match. The first recorded event information may specifically include the player's goal time (accurate to the second), the goal method (e.g., header, bicycle kick), and an overview of the attacking route before and after the goal.

[0302] In some embodiments, the electronic device is a server, and the server is communicatively connected to the recording device. The server, through an event recognition model, obtains first recording event information based on the multimedia data and tagging information sent by the recording device, and sends it to the terminal device. The terminal device can receive the first recording event information sent by the server and display it.

[0303] In some embodiments, the electronic device is a terminal device, and the terminal device is communicatively connected to the recording device. The terminal device obtains first recording event information based on the multimedia data and tag information sent by the recording device through an event recognition model, and displays the first recording event information.

[0304] In some embodiments, the server and the recording device are communicatively connected; the recording device sends multimedia data and tagging information to the server; the server forwards the multimedia data and tagging information to the terminal device. The terminal device obtains first recording event information based on the multimedia data and tagging information sent by the server using an event recognition model, and displays the first recording event information.

[0305] Optionally, the terminal device may display the first recording event information on the homepage of the application corresponding to the recording device. That is, after the user opens the application, he / she can observe the first recording event information corresponding to the marker information.

[0306] In some embodiments, the terminal device may display a first identifier in the display area corresponding to the first recorded event information. The first identifier is used to indicate that the first recorded event information is the recorded event information corresponding to a marking operation. The first identifier may include, but is not limited to, graphic types (such as stars, flags, circular icons, etc.), color types (such as highlight colors, special contrast colors, etc.), text types (such as specific keywords, custom text, etc.), and animation types (such as flashing effects, dynamic icons, etc.).

[0307] Optionally, the shape and / or color of the first identifier can be distinctive and vibrant, making it easier for the terminal device to intuitively indicate that the display area is the display area for the first recorded event information corresponding to the marker information.

[0308] For example, such as Figure 7B As shown, within the display page 710 of the terminal device, area 712 can be used to display the recording time of the target multimedia data corresponding to the first recording event information; the first recording event information is "Event A", and there is a "pentagram" in the display area 714 corresponding to "Event A" to indicate that "Event A" is the recording event information corresponding to the user's marking operation, that is, "Event A" is the event content that the user is interested in.

[0309] In some embodiments, the terminal device may, in response to an information viewing operation for the first recorded event information, display a recording event page corresponding to the first recorded event information. The recording event page corresponding to the first recorded event information is used to display the event content corresponding to the first recorded event information, and / or to display the event content of the recorded event associated with the first recorded event information.

[0310] Optionally, the information viewing operation for the first recorded event information may include, but is not limited to, performing a touch operation on the display area corresponding to the first recorded event information, such as a single click, double click, or long press; performing a specific gesture swipe operation on the display area corresponding to the first recorded event information, such as swiping left and right or up and down to bring up the viewing function; or triggering the viewing through voice commands, whereby the user speaks specific voice keywords to instruct the viewing of the first recorded event information.

[0311] Optionally, the recording event page corresponding to the first recorded event information can be displayed in full-screen mode. For example, in response to an information viewing operation on the first recorded event information, the terminal device controls the display page to jump to the recording event page corresponding to the first recorded event information. The recording event page can also be displayed in pop-up window mode, allowing users to quickly view event details without completely obscuring the current display interface, while also allowing them to return to the original interface at any time to perform other operations. The recording event page can also be displayed in split-screen mode, dividing the terminal device screen into multiple areas, with one area used to display the recording event page, and the remaining areas retaining the content of the original display interface, making it easy for users to compare and view relevant information.

[0312] Optionally, the event content corresponding to the recorded event information may include a summary of the recorded event information, such as a concise summary of the core points, background, main impacts, and other key information of the event. The event content may also include a detailed description of the recorded event information, covering the specific time and place of the event, the people involved, and the detailed steps of the event.

[0313] For example, such as Figure 7C As shown, when a user wants to view the event content corresponding to "Event A" and / or the event content of the recorded event associated with the first recorded event information, they can touch the display area 714 corresponding to "Event A," causing the terminal device to jump from the display page 710 to the recording event page 720 of "Event A." On the recording event page 720, the event content corresponding to "Event A" can be displayed in the display area 722, and the event content corresponding to the recorded event "Event B" associated with "Event A" can be displayed in the display area 724.

[0314] In some embodiments, the terminal device may respond to a recording and playback operation for the first recording event information by playing multimedia data corresponding to the first recording event information.

[0315] For example, such as Figure 7D As shown, the display area 714 corresponding to "Event A" can display a play control 732, a pause control 734, and a volume adjustment control 736. The user can touch the play control 732 to make the terminal device start playing the multimedia data corresponding to "Event A"; touch the pause control 734 to make the terminal device pause playing the multimedia data corresponding to "Event A"; and touch the volume adjustment control 736 to make the terminal device adjust the volume of the multimedia data being played.

[0316] It should be noted that the types and number of controls related to recording and playback operations in the display area corresponding to the first recording event information are not limited here.

[0317] For example, such as Figure 7E As shown, when a user needs to listen to or watch the multimedia data corresponding to the first recorded event information "Event A", they can also touch the display area 714 corresponding to "Event A", so that the terminal device jumps from the display page 710 to the playback page 740, and plays the multimedia data corresponding to "Event A" through the playback page 740.

[0318] Optionally, the playback page 740 can also be displayed as a pop-up window or in a split-screen format; there are no restrictions on this.

[0319] In this embodiment, the electronic device receives multimedia data and tagging information sent by the recording device, and performs targeted analysis on the target multimedia data and tagging information through an event recognition model. This accurately obtains the first recording event information corresponding to the tagging information, avoiding the situation where the output of the artificial intelligence model does not match the user's expected content due to the randomness and uncertainty of the artificial intelligence model when analyzing a large amount of multimedia data. The first recording event information can be output according to the tagging information corresponding to the tagging operation triggered by the user, so that the first recording event information displayed by the terminal device can accurately meet the user's needs, thus improving the accuracy and reliability of analyzing the multimedia data recorded by the recording device.

[0320] like Figure 8A As shown, in another embodiment, a method for displaying recorded events is provided, which can be applied to the aforementioned terminal device. This method may include the following steps 802 to 806.

[0321] Step 802: In response to the recorded search operation, obtain the input search content.

[0322] Optionally, the recorded search operation may include, but is not limited to, touching a special search control, confirming the entered search content, or initiating a search via voice command.

[0323] For example, users can trigger a recorded search operation by clicking, double-clicking, or long-pressing the search button or search icon set in a specific area, or by clicking the confirmation button such as "Confirm" or "Search", or by pressing the Enter key on the keyboard, or by speaking specific voice keywords.

[0324] Search terms may include, but are not limited to, keywords related to the recorded event (e.g., the theme of the event, names of people involved, key locations where it occurred), the time range of the recorded event (e.g., specific start and end dates, or relative time descriptions), the type of recorded event, and related information about the recorded event.

[0325] Step 804: Search at least a portion of the multimedia data based on the search content to obtain multimedia data that matches the search content.

[0326] In some embodiments, the terminal device may acquire multimedia content corresponding to at least some of the multimedia data; then calculate the similarity between each multimedia content and the search content, and use the multimedia data corresponding to the target multimedia content with a similarity greater than the pixel threshold as the multimedia data that matches the search content.

[0327] Step 806: Analyze the matched multimedia data using the event recognition model to obtain the third recording event information, and display the third recording event information.

[0328] In step 806, the relevant description of the third recorded event information is obtained through the event recognition model. This can be referred to in step 704 of the above embodiment, where the relevant description of the first recorded event information is obtained through the event recognition model. It will not be repeated here.

[0329] For example, such as Figure 8B As shown, the display page 810 of the terminal device includes an input box 812 and a search control 814. The user can input search content through the input box 812 and touch the search control 814 to make the terminal device respond to the recording search operation and obtain the search content in the input box 812. The user searches for at least some multimedia data according to the search content to obtain multimedia data that matches the search content. The user analyzes the matched multimedia data through an event recognition model to obtain multiple third recording event information ("Event C", "Event D" and "Event E"). The input box 812 and the search control 814 in the display page 810 of the terminal device are hidden, and three display areas 816 appear to display "Event C", "Event D" and "Event E" respectively.

[0330] In this embodiment, the terminal device can respond to the recording search operation by reorganizing at least a portion of the multimedia data and the third recording event information related to the search content. It can also use an event recognition model to perform in-depth analysis on these matching data, extract the third recording event information, and display it. Through intelligent analysis (event recognition model), it can help users quickly find the information points they need (search content) from a large amount of multimedia data, improve the efficiency and accuracy of information retrieval, and meet the user's need for rapid retrieval of specific content.

[0331] like Figure 9A As shown, in another embodiment, a method for displaying recorded events is provided, which can be applied to the aforementioned terminal device. This method may include the following step 902.

[0332] Step 902: Display one or more second recorded event information.

[0333] Optionally, the relevant description of the second recorded event information can be obtained through the event recognition model. The relevant description of the first recorded event information obtained through the event recognition model in the above embodiment can be referred to, and will not be repeated here.

[0334] In some embodiments, since the first recording event information is the recording event information corresponding to the target multimedia data that the user is interested in, and the second recording time information is the recording event information summarized by the electronic device, the display area corresponding to the first recording event information can be located above the display areas corresponding to one or more of the second recording event information respectively, so as to highlight the first recording event information and enable the user to pay attention to the first recording event information they want at the first moment.

[0335] For example, such as Figure 9B As shown, within the display page 910 of the terminal device, area 912 can be used to display the recording time of at least a portion of the multimedia data received by the terminal device; the first recording event information is "Event A", and the second recording event information includes "Event B" and "Event C". In the display area 914 corresponding to "Event A", there is a "pentagram" mark to indicate that "Event A" is the recording event information corresponding to the user marking operation; the display area 916 of "Event B" and the display area 918 of "Event C" are both located below the display area 914 of the first recording event information "Event A".

[0336] Optionally, the display order of one or more second recording event information located below the display area corresponding to the first recording event information is not limited here.

[0337] In some embodiments, the terminal device may obtain the start recording time corresponding to the first recording event information and the start recording time corresponding to one or more second recording event information respectively; and display the first recording event information and one or more second recording event information in chronological order of the start recording time.

[0338] Specifically, such as Figure 9C As shown, on the display page 910 of the terminal device, area 912 can be used to display the recording time of at least a portion of the multimedia data received by the terminal device; wherein, the start recording time corresponding to "Event B" is earlier than the start recording time corresponding to "Event A", and the start recording time corresponding to "Event A" is earlier than the start recording time corresponding to "Event C"; therefore, on the display page 910 of the terminal device, the display area 916 of "Event B" is located above the display area 914 of "Event A", and the display area 918 of "Event C" is located below the display area 914 of "Event A".

[0339] In this embodiment of the application, in addition to displaying the first recording event information corresponding to the marker information, multiple second recording event information obtained by comprehensively analyzing at least a portion of the received multimedia data through an event recognition model will also be displayed, so that the user can obtain the content events contained in at least a portion of the multimedia data recorded by the recording device while obtaining the marker information, thereby displaying more comprehensive information to the user.

[0340] like Figure 10A As shown, in another embodiment, a method for displaying recorded events is provided, which can be applied to the aforementioned terminal device. This method may include the following steps 1002 to 1004.

[0341] Step 1002: Display the first recorded event information according to the first display style.

[0342] Step 1004: Display one or more second recorded event information according to the second display style, where the first display style is different from the second display style.

[0343] Display styles may include, but are not limited to, image styles, font styles, layout styles, and dynamic effect styles.

[0344] Image styles can include different icon shapes, icon styles, icon sizes, image themes, image clarity, image display methods (such as tiling, scaling, cropping, etc.), image borders, and image display effects (such as shadows, rounded corners, etc.).

[0345] Font styles can include font color, font type (e.g., KaiTi, SongTi), font size, and font style (e.g., bold, italic, underline, etc.).

[0346] Layout styles can include arrangement methods (such as horizontal arrangement, vertical arrangement, grid arrangement, etc.), spacing settings, and partition design.

[0347] Dynamic effects styles can include animation effects (such as fade-in, fade-out, scaling, movement, etc.), transition effects (such as mouse hover, click, etc.), interactive feedback effects (such as changing the element's color, size, or displaying additional information when the mouse hovers over it, or changing the element's state after clicking, etc.).

[0348] Optionally, the second display style corresponding to different second recorded event information may be different, but all second display styles are different from the first display style.

[0349] In some embodiments, the recorded event information includes an event theme, the first display style includes a first font style corresponding to the first event theme of the first recorded event information, and the second display style includes a second font style corresponding to the second event theme of the second recorded event information; the first font style is different from the second font style.

[0350] The event theme refers to the core content, core purpose, or main characteristics contained in the recorded event information.

[0351] For example, such as Figure 10BAs shown, on the display page 1010 of the terminal device, area 1012 can be used to display the recording time of at least a portion of the multimedia data received by the terminal device; wherein, in the display area 1014 corresponding to the first recording event information "Event A", the first font style corresponding to the first event theme "Math Class" of "Event A" is Lishu; in the display areas 1016 corresponding to the second recording event information "Event B" and 1018 corresponding to "Event C", the second font styles corresponding to the second event themes "Physical Education Class" and "Music Class" are both Songti.

[0352] Optionally, the first display style includes a first event image, and the second display style includes a second event image.

[0353] In the display area corresponding to the first recorded event information, the first event image corresponding to the first recorded event information is displayed; in the display area corresponding to each second recorded event information, the second event image corresponding to each second recorded event information is displayed.

[0354] Optionally, the second event images corresponding to different second recorded event information can be the same or different. The second event image corresponding to each second recorded event information can be associated with the event content of each second recorded event information.

[0355] For example, such as Figure 10C As shown, on the display page 1010 of the terminal device, area 1012 can be used to display the recording time of at least a portion of the multimedia data received by the terminal device; assuming that "Event A" includes the user's shopping process, "Event B" includes the user's computer use process, and "Event C" includes the user's singing process, then the first event image can be displayed in the display area 1014 corresponding to "Event A" to represent shopping; the second event image can be displayed in the display area 1016 corresponding to "Event B" to represent computer use; and the second event image can be displayed in the display area 1018 corresponding to "Event C" to represent singing.

[0356] Optionally, the above-mentioned multiple display styles can appear simultaneously, that is, the first display style can simultaneously include a font type of Lishu and a first event image; the second display style can simultaneously include a font type of Songti and a second event image.

[0357] In this embodiment, the terminal device displays the first recorded event information corresponding to the marked information in a way that distinguishes it from other second recorded event information. This visual distinction enhances the importance of the recorded event information actively marked by the user and highlights the first recorded event information.

[0358] like Figure 11AAs shown, in another embodiment, a method for displaying recorded events is provided, which can be applied to the aforementioned terminal device. This method may include the following steps 1102 to 1104.

[0359] Step 1102: Analyze the first recorded event information and one or more second recorded event information, and determine one or more target second recorded event information that are associated with the first recorded event information from the one or more second recorded event information.

[0360] In some embodiments, the recorded event information may include a text description. The terminal device may map the text description in the first recorded event information and one or more second recorded event information into a numerical vector to obtain a first vector corresponding to the first recorded event information and a second vector corresponding to each of the second recorded event information; calculate the similarity between the first vector and each of the second vectors, and take the second recorded event information corresponding to the second vector with a similarity greater than the association similarity threshold as one or more target second recorded event information associated with the first recorded event information.

[0361] Optionally, the terminal device may employ methods for mapping text to numerical vectors, including but not limited to the bag-of-words model, TF-IDF (Term Frequency-Inverse Document Frequency) algorithm, or word embedding models (such as Word2Vec, BERT, etc.).

[0362] Optionally, the similarity calculation methods that the terminal device can use include cosine similarity, Euclidean distance, etc. Step 1104: Display the second identifier in the display area corresponding to the second recorded event information of each target.

[0363] The second identifier is used to indicate that the corresponding target second recorded event information is associated with the first recorded event information. It should be noted that the second identifier needs to be different from the first identifier mentioned above, so as to avoid users being unable to distinguish between the first recorded event information and the target second event information.

[0364] For example, such as Figure 11B As shown, on the display page 1110 of the terminal device, area 1112 can be used to display the recording time of at least a portion of the multimedia data received by the terminal device; if “Event A” is the first recording event information, then the display area 1114 corresponding to “Event A” has a first identifier “pentagram”; assuming that “Event C” is the target second recording event information associated with “Event A”, then the display area 1118 corresponding to “Event C” displays a second identifier (text identifier “related to Event A”), which can intuitively determine the associated event of “Event A”; while in the display area 1116 corresponding to “Event B”, the second identifier is not displayed.

[0365] In some embodiments, the display styles of one or more target second recorded event information are different; the display style of the target second recorded event information is determined according to the degree of correlation between the target second recorded event information and the first recorded event information.

[0366] For example, such as Figure 11C As shown, on the display page 1110 of the terminal device, area 1112 can be used to display the recording time of at least a portion of the multimedia data received by the terminal device; assuming that “Event C” is the target second recording event information associated with “Event A”, while “Event B” is not the target second recording event information, then when the font size used in the display area 1114 of “Event A” is “12pt (Point)”, the font size used in the display area 1116 of “Event B” is “8pt”, and the font size used in the display area 1118 of “Event C” is “10pt”. That is, the font size of “Event C” is closer to the font size of “Event A” than that of “Event B”.

[0367] In this embodiment of the application, the terminal device filters out the target second recorded event information associated with the marking information from the second recorded event information, and adds a second identifier to its display area. This enables the visual display of the relationship between the various recorded event information to be displayed intuitively, thereby improving the visibility of the terminal device's display page.

[0368] like Figure 12A As shown, in another embodiment, a method for displaying recorded events is provided, which can be applied to the aforementioned terminal device. This method may include the following steps 1102 to 1104.

[0369] Step 1202: Obtain historical marker recording event information.

[0370] Historical marker recording event information refers to the first recording event information corresponding to the marker information sent by the recording device to the electronic device within a historical time period.

[0371] In some embodiments, if, during a historical time period, the recording device determines the first recording event information corresponding to the tag information when sending tag information to the electronic device, and stores it locally, then the terminal device can obtain the historical tag recording event information from the local database or memory.

[0372] Optionally, there is no limit to the number of historical tagged recorded event information acquired by the terminal device. The terminal device can associate the current recorded event information with multiple historical tagged recorded event information, thereby linking the content that the user is interested in over a period of time, which helps the user organize the recorded events.

[0373] Step 1204: Analyze the first recorded event information and one or more second recorded event information, and their correlation with the historical marked recorded event information, to determine one or more fourth recorded event information associated with the historical marked recorded event information.

[0374] In step 1204, the relevant description of one or more fourth recording event information associated with the historical marker recording event information is determined from the first recording event information and one or more second recording event information. This can be referred to in step 1102 of the above embodiment, where the relevant description of one or more target second recording event information associated with the first recording event information is determined from one or more second recording event information. It will not be repeated here.

[0375] Step 1206: Display the third identifier in the display area corresponding to each fourth recorded event information.

[0376] The third identifier is used to indicate that the corresponding fourth recorded event information is associated with the historically marked recorded event information. It should be noted that the third identifier also needs to be distinguished from the first and second identifiers mentioned above.

[0377] For example, such as Figure 12B As shown, on the display page 1210 of the terminal device, area 1212 can be used to display the recording time of at least a portion of the multimedia data received by the terminal device. Assuming the current recording time is "XXXX / XX / 05", according to the analysis, it can be determined that "Event A" is associated with "Event P" of XXXX / XX / 04; "Event B" is associated with "Event Q" of XXXX / XX / 02; "Event C" is associated with "Event R" of XXXX / XX / 03; and "Event C" is associated with "Event A". Then, on the display page 1210 of the terminal device, there is a third identifier in the form of a text identifier in the display area 1214 of "Event A", the display area 1216 of "Event B" and the display area 1218 of "Event C". At the same time, the display area 1214 of "Event A" also includes a first identifier "pentagon", indicating that "Event A" is the current first recording event information; the display area 1218 of "Event C" also includes a second identifier "locator", used to indicate that "Event C" is associated with the current first recording event information "Event A".

[0378] In this embodiment of the application, the terminal device analyzes the potential relationship between the first recorded event information, the second recorded event information and the historical marked recorded event information, and adds a third identifier to the display area of ​​the associated fourth recorded event information. This enables the current recorded event information to be associated with the user's historical marked information, thereby showing the continuity of the event sequence, which is beneficial for subsequent processing of recorded event information.

[0379] like Figure 13 As shown, in one embodiment, a recording tagging device 1300 is provided, which can be applied to the recording device described above. The recording tagging device 1300 may include a recording module 1310, a tagging module 1320, and a sending module 1330.

[0380] The recording module 1310 is used to collect multimedia data through the data acquisition module when the recording device is in a target recording scenario. The target recording scenario includes a scenario where the recording device continuously records multimedia for a duration greater than a duration threshold.

[0381] The tagging module 1320 is used to determine the tagging information corresponding to the target multimedia data in response to the triggered tagging operation.

[0382] The sending module 1330 is used to send at least a portion of the multimedia data and tagging information collected by the acquisition module to the electronic device, so that the electronic device can analyze the target multimedia data and tagging information in the at least a portion of the multimedia data through an event recognition model to obtain first recording event information corresponding to the tagging information; the electronic device includes a terminal device and / or a server, and the first recording event information is used to display on the terminal device.

[0383] Optionally, the tagging information includes tagging time information; and / or, the tagging information includes tagging content information.

[0384] In some embodiments, the marking module 1320 is further configured to obtain the operation trigger time corresponding to the marking operation; and determine the marking time information corresponding to the target multimedia data to be marked based on the operation time.

[0385] Optionally, the time information is marked as any of the following:

[0386] The time information is used to indicate the first time period prior to the operation trigger moment;

[0387] The time information is used to indicate a second time period following the moment the operation was triggered.

[0388] The time information is used to indicate the third time period before the operation trigger time and the fourth time period after the operation trigger time.

[0389] Optionally, the marking operation includes a start marking operation and an end marking operation; the marking time information is used to indicate the time period between the first operation trigger time corresponding to the start marking operation and the second operation trigger time corresponding to the end marking operation.

[0390] In some embodiments, the marking module 1320 is further configured to acquire multimedia data segments corresponding to the marking operation, identify the multimedia data segments to obtain recording key information, and use the recording key information as marking content information. The marking content information is used by the electronic device to search for multimedia data that matches the recording key information from at least a portion of the multimedia data, based on the recording key information, as the target multimedia data for marking.

[0391] In some embodiments, the marking module 1320 is further configured to acquire multimedia data segments corresponding to the marking operation, use the multimedia data segments as marking content information, and use the marking content information for the electronic device to identify the multimedia data segments, obtain recording key information, and search for multimedia data matching the recording key information from at least a portion of the multimedia data based on the recording key information, as the target multimedia data for marking.

[0392] Optionally, the recorded key information includes at least one of keywords, key sentences, and object information corresponding to the target recording object.

[0393] Optionally, the marked content information is used by the electronic device to search for multimedia data that matches the recorded key information in the multimedia data corresponding to the marked time information, based on the recorded key information, and to use it as the target multimedia data for marking.

[0394] In some embodiments, the tagging module 1320 is further configured to determine a target tagging mode in response to a triggered tagging operation; the target tagging mode includes a first tagging mode or a second tagging mode; the first tagging mode is a time-based tagging mode; the second tagging mode is a content-based tagging mode; and according to the target tagging mode, determine the tagging information corresponding to the target multimedia data to be tagged.

[0395] Optionally, the first marking pattern corresponds to the first marking operation, and the second marking pattern corresponds to the second marking operation, wherein the first marking operation and the second marking operation are different.

[0396] In some embodiments, the tagging module 1320 is further configured to, if a first tagging operation is detected, determine the target tagging mode as a first tagging mode in response to the first tagging operation; and if a second tagging operation is detected, determine the target tagging mode as a second tagging mode in response to the second tagging operation.

[0397] Optionally, the marking operation can be performed by at least one of the following methods: tapping on the recording device, touching, pressing a control, inputting a target voice command, or performing a target action.

[0398] Optionally, the tapping operation includes at least one of the following: a preset number of taps, a preset tapping frequency, and a preset tapping force.

[0399] In some embodiments, the tagging module 1320 is further configured to receive mode information sent by the terminal device, the mode information being used to indicate a target tagging mode; and to determine the tagging information corresponding to the target multimedia data to be tagged based on the target tagging mode.

[0400] In some embodiments, the sending module 1330 is further configured to send at least a portion of the multimedia data collected by the data acquisition module and the tagging information to the electronic device after acquiring the tagging information.

[0401] In some embodiments, the sending module 1330 is further configured to send at least a portion of the multimedia data collected by the data acquisition module and the tagging information to the electronic device if a preset sending condition is met.

[0402] Optionally, preset sending conditions include at least one of the following:

[0403] The recording device has less than the battery threshold remaining.

[0404] The recording device is now charging.

[0405] The duration since the last transmission has reached the cycle duration. The last transmission time is the time when the recording device last sent data and tag information to the electronic device.

[0406] Send operation detected.

[0407] Optionally, at least a portion of the multimedia data is also used by the electronic device to analyze the at least portion of the multimedia data to obtain one or more second recording event information.

[0408] Optionally, multimedia data includes one or more of audio data, video data, and image data.

[0409] In this embodiment, the recording device supports recording in the target recording scenario, i.e., it supports long-term continuous recording of multimedia data. During this long-term continuous recording, the user can trigger a marking operation according to their needs. The recording device can then mark the target multimedia data based on the triggered marking operation. The electronic device can use an event recognition model to perform targeted analysis based on the multimedia data collected by the recording device and the marking information corresponding to the marking operation, thereby accurately obtaining the first recording event information corresponding to the marking information. This avoids the situation where the randomness and uncertainty of the artificial intelligence model when analyzing large amounts of multimedia data lead to a mismatch between the output of the artificial intelligence model and the user's expected content. The event recognition model in this embodiment can output the first recording event information expected by the user based on the marking information corresponding to the marking operation triggered by the user, accurately meeting the user's needs and improving the accuracy and reliability of analyzing the multimedia data recorded by the recording device. Furthermore, the recording device supports portable multimedia data recording, improving its ease of use.

[0410] like Figure 14 As shown, in one embodiment, a recording event display device 1400 is provided, which can be applied to the terminal device described above. The recording event display device 1400 may include a receiving module 1410, an identification module 1420, and a display module 1430.

[0411] The receiving module 1410 is used to receive at least a portion of multimedia data and tagging information sent by the recording device; the at least a portion of the multimedia data is collected by the recording device through the data acquisition module when it is in a target recording scene; the target recording scene includes a scene in which the recording device continuously records multimedia for a duration greater than a duration threshold; the tagging information is determined by the recording device in response to a triggered tagging operation, and the tagging information is used to indicate the target multimedia data being tagged.

[0412] The identification module 1420 is used to analyze the target multimedia data and tag information in at least a portion of the multimedia data through an event identification model to obtain the first recorded event information corresponding to the tag information.

[0413] Display module 1430 is used to display the first recorded event information.

[0414] In some embodiments, the display module 1430 is further configured to display a first identifier in the display area corresponding to the first recorded event information, the first identifier being used to indicate that the first recorded event information is the recorded event information corresponding to the marking operation.

[0415] In some embodiments, the recording event display device 1400 further includes a viewing module, a retrieval module, and a playback module.

[0416] The viewing module is used to respond to the information viewing operation for the first recorded event information, and to display the recording event page corresponding to the first recorded event information. The recording event page corresponding to the first recorded event information is used to display the event content corresponding to the first recorded event information, and / or to display the event content of the recorded event associated with the first recorded event information.

[0417] The retrieval module is used to respond to the recording search operation, obtain the input search content, search for at least part of the multimedia data according to the search content, obtain multimedia data that matches the search content, analyze the matched multimedia data through an event recognition model, obtain third recording event information, and display the third recording event information.

[0418] The playback module is used to respond to the recording and playback operation for the first recording event information and play the multimedia data corresponding to the first recording event information.

[0419] In some embodiments, the identification module 1420 is further configured to analyze at least a portion of the multimedia data through an event identification model to obtain one or more second recorded event information;

[0420] In some embodiments, the display module 1430 is further configured to display one or more second recorded event information.

[0421] Optionally, the display area corresponding to the first recorded event information is located above the display areas corresponding to one or more second recorded event information respectively.

[0422] In some embodiments, the display module 1430 is further configured to obtain the start recording time corresponding to the first recording event information and the start recording time corresponding to one or more second recording event information respectively; and to display the first recording event information and one or more second recording event information in sequence according to the time order of the start recording time.

[0423] In some embodiments, the display module 1430 is further configured to display first recorded event information according to a first display style; and to display one or more second recorded event information according to a second display style, wherein the first display style is different from the second display style.

[0424] Optionally, the recorded event information includes an event theme, the first display style includes a first font style corresponding to the first event theme of the first recorded event information, and the second display style includes a second font style corresponding to the second event theme of the second recorded event information; the first font style is different from the second font style.

[0425] Optionally, the first display style includes a first event image, and the second display style includes a second event image.

[0426] In some embodiments, the display module 1430 is further configured to display a first event image corresponding to the first recorded event information in the display area corresponding to the first recorded event information. It is also configured to display a second event image corresponding to each of the second recorded event information in the display areas corresponding to each of the second recorded event information.

[0427] In some embodiments, the display module 1430 is further configured to analyze the first recorded event information and one or more second recorded event information, determine one or more target second recorded event information associated with the first recorded event information from the one or more second recorded event information, and display a second identifier in the display area corresponding to each target second recorded event information, the second identifier being used to indicate that the corresponding target second recorded event information is associated with the first recorded event information.

[0428] Optionally, the display styles of one or more target second recorded event information are different; the display style of the target second recorded event information is determined according to the degree of correlation between the target second recorded event information and the first recorded event information.

[0429] In some embodiments, the display module 1430 is further configured to acquire historical marker recording event information; analyze the first recording event information and one or more second recording event information, respectively, and their association with the historical marker recording event information, to determine one or more fourth recording event information associated with the historical marker recording event information; and display a third identifier in the display area corresponding to each fourth recording event information, the third identifier being used to indicate that the corresponding fourth recording event information is associated with the historical marker recording event information.

[0430] In this embodiment, the electronic device receives multimedia data and tagging information sent by the recording device, and performs targeted analysis on the target multimedia data and tagging information through an event recognition model. This accurately obtains the first recording event information corresponding to the tagging information, avoiding the situation where the output of the artificial intelligence model does not match the user's expected content due to the randomness and uncertainty of the artificial intelligence model when analyzing a large amount of multimedia data. The first recording event information can be output according to the tagging information corresponding to the tagging operation triggered by the user. Assuming that the first recording event information displayed by the terminal device can accurately meet the user's needs, the accuracy and reliability of analyzing the multimedia data recorded by the recording device are improved.

[0431] Figure 15 This is a structural block diagram of a recording device in one embodiment. For example... Figure 15As shown, the recording device 1500 may include one or more of the following components: a processor 1510 and a memory 1520 coupled to the processor 1510, wherein the memory 1520 may store one or more computer programs, which may be configured to implement the recording tagging method as described in the above embodiments when executed by one or more processors 1510.

[0432] The processor 1510 may include one or more processing cores. The processor 1510 connects to various parts of the recording device 1500 through various interfaces and lines, and performs various functions of the recording device 1500 and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 1520, and calling data stored in the memory 1520.

[0433] The memory 1520 may include random access memory (RAM) or read-only memory (ROM). The memory 1520 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 1520 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function, instructions for implementing the various method embodiments described above, etc. The data storage area may also store data created by the recording device 1500 during use.

[0434] Understandably, the recording device 1500 may include more or fewer structural elements than those shown in the block diagram above, such as power supply, input buttons, camera, speaker, screen, RF (Radio Frequency) circuitry, Wi-Fi (Wireless Fidelity) module, Bluetooth module, sensors, etc., and may not be limited herein.

[0435] Figure 16 This is a structural block diagram of a terminal device in one embodiment. For example... Figure 16 As shown, the terminal device 1600 may include one or more of the following components: a processor 1610 and a memory 1620 coupled to the processor 1610, wherein the memory 1620 may store one or more computer programs, which may be configured to implement the recorded event display method as described in the above embodiments when executed by one or more processors 1610.

[0436] Processor 1610 may include one or more processing cores. Processor 1610 connects to various parts of the terminal device 1600 through various interfaces and lines, and performs various functions of the terminal device 1600 and processes data by running or executing instructions, programs, code sets or instruction sets stored in memory 1620, and calling data stored in memory 1620.

[0437] The memory 1620 may include random access memory (RAM) or read-only memory (ROM). The memory 1620 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 1620 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function, instructions for implementing the various method embodiments described above, etc. The data storage area may also store data created by the terminal device 1600 during use.

[0438] Understandably, the terminal device 1600 may include more or fewer structural elements than those shown in the block diagram above, such as power supply, input buttons, camera, speaker, screen, RF (Radio Frequency) circuit, Wi-Fi (Wireless Fidelity) module, Bluetooth module, sensors, etc., and may not be limited herein.

[0439] This application discloses a computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the recording marking method applied to a recording device or the recording event display method applied to a terminal device as described in the above embodiments.

[0440] This application discloses a computer program product, including a computer program, which, when executed by a processor, implements the recording marking method applied to a recording device or the recording event display method applied to a terminal device as described in the above embodiments.

[0441] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), etc.

[0442] Any references to memory, storage, databases, or other media used herein may include non-volatile and / or volatile memory. Suitable non-volatile memory may include ROM, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM), which is used as external cache memory.

[0443] The foregoing has provided a detailed description of a recording mark method and apparatus, a recording event display method and apparatus, and a device disclosed in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are merely for the purpose of helping to understand the methods and core ideas of this application. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A recording and marking method, characterized in that, The method is applied to a recording device, the recording device including a data acquisition module; the method includes: When the recording device is in the target recording scenario, multimedia data is collected by the data acquisition module. The target recording scenario includes scenarios where the recording device continuously records multimedia for a duration greater than a duration threshold. In response to a triggered tagging operation, determine the tagging information corresponding to the target multimedia data being tagged; The data acquisition module collects at least a portion of the multimedia data and the tagging information, which are then sent to an electronic device. The electronic device analyzes the target multimedia data and the tagging information in the at least a portion of the multimedia data using an event recognition model to obtain first recording event information corresponding to the tagging information. The electronic device includes a terminal device and / or a server. The first recording event information is used to display on the terminal device. The first recording event information is information in the target multimedia data related to the recording event pointed to by the tagging information.

2. The method according to claim 1, characterized in that, The marking information includes marking time information; and / or, The tagging information includes tag content information.

3. The method according to claim 2, characterized in that, The tagging information includes tagging time information; the process of determining the tagging information corresponding to the target multimedia data in response to the triggered tagging operation includes: Obtain the operation trigger time corresponding to the marking operation; The marking time information corresponding to the marked target multimedia data is determined based on the operation time.

4. The method according to claim 3, characterized in that, The marker time information is any one of the following: The marked time information is used to indicate a first time period prior to the operation trigger time; The marked time information is used to indicate a second time period after the operation trigger time; The marked time information is used to indicate a third time period before the operation trigger time and a fourth time period after the operation trigger time.

5. The method according to claim 3, characterized in that, The marking operation includes a start marking operation and an end marking operation; The marking time information is used to indicate the time period between the first operation trigger time corresponding to the start marking operation and the second operation trigger time corresponding to the end marking operation.

6. The method according to claim 2, characterized in that, The tagging information includes tagging content information; the process of determining the tagging information corresponding to the target multimedia data in response to the triggered tagging operation includes: The electronic device acquires the multimedia data segment corresponding to the marking operation, identifies the multimedia data segment to obtain recording key information, and uses the recording key information as the marking content information. The marking content information is used by the electronic device to search for multimedia data that matches the recording key information from at least a portion of the multimedia data, and uses it as the target multimedia data for marking.

7. The method according to claim 6, characterized in that, The method further includes: The multimedia data segment corresponding to the marking operation is obtained, and the multimedia data segment is used as the marking content information. The marking content information is used by the electronic device to identify the multimedia data segment, obtain recording key information, and search for multimedia data that matches the recording key information from at least a portion of the multimedia data based on the recording key information, and use it as the target multimedia data for marking.

8. The method according to claim 6, characterized in that, The recorded key information includes at least one of keywords, key sentences, and object information corresponding to the target recording object.

9. The method according to claim 6, characterized in that, The marking information also includes marking time information; The marked content information is used by the electronic device to search for multimedia data that matches the recorded key information in the multimedia data corresponding to the marked time information, based on the recorded key information, and to use it as the target multimedia data for marking.

10. The method according to any one of claims 2 to 9, characterized in that, The method of determining the tagging information corresponding to the target multimedia data in response to the triggered tagging operation includes: In response to a triggered tagging operation, a target tagging pattern is determined; the target tagging pattern includes a first tagging pattern or a second tagging pattern; the first tagging pattern is a time-based tagging pattern; the second tagging pattern is a content-based tagging pattern. Based on the target tagging pattern, determine the tagging information corresponding to the target multimedia data.

11. The method according to claim 10, characterized in that, The first marking pattern corresponds to the first marking operation, and the second marking pattern corresponds to the second marking operation. The first marking operation and the second marking operation are different. The process of determining the target marking pattern in response to a triggered marking operation includes: If the first marking operation is detected, then in response to the first marking operation, the target marking pattern is determined to be the first marking pattern; If the second marking operation is detected, then in response to the second marking operation, the target marking pattern is determined to be the second marking pattern.

12. The method according to any one of claims 2 to 9, characterized in that, The method of determining the tagging information corresponding to the target multimedia data in response to the triggered tagging operation includes: Receive pattern information sent by the terminal device, the pattern information being used to indicate the target marking pattern; Based on the target tagging pattern, determine the tagging information corresponding to the target multimedia data.

13. The method according to any one of claims 1 to 9, characterized in that, The marking operation includes at least one of the following: tapping operation on the recording device, touch operation, control pressing operation, inputting target voice command, and target action operation.

14. The method according to any one of claims 1 to 9, characterized in that, The step of sending at least a portion of the multimedia data collected by the data acquisition module and the tagging information to the electronic device includes: After acquiring the tagging information, the data acquisition module sends at least a portion of the multimedia data and the tagging information to the electronic device.

15. The method according to any one of claims 1 to 9, characterized in that, The step of sending at least a portion of the multimedia data collected by the data acquisition module and the tagging information to the electronic device includes: If the preset sending conditions are met, at least a portion of the multimedia data collected by the data acquisition module and the tagging information are sent to the electronic device.

16. The method according to claim 15, characterized in that, The preset sending conditions include at least one of the following: The remaining battery power of the recording device is less than the battery threshold. The recording device enters a charging state; The duration since the last transmission time has reached the cycle duration, where the last transmission time is the time when the recording device last sent data and tag information to the electronic device; Send operation detected.

17. The method according to claim 1, characterized in that, The at least portion of the multimedia data is also used by the electronic device to analyze the at least portion of the multimedia data to obtain one or more second recording event information.

18. The method according to claim 1, characterized in that, The multimedia data includes one or more of the following: audio data, video data, and image data.

19. A method for displaying recorded events, characterized in that, Applied to terminal devices; the method includes: Display the first recording event information, which is information in the target multimedia data related to the recording event pointed to by the marker information; Wherein, the first recording event information is obtained by the electronic device through an event recognition model based on the target multimedia data and tag information in at least a portion of the multimedia data; the at least a portion of the multimedia data is collected by the recording device through its data acquisition module and sent to the electronic device when it is in a target recording scenario; the target recording scenario includes a scenario where the recording device continuously records multimedia for a duration greater than a duration threshold; the tag information is determined by the recording device in response to a triggered tagging operation, and the tag information is used to indicate the target multimedia data being tagged; the electronic device includes the terminal device and / or the server.

20. The method according to claim 19, characterized in that, The method further includes: In the display area corresponding to the first recorded event information, a first identifier is displayed. The first identifier is used to indicate that the first recorded event information is the recorded event information corresponding to the marking operation.

21. The method according to claim 19, characterized in that, The method further includes: In response to an information viewing operation for the first recorded event information, a recording event page corresponding to the first recorded event information is displayed. The recording event page corresponding to the first recorded event information is used to display the event content corresponding to the first recorded event information, and / or to display the event content of the recorded event associated with the first recorded event information.

22. The method according to claim 19, characterized in that, The method further includes: In response to a recorded search operation, retrieve the entered search content; The multimedia data is searched according to the search content to obtain multimedia data that matches the search content; The event recognition model is used to analyze the matched multimedia data to obtain third recording event information, which is then displayed.

23. The method according to claim 19, characterized in that, The method further includes: In response to the recording and playback operation for the first recorded event information, the multimedia data corresponding to the first recorded event information is played.

24. The method according to any one of claims 19 to 23, characterized in that, The method further includes: The event recognition model is used to analyze at least a portion of the multimedia data to obtain one or more second recorded event information. Display the information of the one or more second recorded events.

25. The method according to claim 24, characterized in that, The display area corresponding to the first recorded event information is located above the display areas corresponding to the one or more second recorded event information respectively.

26. The method according to claim 24, characterized in that, The method further includes: Obtain the start recording time corresponding to the first recording event information, and the start recording time corresponding to the one or more second recording event information respectively; The first recording event information and one or more second recording event information are displayed sequentially according to the time order of the start recording time.

27. The method according to claim 24, characterized in that, The method further includes: The first recorded event information is displayed according to the first display style; The one or more second recorded event information are displayed according to a second display style, wherein the first display style is different from the second display style.

28. The method according to claim 27, characterized in that, The recorded event information includes an event theme, the first display style includes a first font style corresponding to the first event theme of the first recorded event information, and the second display style includes a second font style corresponding to the second event theme of the second recorded event information; the first font style is different from the second font style.

29. The method according to claim 27, characterized in that, The first display style includes a first event image, the second display style includes a second event image, and displaying the first recorded event information according to the first display style includes: In the display area corresponding to the first recorded event information, the first event image corresponding to the first recorded event information is displayed; The step of displaying the one or more second recorded event information according to the second display style includes: In the display area corresponding to each of the second recorded event information, the second event image corresponding to each of the second recorded event information is displayed.

30. The method according to claim 24, characterized in that, The method further includes: Analyze the first recorded event information and the one or more second recorded event information, and determine one or more target second recorded event information that is associated with the first recorded event information from the one or more second recorded event information; A second identifier is displayed in the display area corresponding to each of the target second recorded event information. The second identifier is used to indicate that the corresponding target second recorded event information is associated with the first recorded event information.

31. The method according to claim 30, characterized in that, The display styles of the one or more target second recorded event information are different; the display style of the target second recorded event information is determined according to the degree of correlation between the target second recorded event information and the first recorded event information.

32. The method according to claim 24, characterized in that, The method further includes: Retrieve historical event recording information; Analyze the first recorded event information and the one or more second recorded event information, and their correlation with the historical marked recorded event information, to determine one or more fourth recorded event information associated with the historical marked recorded event information; A third identifier is displayed in the display area corresponding to each of the fourth recorded event information, the third identifier being used to indicate that the corresponding fourth recorded event information is associated with the historical marked recorded event information.

33. A recording and marking device, characterized in that, Applied to a recording device, the recording device including a data acquisition module; The device includes: The recording module is used to collect multimedia data through the data acquisition module when the recording device is in a target recording scenario, wherein the target recording scenario includes a scenario in which the recording device continuously records multimedia for a duration greater than a duration threshold; The tagging module is used to determine the tagging information corresponding to the target multimedia data in response to the triggered tagging operation; A sending module is used to send at least a portion of the multimedia data collected by the acquisition module and the tagging information to an electronic device, so that the electronic device can analyze the target multimedia data and the tagging information in the at least a portion of the multimedia data through an event recognition model to obtain first recording event information corresponding to the tagging information. The electronic device includes a terminal device and / or a server. The first recording event information is used to display on the terminal device. The first recording event information is information in the target multimedia data related to the recording event pointed to by the tagging information.

34. A recording event display device, characterized in that, Applied to terminal devices; the device includes: The display module is used to display first recording event information, which is information related to the recording event pointed to by the marker information in the target multimedia data; Wherein, the first recording event information is obtained by the electronic device through an event recognition model based on the target multimedia data and tag information in at least a portion of the multimedia data; the at least a portion of the multimedia data is collected by the recording device through its data acquisition module and sent to the electronic device when it is in a target recording scenario; the target recording scenario includes a scenario where the recording device continuously records multimedia for a duration greater than a duration threshold; the tag information is determined by the recording device in response to a triggered tagging operation, and the tag information is used to indicate the target multimedia data being tagged; the electronic device includes the terminal device and / or the server.

35. A recording device, characterized in that, The system includes a memory and a processor, wherein the memory stores a computer program that, when executed by the processor, causes the processor to perform the method as described in any one of claims 1 to 18.

36. A terminal device, characterized in that, The system includes a memory and a processor, wherein the memory stores a computer program that, when executed by the processor, causes the processor to perform the method as described in any one of claims 19 to 32.

37. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method as described in any one of claims 1-18 or 19-32.

Images