A diary generation method and device, electronic equipment, and storage medium

Abstract

Embodiments of the present application provide a diary generation method and device, electronic equipment and storage medium. The method comprises: acquiring diary materials collected by an augmented reality (AR) device; in response to a diary generation instruction, arranging the diary materials according to a preset rule to generate diary data; and in response to a diary display instruction, displaying the diary data through the AR device. The diary materials can be collected at any time by using the feature of the AR device. The collected diary materials are arranged according to the preset rule to automatically generate the diary data. In the whole process, the user only needs to trigger the collection of the diary materials, and the subsequent arrangement of the materials does not require human intervention. Therefore, the time spent by the user on arranging the materials is reduced, and the convenience of diary generation is improved.

Description

Technical Field

[0001] This application relates to the field of augmented reality technology, and more specifically, to a method, apparatus, electronic device, and storage medium for generating a diary. Background Technology

[0002] With the rapid development of electronic technology, diary writing has gradually shifted from pen and paper to electronic documents generated and stored on electronic devices. While generating diaries via electronic devices saves significantly more time compared to traditional pen-and-paper writing, users still need to collect and organize materials, as well as refine and polish the written content. This still requires considerable time, resulting in insufficient convenience for diary generation and recording. Summary of the Invention

[0003] The purpose of this application is to provide a diary generation method, apparatus, electronic device, and storage medium to achieve the technical effect of improving the convenience of diary generation.

[0004] A first aspect of this application provides a method for generating a diary, the method comprising:

[0005] Acquire diary material collected through augmented reality (AR) devices;

[0006] In response to the diary generation command, the diary materials are arranged according to preset rules to generate diary data;

[0007] In response to a diary display command, the diary data is displayed via the AR device.

[0008] In the above implementation process, the ability of AR devices to collect materials at any time is utilized to gather diary material. Simultaneously, the collected diary material is arranged according to preset rules, automatically generating diary data. Throughout the process, the user only needs to trigger the collection of diary material; subsequent material arrangement requires no manual intervention, thereby reducing the time spent by the user on material arrangement and improving the convenience of diary generation.

[0009] Furthermore, the method also includes:

[0010] Extract material information to characterize the diary material; the material information includes descriptive information;

[0011] The step of arranging the diary materials according to preset rules to generate diary data includes:

[0012] The diary materials and corresponding material information are arranged according to preset rules to generate diary data including the material information and the diary materials.

[0013] In the above implementation process, descriptive information for describing the diary material is extracted from the diary material. This descriptive information can be automatically generated without the user having to think about and polish the text content in the diary. In this way, both the arrangement of the material and the text content in the diary, which previously required time-consuming manual work by the user, are automatically generated, resulting in a diary that includes both the diary material and the text content, further improving the convenience of diary generation.

[0014] Furthermore, the material information also includes identity information; the step of arranging the diary material and the corresponding material information according to preset rules to generate diary data including the material information and the diary material includes:

[0015] The material information is arranged according to preset rules to generate a diary template;

[0016] Based on the identity information, diary material corresponding to the identity information is inserted into the diary template to generate diary data including the material information and the diary material.

[0017] In the above implementation process, by having AR devices and servers collaboratively extract descriptive information of diary materials, and by having AR devices and servers collaboratively arrange diary materials and material information, the computing power resources of the server are fully utilized, the occupation of transmission resources is reduced, and the efficiency of diary generation is improved.

[0018] Furthermore, displaying the diary data through the AR device includes:

[0019] The AR device displays diary data including the descriptive information.

[0020] In response to the description information being triggered, the diary material corresponding to the description information is displayed.

[0021] In the above implementation process, by displaying diary data in two levels—descriptive information and diary material—users can hide or expand parts of the diary entries, thus improving the flexibility of diary data display.

[0022] Furthermore, the material information also includes one or more of the following: collection time, collection location, and material classification information;

[0023] The step of arranging the diary materials according to preset rules to generate diary data includes one or more of the following:

[0024] The diary materials are arranged according to the collection time to generate time-series diary data;

[0025] The diary materials are categorized by the collection location, and the diary materials belonging to the same location category are arranged according to the collection time to generate location diary data;

[0026] Based on the material classification information, diary materials belonging to the same material category are arranged according to the collection time to generate classified diary data;

[0027] The diary display instruction is used to indicate the type of diary data to be displayed.

[0028] In the above implementation process, by generating different types of diary data according to different preset rules, users can view diaries by time sequence, by location, or by the category described in the material, which greatly improves the flexibility of diaries and meets more user needs.

[0029] Furthermore, the method also includes:

[0030] Retrieve schedule data, including schedule events;

[0031] The step of arranging the diary materials according to the collection time to generate time-series diary data includes:

[0032] The diary materials are associated with the schedule events according to the collection time to generate time-series diary data associated with the schedule data.

[0033] In the above implementation process, by linking time-series diary data with schedule data, users can view the schedule and time-series diary for the day at the same time, which improves the flexibility of diary data display and meets more user needs.

[0034] Furthermore, when displaying the time-series diary data, the method further includes:

[0035] In response to a filter instruction indicating a material category, diary entries belonging to that material category are displayed in the time-series diary.

[0036] In the above implementation process, by adding a category filtering function to the display of time-series diary data, users can view only diary materials of specific categories according to the order of collection time, which improves the flexibility of diary data display.

[0037] A second aspect of this application provides a diary generation apparatus, the apparatus comprising:

[0038] The acquisition module is used to acquire diary materials recorded through AR devices;

[0039] The diary generation module is used to respond to the diary generation command, arrange the diary materials according to preset rules, and generate diary data;

[0040] The diary display module is used to display the diary data through the AR device in response to a diary display command.

[0041] A third aspect of this application provides an electronic device, the electronic device comprising:

[0042] processor;

[0043] Memory used to store processor-executable instructions;

[0044] Wherein, when the processor invokes the executable instructions, it implements the operation of any of the methods described in the first aspect.

[0045] A fourth aspect of this application provides a computer-readable storage medium having computer instructions stored thereon, which, when executed by a processor, implement the steps of any of the methods described in the first aspect. Attached Figure Description

[0046] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of this application and should not be regarded as a limitation of the scope. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0047] Figure 1 A flowchart illustrating a diary generation method provided in an embodiment of this application;

[0048] Figure 2 A flowchart illustrating another diary generation method provided in this application embodiment;

[0049] Figure 3 A flowchart illustrating another diary generation method provided in this application embodiment;

[0050] Figure 4 This is a schematic diagram of the virtual interface of the AR device in the embodiments of this application;

[0051] Figure 5 A flowchart illustrating another diary generation method provided in this application embodiment;

[0052] Figure 6 A structural block diagram of a diary generation device provided in an embodiment of this application;

[0053] Figure 7This is a hardware structure diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0054] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.

[0055] It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures. Furthermore, in the description of this application, terms such as "first," "second," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0056] With the rapid development of electronic technology, diary writing has gradually shifted from pen and paper to electronic documents generated and stored on electronic devices. While generating diaries via electronic devices saves significantly more time compared to traditional pen-and-paper writing, users still need to collect and organize materials, as well as refine and polish the written content. This still requires considerable time, resulting in insufficient convenience for diary generation and recording.

[0057] Therefore, this application provides a method for generating a diary, including as follows: Figure 1 The steps shown are as follows:

[0058] Step 110: Acquire diary material collected through augmented reality (AR) devices;

[0059] Step 120: In response to the diary generation instruction, the diary materials are arranged according to preset rules to generate diary data;

[0060] Step 130: In response to the diary display instruction, display the diary data through the AR device.

[0061] Regarding the application scenarios of this application, it includes any scenario where there is a need to generate diaries using AR devices.

[0062] For example, in a factory inspection scenario, AR devices can be used to collect inspection materials, including taking photos or videos of the inspection, recording the inspection with voice, and then using the diary generation method provided in this application to generate an inspection diary.

[0063] For example, when attending an exhibition, AR devices can be used to record venue materials in real time, including taking pictures or recording the overall layout of the booth, specific exhibits, and voice recording evaluations of the exhibits. Then, the diary generation method provided in this application can be used to generate an exhibition diary.

[0064] For example, in a field survey scenario, AR devices can be used to record on-site materials, and then the survey diary can be generated using the diary generation method provided in this application.

[0065] For example, in hygiene, environmental protection, and fire safety inspection scenarios, AR devices can be used to record materials of the inspection targets and evaluate them via voice. Then, the diary generation method provided in this application can be used to generate inspection reports and inspection diaries.

[0066] For example, in everyday life scenarios, AR devices can be used to record life scenes, including shooting or recording scenes of playing, shopping, and dining, and voice recording of travel feelings and processes. Then, the diary generation method provided in this application can be used to generate life diaries, travel diaries, visit diaries, etc.

[0067] Optionally, the entity performing the above steps could be an AR device. Thus, the entire process, from collecting and arranging diary materials to generating and displaying diary data, would be handled by an AR device.

[0068] Alternatively, the executing entity can also be a server that communicates with the AR device. In this case, the server acquires the diary material collected by the AR device. Upon receiving a diary generation instruction, it arranges the diary material to generate diary data. Upon receiving a diary display instruction, it returns the diary data to the AR device for display.

[0069] Optionally, the execution entities can also be an AR device and a server. That is, some steps are performed by the AR device, and some by the server. For example, the AR device can collect diary material and send it to the server. When the server receives a diary generation instruction, it arranges the diary material, generates diary data, and returns the diary data to the AR device. The AR device then displays the diary data when it receives a diary display instruction.

[0070] AR devices refer to Augmented Reality devices, which may include, but are not limited to, AR glasses, AR helmets, and other wearable devices equipped with AR technology.

[0071] The AR device described in this application has a diary material collection function. Diary materials can include, but are not limited to, audio, images, videos, and other materials that can be added to a diary. Thus, the AR device has audio collection capabilities, such as recording; image collection capabilities, such as taking photos; and video collection capabilities, such as recording videos.

[0072] For example, the AR device may have an operation button for triggering the above-mentioned data collection function.

[0073] Optionally, the operation button can be a physical key on the AR device. The AR device's data acquisition function is triggered by touching the physical key.

[0074] Optionally, the operation button can be a virtual button on the virtual interface of the AR device. The virtual button can be triggered using technologies such as gestures, voice, and eye tracking to activate the AR device's data acquisition function.

[0075] As an example, different combinations of operations on the operation buttons can trigger different data acquisition functions of the AR device. For instance, a single click triggers voice acquisition; a double click triggers image acquisition; and a long press triggers video acquisition. The operation buttons described in this example can be physical keys or virtual buttons on a virtual interface.

[0076] As an example, corresponding operation buttons can be set for different data acquisition functions. Triggering these buttons will execute the corresponding data acquisition function. For instance, an AR device includes a record button, a photo button, and a video button. Triggering the record button will start the AR device recording audio; triggering the photo button will take a photo; and triggering the video button will record video. In this example, the record button, photo button, and video button can be physical buttons or virtual buttons on a virtual interface.

[0077] After collecting diary materials through AR devices, when a diary generation instruction is received, the diary materials can be arranged according to preset rules to generate diary data.

[0078] The diary generation command can be input by the user into the AR device. For example, the user can input the diary generation command through the diary generation button. The diary generation button can be a physical button or a virtual button on the virtual interface.

[0079] Optionally, after receiving the diary generation instruction, the AR device can arrange the collected diary materials according to preset rules to generate diary data in response to the diary generation instruction.

[0080] Optionally, the AR device can send the received diary generation instruction to the server. In response to the diary generation instruction, the server arranges the diary material obtained from the AR device according to preset rules to generate diary data.

[0081] After the diary data is generated, the generated diary data is displayed through an AR device when a diary display instruction is received.

[0082] The diary display command can be input by the user into the AR device. For example, the user can input the command to generate a diary through the diary display button. The diary display button can be a physical button or a virtual button on the virtual interface.

[0083] Optionally, if the diary data is generated by an AR device, the AR device, upon receiving a diary display instruction, responds to the diary display instruction and displays the generated diary data.

[0084] Optionally, if the diary data is generated by the server, the AR device can send the received diary display command to the server. In response to the diary display command, the server returns the generated diary data to the AR device, allowing the AR device to display the server-generated diary data. Alternatively, the server may return the diary data to the AR device immediately after generating it. The AR device then responds to the diary display command and displays the server-generated diary data.

[0085] As can be seen, the diary generation method provided in this application utilizes the ability of AR devices to collect materials at any time to gather diary content. Simultaneously, the collected diary content is arranged according to preset rules to automatically generate diary data. Throughout the process, the user only needs to trigger the collection of diary content; subsequent arrangement of the content requires no manual intervention, thereby reducing the time spent by the user on arranging the content and improving the convenience of diary generation.

[0086] The following provides a detailed description of steps 110-130.

[0087] In some embodiments, the above-described diary generation method further includes the step of: extracting material information from the diary material to characterize the diary material.

[0088] This step can be performed after the diary material is obtained, or it can be performed after receiving the diary generation instruction.

[0089] Material information is used to characterize diary material and can include various types of information. For example, material information may include, but is not limited to, one or more of the following: diary material identity information, collection time, collection location, material classification information, and descriptive information. Furthermore, in different embodiments, material information may include the aforementioned different types of information.

[0090] In this context, identity information refers to information used to uniquely identify diary materials, such as a material ID. Identity information links diary materials to material information, allowing users to locate the corresponding diary material. Collection time and location indicate the time and location when the diary material was collected. When collecting diary materials, the AR device can generate identity information corresponding to the diary material and record the collection time and location. Thus, the above steps—extracting material information to characterize the diary material—can include: obtaining identity information, recording time, and recording location from the diary material, or one or more of these.

[0091] Material classification information refers to the categories described in the diary materials. These categories can be determined based on the specific circumstances. For example, for a travel diary, the categories could include sightseeing and food, etc. Description information refers to the information that describes the diary materials, such as textual descriptions.

[0092] Regarding the extraction process of category and descriptive information for the diary materials, if the diary materials include audio materials, the audio materials are converted into first text data. For example, the audio materials are recognized using ASR (Automatic Speech Recognition) technology and converted into first text data. Then, semantic analysis is performed on the first text data to determine the category to which the audio materials belong. In this way, the first text data is the descriptive information of the audio materials, and the category to which the audio materials belong is the category information of the materials.

[0093] If the diary material includes images, the images are compressed to generate grayscale images. An image recognition model is then used to extract image features from the grayscale images. These features are then used to classify the images and determine their categories. The image features are then input into a text generation model, which outputs second text data. This second text data describes the images. For example, the image recognition model could be a Convolutional Neural Network (CNN); the text generation model could be a Recurrent Neural Network (RNN). Thus, the second text data serves as the descriptive information for the images, and the category to which the images belong serves as the material classification information.

[0094] If the diary material is video material, a preset number of video frames are extracted from it. The specific value of the preset number can be determined based on the processing power of the AR device or processor; for example, it could be 5 frames. The extracted video frames can be randomly selected, spaced out, or selected from the preset number of frames at the beginning, middle, or end. The extracted video frames can be, for example, keyframes. As a feasible example, the first 5 keyframes can be extracted from the video material.

[0095] For each extracted video frame, the frame is compressed to generate a grayscale image. Image features are then extracted from the grayscale image using an image recognition model. These features are then used to classify the video material and determine its category. The image features are then input into a text generation model, which outputs third-party text data. This third-party text data describes the video frame. One set of third-party text data is generated for each video frame. Finally, the complete third-party text data is selected from all available data as the descriptive information for the video material. Thus, the third-party text data corresponding to a given video frame serves as the descriptive information for the video material, and the category to which the video material belongs serves as its classification information.

[0096] The extraction of the aforementioned material classification and description information can be performed by the AR device and / or the server. As mentioned above, the extraction of material classification and description information requires a neural network model, thus placing high demands on the device's computing power. When the AR device has sufficient computing resources, it can perform the extraction of material classification and description information. Furthermore, since the diary material is collected by the AR device, if the server were to extract the material classification and description information, the AR device would need to transmit the diary material to the server via a communication link. However, diary material files such as audio and video are large, consuming significant transmission resources. Therefore, when the transmission resources between the AR device and the server are abundant, the server can perform the extraction of material classification and description information.

[0097] However, in practice, due to limitations in the computing power of AR devices and the transmission resources between AR devices and servers, the extraction of material classification and description information can be completed jointly by AR devices and servers.

[0098] As a feasible example, an AR device can send audio materials, identity information, collection time, and collection location to a server, allowing the server to convert the audio materials into first text data and determine the category of the audio materials. Similarly, an AR device can compress image materials to generate grayscale images. The AR device then sends the grayscale images, the image material's identity information, collection time, and collection location to the server, allowing the server to extract image features from the grayscale images using an image recognition model and output second text data using a text generation model, while also determining the category of the image materials. Furthermore, an AR device can extract a predetermined number of video frames from video materials, compress each video frame to generate a grayscale image, and then send the grayscale image, the video material's identity information, collection time, and collection location to the server. The server then uses an image recognition model to extract image features from the grayscale images and uses a text generation model to output third text data, while also determining the category of the video materials.

[0099] In this way, the AR device and the server work together to extract the material classification and description information. This not only utilizes the server's powerful computing power to extract the description information, but also allows the AR device to complete the compression of images and video frames and the generation of grayscale images in the early stages. Only the data necessary for extracting the material classification and description information needs to be sent to the server, which greatly reduces the consumption of transmission resources.

[0100] In some embodiments, the material information includes the above-described information. Thus, the generation of diary data in step 120 may include: arranging the diary material and the corresponding material information according to preset rules to generate diary data including the material information and the diary material.

[0101] Since each diary entry has corresponding material information, or rather, each diary entry has corresponding descriptive information, the diary entries and their corresponding material information (descriptive information) can be arranged together according to preset rules when compiling the diary entries. This ensures that the generated diary data contains both the diary entries and the material information. Furthermore, the diary entries and the material information can be linked through identity information.

[0102] In this embodiment, descriptive information for describing the diary material is extracted from the diary material itself. This descriptive information can be automatically generated without the user having to manually craft the text content in the diary. Thus, instead of requiring time-consuming manual work from the user in both the arrangement of the material and the text content, a diary entry that includes both the material and the text content is automatically generated, further improving the convenience of diary generation.

[0103] Regarding the arrangement of diary materials and corresponding material information, in some embodiments, the extraction of descriptive information and the arrangement of diary materials and corresponding material information can be performed by the same device. Thus, after the descriptive information is extracted on the AR device or server, the acquired diary materials and extracted descriptive information can be directly arranged according to preset rules.

[0104] However, as mentioned above, in practice, due to limitations in the computing power and transmission resources of AR devices, the extraction of descriptive information is often a joint task between the AR device and the server. In such cases, the descriptive information is generated by the server, while the diary material is stored in the AR device.

[0105] As a feasible example, the material information includes descriptive information and identity information. The server can send the material information, including descriptive and identity information, to the AR device. In this way, the AR device can determine the corresponding diary material based on the identity information and arrange the diary material and corresponding descriptive information according to preset rules.

[0106] As another feasible example, the server and AR device can jointly participate in the arrangement of diary materials and information, collaboratively generating diary data. Thus, step 120 above could include, for example... Figure 2 The steps shown are as follows:

[0107] Step 210: Arrange the material information according to preset rules to generate a diary template;

[0108] Step 220: Based on the identity information, insert diary material corresponding to the identity information into the diary template to generate diary data including the material information and the diary material.

[0109] Step 210 is executed by the server. That is, the server arranges the generated material information according to preset rules to create a diary template. The diary template includes the arranged material information. In other words, the diary template pre-arranges which material information corresponds to which positions. However, the diary template does not include the original diary material; therefore, the diary template can be understood as a semi-finished product of the diary data.

[0110] Subsequently, the server sends the diary template to the AR device, which then executes step 220. Since the material information includes identity information, the AR device can locate the corresponding diary material based on the identity information and insert the diary material corresponding to the identity information into the appropriate position in the diary template.

[0111] In this embodiment, by having the AR device and the server collaboratively extract descriptive information of the diary material, and by having the AR device and the server collaboratively arrange the diary material and material information, the computing power of the server is fully utilized, the occupation of transmission resources is reduced, and the efficiency of diary generation is improved.

[0112] Based on the above embodiments, when the diary data includes material information and diary material, step 130 may include, for example: Figure 3 The steps shown are as follows:

[0113] Step 310: Display diary data including the descriptive information using the AR device;

[0114] Step 320: In response to the description information being triggered, display the diary material corresponding to the description information.

[0115] In response to a diary display command, the AR device can first display diary data including descriptive information. When the descriptive information is triggered, such as when a user clicks on it, the corresponding diary material is then displayed. Optionally, in addition to the first, second, and third text data mentioned above, the descriptive information may include thumbnails.

[0116] For example, the diary data can display descriptive information corresponding to the audio material, such as first text data. When the descriptive information, such as the first text data, is triggered, the audio material corresponding to the first text data is played.

[0117] For example, diary data can display descriptive information corresponding to image assets, including thumbnails of the image assets and secondary text data. When the descriptive information, such as the thumbnail or the secondary text data, is triggered, the complete image asset corresponding to the secondary text data is displayed, for example, an enlarged image asset.

[0118] For example, the diary data can display descriptive information corresponding to video footage, including thumbnails of the video footage and third-party text data. When the descriptive information, such as the thumbnail or the third-party text data, is triggered, the video footage corresponding to the third-party text data is played.

[0119] In this embodiment, by displaying diary data in two levels—descriptive information and diary material—users can hide or expand parts of the diary entries, thus improving the flexibility of diary data display.

[0120] In some embodiments, the material information includes one or more of the above-mentioned collection time, collection location, and material classification information. In step 120 above, the diary materials are arranged according to preset rules, which may include chronological rules, location rules, and classification rules.

[0121] If arranged according to chronological rules, the diary materials will be arranged according to the collection time to generate chronological diary data;

[0122] Optionally, the material information also includes the aforementioned descriptive information. In this case, the diary materials and corresponding material information can be arranged according to the recording time to generate time-series diary data that includes both material information and diary materials.

[0123] Optionally, the server can arrange the material information according to the collection time to generate a time-series diary template. Then, the AR device can insert diary materials corresponding to the identity information into the time-series diary template based on the identity information to generate time-series diary data including material information and diary materials.

[0124] If arranged according to location rules, the diary materials will be categorized by the location where they were collected, and diary materials belonging to the same location category will be arranged by the time of collection to generate location diary data.

[0125] Optionally, the material information also includes the aforementioned descriptive information. In this case, the diary materials and their corresponding material information can be classified by location according to the collection location. Diary materials and their corresponding material information belonging to the same location category can be arranged according to the collection time to generate location diary data that includes both material information and diary materials.

[0126] Optionally, the server can categorize locations, arranging material information belonging to the same location category according to the collection time to generate a location diary template. Then, the AR device, based on identity information, inserts diary materials corresponding to the identity information into the location diary template, generating location diary data that includes material information and diary materials.

[0127] If arranged according to classification rules, then based on the material classification information, diary materials belonging to the same material category will be arranged according to the collection time to generate classified diary data.

[0128] Optionally, the material information also includes the aforementioned descriptive information. In this case, based on the material classification information, diary materials belonging to the same material category and their corresponding material information can be arranged according to the collection time to generate location diary data that includes both material information and diary materials.

[0129] Optionally, the server can arrange material information belonging to the same category according to the collection time based on the material classification information to generate a categorized diary template. Then, the AR device can insert diary materials corresponding to the identity information into the categorized diary template based on the identity information to generate categorized diary data including material information and diary materials.

[0130] For example, when generating diary data, the three types of diary data mentioned above can be generated simultaneously: time-series diary data, location-based diary data, and categorized diary data. For instance, the server can generate all three diary templates simultaneously and return them to the AR device. The AR device then inserts diary material into each of the three templates to generate the three types of diary data. When displaying the diary data, a diary display instruction can specify the type of diary data to be displayed, allowing the AR device to display one or more types of diary data according to the instruction.

[0131] As an example, the diary display buttons described above can include three types of display buttons. Each of these three display buttons corresponds to a different type of diary data. By triggering different display buttons, the display of the three types of diary data can be switched.

[0132] In this embodiment, by generating different types of diary data according to different preset rules, users can view diaries by time sequence, by location, or by the category described in the material, which greatly improves the flexibility of diaries and meets more user needs.

[0133] In some embodiments, a diary can also be linked to a schedule. In scenarios such as travel or inspection, people often plan their schedules in advance and then execute the scheduled events one by one. Therefore, a diary can also be linked to a schedule, allowing users to view both their daily schedule and diary entries simultaneously.

[0134] For example, a device used to generate diary data, such as a server, can acquire schedule data that includes schedule events.

[0135] The schedule data records the scheduled events and the planned time for those events. For example, the schedule data records "having morning tea from 10:00 AM to 12:00 PM". "Having morning tea" is the scheduled event, and "10:00 AM to 12:00 PM" is the planned time for the scheduled event.

[0136] As an example, users can enter schedule data on electronic devices such as computers and mobile phones, or on AR devices. The electronic or AR device can then upload the schedule data to a server. Simultaneously, the AR device can also retrieve schedule data from the server for display.

[0137] Optionally, after acquiring the schedule data, semantic analysis can be performed on each schedule event in the schedule data to generate the event category of the schedule event.

[0138] Optionally, the above material classification information is matched with event categories. For example, the categories into which diary materials are divided can be determined based on the event category. For instance, if the schedule events in the schedule data include both "visiting" and "food" categories, the diary materials can be divided into "visiting" and "food" categories based on the first text data or image features.

[0139] After acquiring the schedule data, during the process of arranging the diary materials according to the time sequence rules, the diary materials can be associated with the schedule events according to the collection time to generate time-series diary data associated with the schedule data.

[0140] For example, by matching the collection time of diary materials with the planning time of schedule events, diary materials falling within the planning time can be associated with schedule events, and then the diary materials can be arranged according to the collection time to obtain time-series diary data associated with schedule data.

[0141] In this embodiment, by linking time-series diary data with schedule data, users can view both the day's schedule and time-series diary simultaneously, improving the flexibility of diary data display and meeting more user needs.

[0142] In some embodiments, the display of time-series diary data also includes a category filtering function. For example, an AR device may include a category filtering button on the time-series diary data display page. Triggering the category filtering button activates the category filtering function for the time-series diary data.

[0143] Specifically, based on the target category tag selected by the user, diary entries belonging to the target category can be retained and displayed in the time-series diary data, while diary entries belonging to other categories can be hidden. In this way, the time-series diary data, after being filtered by category, displays diary entries of specific categories in chronological order of collection time.

[0144] In this embodiment, by adding a category filtering function to the display of time-series diary data, users can view only diary materials of specific categories according to the order of collection time, which improves the flexibility of diary data display.

[0145] To better understand the diary generation method provided in this application, the following will be used as an example. Figures 4-5 The illustrated embodiments will be further explained.

[0146] In this embodiment, the AR device supports network connectivity, audio recording, video recording, and photography, and also has functions such as location tracking, diary generation, and display. Figure 4 As shown, users can trigger corresponding functions through various virtual buttons on the AR device's virtual interface.

[0147] Thus, the AR device can collect various forms of diary material (step 501), including audio, image, and video materials. While collecting diary material, the AR device also generates corresponding identity information for each piece of diary material, and records the collection time and location. The AR device can also preprocess the diary material (step 502), generating preprocessed data. For example, it generates grayscale images for image materials; it extracts video frames from video materials and generates grayscale images of the video frames. Subsequently, the AR device sends the identity information, collection time, collection location, and preprocessed data of the diary material to the server for storage (step 503).

[0148] When the AR device sends a diary generation command to the server (step 504), the server can extract the description and classification information of the diary material using preprocessed data (step 505). At this point, the server has obtained material information including the diary material's identity information, collection time, collection location, classification information, and description. Subsequently, the server arranges the material information according to chronological, location, and classification rules, respectively, to obtain three types of diary templates: a chronological diary template, a location diary template, and a classification diary template (step 506). The server returns the three diary templates to the AR device (step 507). Since the material information includes identity information, the AR device can insert the diary material corresponding to the identity information into the corresponding positions of the three types of diary templates, respectively, to obtain three types of diary data: chronological diary data, location diary data, and classification diary data (step 508). Finally, in response to the diary display command, the AR device displays the generated diary data (step 509).

[0149] As can be seen, the diary generation method provided in this application utilizes the ability of AR devices to collect materials at any time to gather diary content. Simultaneously, the collected diary content is arranged according to preset rules to automatically generate diary data. Throughout the process, the user only needs to trigger the collection of diary content; subsequent material arrangement and diary content generation require no human intervention, thereby reducing the time spent by the user on material arrangement and improving the convenience of diary generation.

[0150] Based on any of the above embodiments, this application also provides a diary generation apparatus. For example... Figure 6 As shown, a diary generation device 600 includes:

[0151] Module 610 is used to acquire diary material recorded through an AR device;

[0152] The diary generation module 620 is used to respond to the diary generation instruction, arrange the diary materials according to preset rules, and generate diary data;

[0153] The diary display module 630 is used to display the diary data through the AR device in response to a diary display command.

[0154] In some embodiments, a diary generation device 600 further includes:

[0155] An extraction module is used to extract material information from the diary material to characterize the diary material; the material information includes descriptive information;

[0156] The diary generation module 620 is specifically used for:

[0157] The diary materials and corresponding material information are arranged according to preset rules to generate diary data including the material information and the diary materials.

[0158] In some embodiments, the material information further includes identity information; the diary generation module 620 is specifically used for:

[0159] The material information is arranged according to preset rules to generate a diary template;

[0160] Based on the identity information, diary material corresponding to the identity information is inserted into the diary template to generate diary data including the material information and the diary material.

[0161] In some embodiments, the diary display module 630 is specifically used for:

[0162] The AR device displays diary data including the descriptive information.

[0163] In response to the description information being triggered, the diary material corresponding to the description information is displayed.

[0164] In some embodiments, the material information may further include one or more of the following: collection time, collection location, and material classification information;

[0165] The diary generation module 620 is specifically used for:

[0166] The diary materials are arranged according to the collection time to generate time-series diary data;

[0167] The diary materials are categorized by the collection location, and the diary materials belonging to the same location category are arranged according to the collection time to generate location diary data;

[0168] Based on the material classification information, diary materials belonging to the same material category are arranged according to the collection time to generate classified diary data;

[0169] The diary display instruction is used to indicate the type of diary data to be displayed.

[0170] In some embodiments, a diary generation device 600 further includes:

[0171] The schedule module is used to retrieve schedule data, including schedule events;

[0172] The diary generation module 620 is specifically used for:

[0173] The diary materials are associated with the schedule events according to the collection time to generate time-series diary data associated with the schedule data.

[0174] In some embodiments, when displaying the time-series diary data, a diary generation apparatus 600 further includes:

[0175] A filtering module is used to display diary entries belonging to the specified material category in the time-series diary in response to a filtering instruction indicating a material category.

[0176] The specific implementation process of the functions and roles of each module in the above device can be found in the implementation process of the corresponding steps in the above method, and will not be repeated here.

[0177] Based on the diary generation method described in any of the above embodiments, this application also provides, as well as... Figure 7 The diagram shows the structure of an electronic device. Figure 7 At the hardware level, the electronic device includes a processor, an internal bus, a network interface, memory, and non-volatile memory, and may also include other hardware required for business operations. The processor reads the corresponding computer program from the non-volatile memory into memory and then runs it to implement a log generation method as described in any of the above embodiments.

[0178] For example, the electronic device can be an AR device or a server.

[0179] This application also provides a computer storage medium storing a computer program, which, when executed by a processor, can be used to perform a diary generation method as described in any of the above embodiments.

[0180] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can also be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0181] In addition, the functional modules in the various embodiments of this application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0182] If the aforementioned functions are implemented as software functional modules and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0183] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application. It should be noted that similar reference numerals and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0184] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0185] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

Claims

1. A method for generating a diary, characterized in that, The method includes: Acquire diary material collected through augmented reality (AR) devices; Extract material information to characterize the diary material; the material information includes descriptive information and identity information; In response to a diary generation instruction, the diary materials are arranged according to preset rules to generate diary data, including: arranging the material information according to preset rules to generate a diary template, and inserting diary materials corresponding to the identity information into the diary template based on the identity information to generate diary data including the material information and the diary materials; In response to a diary display command, the diary data is displayed via the AR device.

2. The method according to claim 1, characterized in that, The process of displaying the diary data via the AR device includes: The AR device displays diary data including the descriptive information. In response to the description information being triggered, the diary material corresponding to the description information is displayed.

3. The method according to claim 1, characterized in that, The material information also includes one or more of the following: collection time, collection location, and material classification information; The step of arranging the diary materials according to preset rules to generate diary data includes one or more of the following: The diary materials are arranged according to the collection time to generate time-series diary data; The diary materials are categorized by the collection location, and the diary materials belonging to the same location category are arranged according to the collection time to generate location diary data; Based on the material classification information, diary materials belonging to the same material category are arranged according to the collection time to generate classified diary data; The diary display instruction is used to indicate the type of diary data to be displayed.

4. The method according to claim 3, characterized in that, The method further includes: Retrieve schedule data, including schedule events; The step of arranging the diary materials according to the collection time to generate time-series diary data includes: The diary materials are associated with the schedule events according to the collection time to generate time-series diary data associated with the schedule data.

5. The method according to claim 3, characterized in that, When displaying the time-series log data, the method further includes: In response to a filter instruction indicating a material category, diary entries belonging to that material category are displayed in the time-series diary.

6. A diary generation device, characterized in that, The device includes: The acquisition module is used to acquire diary materials recorded through AR devices; An extraction module is used to extract material information from the diary material to characterize the diary material; the material information includes descriptive information and identity information; The diary generation module is used to respond to the diary generation instruction, arrange the material information according to preset rules, generate a diary template, and insert diary materials corresponding to the identity information into the diary template based on the identity information, thereby generating diary data including the material information and the diary materials; The diary display module is used to display the diary data through the AR device in response to a diary display command.

7. An electronic device, characterized in that, The electronic device includes: processor; Memory used to store processor-executable instructions; When the processor invokes the executable instructions, it implements the operation of any one of the methods described in claims 1-5.

8. A computer-readable storage medium, characterized in that, It stores computer instructions that, when executed by a processor, implement the steps of the method according to any one of claims 1-5.

Images