Kitchen device and audio editing method

Abstract

The application provides a kitchen device and an audio editing method. If the ratio of the length of the touch area to the length of the waveform display area is greater than a preset ratio, a delete control and a re-recording control are displayed. In response to a selection operation of the delete control by a user, waveform information of a first audio segment corresponding to the waveform display area where the touch area is located is deleted, and the waveform display area where the touch area is located is retained. The waveform display area is a blank waveform display area. In response to a selection operation of the re-recording control by the user, waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, a second audio segment is recorded, and waveform information of the second audio segment is displayed in the waveform display area where the touch area is located. In the application, the waveform display area where the touch area is located is retained, so that the content of the audio segment at each moment still corresponds to the firepower data after the first audio segment corresponding to the deleted touch area, and the user experience is improved.

Description

[0001] This application claims priority to Chinese Patent Application No. 202210842128.7, filed on July 18, 2022, entitled “Kitchen Equipment and Audio Editing Method”, the entire contents of which are incorporated herein by application. Technical Field

[0002] This application relates to the field of display technology, and more particularly to a kitchen appliance and an audio editing method. Background Technology

[0003] Sharing a successfully prepared dish with others through a recorded recipe, allowing them to recreate the dish using the audio and heat settings provided in the recording, is called recipe replication. During recipe replication, the audio segments at any given moment correspond to the heat settings. If an error occurs in one of the recorded audio segments during the replication process, the erroneous audio segment needs to be edited, either by deleting or replacing it—that is, re-recording.

[0004] Currently, when an audio segment is deleted, the waveform display area corresponding to the user-selected audio segment is also deleted, and the waveform display area of ​​the audio segment following the user-selected audio segment moves to the waveform display area corresponding to the user-selected audio segment. However, this movement of the waveform display area of ​​the audio segment following the user-selected audio segment causes the content of the moved audio segment to mismatch with the firepower data, resulting in a poor user experience. Summary of the Invention

[0005] This application provides a kitchen appliance and an audio editing method to address the technical problem of low accuracy in user touch positioning and poor user experience.

[0006] To address the aforementioned technical problems, the embodiments of this application disclose the following technical solutions:

[0007] In a first aspect, embodiments of this application disclose a kitchen appliance, the kitchen appliance comprising:

[0008] A display for showing an audio editing page interface including an audio information preview area, the audio information preview area including at least one waveform display area for displaying waveform information of an audio segment, the audio segment being audio information generated during recipe recording;

[0009] A communicator is used to communicate with a cooking device to obtain heat data generated by the cooking device, wherein the cooking time of the cooking device corresponds to the recipe recording time.

[0010] The controller, which is communicatively connected to the display, is configured to:

[0011] In response to a user's touch operation in the waveform display area, the length of the touch area is obtained, where the touch area refers to the area where the user touches the screen.

[0012] If the ratio of the length of the touch area to the length of the waveform display area is greater than a preset ratio, the display is controlled to show a delete control and a re-encode control above the waveform display area.

[0013] In response to the user's selection of the delete control, the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, while the waveform display area where the touch area is located is retained. The first audio segment is a recorded audio segment, and the waveform display area is a blank waveform display area.

[0014] In response to the user's selection of the re-record control, the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, the second audio segment is recorded, and the waveform information of the second audio segment is displayed in the waveform display area where the touch area is located.

[0015] Secondly, embodiments of this application disclose an audio editing method, the method comprising:

[0016] In response to a user's touch operation in the waveform display area, the length of the touch area is obtained, where the touch area refers to the area where the user touches the screen.

[0017] If the ratio of the length of the touch area to the length of the waveform display area is greater than a preset ratio, the display is controlled to show the delete control and the re-encode control in the waveform display area;

[0018] In response to the user's selection of the delete control, the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, while the waveform display area where the touch area is located is retained. The first audio segment is a recorded audio segment, and the waveform display area is a blank waveform display area.

[0019] In response to the user's selection of the re-record control, the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, the second audio segment is recorded, and the waveform information of the second audio segment is displayed in the waveform display area where the touch area is located.

[0020] Compared with the prior art, the beneficial effects of this application are as follows:

[0021] This application provides a kitchen appliance and an audio editing method. In response to a user's touch operation on the waveform display area, the length of the touch area is obtained, where the touch area refers to the area where the user touches the device. If the ratio of the touch area length to the length of the waveform display area is greater than a preset ratio, a delete control and a re-record control are displayed above the waveform display area. In response to the user's selection of the delete control, the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, while the waveform display area where the touch area is located is retained. The first audio segment is a recorded audio segment, and the waveform display area is a blank waveform display area. In response to the user's selection of the re-record control, the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, a second audio segment is recorded, and the waveform information of the second audio segment is displayed in the waveform display area where the touch area is located. In this application, by retaining the waveform display area where the touch area is located, it is ensured that after the waveform information of the first audio segment corresponding to the deleted touch area is removed, the content of the audio segment still corresponds to the firepower data at each moment, thus improving the user experience. By ensuring that the ratio of the length of the touch area to the length of the waveform display area is greater than a preset ratio, accidental touches on the waveform display area are avoided, improving the accuracy of the user's touch positioning to the first audio segment corresponding to the waveform display area, thereby improving the user experience.

[0022] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0023] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 The diagram illustrates, by way of example, an operational scenario of a kitchen appliance according to some embodiments;

[0025] Figure 2 The diagram illustrates, by way of example, a hardware configuration block diagram of a kitchen appliance 200 according to some embodiments;

[0026] Figure 3 The diagram illustrates, by way of example, a communication architecture diagram between a kitchen appliance 200 and a cooking apparatus 100 according to some embodiments;

[0027] Figure 4a The diagram illustrates a flowchart of an audio editing method according to some embodiments;

[0028] Figure 4bThe diagram illustrates a flowchart of another audio editing method according to some embodiments;

[0029] Figure 5 The image above exemplifies a schematic diagram showing the display effect of a homepage according to some embodiments;

[0030] Figure 6a The image above exemplifies a display effect diagram of a left-side stove details page according to some embodiments;

[0031] Figure 6b The image above exemplifies the display effect of a DIY recipe details page according to some embodiments;

[0032] Figure 6c The image above exemplifies the display effect of a DIY recipe instruction page according to some embodiments;

[0033] Figure 7a The diagram illustrates, by way of example, the display effect of an audio editing page interface and a firepower curve interface according to some embodiments;

[0034] Figure 7b The diagram illustrates, exemplarily, the display effect of another audio editing page interface and firepower curve interface according to some embodiments;

[0035] Figure 7c The diagram illustrates, exemplarily, the display effect of another audio editing page interface and firepower curve interface according to some embodiments;

[0036] Figure 8a The image above exemplifies the display effect of an audio editing page according to some embodiments;

[0037] Figure 8b The diagram illustrates, exemplarily, the display effect of another audio editing page according to some embodiments;

[0038] Figure 8c The diagram illustrates, exemplarily, the display effect of another audio editing page according to some embodiments;

[0039] Figure 8d The diagram illustrates, exemplarily, the display effect of another audio editing page according to some embodiments;

[0040] Figure 9 The image above exemplifies the display effect of a second audio segment recording page according to some embodiments;

[0041] Figure 10 The diagram illustrates, for example, the display effect of the remaining recording time of the second audio segment according to some embodiments;

[0042] Figure 11 The diagram illustrates, for example, the display effect of a masked area according to some embodiments. Detailed Implementation

[0043] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.

[0044] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0045] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0046] The first audio segment can be a previously recorded audio segment, and the second audio segment can be a newly recorded audio segment. The first distance is the distance between the end of the touch area closest to the start of the audio information preview area and the start of the audio information preview area itself. The second distance is the distance between the end of the touch area furthest from the start of the audio information preview area and the end of the audio information preview area itself. The third distance is the product of the time difference and the length of the audio information preview area per unit time. The time difference is the difference between the start time of the waveform information of the audio segment and the time corresponding to the start of the audio information preview area. The length of the audio information preview area per unit time is the ratio of the length of the audio information preview area to the duration of the waveform information of the audio segment contained within the audio information preview area.

[0047] The second audio segment is used to replace the first audio segment. When the audio segment already recorded by the user is the same as the re-recorded audio segment, the first audio segment is the same as the second audio segment. When the audio segment already recorded by the user is different from the re-recorded audio segment, the first audio segment is different from the second audio segment.

[0048] When the center line of the touch area coincides with the center line of the audio information preview area, the first distance and the second distance are equal; when the center line of the touch area does not coincide with the center line of the audio information preview area, the first distance and the second distance are not equal.

[0049] When the end of the touch area near the beginning of the audio information preview area coincides with the end of the waveform display area corresponding to the start time of the waveform information of the audio segment, the first distance and the third distance are equal. When the end of the touch area near the beginning of the audio information preview area does not coincide with the end of the waveform display area corresponding to the start time of the waveform information of the audio segment, the first distance and the third distance are not equal.

[0050] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0051] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0052] Figure 1 This is a schematic diagram illustrating the operation scenario of the kitchen equipment according to the embodiments. For example... Figure 1 As shown, users can operate the kitchen equipment 200 via touch.

[0053] It should be understood that when a user is cooking, the cooking device 100 can record the heat curve during the cooking process. The heat curve indicates the heat data at various moments during the cooking process. Audio information at various moments during the cooking process can also be recorded. The kitchen appliance 200, which communicates with the cooking device 100, can simultaneously acquire the heat curve and the audio information corresponding to each moment indicated by the heat curve. This facilitates sharing the audio information used for voice instructions at various moments during the cooking process, as well as the heat curve corresponding to each moment indicated by the audio information, with others, making it easier for others to replicate the user's cooking process.

[0054] When a user is cooking, after selecting the dish to be cooked, they can also select the recipe to be replicated in the kitchen appliance 200. After selecting the recipe, the corresponding audio information and heat curve are loaded. During the cooking process, the kitchen appliance 200 plays the audio information at various moments in the cooking process and controls the heat of the cooking device 100 to be consistent with the heat curve, so that the user can replicate the cooking process of others.

[0055] Figure 2 A hardware configuration block diagram of a kitchen appliance 200 according to an exemplary embodiment is shown.

[0056] In some embodiments, the kitchen appliance 200 includes at least one of a communicator 220, a detector 230, an odor sensor 240, a controller 250, a display 260, an audio output interface 270, a power control circuit 280, a memory, a power supply, and a user interface.

[0057] In some embodiments, the controller includes a processor, an audio processor, a graphics processor, RAM, ROM, and a first interface to an nth interface for input / output.

[0058] In some embodiments, the display 260 includes a display screen component for presenting an image, a driving component for driving the image display, a component for receiving image signals from the controller output, and a menu control interface and a user control UI interface.

[0059] In some embodiments, the display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.

[0060] In some embodiments, the communicator 220 is a component for communicating with the cooking appliance 100 according to various communication protocol types. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The kitchen appliance 200 can establish the transmission and reception of control signals and data signals with the cooking appliance 100 through the communicator 220.

[0061] In some embodiments, the detector 230 includes a sound acquisition device, such as a microphone, which is used to receive external sounds and is configured to record the audio information of the cook.

[0062] The audio output interface 270 is configured to broadcast instructions for cooking actions, etc.

[0063] The odor sensor 240 is configured to detect whether there is an odor from burnt food in the cooking appliance 100 or an odor from dry burning in the pot, and transmit the signal to the control module for processing.

[0064] The firepower adjustment circuit 280 is configured to adjust the firepower of the cooking device 100 according to the firepower curve. When the cooking device 100 is an induction cooker, it outputs a signal to the induction cooker power adjustment circuit to adjust the firepower according to the signal. When the cooker is a gas cooker, it outputs a signal to the valve regulator to adjust the valve size according to the signal.

[0065] In some embodiments, the controller 250 controls the operation of the kitchen appliance and responds to user operations via various software control programs stored in memory. The controller 250 controls the overall operation of the kitchen appliance 200. For example, in response to receiving a user command to select a UI object to display on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0066] The aforementioned control module is implemented using a processor. It is configured such that the cooking user selects the left burner of the cooking device 100 on the homepage via a touchscreen or voice command to enter the left burner details page. On the left burner details page, the user can select the DIY recipe control to enter the DIY recipe instructions page. Alternatively, the user can select the DIY recipe control on the homepage via a touchscreen or voice command to enter the DIY recipe details page. On the DIY recipe details page, the user can select the "Create New DIY Recipe" control to enter the DIY recipe instructions page. The user can select the "Continue" control on the DIY recipe instructions page to enter the audio editing page interface. The user can display the waveform information of the first audio segment on the audio editing page interface, and display the heat curve corresponding to the recording time of the waveform information of the first audio segment on the heat curve interface. The waveform information of the first audio segment is displayed in the waveform display area, which is displayed in the audio information preview area of ​​the audio editing page. The cooking user can select the first audio segment to be deleted or replaced via a touchscreen or voice command to correct any errors in the first audio segment.

[0067] In some embodiments, the object can be any of the optional objects, such as a hyperlink, an icon, or other operable controls. Operations related to the selected object include: displaying links to hyperlinked pages, documents, images, etc., or performing operations corresponding to the program associated with the icon.

[0068] In some embodiments, the controller includes at least one of a central processing unit (CPU), an audio processor, a graphics processing unit (GPU), RAM (random access memory), ROM (read-only memory), a first to an nth interface for input / output, a communication bus, etc.

[0069] A CPU (CPU) processor is used to execute operating system and application instructions stored in memory, as well as various interactive instructions received from external input, to execute various applications, data, and content, ultimately for the display and playback of various audio content. A CPU processor can include multiple processors, such as a main processor and one or more sub-processors.

[0070] In some embodiments, the audio processor is configured to receive external audio signals, and according to the standard codec protocol of the input signals, perform decompression and decoding, as well as noise reduction, digital-to-analog conversion, and amplification processing, to obtain a sound signal that can be played in a speaker.

[0071] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0072] In some embodiments, a "user interface" is the medium through which an application or operating system interacts and exchanges information with a user, converting information between its internal form and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0073] In some embodiments, the system of a kitchen appliance may include a kernel, a command interpreter (shell), a file system, and applications. The kernel, shell, and file system together form the basic operating system structure, allowing users to manage files, run programs, and use the system. Upon power-up, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, and runs and maintains virtual memory, the scheduler, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. The applications are compiled into machine code after startup, forming a process.

[0074] Figure 3 This is a schematic diagram of the communication architecture between the kitchen appliance 200 and the cooking device 100 according to the embodiment.

[0075] In some embodiments, such as Figure 3 As shown, the kitchen appliance 200 includes an application layer and a service layer. The application layer mainly consists of user-operable applications, including a homepage and DIY recipes; the service layer mainly provides Bluetooth communication, message parsing, and Binder communication services with applications. Binder communication is an inter-process communication method in the Android system, which is a client-server communication structure.

[0076] The cooking device 100 is the cooking device that users usually use for stir-frying. The cooking device 100 can be a stove. It can communicate with the kitchen equipment 200 via Bluetooth. The cooking device 100 has built-in Bluetooth communication and message processing programs.

[0077] In some embodiments, the hardware or software architecture can be based on the description in the above embodiments, and in some embodiments it can be based on other similar hardware or software architectures, as long as the technical solution of this application can be implemented.

[0078] Based on the aforementioned kitchen appliance 200, users can record recipes by selecting the DIY recipe control on the homepage of the kitchen appliance 200. The recipe recording includes recording audio segments, wherein the kitchen appliance 200 and the cooking device 100 are successfully paired via Bluetooth. The control display 260 displays the waveform information of the recorded audio segments, i.e., the waveform information of the first audio segment, in the waveform display area of ​​the audio information preview area. There are multiple first audio segments. The control display 260 also displays the power curve on the power curve interface. In a scenario where each of the first audio segments has a one-to-one temporal correspondence with the firepower data of the firepower curve, if the user records an incorrect first audio segment, deleting or replacing any of the first audio segments using traditional methods will cause subsequent first audio segments to re-establish a correspondence with the firepower data of the firepower curve after deletion. Furthermore, replacing any of the first audio segments will cause the second audio segment to establish a correspondence with all firepower data in the firepower curve except those that have a temporal correspondence with the deleted first audio segment. Therefore, it is impossible to maintain the one-to-one temporal correspondence between each audio segment and the firepower data of the firepower curve. The audio segments include both the first and second audio segments.

[0079] To improve the user experience, this application provides a kitchen appliance and an audio editing method.

[0080] See Figure 4a and Figure 4bThe control display 260 displays the waveform information of the recorded audio segments, i.e., the waveform information of the first audio segment, in the waveform display area of ​​the audio information preview area. There are multiple first audio segments. The control display 260 also displays the firepower curve on the firepower curve interface. When the user records an incorrect first audio segment, the user can select any first audio segment by touching the waveform information display area corresponding to that segment to delete or replace it. Since each first audio segment has a temporal correspondence with the firepower data of the firepower curve, deleting any first audio segment does not establish a new correspondence between the firepower data in the firepower curve and any other first audio segment besides the deleted one. Therefore, when replacing any first audio segment, a new correspondence is established between the firepower data of the firepower curve and the second audio segment used to replace it. This firepower data is the firepower data that has a temporal correspondence with the deleted first audio segment. This ensures that the one-to-one temporal correspondence between each audio segment and the firepower data of the firepower curve remains unchanged.

[0081] The audio editing process provided in the embodiments of this application will now be described with reference to the accompanying drawings.

[0082] Figure 4a The diagram illustrates a flowchart of an audio editing method according to some embodiments. Figure 4b The diagram illustrates a flowchart of another audio editing method according to some embodiments, in conjunction with... Figure 4a and Figure 4b The method includes the following steps:

[0083] S401: In response to a user's touch operation in the waveform display area, obtain the length of the touch area, where the touch area refers to the area where the user touches the screen.

[0084] S402: If the ratio of the length of the touch area to the length of the waveform display area is greater than a preset ratio, then control the display to show the delete control and the re-encode control in the waveform display area.

[0085] S403: In response to the user's selection operation on the delete control, delete the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located, and retain the waveform display area where the touch area is located. The first audio segment is a recorded audio segment, and the waveform display area is a blank waveform display area, so that the correspondence between the remaining waveform information and the firepower curve remains unchanged.

[0086] In some embodiments, such as Figure 7aAs shown, before any waveform information 708 of the first audio segment is deleted and re-recorded, the recording time of the waveform information 708 of the first audio segment corresponds to the acquisition time of the firepower data in the firepower curve 709. Figure 7b As shown, after deleting the waveform information 708 of the second first audio segment, the recording time of the waveform information 708 of the first audio segment corresponds to the acquisition time of the firepower data in the firepower curve 709.

[0087] In some embodiments, the waveform display area where the touch area is located is preserved, optionally by setting the waveform display area to gray.

[0088] In some embodiments, the first and second audio segments during the cooking stage can both be saved in the file folder, and deleting the first audio segment corresponding to the waveform display area where the touch area is located can be done by deleting the corresponding audio file in the file folder.

[0089] S404: In response to the user's selection of the re-recording control, delete the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located, record the second audio segment, and display the waveform information of the second audio segment in the waveform display area where the touch area is located, so that the correspondence between the waveform information including the second audio segment and the firepower curve remains unchanged.

[0090] In some embodiments, by Figure 7c As shown, after re-recording the waveform information 708 of any of the first audio segments, the recording time of the waveform information 708 of the first audio segment, the waveform information 710 of the second audio segment, and the acquisition time of the firepower data in the firepower curve 709 correspond to each other.

[0091] In some embodiments, the correspondence between the waveform information and the firepower curve includes: the correspondence between the recording time of the audio segment and the acquisition time of the firepower data, and / or the correspondence between the content information included in the audio segment and the size of the firepower data.

[0092] In some embodiments, the correspondence between the recording time of the audio segment and the acquisition time of the firepower data is as follows: the 5th second of the audio segment recording corresponds to the 5th second of the firepower data acquisition.

[0093] In some embodiments, the correspondence between the content information included in the audio segment and the size of the heat data includes a specific indication of the heat data size and the heat level required for cooking the ingredients. Specifically, the indication of the heat data size is as follows: when the audio segment content indicates that the heat is turned up, the heat data increases. The heat level required for cooking the ingredients is as follows: when the audio segment mentions adding cooking ingredient 1, the heat data matches the heat level required for cooking ingredient 1.

[0094] In some embodiments, in response to a user's selection of the re-recording control, the start time of the first audio segment corresponding to the waveform display area where the touch area is located is obtained, the storage file of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, a second audio segment is recorded, and the start time of the second audio segment is set as the start time of the first audio segment corresponding to the waveform display area where the touch area is located.

[0095] In some embodiments, in response to the user's selection of the re-recording control, the sequence number of the audio segment corresponding to the waveform display area where the touch area is located is obtained. When the waveform display area where the touch area is located is the second of the four first audio segments, the sequence number of the first audio segment corresponding to the waveform display area where the touch area is located is 2, the sequence number of the recorded second audio segment is 5, the start time of recording the audio segment with sequence number 5 is the start time of the audio segment with sequence number 2, and the order of the first audio segments corresponding to the waveform display area is audio 1, audio 5, audio 3, audio 4.

[0096] In some embodiments, during the recording of firepower data corresponding to the audio segment content at each moment, the recording of firepower data is paused when the user selects the re-record control or deletes the control.

[0097] In some embodiments, the deletion or replacement of a first audio segment corresponding to the waveform display area where the touch area is located by a re-recorded second audio segment does not affect the sum of the durations of the multiple first audio segments corresponding to multiple waveform display areas. Therefore, the waveform information of the audio segments still needs to be drawn over time and is at the same pace as the firepower data.

[0098] When the first audio segment replaced by the deleted or re-recorded second audio segment is the first audio segment corresponding to the last waveform display area in multiple waveform display areas, the waveform display area will still display over time, but the waveform information of the audio segment will no longer be drawn after the audio is paused.

[0099] In some embodiments, when there are multiple recorded first audio segments, and one of the multiple first audio segments has been deleted, in response to the user's selection operation of the re-recording control, the end time of the waveform information of the first audio segment corresponding to the previous waveform display area of ​​the waveform display area where the touch area is located is obtained, and the start time of the waveform information of the first audio segment corresponding to the next waveform display area of ​​the waveform display area where the touch area is located is obtained. The interval duration is the difference between the start time and the end time. During the recording of the second audio segment, the remaining recording time of the second audio segment is the interval duration. The display is controlled to show the remaining recording time of the second audio segment. When the recording of the second audio segment ends, the waveform information of the second audio segment is displayed in the waveform display area where the touch area is located.

[0100] In some embodiments, the audio segments of both the food preparation stage and the cooking stage can be stored in the file folder. Each audio segment corresponds to an audio file, which includes the start timestamp of the audio segment and the audio segment number. When there are four first audio segments in the cooking stage, the filename of the fourth audio file can be selected as cooking+audio1-0630152004.wav, cooking+audio2-0630153010.wav, cooking+audio3-0630152004.wav, and cooking+audio4-0630152004.wav. The filename of the audio file corresponding to the audio segment in the food preparation stage can be selected as food preparation+audio-0630151230.wav.

[0101] In some embodiments, in response to a user's selection of the re-recording control, the duration of the waveform information of the first audio segment corresponding to the waveform display area 702 where the touch area 706 is located is obtained, the end time of the waveform information of the first audio segment corresponding to the waveform display area 702 where the touch area 706 is located is obtained, and the start time of the waveform information of the first audio segment corresponding to the next waveform display area 702 where the touch area 706 is located is obtained. The interval duration is the difference between the start time and the end time. During the recording of the second audio segment, the remaining recording time of the second audio segment is the sum of the duration of the waveform information of the first audio segment and the interval duration. The display is controlled to show the remaining recording time of the second audio segment. When the recording of the second audio segment ends, the waveform information of the second audio segment is displayed in the waveform display area where the touch area is located.

[0102] Figure 8d The image above exemplifies the display effect of another audio editing page according to some embodiments. Figure 8dAs shown, the duration 7022 of the waveform information of the audio segment contained in the audio information preview area 701 can be selected as 12 minutes. During the recording of the second audio segment, the remaining recording time is the sum of the duration 7022 of the waveform information of the audio segment and the interval duration 707, and the control display 260 displays the remaining recording time. The second audio segment is... Figure 8d When the audio segment is displayed in the waveform display area 702 near the beginning of the audio information preview area, the duration 7022 and interval duration 707 of the waveform information of the audio segment are as follows: Figure 8d As shown.

[0103] Figure 9 The image above exemplifies the display effect of a second audio segment recording page according to some embodiments. Figure 9 As shown, during the recording of the second audio segment, the time difference between the current time of the second audio segment and the start time of the second audio segment is obtained. When the time difference is less than a preset time difference, the control display 260 displays an abandon control. When the time difference is greater than or equal to the preset time difference and less than the remaining recording time, the control display 260 displays an abandon control and a save and replace control.

[0104] Figure 10 The image above exemplifies the display effect of the remaining recording time of a second audio segment according to some embodiments. Figure 10 As shown, in some embodiments, the duration of the waveform information of the audio segment contained in the audio information preview area 701 can be selected as 12 minutes. The time difference between the start time of the waveform information of the next first audio segment and the start time of the waveform information of the first audio segment is obtained. The time difference is the recordable time 901 of the first audio segment. The remaining recording time 902 of the second audio segment is the same as the recordable time 901 of the first audio segment.

[0105] In some embodiments, during the recording of the second audio segment, the control display 260 displays the remaining recording time of the second audio segment. When the time difference between the current time and the start time of the second audio segment (the duration of the second audio segment) is less than a preset time, an abandon control is displayed, and the save and replace control is grayed out. When the time difference is greater than or equal to the preset time difference and less than the remaining recording time, the control display displays both the abandon control and the save and replace control. Graying out indicates that it cannot be selected, meaning that when the duration of the second audio segment is less than the preset time, the second audio segment cannot be saved and replace the first audio segment. The preset time can be selected as 3 seconds.

[0106] In some embodiments, when the remaining recording time of the second audio segment is 0, the area used to display the remaining recording time of the second audio segment displays a reminder for the user to replace the audio segment. The reminder for the user to replace the audio segment may be that the recording has ended.

[0107] In some embodiments, after the user selects the save and replace control, the replace interface is called, and the UI draws the corresponding waveform information of the second audio segment based on the start time and duration of the second audio segment.

[0108] When the duration of the second audio segment is less than the duration of the first audio segment, the portion of the second audio segment shorter than the first audio segment will not have waveform information displayed. In other words, when the duration of the second audio segment is less than the duration of the first audio segment, the length of the waveform display area corresponding to the second audio segment is less than the length of the waveform display area corresponding to the first audio segment.

[0109] Depend on Figure 4b As shown, if the touch area is within the waveform display area and the ratio of the length of the touch area to the length of the waveform display area is greater than a preset ratio, the display 260 is controlled to display the re-recording control and the delete control in the audio information preview area.

[0110] In some embodiments, the re-recording control and the delete control may be displayed as pop-up windows. After the user selects the delete control, a confirmation pop-up window is displayed in the audio information preview area. When the user confirms, the first audio segment is deleted; when the user does not confirm, the confirmation pop-up window disappears.

[0111] Figure 5 The image below exemplifies the display effect of a homepage according to some embodiments. Figure 5 As shown, the kitchen appliance 200 displays a homepage on the display interface. When the kitchen appliance 200 is connected to the cooking device 100 via Bluetooth communication, the homepage displays the status of the cooking device 100, which includes recording and non-recording states. The cooking device 100 can be a cooktop, which can be a left cooktop, a middle cooktop, or a right cooktop.

[0112] In some embodiments, in response to a user's touch operation, the state of the kitchen device is determined. When the kitchen device is in recording mode, the state of the kitchen device is controlled to change from recording mode to pause mode and a first audio segment is played. When the kitchen device is in non-recording mode, the first audio segment is played.

[0113] Figure 6a The image below exemplifies a display effect diagram of a left-side stove details page according to some embodiments. Figure 6a As shown, users can select the left burner of the cooking device 100 by touch to enter the left burner details page. Users can select the DIY recipe control on the left burner details page to enter the DIY recipe instructions page.

[0114] Figure 6b The image below exemplifies the display effect of a DIY recipe details page according to some embodiments. Figure 6bAs shown, users can select the DIY recipe control on the homepage by touching it to enter the DIY recipe details page. On the DIY recipe details page, users can select the "Create New DIY Recipe" control to enter the DIY recipe instructions page.

[0115] Figure 6c The image below exemplifies the display effect of a DIY recipe instruction page according to some embodiments. Figure 6c As shown, users can select the continue control on the DIY recipe instructions page to enter the process of recording the audio segment of the recipe.

[0116] Figure 7a The diagram illustrates, exemplarily, the display effect of an audio editing page interface and a firepower curve interface according to some embodiments. Figure 7b The diagram illustrates, exemplarily, the display effect of another audio editing page interface and firepower curve interface according to some embodiments. Figure 7c The image above exemplifies the display effect of another audio editing page interface and a firepower curve interface according to some embodiments. Figure 7a , Figure 7b and Figure 7c As shown, the user can display the waveform information 708 (the waveform information of the recorded audio segment) of the first audio segment in the audio editing page interface, and display the firepower curve 709 corresponding to the recording time of the waveform information of the first audio segment in the firepower curve interface.

[0117] Figure 8a The image below exemplifies the display effect of an audio editing page according to some embodiments. Figure 8a As shown, the user can display the waveform information of the first audio segment (the waveform information of the recorded audio segment) in the waveform display area 702, and the waveform display area 702 is displayed in the audio information preview area 701 of the audio editing page.

[0118] In some embodiments, the audio editing page interface includes an audio information preview area, which includes at least one waveform display area for displaying waveform information of an audio segment, wherein the audio segment is audio information generated during recipe recording.

[0119] In some embodiments, a user performs a touch operation on the waveform display area, and the touch area is within the waveform display area.

[0120] Figure 8b The image above exemplifies the display effect of another audio editing page according to some embodiments. Figure 8bAs shown, in some embodiments, the time difference is the difference between the start time of the waveform information of the audio segment and the time corresponding to the start of the audio information preview area, and the third distance 705 is the product of the time difference and the length of the audio information preview area per unit time.

[0121]

[0122] Where thirdLength is the third distance, totalAudioBeginTime is the time corresponding to the start of the audio information preview area, audioBegin is the start time of the waveform information of the audio segment, totalAudioLength is the length of the audio information preview area, and totaltimeLength is the duration of the waveform information of the audio segment contained in the audio information preview area.

[0123] In some embodiments, the start time of the waveform information of the audio segment can be selected as 2 min 30 s, the time corresponding to the start of the audio information preview area can be selected as 0 min 0 s, the length of the audio information preview area can be selected as 800 pixels, the duration of the waveform information of the audio segment contained in the audio information preview area can be selected as 12 minutes, the unit time can be selected as minutes or seconds, and the third distance 705 can be selected as 166.67 pixels.

[0124] In some embodiments, the distance between the touch area and the beginning of the audio information preview area is greater than or equal to a first distance and less than or equal to the sum of the length of the touch area and the first distance; the distance between the waveform display area and the beginning of the audio information preview area is greater than or equal to a third distance 705 and less than or equal to the sum of the length of the waveform display area and the third distance 705.

[0125] firstLength≤toucharea-totalAudioBegin≤touchLength+firstLength

[0126] Where touchaya is the touch area, totalAudioBegin is the beginning of the audio information preview area, touchLength is the length of the touch area, and firstLength is the first distance.

[0127] In some embodiments, the duration of the waveform information of the audio segment is the difference between the end time and the start time of the waveform information of the audio segment, the length of the audio information preview area per unit time is the ratio of the length of the audio information preview area to the duration of the waveform information of the audio segment contained in the audio information preview area, and the length of the waveform display area is the product of the duration of the waveform information of the audio segment and the length of the audio information preview area per unit time.

[0128]

[0129] Where AudioLength is the length of the waveform display area, audioEnd is the end time of the waveform information of the audio segment, audioBegin is the start time of the waveform information of the audio segment, totalAudioLength is the length of the audio information preview area, and totaltimeLength is the duration of the waveform information of the audio segment contained in the audio information preview area.

[0130] In some embodiments, the length of the audio information preview area can be selected as 800 pixels, the duration of the waveform information of the audio segment contained in the audio information preview area can be selected as 12 minutes, the unit time can be selected as minutes or seconds, the start time of the waveform information of the audio segment can be selected as 2 minutes 30 seconds, the end time of the waveform information of the audio segment can be selected as 4 minutes 50 seconds, that is, the duration of the waveform information of the audio segment can be selected as 140 seconds, and the length of the waveform display area can be selected as 155.56 pixels.

[0131] Figure 8b The image above exemplifies the display effect of another audio editing page according to some embodiments. Figure 8b As shown, the waveform display area start end 7021 is one end of the waveform display area 702 corresponding to the start time of the waveform information of the audio segment; the audio information preview area start end 7011 is one end of the audio information preview area 701 that is close to the waveform display area start end 7021; the audio information preview area end end 7012 is one end of the audio information preview area that is far away from the waveform display area start end; the first distance 703 is the distance between the end of the touch area 706 that is close to the audio information preview area start end 7011 and the audio information preview area start end 7011; the second distance 704 is the distance between the end of the touch area 706 that is far away from the audio information preview area start end 7011 and the audio information preview area end end 7012; the length difference between the touch area 706 and the audio information preview area 701 is the sum of the first distance 703 and the second distance 704; and the length of the touch area 706 is the difference between the length of the audio information preview area 701 and the aforementioned length difference.

[0132] touchLength=totalAudioLength-firstLength-secondLength

[0133] Where touchLength is the length of the touch area, totalAudioLength is the length of the audio information preview area, totaltimeLength is the duration of the waveform information of the audio segment contained in the audio information preview area, firstLength is the first distance, and secondLength is the second distance.

[0134] Figure 8c The image above exemplifies the display effect of another audio editing page according to some embodiments. Figure 8c As shown, when there are multiple recorded first audio segments, one end of the touch area 706 is located within one of the multiple waveform display areas 702, and the other end of the touch area 706 is not located in any waveform display area other than the waveform display area 702 in which one end of the touch area 706 is located.

[0135] thirdLength≤toucharea≤AudioLength+thirdLength

[0136] Where toucharea is the touch area, AudioLength is the length of the waveform display area, and thirdLength is the third distance.

[0137] In some embodiments, when there are multiple recorded first audio segments, the control display 260 displays a switching control for the first audio segment above the waveform display area. The switching control is used to switch the first audio segment corresponding to the touch area 706 to any of the remaining first audio segments among the multiple first audio segments.

[0138] The toggle control is not displayed when there is only one recorded audio segment. The toggle control is displayed when there are multiple recorded audio segments.

[0139] In some embodiments, the toggle control may be an arrow control, which includes a left arrow control and a right arrow control.

[0140] When the user touches and selects the first audio segment, which is the last of multiple first audio segments, the control display 260 displays the left arrow control of the first audio segment; when the user touches and selects the first audio segment, which is the first of multiple first audio segments, the control display 260 displays the right arrow control of the first audio segment; when the user touches and selects the first audio segment, which is neither the first nor the last of multiple first audio segments, the control display 260 displays both the left arrow control and the right arrow control of the first audio segment.

[0141] Figure 11 The diagram illustrates, exemplarily, the display effect of a masked area according to some embodiments. Figure 11 As shown, in some embodiments, when the control display 260 displays the re-recording control and the delete control in the audio information preview area 701, the user can make the re-recording control and the delete control disappear by selecting the mask area 1001.

[0142] When a user performs a touch operation on the waveform display area, i.e., when the touch area (the area operated by the user during the touch operation) is within the waveform display area, it avoids the user being unable to locate the waveform display area by touch. By ensuring that the ratio of the length of the touch area to the length of the waveform display area is greater than a preset ratio, it avoids accidental touches on the waveform display area, improves the accuracy of the user locating the first audio segment corresponding to the waveform display area by touch, and enhances the user experience.

[0143] Based on the same inventive concept as the aforementioned kitchen equipment, this application also provides an audio editing method. The audio editing method includes: a controller 250 controlling a display 260 to display waveform information of a first audio segment in an audio information preview area; determining a waveform display area in the audio information preview area for displaying the waveform information of the audio segment; the controller 250 responding to a user's touch operation to obtain the length of the touch area, where the touch area refers to the area operated by the user during the touch operation; if the touch area is within the waveform display area, and the ratio of the touch area length to the waveform display area length is greater than a preset ratio, then the controller 250 controlling the display 260 to display a re-recording control in the audio information preview area; the controller 250 responding to the user's selection of the re-recording control to record a second audio segment; and the controller 250 controlling the display 260 to display the waveform information of the second audio segment in the audio information preview area.

[0144] Since the above embodiments are all described in conjunction with other methods, and different embodiments have the same parts, the same or similar parts between the various embodiments in this specification can be referred to mutually. They will not be described in detail here.

[0145] It should be noted that in this specification, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a circuit structure, article, or device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a circuit structure, article, or device. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the circuit structure, article, or device that includes the element.

[0146] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the content of the claims.

[0147] The above embodiments of this application do not constitute a limitation on the scope of protection of this application.

Claims

1. A kitchen appliance, characterized in that, The kitchen equipment includes: A communicator is used to communicate with the cooking device to obtain the heat data acquired by the cooking device at various moments during the cooking process, wherein the cooking time of the cooking device corresponds to the recipe recording time. The display is used to show an audio editing page interface including an audio information preview area and a power curve interface for displaying a power curve. The audio information preview area includes at least one waveform display area for displaying waveform information of an audio segment, which is audio information generated during recipe recording. The power curve is used to indicate the power data acquired at various times during the cooking process. The controller, which is communicatively connected to the display, is configured to: In response to a user's touch operation in the waveform display area, the length of the touch area is obtained, where the touch area refers to the area where the user touches the screen. If the ratio of the length of the touch area to the length of the waveform display area is greater than a preset ratio, the display is controlled to show a delete control and a re-encode control above the waveform display area. In response to the user's selection of the delete control, the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, while the waveform display area where the touch area is located is retained. The first audio segment is a recorded audio segment, and the waveform display area is a blank waveform display area, so that the correspondence between the remaining waveform information and the firepower curve remains unchanged. When there are multiple recorded first audio segments, the display is controlled to show a switching control for the first audio segment above the waveform display area. The switching control is used to switch the first audio segment corresponding to the touch area to any of the remaining first audio segments among the multiple first audio segments. In response to the user's selection of the re-recording control, the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, the second audio segment is recorded, and the waveform information of the second audio segment is displayed in the waveform display area where the touch area is located, so that the correspondence between the waveform information including the second audio segment and the firepower curve remains unchanged.

2. The kitchen equipment according to claim 1, characterized in that, The correspondence between the waveform information and the firepower curve includes: The correspondence between the recording time of the audio segment and the acquisition time of the firepower data, and / or the correspondence between the content information included in the audio segment and the size of the firepower data.

3. The kitchen equipment according to claim 1, characterized in that, In the steps of deleting the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located in response to the user's selection operation of the re-recording control, recording the second audio segment, and displaying the waveform information of the second audio segment in the waveform display area where the touch area is located, the controller is further configured to: In response to the user's selection of the re-recording control, the start time of the first audio segment corresponding to the waveform display area where the touch area is located is obtained, and the storage file of the first audio segment corresponding to the waveform display area where the touch area is located is deleted; Record the second audio segment and set the start time of the second audio segment to the start time of the first audio segment corresponding to the waveform display area where the touch area is located.

4. The kitchen equipment according to claim 1, characterized in that, The duration of the waveform information of an audio segment is the difference between the end time and the start time of the waveform information of the audio segment. The length of the audio information preview area per unit time is the ratio of the length of the audio information preview area to the duration of the waveform information of the audio segment contained in the audio information preview area; The length of the waveform display area is the product of the duration of the waveform information of the audio segment and the length of the audio information preview area per unit time.

5. The kitchen equipment according to claim 1, characterized in that, The beginning of the waveform display area is the end of the waveform display area corresponding to the start time of the waveform information of the audio segment; The beginning of the audio information preview area is the end of the audio information preview area closest to the beginning of the waveform display area; The end of the audio information preview area is the end of the audio information preview area that is furthest from the beginning of the waveform display area. The first distance is the distance between the end of the touch area closest to the beginning of the audio information preview area and the beginning of the audio information preview area; The second distance is the distance between the end of the touch area away from the beginning of the audio information preview area and the end of the audio information preview area; The length difference between the touch area and the audio information preview area is the sum of the first distance and the second distance; The touch area length is the difference between the length of the audio information preview area and the length difference mentioned above.

6. The kitchen equipment according to claim 1, characterized in that, After the step of controlling the display to show delete and re-encode controls above the waveform display area if the ratio of the length of the touch area to the length of the waveform display area is greater than a preset ratio, the controller is further configured to: The status of the kitchen equipment is determined in response to the user's touch operation in the waveform display area; When the kitchen equipment is in recording mode, control the kitchen equipment to change from recording mode to pause mode and play the first audio segment; Play the first audio segment when the kitchen equipment is not in recording mode.

7. The kitchen equipment according to claim 1, characterized in that, In the steps of deleting the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located in response to the user's selection operation of the re-recording control, recording the second audio segment, and displaying the waveform information of the second audio segment in the waveform display area where the touch area is located, the controller is further configured to: When there are multiple recorded first audio segments, and none of the multiple first audio segments have been deleted, in response to the user's selection operation of the re-recording control, the duration of the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is obtained, the end time of the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is obtained, and the start time of the waveform information of the first audio segment corresponding to the next waveform display area where the touch area is located is obtained. The interval duration is the difference between the start time and the end time. During the recording of the second audio segment, the remaining recording time of the second audio segment is the sum of the duration of the waveform information of the first audio segment and the interval duration. The display is controlled to show the remaining recording time of the second audio segment. When the recording of the second audio segment ends, the waveform information of the second audio segment is displayed in the waveform display area where the touch area is located.

8. The kitchen equipment according to claim 7, characterized in that, During the recording of the second audio segment, the remaining recording time of the second audio segment is the sum of the duration of the waveform information of the first audio segment and the interval duration. In the step of controlling the display to show the remaining recording time of the second audio segment, the controller is further configured to: During the recording of the second audio segment, the time difference between the current time of the second audio segment and the start time of the second audio segment is obtained; When the time difference is less than a preset time difference, the display shows an abandon control. When the time difference is greater than or equal to the preset time difference and less than the remaining recording time, the display is controlled to show the abandon control and the save and replace control.

9. The kitchen equipment according to claim 1, characterized in that, In the steps of deleting the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located in response to the user's selection operation of the re-recording control, recording the second audio segment, and displaying the waveform information of the second audio segment in the waveform display area where the touch area is located, the controller is further configured to: When there are multiple recorded first audio segments, and one of the multiple first audio segments has been deleted, in response to the user's selection operation of the re-record control, the end time of the waveform information of the first audio segment corresponding to the previous waveform display area of ​​the waveform display area where the touch area is located is obtained, and the start time of the waveform information of the first audio segment corresponding to the next waveform display area of ​​the waveform display area where the touch area is located is obtained. The interval is the difference between the start time and the end time. During the recording of the second audio segment, the remaining recording time of the second audio segment is the interval duration, and the display is controlled to show the remaining recording time of the second audio segment; When the recording of the second audio segment ends, the waveform information of the second audio segment is displayed in the waveform display area where the touch area is located.

10. An audio editing method, characterized in that, The method includes: In response to a user's touch operation in the waveform display area, the length of the touch area is obtained, where the touch area refers to the area where the user touches the screen. If the ratio of the length of the touch area to the length of the waveform display area is greater than a preset ratio, the display is controlled to show a delete control and a re-encode control above the waveform display area. In response to the user's selection of the delete control, the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, while the waveform display area where the touch area is located is retained. The first audio segment is a recorded audio segment, and the waveform display area is a blank waveform display area, so that the correspondence between the remaining waveform information and the firepower curve remains unchanged. When there are multiple recorded first audio segments, the display is controlled to show a switching control for the first audio segment above the waveform display area. The switching control is used to switch the first audio segment corresponding to the touch area to any of the remaining first audio segments among the multiple first audio segments. In response to the user's selection of the re-recording control, the waveform information of the first audio segment corresponding to the waveform display area where the touch area is located is deleted, the second audio segment is recorded, and the waveform information of the second audio segment is displayed in the waveform display area where the touch area is located, so that the correspondence between the waveform information including the second audio segment and the firepower curve remains unchanged.

Images