Recipe generation methods, devices, equipment, storage media, and program products

Abstract

This invention provides a recipe generation method, apparatus, device, storage medium, and program product. The method includes: when a stove is detected to be started, projecting a first query message regarding whether to record a recipe at a preset location; identifying a first user action performed by the user based on the first query message; if the first user action is the same as a first preset action, recording a preset cooking area to obtain a cooking recording video; and editing the cooking recording video to obtain a recipe. This method, by projecting the first query message and then identifying the user's action, can determine whether the user needs to start recipe generation, making it easier for the user to control the recipe recording process.

Description

Technical Field

[0001] This invention belongs to the field of smart home technology, specifically relating to a recipe generation method, device, equipment, storage medium, and program product. Background Technology

[0002] In today's increasingly interconnected world, Internet of Things (IoT) technology has enabled most home appliances to play a greater role. However, the current development of range hoods is still mainly focused on increasing suction power and improving control methods, with only a few technologies adding new features to range hoods.

[0003] In the existing technology, in order to increase the enjoyment of cooking, there are technical solutions to add video recording functions to range hoods, record the food preparation process, and generate recipes.

[0004] However, the inventors have discovered that the existing technology has at least the following technical problems: when using a range hood to record recipes, it is difficult for users to control the recipe recording process. Summary of the Invention

[0005] This application provides a recipe generation method, apparatus, device, storage medium, and program product to solve the problem that users have difficulty controlling the recipe recording process.

[0006] In a first aspect, the present invention provides a recipe generation method, applied to a range hood, comprising:

[0007] When the stove is detected to be started, a first question about whether to record a recipe is projected at a preset position; the first user action performed by the user based on the first question is identified; if the first user action is the same as the first preset action, the preset cooking area is recorded to obtain a cooking recording video; the cooking recording video is edited to obtain a recipe.

[0008] In one possible implementation, when the stove is detected to be starting, a first query message regarding whether to record a recipe is projected at a preset position, including: when the stove sends a start-up message, the first query message regarding whether to record a recipe is projected at a preset position.

[0009] In one possible implementation, when the stove is detected to be started, a first query message regarding whether to record a recipe is projected at a preset position, including: continuously acquiring video information of the stove, and when flames are detected in the video information of the stove, projecting the first query message regarding whether to record a recipe at the preset position.

[0010] In one possible implementation, editing a cooking video to obtain a recipe includes: if it is determined that keyframes can be extracted from the cooking video, then extracting multiple keyframes from the cooking video according to preset features; dividing the cooking video into multiple short videos according to the keyframes; using the keyframes as the cover of the corresponding short videos, and sorting the multiple short videos to obtain the recipe.

[0011] In one possible implementation, keyframes are extracted from the cooking video based on preset features, including: extracting keyframes from the cooking video based on the heat of the stove; or, extracting keyframes from the cooking video based on the color of the dish.

[0012] In one possible implementation, keyframes are extracted from the cooking video based on the stove's heat output. This includes: determining the first frame of the cooking video as the calibration frame; acquiring the heat output data for all frames in the cooking video; subtracting the heat output data of each frame from the heat output data of the calibration frame to obtain the difference; identifying the first target frame whose difference is greater than a first preset value as a keyframe and designating the target frame as a new calibration frame; and repeating this process until the difference values ​​of all frames are compared with the first preset value to obtain all keyframes.

[0013] In one possible implementation, obtaining the heat intensity data of all frames in the cooking video recording includes: obtaining the infrared video corresponding to the cooking video recording; taking the number of pixels in each frame of the infrared video whose temperature exceeds a second preset value as the heat intensity data; and matching the heat intensity data with the cooking video recording to obtain the heat intensity data of all frames in the cooking video recording.

[0014] In one possible implementation, obtaining the firepower data of all frames in the cooking video recording includes: continuously acquiring the firepower data of the stove, matching the firepower data with all frames in the cooking video recording, and obtaining the firepower data of all frames in the cooking video recording.

[0015] In one possible implementation, keyframes are extracted from the cooking video based on the color of the dish, including: identifying the type of dish and continuously detecting the color of the dish; if the color of the dish in any frame of the cooking video is the same as any of a set of preset colors, then that frame is taken as a keyframe, wherein the preset colors correspond to the types of dishes.

[0016] In one possible implementation, editing a cooking video to obtain a recipe includes: if it is determined that keyframes cannot be extracted from the cooking video, then marking the cooking video as an unrecognizable video; projecting the unrecognizable video and receiving editing information from the user regarding the unrecognizable video; modifying the unrecognizable video according to the editing information to obtain the recipe.

[0017] In one possible implementation, if the first user action is the same as the first preset action, after recording the preset cooking area, the method further includes: obtaining a turn-off signal; projecting a second query message indicating whether to end recipe recording at a second preset position based on the turn-off signal; identifying the second user action performed by the user based on the second query message; if the second user action is the same as the second preset action, stopping recording to obtain a cooking recording video; if the second user action is the same as the third preset action, continuing recording.

[0018] In one possible implementation, after recording the preset cooking area if the first user action is the same as the first preset action, the method further includes: obtaining pause information input by the user, and pausing the recording of the preset cooking area according to the pause information.

[0019] In one possible implementation, after recognizing the first user action performed by the user based on the first query information, the method further includes: if the first user action is the same as the fourth preset action, then projecting a quick recording button at a preset position.

[0020] Secondly, this application provides a recipe preparation method applied to a stove, comprising: sending a start-up message to a range hood to cause the range hood to project a first query message regarding whether to record a recipe at a preset position; identifying a first user action performed by the user based on the first query message; if the first user action is the same as a first preset action; recording a preset cooking area to obtain a cooking recording video; and editing the cooking recording video to obtain a recipe.

[0021] Thirdly, this application provides a recipe generation device, comprising: a first projection module, used to project a first query message regarding whether to record a recipe at a preset position when the stove is detected to be started; a first recognition module, used to recognize a first user action performed by the user based on the first query message; a video recording module, used to record a preset cooking area to obtain a cooking recording video if the first user action is the same as a first preset action; and a video editing module, used to edit the cooking recording video to obtain a recipe.

[0022] Fourthly, this application provides a recipe generation device, comprising: an information sending module, configured to send start information to a range hood to cause the range hood to project a first query message regarding whether to record a recipe at a preset position, identify a first user action performed by the user based on the first query message, and if the first user action is the same as a first preset action, record a preset cooking area to obtain a cooking recording video, and edit the cooking recording video to obtain a recipe.

[0023] Fifthly, this application provides a range hood, including: a controller, and a camera and a projection device communicatively connected to the controller; the camera is used to acquire user actions and record video of the cooking area; the projection device is used to project a first query message indicating whether recording is required; and the controller is used to execute the recipe generation method as described in the first aspect.

[0024] Sixthly, this application provides a stove, including: a stove body, and a controller and a start module disposed within the stove body; the start module is used to generate start information based on a user's ignition operation; the controller is used to execute the recipe generation method as described in the second aspect.

[0025] In a seventh aspect, this application provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the recipe generation method as described in any of the foregoing aspects.

[0026] Eighthly, this application provides a computer program product including a computer program that, when executed by a processor, provides a recipe generation method as described in any of the foregoing aspects.

[0027] The recipe generation method, apparatus, equipment, storage medium, and program product provided in this application project a first query message regarding whether to record the recipe at a preset location when the stove is detected to be running. The system then identifies a first user action performed by the user based on the first query message. If the first user action matches a first preset action, it determines that the user agrees to record the video, thus enabling the user to actively control the start of the cooking video recording process. The system then records a preset cooking area to obtain a cooking video, which is finally edited to generate the recipe. This approach makes the recipe recording process easier for the user to control. Attached Figure Description

[0028] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0029] Figure 1 This is a schematic diagram illustrating an application scenario of the recipe generation method provided in the embodiments of this application;

[0030] Figure 2 A flowchart illustrating the recipe generation method provided in this application embodiment;

[0031] Figure 3 This is a schematic diagram of the first query information interface provided in an embodiment of this application;

[0032] Figure 4 This is a schematic diagram of the recipe interface provided in an embodiment of this application;

[0033] Figure 5 This is a schematic diagram of the pause recording interface provided in an embodiment of this application;

[0034] Figure 6 A schematic diagram of a recipe generation device provided in this application embodiment. Figure 1 ;

[0035] Figure 7 A schematic diagram of a recipe generation device provided in this application embodiment. Figure 2 ;

[0036] Figure 8 This is a schematic diagram of the structure of a range hood provided in an embodiment of this application;

[0037] Figure 9 This is a schematic diagram of the structure of a stove provided in an embodiment of this application. Detailed Implementation

[0038] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0039] As society becomes increasingly information-driven, more and more home appliances are becoming network-connected. They are no longer limited to providing traditional functions; they can also achieve new functions such as remote operation and timed operation via the internet. Range hoods, as a common home appliance, still have much room for exploration in terms of new functions. Currently, to add more enjoyment to cooking, some people like to film and share cooking videos, sharing the joy of life while also allowing others to learn cooking techniques.

[0040] To reduce the preparation steps for filming cooking videos, there are solutions that involve installing cameras on range hoods to record and edit the cooking process to generate recipes. However, this solution lacks control over the recording process, thus preventing users from taking control of the recipe creation process.

[0041] To address the aforementioned technical problems, the inventors proposed the following technical concept: The range hood monitors the status of the stove and projects a prompt box at a fixed location when the stove is started, asking whether recording should be started. If the user clicks the "Confirm Recording" button in the prompt box, the range hood will record the preset cooking area to obtain a cooking video. The cooking video can then be edited to obtain a recipe.

[0042] This application is applied to the scenario of generating recipes. The acquisition, storage, and application of user personal data involved in the technical solution of this application all comply with relevant laws and regulations and do not violate public order and good morals.

[0043] Figure 1 This is a schematic diagram illustrating an application scenario of the recipe generation method provided in this application embodiment. For example... Figure 1 The scene includes: a range hood 101 and a stove 102.

[0044] The range hood 101 can be composed of a main body, a controller, a camera, and a projection module. The camera and projection device can be configured as follows: Figure 1 The camera can be located in the same location or in different locations. It can include conventional cameras and infrared cameras. The camera can be installed on the range hood or outside the range hood.

[0045] The stove 102 can consist of a stove body and a controller. The controller can be a processor such as a CPU (central processing unit), or a control board, etc.

[0046] In the specific implementation process, the range hood 101 is used to detect the status of the stove. When the stove is started, it projects a first question about whether to record the recipe at a preset position, identifies the user's action based on the question, and if the user's action is the same as the preset action, it starts recording the preset personal area and edits the recorded video. The preset position can be... Figure 1 The position shown between the two burners can also be in other locations.

[0047] The stove 102 is used to generate start-up information based on the user's ignition operation and send the start-up information to the range hood 101.

[0048] The connection between the range hood 101 and the stove 102 can be either wired or wireless, and this application does not impose any special restrictions on this.

[0049] It is understood that the structure illustrated in the embodiments of this application does not constitute a specific limitation on the recipe generation method. In other feasible embodiments of this application, the above architecture may include more or fewer components than illustrated, or combine some components, or split some components, or arrange different components, which can be determined according to the actual application scenario and is not limited here. Figure 1 The components shown can be implemented in hardware, software, or a combination of both.

[0050] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0051] Figure 2 This is a flowchart illustrating the recipe generation method provided in an embodiment of this application. The execution entity of this embodiment may be... Figure 1 The range hood in the picture can also refer to the controller within the range hood. For example... Figure 2 As shown, the method includes:

[0052] S201: When the stove is detected to be starting, a first query message asking whether to record the recipe is projected at a preset position.

[0053] In this step, detecting that the stove has started can be achieved by detecting the presence of a flame on the burner, detecting that the stove knob has been turned on by the user, or detecting that the stove switch has been turned on by the user. The first query message can be a prompt box, drop-down menu, etc.

[0054] S202: Identify the first user action performed by the user based on the first query information.

[0055] In this step, the first user action can be the user action within a preset time after the first query information about whether to record the recipe is projected.

[0056] S203: If the first user action is the same as the first preset action, then the preset cooking area is recorded to obtain a cooking recording video.

[0057] In this step, the first preset action can be pre-set by the user, or it can be an operation such as clicking, long-pressing, or dragging the preset position of the projected first query information.

[0058] S204: Edit the recorded cooking video to obtain the recipe.

[0059] In this step, editing the cooking video can involve segmenting the video, naming the video, adding a cover, and adding stove-related data for each step of the cooking video.

[0060] The relevant data for the stove includes the stove's heat output and the duration of the heat output.

[0061] As described in the above embodiments, this application embodiment projects a first query message regarding whether to record a recipe at a preset position when the stove is detected to be running. It then identifies a first user action performed by the user based on the first query message. If the first user action is the same as a first preset action, it determines that the user agrees to record the video, thus enabling the user to actively control the start of recording the cooking video. The preset cooking area is then recorded to obtain a cooking video. Finally, the cooking video is edited to obtain a recipe, making it easier for the user to control the recipe recording process.

[0062] Figure 3 This is a schematic diagram of the first query information interface provided in an embodiment of this application. Figure 3 As shown, the first query information may include whether to enter recipe recording, and corresponding options. The range hood can recognize the user's click on the options and determine whether to start recording.

[0063] In one possible implementation, step S201 above, when the stove is detected to be starting, projects a first query message regarding whether to record the recipe at a preset position, including:

[0064] S201A: When the start-up information sent by the stove is received, the first query information on whether to record the recipe is projected at a preset position.

[0065] In this step, the start-up information can be a signal, and the preset position can be the center of the stove or other preset positions.

[0066] Among these, the other locations mentioned above can be outside the stove.

[0067] As can be seen from the description of the above embodiments, the embodiments of this application eliminate the need to identify the start-up process of the stove by directly projecting the query information when receiving the stove's start-up information. Since the projection method is more obvious, it also eliminates the need for the user to find the start recording button, reducing the user's operation steps. At the same time, using the projection method instead of using a touch panel or other direct touch control methods can avoid contaminating the surface of the range hood when touched.

[0068] In one possible implementation, step S201 above, when the stove is detected to be started, projects a first query message regarding whether to record the recipe at a preset position, including:

[0069] S201B: Continuously acquires video information from the stove. When flames are detected in the stove's video information, a first query message asking whether to record a recipe is projected at a preset position.

[0070] In this step, acquiring video information about the stove can be done by recording a video of the stove. Identifying the presence of flames in the stove's video information can be achieved if flames are not detected in any particular frame of the video, but are detected in the next frame or several frames later.

[0071] As can be seen from the description of the above embodiments, the embodiments of this application recognize the appearance of the stove flame and directly project the query information when the flame appears, eliminating the need for the user to search for the start recording button and making the recipe making process simpler.

[0072] In one possible implementation, step S204 above, which involves editing the recorded cooking video to obtain a recipe, specifically includes:

[0073] S2041: If it is determined that keyframes can be extracted from the cooking video, then extract multiple keyframes from the cooking video according to preset features.

[0074] In this step, determining whether keyframes can be extracted from the cooking video means that specific frames can be found in the cooking video as keyframes. Keyframes can represent some key steps in the cooking process.

[0075] S2042: Segment the cooking video recording into multiple short videos based on keyframes.

[0076] In this step, the cooking video is divided into multiple short videos based on keyframes. This can be done by combining all frames from any keyframe to the next keyframe or the last frame into a single short video, where the first frame of the cooking video can be considered a keyframe.

[0077] For example, if a total of three keyframes, including the first frame, can be extracted from the current video, then the video can be divided into three short videos.

[0078] S2043: Use keyframes as the cover of the corresponding short video, and sort multiple short videos to obtain the recipe.

[0079] In this step, the recipe consists of multiple short videos with covers. The recipe content can be displayed using the cover of the first short video, or more recipe details can be shown after clicking. All short video covers can be displayed simultaneously, or some covers can be displayed sequentially.

[0080] Figure 4 This is a schematic diagram of a recipe interface provided in an embodiment of this application. Figure 4 The left side shows a projected recipe illustration, and the right side shows the recipe details after clicking. The right frame contains the projected content. Each step in the recipe details is a short video, with the cover showing the corresponding keyframe. Users can drag or swipe to display more content.

[0081] As can be seen from the description of the above embodiments, the embodiments of this application extract multiple keyframes, divide the cooking recording video into multiple short videos, use the keyframes as the cover of the short videos, and then sort the short videos to obtain the recipe. Since the cover of each short video in the recipe is a keyframe, it can reflect the key steps in the cooking process, and the whole process is automatic, reducing the time for manual editing.

[0082] In one possible implementation, step S2041 above, which involves extracting keyframes from the cooking video recording based on preset features, specifically includes:

[0083] S2041A: Extracts keyframes from cooking video recordings based on stove heat levels. Alternatively,

[0084] In this step, the firepower of the stove can be obtained directly from the stove or by recognizing an image of the stove.

[0085] S2041B: Extract keyframes from cooking videos based on the color of the food.

[0086] In this step, the color of the vegetable can be either its RGB (red, green, blue) value in the image or its grayscale value.

[0087] As can be seen from the description of the above embodiments, the embodiments of this application achieve automatic acquisition of key frames by obtaining the firepower of the stove or analyzing the color of the dish, thereby reducing the time wasted due to manual key frame calibration.

[0088] In one possible implementation, step S2041A above, extracting keyframes from the cooking video based on the stove's heat level, specifically includes:

[0089] S2041A1: Determine the first frame of the cooking video as the calibration frame, obtain the heat intensity data of all frames in the cooking video, and subtract the heat intensity data of each frame from the heat intensity data of the calibration frame to obtain the difference.

[0090] In this step, the heat intensity data of all frames in the cooking video is obtained. This can be achieved by analyzing the flame size of all frames in the cooking video or the size of the area with a temperature exceeding a certain value in the infrared image, or by directly obtaining the heat intensity data from the stove.

[0091] S2041A2: The first target frame whose difference is greater than the first preset value is identified as a key frame, and the target frame is identified as a new calibration frame, until the difference corresponding to all frames is compared with the first preset value, and all key frames are obtained.

[0092] In this step, the difference can be obtained by subtracting the two values ​​and then taking their absolute values.

[0093] As described in the above embodiments, this application obtains all key frames in the cooking video by comparing the heat intensity data of each frame with that of the calibration frame. This also reduces the time required for manual operation.

[0094] In one possible implementation, step S2041A1 above, which involves obtaining the heat intensity data for all frames in the cooking video recording, specifically includes:

[0095] Obtain the infrared video corresponding to the cooking video recording. Take the number of pixels in each frame of the infrared video whose temperature exceeds the second preset value as the firepower data. Match the firepower data with the cooking video recording to obtain the firepower data of all frames in the cooking video recording.

[0096] The infrared video can be captured by an infrared camera. The number of pixels whose temperature exceeds a second preset value can also be represented by the percentage of pixels whose temperature exceeds the second preset value out of the total number of pixels.

[0097] As can be seen from the description of the above embodiments, the embodiments of this application obtain key frames by comparing the number of pixels in each frame whose temperature exceeds the second preset value, which can realize the firepower data by recognizing the image and avoid the tedious manual calibration of firepower data.

[0098] In one possible implementation, step S2041A1 above, which involves obtaining the heat intensity data for all frames in the cooking video recording, specifically includes:

[0099] Continuously acquire the stove's heat output data, match the heat output data with all frames in the cooking video recording, and obtain the heat output data for all frames in the cooking video recording.

[0100] In this step, the stove's firepower data can be obtained by receiving firepower data sent by the stove, or by detecting the status of the stove's knobs.

[0101] As can be seen from the description of the above embodiments, the embodiments of this application directly obtain the firepower data of the stove, eliminating the need for the analysis process of indirectly obtaining the firepower data and simplifying the steps of obtaining the firepower.

[0102] In one possible implementation, step S2041B above, extracting keyframes from the cooking video based on the color of the dish, includes:

[0103] S2041B1: Identify the type of vegetable and continuously detect its color.

[0104] In this step, identifying the type of vegetable can be done using a preset model, and detecting the color of the vegetable can be done by detecting its RGB or grayscale values.

[0105] S2041B2: If the color of the dish in any frame of a cooking video is the same as any of the preset colors, then that frame is taken as a keyframe, where the preset colors correspond to the types of dishes.

[0106] In this step, the preset colors can be multiple RGB values. Colors are the same if their RGB values ​​are the same.

[0107] As can be seen from the description of the above embodiments, the embodiments of this application determine key frames by comparing RGB values, so that key frames can be extracted using only common cameras, thereby reducing the manufacturing cost of range hoods.

[0108] In one possible implementation, step S204 above involves editing the recorded cooking video to obtain a recipe, specifically including:

[0109] S2041C1: If it is determined that keyframes cannot be extracted from a cooking video, then the cooking video will be marked as an unrecognizable video.

[0110] In this step, the inability to extract keyframes from the cooking video may be due to: the detected changes in stove heat intensity from the beginning to the end of the video not exceeding a preset threshold; the type of dish being unidentifiable; and / or the color or shape of the dish not being detected to exceed a preset threshold.

[0111] S2041C2: Projects unrecognizable video and receives user editing information for the unrecognizable video.

[0112] In this step, projecting an unrecognizable video can be done by using the first frame of the unrecognizable video as the cover, projecting the unrecognizable video with the cover, and the unrecognizable video can be accompanied by corresponding prompts.

[0113] The prompts may include messages such as "Video cannot be recognized," "Video steps cannot be recognized," or "Please divide the cooking steps." This application does not limit the specific content of the prompts. Editing information may include editing the video title or dividing the video content.

[0114] S2041C3: Modify unrecognizable videos based on editing information to obtain recipes.

[0115] In this step, if the editing information pertains to editing the video title, then the video title will be changed accordingly. If the editing information pertains to dividing the video content, then the cooking video will be divided into multiple short videos according to the editing information.

[0116] As can be seen from the description of the above embodiments, the embodiments of this application can edit unrecognizable cooking recording videos by receiving user editing information, reducing the possibility of a single long video being used as a recipe.

[0117] In one possible implementation, after recording the preset cooking area in step S203 above, if the first user action is the same as the first preset action, the method further includes:

[0118] S204A: Obtain the shutdown signal.

[0119] In this step, the shut-off signal can be obtained by detecting the flame level of the stove, or it can be obtained by receiving a shut-off signal sent by the stove.

[0120] S205A: Based on the turn-off signal, a second query message indicating whether the recipe recording has ended is projected at the second preset position.

[0121] In this step, the second preset position can be the same as or different from the first preset position.

[0122] S206A: Identify a second user action performed by the user based on the second query information.

[0123] In this step, the second query message can be a query asking whether to stop recording. This application does not limit the specific content of the query message.

[0124] S207A: If the second user action is the same as the second preset action, then stop recording and obtain the cooking recording video.

[0125] In this step, the second preset action can be clicking or long-pressing the query information, or any preset gesture or action, indicating that recording has stopped.

[0126] S208A: If the second user action is the same as the third preset action, then continue recording.

[0127] In this step, the third preset action can also be a click or long press on the query information, or any preset gesture or action, indicating that recording will not stop.

[0128] As can be seen from the description of the above embodiments, the embodiments of this application save users from having to search for the stop button by projecting the second query information after the stove is turned off. At the same time, since it can be touched only at a preset position, it avoids contamination of the range hood or other places by touching.

[0129] In one possible implementation, after recording the preset cooking area in step S203 above, if the first user action is the same as the first preset action, the method further includes:

[0130] S204B: Obtain pause information input by the user and pause recording of the preset cooking area according to the pause information.

[0131] In this step, obtaining the pause information input by the user can be achieved by projecting a pause button at a preset position after recording has started, recognizing the user's actions, and confirming that the pause information input by the user has been obtained if the user clicks or presses and holds the pause button.

[0132] As can be seen from the description of the above embodiments, the embodiments of this application realize the function of pausing recording when recording video in the cooking area by obtaining the pause information input by the user, which facilitates the reduction of subsequent editing and modification of the cooking recording video.

[0133] Figure 5 This is a schematic diagram of the pause recording interface provided in an embodiment of this application. Figure 5 As shown, after obtaining the first user action that is the same as the first preset action, the recording process can be displayed, as well as cancel and pause recording buttons. The cancel button is used to stop recording, and the pause button is used to pause recording.

[0134] In one possible implementation, after identifying the first user action performed by the user based on the first query information, the process further includes:

[0135] S204C: If the first user action is the same as the fourth preset action, then project the quick recording button at the preset position.

[0136] In this step, the fourth preset action indicates that recording is refused, and the quick record button is used to start recording.

[0137] As can be seen from the description of the above embodiments, the embodiments of this application realize the determination to refuse recording by recognizing that the first action and the fourth action are the same, and after refusing recording, a quick recording button will be projected so that the user can directly press the quick recording button when recording is needed, avoiding the trouble of having to turn off the engine and restart it.

[0138] In one possible implementation, after step S204 above, the user's sharing instruction can be obtained, and the recipe can be sent to the cloud or other terminals according to the sharing instruction.

[0139] The transmission method can be wired or wireless, such as via a local area network or mobile network.

[0140] As can be seen from the description of the above embodiments, the embodiments of this application can complete the sharing of recipes and achieve the effect of convenient recipe transmission.

[0141] In one possible implementation, before obtaining the cooking video in step S203, the method further includes: receiving a recording instruction sent by the user, and recording a preset cooking area according to the recording instruction.

[0142] The recording command can be received via the network.

[0143] As can be seen from the description of the above embodiments, the embodiments of this application can enable other users to remotely start recording when the user cooking does not know how to start recording.

[0144] This application also provides a recipe generation method applied to a stove, comprising: sending a start-up message to a range hood to cause the range hood to project a first query message on whether to record a recipe at a preset position; identifying a first user action performed by the user based on the first query message; if the first user action is the same as a first preset action; recording a preset cooking area to obtain a cooking recording video; and editing the cooking recording video to obtain a recipe.

[0145] Figure 6 A schematic diagram of a recipe generation device provided in this application embodiment. Figure 1 .like Figure 6 As shown, the recipe generation device 600 includes: a first projection module 601, a first recognition module 602, a video recording module 603, and a video editing module 604.

[0146] The first projection module 601 is used to project a first query message on whether to record the recipe at a preset position when the stove is detected to be started.

[0147] The first identification module 602 is used to identify the first user action performed by the user based on the first query information;

[0148] The video recording module 603 is used to record a preset cooking area to obtain a cooking recording video if the first user's action is the same as the first preset action.

[0149] The video editing module 604 is used to edit cooking videos to obtain recipes.

[0150] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0151] In one possible implementation, the first projection module 601 is specifically used to project a first query message regarding whether to record a recipe at a preset position when it receives the start-up information sent by the stove.

[0152] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0153] In one possible implementation, the first projection module 601 is specifically used to continuously acquire video information of the stove. When it is detected that there is a flame in the video information of the stove, it projects a first query message on whether to record the recipe at a preset position.

[0154] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0155] In one possible implementation, the video editing module 604 is specifically used to extract multiple keyframes from the cooking video based on preset features if it is determined that keyframes can be extracted from the cooking video. The cooking video is then segmented into multiple short videos based on the keyframes. Each short video is used as a cover image for a given keyframe, and the multiple short videos are sorted to obtain the recipe.

[0156] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0157] In one possible implementation, the video editing module 604 is specifically used to extract keyframes from the cooking video based on the heat of the stove, or based on the color of the dish.

[0158] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0159] In one possible implementation, the video editing module 604 is specifically used to determine the first frame of the cooking video recording as the calibration frame, acquire the heat intensity data of all frames in the cooking video recording, and subtract the heat intensity data of each frame from the heat intensity data of the calibration frame to obtain the difference. The first target frame whose difference is greater than a first preset value is identified as a key frame, and the target frame is identified as the new calibration frame, until the difference values ​​of all frames are compared with the first preset value, thus obtaining all key frames.

[0160] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0161] In one possible implementation, the video editing module 604 is specifically used to acquire the infrared video corresponding to the cooking recording video, take the number of pixels in each frame of the infrared video whose temperature exceeds a second preset value as the firepower data, match the firepower data with the cooking recording video, and obtain the firepower data of all frames in the cooking recording video.

[0162] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0163] In one possible implementation, the video editing module 604 is specifically used to continuously acquire the firepower data of the stove, match the firepower data with all frames in the cooking recording video, and obtain the firepower data of all frames in the cooking recording video.

[0164] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0165] In one possible implementation, the video editing module 604 is specifically used to identify the type of dish and continuously detect its color. If the color of the dish in any frame of the cooking video recording is the same as any of a set of preset colors, then that frame is taken as a keyframe, where the preset colors correspond to the types of dishes.

[0166] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0167] In one possible implementation, the video editing module 604 is specifically used to mark the cooking recording video as unrecognizable if it is determined that no keyframes can be extracted from it. The unrecognizable video is projected, and the user's editing information for the unrecognizable video is received. The unrecognizable video is modified according to the editing information to obtain the recipe.

[0168] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0169] In one possible implementation, the recipe generation device 600 further includes a second recognition module 605.

[0170] The second recognition module 605 is used to acquire a turn-off signal. Based on the turn-off signal, it projects a second query message indicating whether recipe recording has ended at a second preset position. It then recognizes a second user action performed by the user based on the second query message. If the second user action is the same as a second preset action, recording stops, and a cooking video is obtained. If the second user action is the same as a third preset action, recording continues.

[0171] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0172] In one possible implementation, the recipe generation device 600 further includes a pause recording module 606.

[0173] The pause recording module 606 is used to obtain pause information input by the user and pause recording of the preset cooking area according to the pause information.

[0174] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0175] In one possible implementation, the recipe generation device 600 further includes a second projection module 607.

[0176] The second projection module 607 is used to project a quick recording button at a preset position if the first user action is the same as the fourth preset action.

[0177] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0178] Figure 7 A schematic diagram of a recipe generation device provided in this application embodiment. Figure 2 .like Figure 7 As shown, the recipe generation device 700 includes: an information sending module 701.

[0179] The information sending module 701 is used to send start information to the range hood so that the range hood projects a first query message on whether to record a recipe at a preset position, identifies the first user action performed by the user based on the first query message, and if the first user action is the same as the first preset action, then the preset cooking area is recorded to obtain a cooking recording video, and the cooking recording video is edited to obtain a recipe.

[0180] Figure 8 This is a schematic diagram of a range hood structure provided in an embodiment of this application. Figure 8As shown, the range hood 800 includes: a controller 801, and a camera 802 and a projection device 803 that are communicatively connected to the controller 801.

[0181] Camera 802 is used to capture user actions and record video of the cooking area.

[0182] Projection device 803 is used to project a first query message regarding whether recording is required.

[0183] Controller 804 is configured to perform a recipe generation method as described in any of the above embodiments applied to a range hood.

[0184] Figure 9 This is a schematic diagram of a stove provided as an embodiment of this application. Figure 9 As shown, the stove includes: a stove body 900, a controller 901 and a start module 902 disposed within the stove body 900.

[0185] The startup module 902 is used to generate startup information based on the user's ignition operation;

[0186] The controller 901 is used to execute the recipe generation method as described in the above embodiment applied to the stove.

[0187] This application also provides a computer-readable storage medium storing computer-executable instructions. When a processor executes the computer-executable instructions, it implements the technical solution of the recipe generation method in any of the above embodiments. Its implementation principle and beneficial effects are similar to those of the recipe generation method, and can be found in the implementation principle and beneficial effects of the recipe generation method, which will not be repeated here.

[0188] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the technical solution of the recipe generation method in any of the above embodiments. Its implementation principle and beneficial effects are similar to those of the recipe generation method, and can be found in the implementation principle and beneficial effects of the recipe generation method, which will not be repeated here.

[0189] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or modules may be electrical, mechanical, or other forms.

[0190] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to implement the solution of this embodiment according to actual needs.

[0191] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing unit, or each module can exist physically separately, or two or more modules can be integrated into one unit. The unit composed of the above modules can be implemented in hardware or in the form of hardware plus software functional units.

[0192] The integrated modules described above, implemented as software functional modules, can be stored in a computer-readable storage medium. These software functional modules, stored in a storage medium, include several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute some steps of the methods of the various embodiments of this application.

[0193] It should be understood that the aforementioned processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly manifested as being executed by a hardware processor, or executed by a combination of hardware and software modules within the processor.

[0194] The memory may include high-speed RAM, and may also include non-volatile storage (NVM), such as at least one disk storage device, and may also be a USB flash drive, external hard drive, read-only memory, disk or optical disc, etc.

[0195] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0196] The aforementioned storage medium can be implemented from any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The storage medium can be any available medium accessible to general-purpose or special-purpose computers.

[0197] An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Alternatively, the storage medium can be an integral part of the processor. Both the processor and the storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and storage medium can exist as discrete components in an electronic device or host device.

[0198] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0199] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0200] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A recipe generation method, characterized in that, Applications include: [List of applications] When the stove is detected to be starting, a first question about whether to record the recipe is projected at a preset position; Identify the first user action performed by the user based on the first query information; If the first user action is the same as the first preset action, then the preset cooking area is recorded to obtain a cooking recording video; Edit cooking videos to create recipes; The process of editing the recorded cooking video to obtain a recipe includes: If it is determined that keyframes can be extracted from the cooking video, then multiple keyframes are extracted from the cooking video according to preset features; the cooking video is divided into multiple short videos according to the keyframes; the keyframes are used as the cover of the corresponding short videos, and the multiple short videos are sorted to obtain the recipe; The step of extracting keyframes from a cooking video based on preset features includes: Extract keyframes from the cooking video recording based on the stove's heat level; or, Keyframes are extracted from the cooking video based on the color of the dish.

2. The method according to claim 1, characterized in that, When the stove is detected to be started, the first query message regarding whether to record the recipe is projected at a preset position, including: When the start-up message sent by the stove is received, the first question about whether to record the recipe is projected at a preset position.

3. The method according to claim 1, characterized in that, When the stove is detected to be started, the first query message regarding whether to record the recipe is projected at a preset position, including: The system continuously acquires video information from the stove. When flames are detected in the video information of the stove, a first query message asking whether to record a recipe is projected at a preset position.

4. The method according to claim 1, characterized in that, Extracting keyframes from the cooking video recording based on the stove's heat output includes: The first frame of the cooking video is determined as the calibration frame. The heat intensity data of all frames in the cooking video are obtained. The heat intensity data of each frame is subtracted from the heat intensity data of the calibration frame to obtain the difference. The first target frame whose difference is greater than the first preset value is identified as a key frame, and the target frame is identified as a new calibration frame, until the difference corresponding to all frames is compared with the first preset value, and all key frames are obtained.

5. The method according to claim 4, characterized in that, The step of obtaining the heat intensity data for all frames in the cooking video recording includes: Obtain the infrared video corresponding to the cooking video recording, take the number of pixels in each frame of the infrared video whose temperature exceeds a second preset value as the firepower data, match the firepower data with the cooking video recording, and obtain the firepower data of all frames in the cooking video recording.

6. The method according to claim 4, characterized in that, The step of obtaining the heat intensity data for all frames in the cooking video recording includes: The firepower data of the stove is continuously acquired, and the firepower data is matched with all frames in the cooking video recording to obtain the firepower data of all frames in the cooking video recording.

7. The method according to claim 1, characterized in that, Extracting keyframes from the cooking video based on the color of the dish includes: Identify the type of vegetable and continuously detect its color; If, in any frame of the cooking video recording, the color of the dish is the same as any one of a set of preset colors, then that frame is taken as the key frame, wherein the set of preset colors corresponds to the type of dish.

8. The method according to any one of claims 1 to 7, characterized in that, The process of editing the recorded cooking video to obtain a recipe includes: If it is determined that no keyframes can be extracted from the cooking video, then the cooking video will be marked as an unrecognizable video. Project the unrecognizable video and receive the user's editing information for the unrecognizable video; The unrecognizable video is modified based on the editing information to obtain the recipe.

9. The method according to any one of claims 1 to 7, characterized in that, If the first user action is the same as the first preset action, then after recording the preset cooking area, the method further includes: Receive the shutdown signal; Based on the turn-off signal, a second query message indicating whether the recipe recording has ended is projected at a second preset position; Identify the second user action performed by the user based on the second query information; If the second user action is the same as the second preset action, then recording stops and a cooking video is obtained; If the second user action is the same as the third preset action, then recording continues.

10. The method according to any one of claims 1 to 7, characterized in that, After recording the preset cooking area if the first user action is the same as the first preset action, the method further includes: Obtain pause information input by the user, and pause recording of the preset cooking area according to the pause information.

11. The method according to any one of claims 1 to 7, characterized in that, After identifying the first user action performed by the user based on the first query information, the method further includes: If the first user action is the same as the fourth preset action, then a quick recording button is projected at the preset position.

12. A method for generating recipes, characterized in that, Applied to stoves, including: A start-up message is sent to the range hood so that the range hood projects a first query message asking whether to record a recipe at a preset position. The user's first action is identified based on the first query message. If the first user action is the same as the first preset action, the preset cooking area is recorded to obtain a cooking recording video. The cooking recording video is then edited to obtain a recipe. The process of editing the recorded cooking video to obtain a recipe includes: If it is determined that keyframes can be extracted from the cooking video, then multiple keyframes are extracted from the cooking video according to preset features; the cooking video is divided into multiple short videos according to the keyframes; the keyframes are used as the cover of the corresponding short videos, and the multiple short videos are sorted to obtain the recipe; The step of extracting keyframes from a cooking video based on preset features includes: Extract keyframes from the cooking video recording based on the stove's heat level; or, Keyframes are extracted from the cooking video based on the color of the dish.

13. A recipe generation device, characterized in that, Applications include: [List of applications] The first projection module is used to project a first query message on whether to record the recipe at a preset position when the stove is detected to be started. The first identification module is used to identify the first user action performed by the user based on the first query information; The video recording module is used to record a preset cooking area to obtain a cooking recording video if the first user's action is the same as the first preset action. The video editing module is used to edit recorded cooking videos to create recipes; The video editing module is specifically used to extract multiple keyframes from the cooking video based on preset features if it is determined that keyframes can be extracted from the cooking video; to divide the cooking video into multiple short videos based on the keyframes; to use the keyframes as the cover of the corresponding short videos; and to sort the multiple short videos to obtain a recipe. When extracting multiple keyframes from a cooking video based on preset features, the video editing module is specifically used to extract keyframes from the cooking video based on the stove's heat level; or, based on the color of the dish.

14. A recipe generation device, characterized in that, Applied to stoves, including: The information sending module is used to send start information to the range hood so that the range hood projects a first question message about whether to record a recipe at a preset position, identifies a first user action performed by the user based on the first question message, and if the first user action is the same as the first preset action, then the preset cooking area is recorded to obtain a cooking recording video, and the cooking recording video is edited to obtain a recipe. The process of editing the recorded cooking video to obtain a recipe includes: If it is determined that keyframes can be extracted from the cooking video, then multiple keyframes are extracted from the cooking video according to preset features; the cooking video is divided into multiple short videos according to the keyframes; the keyframes are used as the cover of the corresponding short videos, and the multiple short videos are sorted to obtain the recipe; The step of extracting keyframes from a cooking video based on preset features includes: Extract keyframes from the cooking video recording based on the stove's heat level; or, Keyframes are extracted from the cooking video based on the color of the dish.

15. A range hood, characterized in that, include: A controller, and a camera and a projection device communicatively connected to the controller; The camera is used to capture user actions and record video of the cooking area; The projection device is used to project a first query message regarding whether recording has been made. The controller is configured to perform the recipe generation method as described in any one of claims 1 to 11.

16. A stove, characterized in that, include: The stove body, and the controller and start-up module disposed within the stove body; The startup module is used to generate startup information based on the user's ignition operation; The controller is used to execute the recipe generation method as described in claim 12.

17. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the recipe generation method as described in any one of claims 1 to 11 or claim 12.

18. A computer program product, characterized in that, It includes a computer program that, when executed by a processor, implements the recipe generation method as described in any one of claims 1 to 11 or claim 12.

Images