Multi-connected screen control method, device and equipment and computer readable medium

Abstract

The invention relates to a multi-connected-screen control method, device and equipment and a computer readable medium. The method comprises the following steps: acquiring cooking information displayed on first display equipment when a target object operates first cooking equipment, wherein the first display equipment is bound with the first cooking equipment; when it is detected that the target object is converted from operating the first cooking device to operating the second cooking device, determining a second display device bound with the second cooking device; and migrating the cooking information from the first display device to the second display device for display. The display resources of the multi-connected screen are dynamically allocated based on the change of the user operation equipment, the user does not need to manually switch the screen or check the cooking information back and forth, the cooking information is automatically synchronized to the display equipment bound with the current operation equipment along with the change of the user operation equipment, the interaction continuity is kept, and the user experience is improved. The interaction efficiency between the display device in the kitchen and the user is greatly improved, and the technical problem that the interaction efficiency between the display device in the kitchen and the user is extremely low is solved.

Description

Technical Field

[0001] This application relates to the field of smart home technology, and in particular to a multi-screen control method, device, equipment, and computer-readable medium. Background Technology

[0002] In a kitchen setting, users often need to move between multiple areas (such as the sink, cutting board, stove, oven, and refrigerator). For example, when preparing food according to a recipe, the necessary ingredients need to be retrieved from the refrigerator, washed at the sink, cut into the required shape at the cutting board, and finally cooked using the stove, oven, and other cooking equipment following the recipe's instructions. If the recipe is displayed on a phone or refrigerator screen, users who forget the recipe while working in multiple areas will need to move to the phone or refrigerator to check it, then return to each area to continue. Clearly, the interaction efficiency between display devices and users in the kitchen is extremely low, severely impacting the user experience.

[0003] There is currently no effective solution to the problem of extremely low interaction efficiency between display devices and users in the kitchen. Summary of the Invention

[0004] This application provides a multi-screen control method, apparatus, device, and computer-readable medium to solve the technical problem of extremely low interaction efficiency between display devices and users in the kitchen.

[0005] According to one aspect of the embodiments of this application, this application provides a multi-screen control method, including: acquiring cooking information displayed on a first display device when a target object operates a first cooking device, wherein the first display device is bound to the first cooking device; determining a second display device bound to the second cooking device when it is detected that the target object changes from operating the first cooking device to operating a second cooking device; and migrating the cooking information from the first display device to the second display device for display.

[0006] Optionally, transferring cooking information from the first display device to the second display device includes: acquiring behavioral data of the target object operating the second cooking device; identifying target cooking information that matches both the second cooking device and the behavioral data; and jumping to display the target cooking information when transferring cooking information from the first display device to the second display device.

[0007] Optionally, migrating cooking information from the first display device to the second display device for display further includes: waking up the second display device in low-power mode; migrating the cooking information from the first display device to the second display device; and, after the migration is complete, switching the first display device to operate in low-power mode.

[0008] Optionally, the method further includes determining the second display device in the following manner: when the target object is detected to be moving, obtaining the target position coordinates of the target object in the kitchen; calculating the distance from the target position coordinates to each display device; determining the display device with the shortest distance to the target position coordinates as a candidate display device; and determining the candidate display device as the second display device when the distance between the first display device and the candidate display device reaches a preset distance threshold.

[0009] Optionally, before migrating cooking information from the first display device to the second display device for display, the method further includes pairing and networking multiple display devices in the following manner: identifying a pairing request from a display device; generating a temporary key pair and broadcasting the public key in the temporary key pair via Bluetooth in response to the pairing request; upon receiving encrypted information returned by the display device, decrypting the encrypted information using the private key in the temporary key pair, wherein the encrypted information is obtained by encrypting a preset certificate signature using the public key of the display device; upon obtaining the preset certificate signature of the display device through decryption, opening the Bluetooth access port to the display device so that the display device can access the encrypted communication link via Bluetooth to complete the pairing; and sending networking information to the display device via the encrypted communication link so that the display device can access the MESH network via the networking information.

[0010] Optionally, identifying the pairing request of the display device includes: capturing a kitchen scene; if a dynamic light code displayed by the display device is detected in the kitchen scene, identifying the light encoding mode of the dynamic light code; if the light encoding mode is consistent with a preset mode, determining that a pairing request of the display device has been received; or, if an ultrasonic positioning signal is detected, performing sound source localization on the ultrasonic positioning signal and driving the camera to turn towards the sound source direction; if the sound source direction is determined to be the display device, determining that a pairing request of the display device has been received.

[0011] Optionally, after the display device accesses the MESH network via networking information, the method further includes binding the display device to cooking equipment in the kitchen in the following manner: constructing an environmental map of the kitchen, and establishing a three-dimensional coordinate system of the kitchen with the camera as the origin in the environmental map; acquiring first depth information of the display device and second depth information of each cooking device through the camera; calculating the first spatial coordinates of the display device in the environmental map based on the first depth information, and calculating the second spatial coordinates of each cooking device in the environmental map based on the second depth information; calculating the distance between the first spatial coordinates and each second spatial coordinate; binding the target cooking device corresponding to the second spatial coordinate with the shortest distance to the first spatial coordinate to the display device.

[0012] According to another aspect of the embodiments of this application, this application provides a multi-screen control device, including: a migration content acquisition module, used to acquire cooking information displayed on a first display device when a target object operates a first cooking device, wherein the first display device is bound to the first cooking device; a migration target determination module, used to determine a second display device bound to the second cooking device when it is detected that the target object changes from operating the first cooking device to operating a second cooking device; and a migration control module, used to migrate the cooking information from the first display device to the second display device for display.

[0013] According to another aspect of the embodiments of this application, this application provides an electronic device, including a memory, a processor, a communication interface and a communication bus. The memory stores a computer program that can run on the processor. The memory and the processor communicate with each other through the communication bus and the communication interface. When the processor executes the computer program, it implements the steps of the above method.

[0014] According to another aspect of the embodiments of this application, this application also provides a computer-readable medium having processor-executable non-volatile program code that causes the processor to perform the above-described method.

[0015] Compared with related technologies, the technical solutions provided in this application have the following advantages:

[0016] This application provides a multi-screen control method, comprising: acquiring cooking information displayed on a first display device when a target object operates a first cooking device, wherein the first display device is bound to the first cooking device; determining a second display device bound to the second cooking device when it is detected that the target object changes from operating the first cooking device to operating a second cooking device; and migrating the cooking information from the first display device to the second display device for display. This application dynamically allocates display resources for multiple screens based on changes in the user's operating device. Users do not need to manually switch screens or repeatedly check cooking information; the cooking information is automatically synchronized to the display device bound to the currently operating device as the user's operating device changes, maintaining the continuity of interaction and greatly improving the interaction efficiency between display devices and users in the kitchen, thus solving the technical problem of extremely low interaction efficiency between display devices and users in the kitchen. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0018] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, those skilled in the art can obtain other drawings based on these drawings without creative effort.

[0019] Figure 1 This is a schematic diagram of an optional kitchen space according to an embodiment of this application;

[0020] Figure 2 This is a schematic flowchart of an optional multi-screen control method according to an embodiment of this application;

[0021] Figure 3 This is a schematic diagram illustrating spatial coordinate calculation in a three-dimensional coordinate system according to an embodiment of this application;

[0022] Figure 4 This is a schematic diagram illustrating an optional method for calculating a user's three-dimensional coordinates in a kitchen based on dual cameras, according to an embodiment of this application.

[0023] Figure 5 This is a block diagram of an optional multi-screen control device according to an embodiment of this application;

[0024] Figure 6 This is a schematic diagram of an optional electronic device structure provided in an embodiment of this application. Detailed Implementation

[0025] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0026] In the following description, the use of suffixes such as "module," "part," or "unit" to denote elements is solely for the purpose of illustration and has no specific meaning in itself. Therefore, "module" and "part" may be used interchangeably.

[0027] To address the problems mentioned in the background art, according to one aspect of the embodiments of this application, an embodiment of a multi-screen control method is provided.

[0028] Optionally, in this embodiment, the multi-screen control method described above can be applied to kitchen cooking scenarios, as well as other scenarios involving the coordinated control of smart home devices. Taking a kitchen cooking scenario as an example, such as... Figure 1 As shown, multiple screens can be installed in different locations in the kitchen. Each screen is paired with the nearest cooking appliance based on its distance from the cooking appliance, and one screen can be paired with one or more cooking appliances. Multiple screens can be paired and networked with devices such as refrigerators, air conditioners, range hoods, and mobile phones to form a multi-screen system. The refrigerator, air conditioner, range hood, and mobile phone act as the central control device, and their screens serve as the main screens. This multi-screen control method can be executed by the central control device. Figure 2 As shown, the method may include the following steps:

[0029] Step S202: Obtain cooking information displayed on a first display device when the target object operates the first cooking device, wherein the first display device is bound to the first cooking device;

[0030] Step S204: If it is detected that the target object changes from operating the first cooking device to operating the second cooking device, determine the second display device bound to the second cooking device;

[0031] Step S206: Transfer the cooking information from the first display device to the second display device for display.

[0032] In this embodiment, the target object refers to a user performing cooking operations in the kitchen, such as a housewife or chef. The first cooking device is the kitchen cooking-related equipment initially operated by the user, such as a cutting board, stove, or oven. The first display device is a screen attached to the first cooking device, such as a screen installed above the cutting board, used to display information corresponding to the operation of that device. Cooking information can be information related to the cooking process, including recipe steps, ingredient list, timer, heat control instructions, and the operating status of the cooking equipment. The second cooking device is another cooking device operated by the user after moving from the first cooking device, such as moving from the cutting board to the stove. The second display device is a screen attached to the second cooking device, such as a screen next to the stove.

[0033] In this embodiment, the system acquires cooking information displayed on a first display device bound to the target object in real time when the target object operates the first cooking device, via a camera, sensors, or user input. For example, when the user operates on the cutting board (i.e., the first cooking device), screen 1 (i.e., the first display device) next to the cutting board displays the recipe step of "dicing potatoes, 1cm×1cm". The refrigerator's wide-angle camera or TOF rangefinder collects the user's position and movement data in real time, and identifies changes in the user's operating object through AI algorithms. For example, when the user moves from the cutting board to the stove and starts stir-frying, the system determines that the operating device changes from "cutting board" to "stove". Based on the preset binding relationship, the system determines screen 2 (i.e., the second display device) corresponding to the stove (i.e., the second cooking device). The system migrates the cooking information on screen 1 to screen 2 via a wireless protocol and controls screen 2 to display the information. In this way, wherever the user goes and which device they operate, the cooking information will be displayed on the display device bound to that device, eliminating the need for the user to operate their mobile phone while busy or to switch back and forth between a fixed screen to check the cooking information.

[0034] In this embodiment, the system transfers cooking information from screen 1 to screen 2 via a wireless protocol. This can be achieved by the refrigerator sending a transfer command carrying the device identifier of screen 2 to screen 1, screen 1 transmitting the current video stream to screen 2 via the RTSP protocol, and the refrigerator simultaneously sending control commands to screen 2 to indicate playback progress, volume, and other control information. Screen 2 then continues to play the video stream according to the control commands.

[0035] In this embodiment of the application, the system also maintains the continuity of touch operation through an event forwarding mechanism, so that touch operation commands such as clicks and swipes are taken over by the new screen. For example, a recipe page that the user swipes on screen 1 can be swiped on screen 2 after migration.

[0036] Through steps S202 to S206, this application dynamically allocates display resources for multiple screens based on changes in the user's operating device. Users do not need to manually switch screens or travel back and forth to view cooking information. The cooking information is automatically synchronized to the display device bound to the current operating device as the user's operating device changes, maintaining the continuity of interaction and greatly improving the interaction efficiency between the display device and the user in the kitchen. This solves the technical problem of extremely low interaction efficiency between the display device and the user in the kitchen.

[0037] In an optional embodiment, transferring cooking information from the first display device to the second display device for display includes:

[0038] Step 1: Obtain behavioral data of the target object operating the second cooking device;

[0039] Step 2: Identify the target cooking information that matches both the second cooking device and the behavioral data from the cooking information.

[0040] Step 3: When transferring cooking information from the first display device to the second display device, jump to display the target cooking information.

[0041] In this embodiment of the application, behavioral data refers to the specific actions or states of the user when operating the second cooking device, such as picking up a knife, turning on the microwave oven, stir-frying, adjusting the heat, checking the oven temperature, etc., which are identified by body movements collected by the camera or data collected by the device's sensors.

[0042] In this embodiment, the system collects user operation behavior through a refrigerator camera or a sensor of the second cooking device. For example, when the user operates on the stove, the camera recognizes the user's action of "turning the heat knob" and determines the behavior data as "adjusting the heat". The system performs structured processing on the cooking information, such as breaking down the recipe into steps like cutting, stir-frying, and baking. Combining the type of the second cooking device and the behavior data, the system matches the corresponding content in the original cooking information. For example, if the original recipe includes "cutting steps" and "heat control" steps, when the user is cutting vegetables on the cutting board, screen 1 displays the content of the "cutting steps". However, when the user moves to the stove and turns the heat knob, the system determines that "heat control" is the target cooking information. Therefore, when the recipe moves from screen 1 to screen 2, the system automatically jumps to display the content of the "heat control" step instead of continuing to display the content of the "cutting steps".

[0043] This application combines cooking equipment type and user behavior data to enable contextualized navigation of cooking information, avoiding the display of irrelevant information and allowing users to directly access the content they need on the current operating device, thereby further improving the accuracy of information viewing and operational efficiency.

[0044] In an optional embodiment, transferring the cooking information from the first display device to the second display device for display further includes:

[0045] Step 1: Wake up the second display device, which is in low-power mode;

[0046] Step 2: Transfer the cooking information from the first display device to the second display device;

[0047] Step 3: Once the migration is complete, switch the first display device to low-power mode.

[0048] In this embodiment, the low-power mode can be a state in which the display device turns off the backlight, reduces the CPU frequency, and only maintains the wireless connection to reduce energy consumption.

[0049] In this embodiment, when the system detects that a user is about to operate the second cooking device, it sends a wake-up command to the second display device, which is in low-power mode. For example, screen 2 next to the stove is normally in low-power mode and is in a black screen state. When the user moves to the stove, screen 2 is woken up and lit, and the CPU resumes its normal operating frequency. After the second display device is woken up, the system transmits the cooking information from the first display device to the second display device via the RTSP protocol and displays it. For example, the recipe information on screen 1 is transmitted to screen 2 to ensure complete synchronization of content. After the migration is completed, the system sends a low-power command to the first display device to turn off its backlight and reduce its operating frequency. For example, after the user leaves the cutting board, screen 1 enters low-power mode, maintaining only the wireless connection with the refrigerator.

[0050] This application can also dynamically adjust the screen refresh rate and CPU frequency based on the type of content being migrated. For example, for video streams, the refresh rate can be set to 60Hz to ensure smooth dynamic visuals, and the CPU frequency can be set to 1.8GHz to meet video decoding requirements. For structured text or static images, a refresh rate of 30Hz and a CPU frequency of 0.8GHz can meet the basic rendering requirements of static content. For cooking information containing touch-interactive controls such as draggable progress bars and clickable options, the refresh rate can be maintained at 45Hz to balance touch response speed and power consumption, and the CPU frequency can be set to 1.2GHz to meet the real-time interactive command processing requirements. If the migrated cooking information contains multiple types, such as a recipe combining video and text, the parameters can be dynamically switched according to the dominant content currently displayed. For example, when a video clip is playing, the refresh rate is automatically switched to 60Hz and the CPU frequency is 1.8GHz. When the video is paused or text descriptions are displayed, the refresh rate is immediately reduced to 30Hz and the CPU frequency is 0.8GHz. When the user clicks on an interactive control, the refresh rate is temporarily increased to 45Hz and the CPU frequency is 1.2GHz. After the operation is completed, the parameters return to the default parameters of the corresponding type.

[0051] This application significantly reduces the total energy consumption of multi-screen systems by dynamically switching the power consumption mode of the display device, activating the corresponding screen only when needed by the user, and turning off unnecessary energy consumption of inactive screens, thus solving the problem of resource waste caused by the simultaneous operation of multiple screens in traditional systems.

[0052] In an optional embodiment, the method further includes determining a second display device in the following manner:

[0053] Step 1: If the target object is detected to have moved, obtain the target position coordinates of the target object in the kitchen.

[0054] Step 2: Calculate the distance from the target location coordinates to each display device;

[0055] Step 3: Identify the display device with the shortest distance to the target location coordinates as the candidate display device;

[0056] Step 4: If the distance between the first display device and the candidate display device reaches a preset distance threshold, the candidate display device is determined as the second display device.

[0057] In this embodiment, the refrigerator camera can capture images of the kitchen at preset intervals. A human body recognition algorithm extracts the user's limb bounding box, calculates the pixel coordinates of the bounding box center, and combines this with depth data from a TOF sensor to convert it into three-dimensional spatial coordinates, thus obtaining the user's target location coordinates. The depth data may include the measured distance from the user to the camera, combined with the camera's horizontal and vertical deflection angles, such as... Figure 3 As shown, the spatial coordinates of point P can be calculated in a three-dimensional coordinate system using the following formula:

[0058] X = d*sinθ*cosφ;

[0059] Y = d*sinθ*sinφ;

[0060] Z = d * cosθ;

[0061] Where d is the measured distance from the user to the camera, θ is the vertical deflection angle of the camera, and φ is the horizontal deflection angle of the camera.

[0062] This application also provides a method for calculating a user's three-dimensional coordinates in a kitchen based on dual cameras. For example... Figure 4 As shown, the distance between the two cameras a and b is Δd, and the focal length of both cameras a and b is d. Let the camera lens plane be X, and the plane perpendicular to the camera lens plane be Z. To model the person, let the person's center of gravity be P. The image points of the person's center of gravity on the film of cameras a and b through the lenses of cameras a and b are Pa and Pb, respectively. Given that the center points of cameras a and b are Oa and Ob, respectively, establish two-dimensional coordinate systems with Oa and Ob as origins. Since the "film" of a camera consists of millions of independent photodiodes arranged in a regular pattern, with each pixel unit containing a photosensitive area and circuit structure, it is only necessary to arrange these pixel units in an array, maintaining equal spacing between the pixel arrays, and setting the spacing between the arrays to u. By obtaining the array information of the imaging points Pa and Pb at the pixel positions on the film, the coordinates of Pa in a two-dimensional coordinate system with Oa as the origin can be calculated, as can the coordinates of Pb in a two-dimensional coordinate system with Ob as the origin. Then, the vertical deflection angle θ and the horizontal deflection angle φ of camera a towards the center of mass of the person can be calculated, as well as the vertical deflection angle θ`` and the horizontal deflection angle φ`` of camera b towards the center of mass of the person. When camera a and camera b are located on the same vertical line, φ`` = φ.

[0063] Taking camera a as an example, if the origin is set to row 0 and column 0, the array information of pixel Pa is obtained as (n, m), which means that pixel Pa is in the nth row and mth column of the pixel array. Then, the coordinates of Pa in the two-dimensional coordinate system with Oa as the origin can be calculated as (n*u, m*u).

[0064] Given:

[0065] tanφ = opposite side / adjacent side = |d / (n*u)|;

[0066] Then φ = arctan|d / (n*u)|;

[0067] Given:

[0068] cosθ = adjacent side / hypotenuse = |m*u| / sqart{(n*u)} 2 +(m*u) 2 +d 2};

[0069] Then θ=arccos|m*u| / sqart{(n*u) 2 +(m*u) 2 +d 2}

[0070] Similarly, θ`` can be calculated. Since camera a and camera b are located on the same vertical line, φ`` = φ.

[0071] Let d1 be the vertical component of the distance from the human mass center P to the camera b, and let d2 be the vertical distance from the Z-axis to the plane of the human mass center. Then, according to:

[0072] tanθ=d2 / (d1+Δd); tanθ``=d2 / d1;

[0073] It can be deduced that:

[0074] d2=tanθ*tanθ``*Δd / (tan``-tanθ), d1=d2 / sinθ;

[0075] In triangle Sopq, angle OQP = φ, therefore according to:

[0076] X = d*sinθ*cosφ;

[0077] Y = d*sinθ*sinφ;

[0078] Z = d * cosθ;

[0079] The coordinates of point P in the three-dimensional coordinate system can be derived as follows:

[0080] X={tanθ*tan``*Δd / (tanθ``-tanθ)}*cosφ;

[0081] Y={tanθ*tanθ″*Δd / (tanθ``-tanθ)}*sinφ;

[0082] Z = d2*cosθ / sinθ.

[0083] After obtaining the user's target location coordinates, the real-time distance between the user's target location coordinates and the coordinates of each display device is calculated. The distances between the user and all display devices are compared, and the device with the shortest distance is selected as a candidate display device. If the distance between a candidate display device and the first display device exceeds a preset distance threshold, the candidate device is selected as the second display device. This preset distance threshold can be set according to actual needs.

[0084] This application ensures that the screen only switches when the user moves significantly by using precise location calculation and threshold judgment, avoiding frequent migration caused by the user wandering between screens. At the same time, it ensures that the user always uses the nearest screen by using the shortest distance principle, thus improving the stability and convenience of the interaction.

[0085] In an optional embodiment, before migrating cooking information from the first display device to the second display device for display, the method further includes pairing and networking the multiple display devices in the following manner:

[0086] Step 1: Identify the pairing request from the display device;

[0087] Step 2: Generate a temporary key pair and broadcast the public key in the temporary key pair via Bluetooth in response to a pairing request;

[0088] Step 3: Upon receiving the encrypted information returned by the display device, decrypt the encrypted information using the private key in the temporary key pair. The encrypted information is obtained by encrypting the preset certificate signature using the public key of the display device.

[0089] Step 4: After decrypting and obtaining the preset certificate signature of the display device, open the Bluetooth access port to the display device so that the display device can access the encrypted communication link via Bluetooth to complete the pairing.

[0090] Step 5: Send network information to the display device through an encrypted communication link so that the display device can access the MESH network through the network information.

[0091] In this embodiment, the pairing request from the display device is a request to establish a connection from the display device to the central control device, such as a refrigerator. This can be triggered by a physical button or an audio-visual signal. The temporary key pair is a temporary RSA asymmetric key pair generated by the central control device, including a public key (used for encryption) and a private key (held only by the central control device and used for decryption). It expires after one pairing, enhancing security. The preset certificate signature is a manufacturer's digital certificate burned into the display device at the factory, used to prove the device's legitimacy. The encrypted communication link can be an encrypted transmission channel based on the AES-256 algorithm, ensuring the security of data transmission between devices. The MESH networking is a wireless mesh network with the central control device, such as a refrigerator, as the main node and multiple screens as child nodes, supporting multi-hop communication between nodes and improving signal coverage and transmission speed. In a Mesh network, each device can act as a signal relay. For screens that are far from the main screen, the signal is relatively weak, and there may be significant signal delay or signal loss. Therefore, after adding the screen to the Mesh network, for screens located at the edge of the main screen's wireless range, the main controller can select the optimal node for signal relay based on the distance, signal strength, and latency between nodes, thus solving the problems of poor signal, high latency, and signal loss in edge areas.

[0092] In this embodiment, the central control device (refrigerator) identifies the dynamic light code of the display device through a camera or detects ultrasonic signals through a microphone array to confirm that the display device has issued a pairing request. The refrigerator generates a temporary RSA key pair and broadcasts the public key via Bluetooth Low Energy technology for the display device to receive. The refrigerator generates a pair of temporary RSA keys, including a public key and a private key. The public key is broadcast to the surrounding area via the Bluetooth Low Energy module, while the private key is stored locally in the refrigerator and not transmitted. In this application, the public key can be broadcast in the format of "device type + timestamp + public key data," enabling the display device to identify and receive it in a targeted manner. After receiving the public key, the display device calls its built-in encryption module to encrypt its own preset certificate signature using the public key, generating encrypted information. The display device then broadcasts the encrypted information via Bluetooth. After receiving it, the refrigerator calls its decryption module to decrypt the encrypted information using the locally stored private key, obtaining the original preset certificate signature. The refrigerator verifies and decrypts a pre-defined certificate signature using a pre-set manufacturer's public key. If the signature is valid, it confirms the display device is a genuine product certified by the manufacturer and opens its Bluetooth access port to the display device. After the display device connects via Bluetooth, both parties negotiate an AES-256 session key based on the verified certificate information, establish a Bluetooth encrypted communication link, and complete pairing. The refrigerator then sends MESH networking information to the display device through the established encrypted communication link. This MESH networking information may include the SSID, password, and child node role configuration. Upon receiving this information, the display device automatically joins the MESH network with the refrigerator as the master node, becoming a child node and supporting multi-hop communication with other nodes (i.e., other screens).

[0093] This application simplifies the deployment process of multi-screen setups by automatically encrypting, decrypting, and verifying the pairing process, thereby improving user experience and security.

[0094] In an optional embodiment, identifying the pairing request for the display device includes:

[0095] The system captures images of the kitchen; if a dynamic light code is detected on the display device in the kitchen image, it identifies the light encoding mode of the dynamic light code; if the light encoding mode matches the preset mode, it determines that a pairing request from the display device has been received; or, if an ultrasonic positioning signal is detected, it locates the sound source of the ultrasonic positioning signal and drives the camera to turn towards the sound source; if the sound source is determined to be the display device, it determines that a pairing request from the display device has been received.

[0096] In this embodiment, the dynamic optical code can be a specific frequency optical signal displayed on the screen of the display device, such as red and blue light flashing alternately 3 times / second. The ultrasonic positioning signal is an 18KHz-22KHz ultrasonic signal emitted by the display device, used for sound source localization.

[0097] In this embodiment, two methods are provided to trigger pairing. The first method is dynamic light code recognition. For example, after the user presses and holds the dedicated pairing button on the side of the multi-screen unit, the screen displays a preset dynamic light code, such as alternating red and blue three times per second. The refrigerator's camera captures the image in real time, analyzes the light code pattern using an image recognition algorithm, and compares it with the preset pattern. If they match, it is determined to be a valid pairing request. The second method is ultrasonic positioning recognition. For example, if the user says the wake-up phrase "Refrigerator, add a new screen" to the refrigerator, the refrigerator will respond with a voice message: "Please power on the new screen and look at the camera." After the multi-screen unit is powered on, it automatically plays an ultrasonic positioning signal. The refrigerator uses a microphone array to locate the sound source and drives the pan-tilt camera to turn in the direction of the signal. After confirming that the signal comes from the display device, it is determined to be a pairing request.

[0098] This application provides two pairing triggering methods: physical buttons are suitable for manual operation, while sound and light interaction is suitable for contactless scenarios, improving the flexibility and convenience of pairing. At the same time, the validity of the request is confirmed through light code mode and sound source localization to avoid false triggering and enhance the reliability of pairing.

[0099] In an optional embodiment, after the display device accesses the MESH network via networking information, the method further includes binding the display device to cooking equipment in the kitchen in the following manner:

[0100] Step 1: Construct an environmental map of the kitchen and establish a three-dimensional coordinate system for the kitchen with the camera as the origin in the environmental map;

[0101] Step 2: Obtain the first depth information of the display device and the second depth information of each cooking device through the camera;

[0102] Step 3: Calculate the first spatial coordinates of the display device in the environmental map based on the first depth information, and calculate the second spatial coordinates of each cooking device in the environmental map based on the second depth information;

[0103] Step 4: Calculate the distance between the first spatial coordinates and each of the second spatial coordinates;

[0104] Step 5: Bind the target cooking device corresponding to the second spatial coordinate that is closest to the first spatial coordinate to the display device.

[0105] In this embodiment of the application, the kitchen environment map is a three-dimensional kitchen environment model constructed using SLAM technology, which includes the location information of walls, furniture, and cooking equipment.

[0106] In this embodiment, the refrigerator camera performs SLAM mapping on the kitchen, generating an environmental map including objects such as the stove, cutting board, and oven, and establishing a three-dimensional coordinate system with the camera as the origin. First depth information between each display device and the camera, and second depth information between each cooking device and the camera are measured using a TOF sensor. Based on the depth information and the camera's horizontal and vertical deflection angles, the first spatial coordinates of the display devices and the second spatial coordinates of the cooking devices in the environmental map are calculated according to the following formulas:

[0107] X = d*sinθ*cosφ;

[0108] Y = d*sinθ*sinφ;

[0109] Z = d * cosθ;

[0110] Where d represents depth information, i.e., the distance from the object to the camera, θ represents the vertical deflection angle of the camera, and φ represents the horizontal deflection angle of the camera.

[0111] Once the spatial locations of each display device and cooking device in the kitchen are determined, the Euclidean distance between each display device and each cooking device can be calculated, and the display device can be paired with the nearest cooking device.

[0112] This application achieves automatic and precise binding between display devices and cooking equipment through SLAM mapping and 3D coordinate calculation, avoiding the tedious manual binding process and providing a spatial basis for subsequent content migration, thus ensuring the accuracy of the migration target.

[0113] This application also provides a control method for multi-screen cross-screen collaboration in a collaborative kitchen cooking scenario, including the following steps:

[0114] Step 1: Obtain task events generated by multiple target objects on their respective display devices, wherein each display device is connected to a MESH network with the refrigerator as the main node, and the task events include topic names and load data;

[0115] The task event is published to the refrigerator via the MQTT protocol, and the refrigerator acts as a subscription center to receive the task event.

[0116] The refrigerator matches the corresponding subscription subject based on the topic name of the task event and forwards the task event to the display device associated with the subscription subject;

[0117] The refrigerator uses a camera to collect the location coordinates and behavior data of each target object, and analyzes the actions and behaviors included in the task event.

[0118] Based on the location coordinates, the nearest display device corresponding to each target object is determined, and a reminder message matching the action behavior is displayed to the corresponding target object through the nearest display device.

[0119] Taking a scenario where family member A plans this week's recipes on the refrigerator's main screen, family member B prepares ingredients at the dining table, and family member C checks baking tutorials at the oven as an example, in this embodiment, each display device (such as the refrigerator's main screen, dining table screen 1, and oven screen 2) monitors user operations in real time and generates task events containing a topic name and load data. For example, if user A plans this week's recipes on the refrigerator's main screen and performs the operation "Add new recipe 'Curry Chicken'", a task event is generated: [Topic: "Recipe Update"; Load: "Ingredients: 3 potatoes, 500g beef, 1 box of curry cubes"]. If family member C performs the operation "Mark butter to be purchased" on oven screen 2, a task event is generated: [Topic: "Items to be purchased"; Load: "Item: 1 box of butter"]. Each display device acts as an MQTT client, publishing the task events to the MQTT server, such as the refrigerator, through a MESH network. The refrigerator acts as a subscription center, matching the preset subscription subject based on the task event's theme name and forwarding the load data to the corresponding display device. For example, the subscription subject for the "Recipe Update" theme is Table Screen 1 (the screen operated by User B), so the refrigerator forwards the "Curry Chicken Ingredient List" to Screen 1, and Screen 1 automatically updates its display. The subscription subject for the "Items to Buy" theme is the refrigerator's main screen (the screen operated by User A), so the refrigerator forwards the load data "Butter Needs to be Purchased" to the refrigerator's main screen, synchronizing it with User A's shopping list. The refrigerator uses a wide-angle camera to collect the real-time location coordinates of various target objects, such as User A next to the refrigerator and User C next to the oven. It also collects behavioral data from each user, such as User C clicking the "Mark" button on Screen 2. Combining this with the task event's load data, the refrigerator analyzes the action behavior, such as "User C needs to purchase butter." The refrigerator calculates the nearest display device for each target object based on its location coordinates, generates reminder messages for the parsed actions, and pushes them. For example, if user A's nearest display device is the refrigerator's main screen, the refrigerator will display an interactive reminder on the main screen: "User C has marked that butter needs to be purchased. Do you want to add it to the shopping list?" If user B is operating at the dining table and does not check the "recipe update" message on screen 1 in time, the refrigerator will detect that user B is next to the dining table through the camera and trigger screen 1 to display a prompt: "The ingredient list has been updated. Click to view the curry chicken ingredients."

[0120] This application enables real-time information synchronization for multi-user cross-screen collaboration, avoiding the tediousness of manually transferring information and solving the problem of information asynchrony when multiple people collaborate in traditional kitchens. At the same time, through the publish / subscribe mechanism of the MQTT protocol and MESH networking, it ensures the targeted transmission of task events, improves the accuracy and efficiency of information transmission, and avoids interference from irrelevant information.

[0121] This application also enables kitchen situational awareness based on multi-screen setups, including the following steps:

[0122] Step 1: The central control device collects real-time operating data of each cooking device, including temperature, operating status, remaining time, and energy consumption data.

[0123] Step 2: The central control device divides the operating data into global energy consumption data and device sub-data according to the preset binding relationship between the kitchen space area and the multi-screen. The global energy consumption data is displayed on the main screen, and the device sub-data is displayed on the bound screen of the corresponding area.

[0124] Step 3: When the operating data of any device is detected to exceed the preset threshold, the central control device generates a linkage control command to control the associated device to perform the corresponding operation, and displays an abnormality reminder on the bound screen in the area where the device is located.

[0125] Step 4: When the device detects that a user has moved from the area where the device is located to another area, the central control device synchronizes the device's operating data to the bound screen of the user's current area.

[0126] Step 5: When the central control device receives an energy consumption viewing command triggered by the user, it displays a high-energy-consuming device icon on the currently active screen, and when it detects that the user clicks on the icon, it pops up energy consumption optimization suggestions.

[0127] In this embodiment, the central control device (such as a refrigerator) can establish a stable connection with energy metering devices and range hoods via the Zigbee protocol, and establish a high-frequency communication link with smart stoves and ovens via the BLE protocol, forming a wireless control network covering all kitchen equipment. The central control device periodically collects operating data from each device through the established communication links. Based on a "preset binding relationship," the central control device divides the operating data by region and distributes it to the corresponding screens. For example, the main screen (refrigerator main screen) displays global energy consumption data, such as "Today's total energy consumption 1.2kWh," and an overview of the status of devices in each region; screen 1 in the stove area displays detailed data for the smart stove, such as "Current temperature 200℃, recommended heat: medium"; screen 2 in the oven area displays detailed data for the oven, such as "Baking mode: top and bottom heat 180℃, 15 minutes remaining." The central control device compares the operating data of each device with preset thresholds in real time. For example, if the temperature of the smart stove exceeds the safety threshold, it immediately generates a linkage control command and sends it to the range hood via BLE to control it to switch to the maximum setting. At the same time, a red light flashes on screen 1 bound to the stove, and a text reminder is displayed: "Stove temperature too high, range hood activated for forced exhaust." If the oven has 0 remaining time but has not stopped running, "Oven timeout, please handle promptly" is displayed on screen 2 bound to the oven, and a push notification is sent to the user's mobile phone via the central control device. The central control device tracks the user's location in real time using a camera / TOF rangefinder. When the user moves from the oven area (next to screen 2) to the dining table area (bound to screen 3), the central control device synchronizes the oven's operating data (remaining time, internal temperature) to screen 3. The user can remotely pause the oven's operation by clicking the "pause" button on the touch interface of screen 3. When a user triggers the "Energy Consumption View" command via a touch button on the currently active screen (such as the home screen), the central control device retrieves data from the energy metering device and displays the energy consumption of each device in chart form on the screen, marking high-energy-consuming devices. If the user clicks on the high-energy-consuming device icon, a targeted optimization suggestion immediately pops up on the screen, such as: "The oven is currently in rapid baking mode. Switching to energy-saving mode can reduce power consumption by 40%. Do you want to execute?" After the user clicks "Yes," the central control device sends a mode switching command to the oven via BLE.

[0128] This application ensures that users can easily access the information they need in any area through zoned display, solving the problem of scattered equipment status and inconvenience in viewing in traditional kitchens. At the same time, based on cross-regional data synchronization and remote operation support, it adapts to the operating habits of users moving between multiple areas of the kitchen, allowing them to control the equipment without having to return to it, thus enhancing the convenience of interaction.

[0129] This application provides a multi-screen control method, comprising: acquiring cooking information displayed on a first display device when a target object operates a first cooking device, wherein the first display device is bound to the first cooking device; determining a second display device bound to the second cooking device when it is detected that the target object changes from operating the first cooking device to operating a second cooking device; and migrating the cooking information from the first display device to the second display device for display. This application dynamically allocates display resources for multiple screens based on changes in the user's operating device. Users do not need to manually switch screens or repeatedly check cooking information; the cooking information is automatically synchronized to the display device bound to the currently operating device as the user's operating device changes, maintaining the continuity of interaction and greatly improving the interaction efficiency between display devices and users in the kitchen, thus solving the technical problem of extremely low interaction efficiency between display devices and users in the kitchen.

[0130] According to another aspect of the embodiments of this application, such as Figure 5 As shown, a multi-screen control device is provided, comprising:

[0131] The migration content acquisition module 501 is used to acquire cooking information displayed on the first display device when the target object operates the first cooking device, wherein the first display device is bound to the first cooking device;

[0132] The migration target determination module 503 is used to determine the second display device bound to the second cooking device when it is detected that the target object changes from operating the first cooking device to operating the second cooking device;

[0133] The migration control module 505 is used to migrate cooking information from the first display device to the second display device for display.

[0134] It should be noted that the migration content acquisition module 501 in this embodiment can be used to execute step S202 in this application embodiment, the migration target determination module 503 in this embodiment can be used to execute step S204 in this application embodiment, and the migration control module 505 in this embodiment can be used to execute step S206 in this application embodiment.

[0135] It should be noted that the examples and application scenarios implemented by the above modules and corresponding steps are the same, but are not limited to the content disclosed in the above embodiments. It should also be noted that the above modules, as part of the device, can be implemented in software or hardware.

[0136] Optionally, the migration control module is specifically used to: acquire behavioral data of the target object operating the second cooking device; determine the target cooking information that matches both the second cooking device and the behavioral data in the cooking information; and when the cooking information is migrated from the first display device to the second display device, jump to display the target cooking information.

[0137] Optionally, the migration control module is also used to: wake up the second display device in low-power mode; migrate cooking information from the first display device to the second display device; and, after the migration is complete, switch the first display device to low-power mode.

[0138] Optionally, the migration target determination module is further configured to: when the target object is detected to have moved, obtain the target position coordinates of the target object in the kitchen; calculate the distance from the target position coordinates to each display device; determine the display device with the shortest distance to the target position coordinates as a candidate display device; and determine the candidate display device as the second display device when the distance between the first display device and the candidate display device reaches a preset distance threshold.

[0139] Optionally, the multi-screen control device further includes a pairing and networking module, specifically used for: identifying pairing requests from display devices; generating temporary key pairs and broadcasting the public key in the temporary key pairs via Bluetooth in response to pairing requests; upon receiving a preset certificate signature returned by the display device's response public key, opening the Bluetooth access port to the display device to enable Bluetooth access and pairing; establishing an encrypted communication link with the display device based on the preset certificate signature and the temporary key pair; and sending networking information to the display device through the encrypted communication link to enable the display device to access the MESH network via the networking information.

[0140] Optionally, the pairing and networking module is also used to: capture a kitchen scene; identify the optical encoding mode of the dynamic optical code when a dynamic optical code displayed on a display device is detected in the kitchen scene; determine that a pairing request from the display device has been received when the optical encoding mode is consistent with a preset mode; or, locate the source of the ultrasonic positioning signal when an ultrasonic positioning signal is detected, and drive the camera to turn towards the direction of the sound source; determine that a pairing request from the display device has been received when the direction of the sound source is determined to be the display device.

[0141] Optionally, the multi-screen control device further includes a binding module, specifically used for: constructing an environmental map of the kitchen and establishing a three-dimensional coordinate system of the kitchen with the camera as the origin in the environmental map; acquiring first depth information of the display device and second depth information of each cooking device through the camera; calculating the first spatial coordinates of the display device in the environmental map based on the first depth information, and calculating the second spatial coordinates of each cooking device in the environmental map based on the second depth information; calculating the distance between the first spatial coordinates and each second spatial coordinate; and binding the target cooking device corresponding to the second spatial coordinate with the shortest distance to the first spatial coordinate to the display device.

[0142] According to another aspect of the embodiments of this application, this application provides an electronic device, such as... Figure 6 As shown, the system includes a memory 601, a processor 603, a communication interface 605, and a communication bus 607. The memory 601 stores a computer program that can run on the processor 603. The memory 601 and the processor 603 communicate through the communication interface 605 and the communication bus 607. When the processor 603 executes the computer program, it implements the steps of the above method.

[0143] The memory and processor in the aforementioned electronic devices communicate with each other via a communication bus and a communication interface. The communication bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into an address bus, a data bus, a control bus, etc.

[0144] The memory may include random access memory (RAM) or non-volatile memory, such as at least one disk storage device. Optionally, the memory may also be at least one storage device located remotely from the aforementioned processor.

[0145] The processors mentioned above can be general-purpose processors, including central processing units (CPUs), network processors (NPs), etc.; they can also be digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0146] According to another aspect of the embodiments of this application, a computer program product or computer program is also provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the steps of any of the above embodiments.

[0147] Optionally, in embodiments of this application, the computer-readable medium is configured to store program code for the processor to perform the following steps:

[0148] Obtain cooking information displayed on a first display device when the target object operates the first cooking device, wherein the first display device is bound to the first cooking device;

[0149] If the target object is detected to switch from operating the first cooking device to operating the second cooking device, a second display device bound to the second cooking device is determined.

[0150] The cooking information is transferred from the first display device to the second display device for display.

[0151] Optionally, specific examples in this embodiment can refer to the examples described in the above embodiments, and will not be repeated here.

[0152] In specific implementation, the embodiments of this application can be referred to the above embodiments and have corresponding technical effects.

[0153] It is understood that the embodiments described herein can be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described herein, or combinations thereof.

[0154] For software implementation, the techniques described herein can be implemented by units that perform the functions described herein. The software code can be stored in memory and executed by a processor. The memory can be implemented in the processor or external to the processor.

[0155] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0156] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0157] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, devices, or units, and may be electrical, mechanical, or other forms.

[0158] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0159] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0160] If the aforementioned function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks. It should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further restrictions, an element defined by the phrase "comprising a..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0161] The above description is merely a specific embodiment of this application, enabling those skilled in the art to understand or implement this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A multi-screen control method, characterized in that, include: Obtain cooking information displayed on a first display device when the target object operates the first cooking device, wherein the first display device is bound to the first cooking device; If it is detected that the target object changes from operating the first cooking device to operating the second cooking device, a second display device bound to the second cooking device is determined; The cooking information is transferred from the first display device to the second display device for display.

2. The method according to claim 1, characterized in that, The step of transferring the cooking information from the first display device to the second display device for display includes: Obtain behavioral data of the target object operating the second cooking device; Target cooking information that matches both the second cooking device and the behavioral data is determined from the cooking information; When the cooking information is transferred from the first display device to the second display device, the system jumps to display the target cooking information.

3. The method according to claim 1, characterized in that, The step of transferring the cooking information from the first display device to the second display device for display also includes: Wake up the second display device, which is in low-power mode; The cooking information is transferred from the first display device to the second display device; Once the migration is complete, the first display device is switched to the low-power mode.

4. The method according to claim 1, characterized in that, The method further includes determining the second display device in the following manner: If the target object is detected to have moved, obtain the target position coordinates of the target object in the kitchen. Calculate the distance from the target location coordinates to each display device; The display device with the shortest distance to the target location coordinates is identified as the candidate display device; If the distance between the first display device and the candidate display device reaches a preset distance threshold, the candidate display device is determined as the second display device.

5. The method according to any one of claims 1 to 4, characterized in that, Before transferring the cooking information from the first display device to the second display device for display, the method further includes pairing and networking multiple display devices in the following manner: Identify the pairing request of the display device; A temporary key pair is generated, and the public key in the temporary key pair is broadcast via Bluetooth in response to the pairing request; Upon receiving encrypted information returned by the display device, the encrypted information is decrypted using the private key in the temporary key pair, wherein the encrypted information is obtained by the display device encrypting a preset certificate signature using the public key; After decrypting and obtaining the preset certificate signature of the display device, the Bluetooth access port is opened to the display device so that the display device can access the encrypted communication link via Bluetooth to complete pairing; The network information is sent to the display device through the encrypted communication link, so that the display device can access the MESH network through the network information.

6. The method according to claim 5, characterized in that, The pairing request for identifying the display device includes: The system captures a kitchen scene; if a dynamic light code displayed on the display device is detected in the kitchen scene, the system identifies the light encoding mode of the dynamic light code; if the light encoding mode matches a preset mode, the system determines that the pairing request from the display device has been received; or... If an ultrasonic positioning signal is detected, the ultrasonic positioning signal is used to locate the sound source, and the camera is driven to turn towards the sound source direction; if the sound source direction is determined to be the display device, the pairing request from the display device is determined to be received.

7. The method according to claim 6, characterized in that, After enabling the display device to access the MESH network via the networking information, the method further includes binding the display device to cooking equipment in the kitchen in the following manner: Construct an environmental map of the kitchen, and establish a three-dimensional coordinate system for the kitchen with the camera as the origin in the environmental map; The camera acquires first depth information of the display device and second depth information of each cooking device. The first spatial coordinates of the display device in the environmental map are calculated based on the first depth information, and the second spatial coordinates of each cooking device in the environmental map are calculated based on the second depth information. Calculate the distance between the first spatial coordinate and each of the second spatial coordinates; The target cooking device corresponding to the second spatial coordinate that is closest to the first spatial coordinate is bound to the display device.

8. A multi-screen control device, characterized in that, include: The migration content acquisition module is used to acquire cooking information displayed on a first display device when the target object operates the first cooking device, wherein the first display device is bound to the first cooking device; The migration target determination module is used to determine a second display device bound to the second cooking device when it is detected that the target object changes from operating the first cooking device to operating the second cooking device; The migration control module is used to migrate the cooking information from the first display device to the second display device for display.

9. An electronic device comprising a memory, a processor, a communication interface, and a communication bus, wherein the memory stores a computer program executable on the processor, and the memory and the processor communicate via the communication bus and the communication interface, characterized in that... When the processor executes the computer program, it implements the multi-screen control method according to any one of claims 1 to 7.

10. A computer-readable medium having processor-executable non-volatile program code, characterized in that, The program code causes the processor to execute the multi-screen control method according to any one of claims 1 to 7.

Images