Method, device, smart home device and system for screen image transmission

By realizing screen image transmission between smart home devices, the problem of users being unable to watch continuously after leaving is solved, the user experience of walking and watching is realized, and the intelligence of smart home devices and home environment is improved.

CN114690651BActive Publication Date: 2024-12-31QINGDAO HAIER MULTI MEDIA CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011642318.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-31
Publication Date
2024-12-31
Estimated Expiration
2040-12-31

AI Technical Summary

Technical Problem

When users use smart home devices to view screen images, if they leave the current device, they cannot realize continuous viewing, resulting in the intelligence of smart home devices that need to be improved.

Method used

By realizing screen image transmission between smart home devices, after the user leaves the active area, he sends a positioning request to other devices located to find the user, and after receiving successful positioning feedback, the played screen image is passed to the corresponding device for Play.

Benefits of technology

It realizes the experience of continuing to watch screen images regardless of whether the user moves in the home environment, and improves the intelligence of smart home devices and home environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114690651B_ABST
    Figure CN114690651B_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of smart home devices, and discloses a method, device, smart home device, and system for screen image transmission. The method includes: when it is determined that a user in the action area of ​​a first smart home device has left, sending a location request to other smart home devices that support screen image transmission to find the user; when receiving feedback information on successful positioning, determining one or more smart home devices that sent the feedback information on successful positioning as a second smart home device, wherein the feedback information on successful positioning is generated and sent by the smart home device after finding the user according to the positioning request; and transmitting the played screen image to the second smart home device for playback. In this way, a user experience of watching as you go is achieved, and the intelligence of smart home devices is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of smart home devices, for example, to methods, devices, smart home devices and systems for screen image transmission. Background Art

[0002] Refrigerators, air conditioners, televisions, washing machines, kitchen appliances and other household appliances all have functions such as communication, voice interaction, and automatic control. They are all smart home devices. In addition, most smart appliances have screens for image playback.

[0003] Currently, when users use smart home devices to watch content played on the screen, if they need to leave the current smart home device for other things, such as going to the kitchen or bedroom, they can only pause the display through the remote control or far-field voice. They can only continue to watch the content played on the screen when they return to the smart home device. Therefore, users cannot watch the screen image continuously, and the intelligence of smart home devices needs to be improved. Summary of the invention

[0004] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

[0005] The embodiments of the present disclosure provide a method, apparatus, smart home device and system for screen image transmission to solve the technical problem that the intelligence of smart home devices needs to be improved.

[0006] In some embodiments, the method comprises:

[0007] When it is determined that the user in the action area of ​​the first smart home device has left, sending a location request for finding the user to other smart home devices supporting screen image transmission;

[0008] In the case of receiving positioning success feedback information, determining one or more smart home devices that sent the positioning success feedback information as second smart home devices, wherein the positioning success feedback information is generated and sent by the smart home device after finding the user according to the positioning request;

[0009] The played screen image is transmitted to the second smart home device for playing.

[0010] In some embodiments, the apparatus comprises:

[0011] A sending module, configured to send a location request for finding the user to other smart home devices supporting screen image transmission when it is determined that the user in the action area of ​​the first smart home device has left;

[0012] a determination module, configured to, upon receiving positioning success feedback information, determine one or more smart home devices that sent the positioning success feedback information as second smart home devices, wherein the positioning success feedback information is generated and sent by the smart home device after finding the user according to the positioning request;

[0013] The transmission module is configured to transmit the played screen image to the second smart home device for playback.

[0014] In some embodiments, the device for screen image transmission includes a processor and a memory storing program instructions, and the processor is configured to execute the above-mentioned method for screen image transmission when executing the program instructions.

[0015] In some embodiments, the smart home device includes the above-mentioned device for screen image transmission.

[0016] In some embodiments, the system includes: two or more smart home devices that support screen image transmission, wherein:

[0017] The first smart home device is configured to, when determining that a user in the effective area has left, send a location request to other smart home devices that support screen image transmission to find the user, and when receiving feedback information of successful positioning, determine one or more smart home devices that sent the feedback information of successful positioning as second smart home devices, and send the played screen image to the second smart home device;

[0018] The second smart home device is configured to receive the positioning request, generate and send the positioning success feedback information after finding the user according to the positioning request, and receive and play the screen image.

[0019] The method, device, smart home device and system for screen image transmission provided by the embodiments of the present disclosure can achieve the following technical effects:

[0020] After a user leaves the effective area of ​​a smart home device that supports screen image transmission, the screen image being played can be transmitted to other smart home devices that support screen image transmission and are located at the user, thereby realizing screen image transmission between smart home devices. In this way, no matter how the user moves in the home environment, he can continue to watch the screen image, realizing a watch-as-you-go experience, which not only improves the intelligence of smart home devices, but also further improves the intelligence of the home environment.

[0021] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] One or more embodiments are exemplarily described by corresponding drawings, which do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements, and the drawings do not constitute a scale limitation, and wherein:

[0023] Figure 1 is a structural schematic diagram of a screen image transmission system provided by an embodiment of the present disclosure;

[0024] Figure 2 is a flow chart of a method for screen image transmission provided by an embodiment of the present disclosure;

[0025] Figure 3 is a schematic diagram of a signaling interaction for screen image transmission provided by an embodiment of the present disclosure;

[0026] Figure 4 is a structural schematic diagram of a device for screen image transmission provided by an embodiment of the present disclosure;

[0027] Figure 5 is a structural schematic diagram of a device for screen image transmission provided by an embodiment of the present disclosure;

[0028] Figure 6 It is a structural schematic diagram of a screen image transmission device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0029] In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

[0030] The terms "first", "second", etc. in the specification and claims of the embodiments of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments of the embodiments of the present disclosure described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions.

[0031] Unless otherwise stated, the term "plurality" means two or more.

[0032] In the embodiment of the present disclosure, the character " / " indicates that the preceding and following objects are in an "or" relationship. For example, A / B indicates: A or B.

[0033] The term "and / or" is a description of the association relationship between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or, A and B.

[0034] Smart home devices have entered thousands of households, such as air conditioners, televisions, washing machines, refrigerators, etc., and many smart home devices have screens that can play screen images such as photos and videos. In the disclosed embodiment, the smart home device with a screen has the function of supporting screen image transmission. In this way, when a smart home device plays a screen image, if it determines that the user has left the effective area, it can transmit the screen image being played to other smart home devices that support screen image transmission and are located to the user, thereby realizing screen image transmission between smart home devices. In this way, no matter how the user moves in the home environment, he can continue to watch the screen image, realizing the experience of watching as he walks, which not only improves the intelligence of the smart home device, but also further improves the intelligence of the home environment.

[0035] Figure 1 FIG. 1 is a schematic diagram of a structure of a screen image transmission system provided by an embodiment of the present disclosure. Figure 1 As shown, the system for screen image transmission includes: two or more smart home devices that support screen image transmission, wherein the smart home device that is playing the screen image that needs to be transmitted is the first smart home device 100, and the smart home device that locates the user and receives the screen image and plays it is the second smart home device 200.

[0036] Each smart home device in the system for screen image transmission can carry a screen, can play screen images such as pictures and videos, and has the function of supporting screen image transmission. They can be devices in a smart home, so each smart home device can communicate.

[0037] The first smart home device 100 that is playing the screen image is configured to send a location request to find the user to other smart home devices that support screen image transmission when it is determined that the user in the effective area has left, and when receiving feedback information of successful positioning, determine one or more smart home devices that send feedback information of successful positioning as second smart home devices, and send the played screen image to the second smart home device;

[0038] The second smart home device 200 is configured to receive a positioning request, generate and send positioning success feedback information after finding the user according to the positioning request, and receive and play the screen image.

[0039] A user is watching a screen image, such as a video or picture, in the action area of ​​a smart home device. The smart home device that plays the screen image is the first smart home device 100. Suddenly, the user leaves the action area of ​​the first smart home device 100. At this time, the first smart home device 100 may send a location request to find the user to other smart home devices that support screen image transmission.

[0040] Among them, in some embodiments, the identification information of the smart home device supporting screen image transmission is saved in each smart home device in the screen image transmission system, and each home device can communicate with each other. In this way, after the user leaves the action area of ​​the first smart home device 100, the first smart home device 100 can send a location request to find the user to other smart home devices supporting screen image transmission based on the saved identification information of the smart home device. Therefore, the first smart home device 100 is also configured to obtain the identification information of the smart home device supporting screen image transmission and save it in the device list; and establish a communication connection with other smart home devices. Of course, the device list saved in each smart home device can be edited and updated in time. In some embodiments, the first smart home device 100 is also configured to notify the smart home device corresponding to each identification information in the device list when the current identification information is added or reduced in the device list. In this way, in the screen image transmission system, a new current smart home device is added, and the current identification information of the current smart home device is added to the device list saved by each smart home device of the system. If used in a screen image transmission system, when a current smart home device is deleted, the current identification information of the current smart home device is also deleted from the device list saved by each smart home device in the system.

[0041] The smart home device that receives the positioning request can search for the user based on the positioning request. In some embodiments, the user search can be performed based on image recognition. That is, the smart home device is configured to start the image acquisition device to obtain the current image information within the effective area when receiving the positioning request; when the current image information matches the user image information carried in the positioning request, it generates and sends feedback information on successful positioning.

[0042] The smart home device that receives the positioning request parses the positioning request, determines the user image information, and performs image recognition after starting the image acquisition device to obtain the current image information in the effective area. If the recognized image includes the user image information, it can be determined that the current image information matches the user image information carried in the positioning request, and a positioning success feedback information can be sent to the first smart home device 100.

[0043] In this way, the first smart home device 100 can receive feedback information on successful positioning. There may be one, two or more smart home devices in the screen image transmission system that can locate the user, that is, feedback information on successful positioning is fed back, that is, the first smart home device 100 can receive one or more feedback information on successful positioning. In some embodiments, the first smart home device 100 can determine each smart home device that sends feedback information on successful positioning as a second smart home device. Alternatively, the first smart home device 100 can determine a smart home device that sends feedback information on successful positioning as a second smart home device based on the angular distance information between the user and the device carried in the feedback information on successful positioning. Alternatively, the first smart home device 100 can randomly determine a smart home device that sends feedback information on successful positioning as a second smart home device.

[0044] Among them, according to the angle distance information between the user and the device carried in the positioning success feedback information, determining a smart home device that sends positioning success feedback information as the second smart home device may include: comparing the distance values ​​in the angle distance information, and determining the smart home device corresponding to the minimum distance value as the second smart home device. Alternatively, preset an angle weight value and a distance weight value, and then, according to the preset angle weight value and the distance weight value, respectively calculate the angle value and the distance value in each angle distance information to obtain a weighted angle distance value, and determine the smart home device corresponding to the minimum weighted angle distance value as the second smart home device.

[0045] Each smart home device in the screen image transmission system can perform user search upon receiving a positioning request, wherein the second smart home device 200 can generate and send positioning success feedback information after finding the user according to the positioning request, and receive and play the screen image.

[0046] It can be seen that each smart home device used in the screen image transmission system can sometimes be the first smart home device and sometimes be the second smart home device. Therefore, each smart home device has the functions of both the first smart home device and the second smart home device.

[0047] In the screen image transmission system, each smart home device can perform screen image transmission.

[0048] Figure 2 FIG. 1 is a flow chart of a method for transmitting screen images provided by an embodiment of the present disclosure. Figure 2 As shown, the process for screen image delivery includes:

[0049] Step 201: When it is determined that the user in the action area of ​​the first smart home device has left, a location request for finding the user is sent to other smart home devices that support screen image transmission.

[0050] In the disclosed embodiment, the smart home device in the screen image playback is a first smart home device. The first smart home device can determine the user in the effective area through human body sensing, face recognition, etc. When it is determined that the user has left, the first smart home device sends a location request to other smart home devices that support screen image transmission to find the user.

[0051] In some embodiments, each smart home device saves the identification information of the smart home device that supports screen image transmission in the device list and can communicate with other smart devices, that is, it also includes: obtaining the identification information of the smart home device that supports screen image transmission and saving it in the device list; establishing a communication connection with other smart home devices.

[0052] In this way, based on the saved device list, a location request for finding the user can be sent to other smart home devices that support screen image transmission.

[0053] Of course, in some embodiments, the saved device list can also be updated in real time, that is, when the current identification information is added or reduced in the device list, the smart home device corresponding to each identification information in the device list is notified. In this way, the system for screen image transmission is updated in real time, ensuring the stability of the system.

[0054] Step 202: when receiving positioning success feedback information, one or more smart home devices that send positioning success feedback information are determined as second smart home devices.

[0055] Among them, the smart home device that receives the positioning request can search for the user according to the positioning request. In some embodiments, the user search can be performed according to image recognition, that is, after the user is found according to the positioning request, the positioning success feedback information is generated and sent, including: when the positioning request is received, the image acquisition device is started to obtain the current image information in the effective area; when the current image information matches the user image information carried in the positioning request, the positioning success feedback information is generated and sent. Of course, if the smart home device fails to find the user, it will not send the positioning success feedback information, that is, it fails to identify the user image information in the current image information, and it will not send the positioning success feedback information.

[0056] The number of smart home devices that receive the positioning request may be one, two, or more, and the number of smart home devices that can find the user may be zero, one, two, or more. In this way, the first smart home device may receive one, two, or more positioning success feedback information. In some embodiments, each smart home device that sends positioning success feedback information may be determined as the second smart home device. Alternatively, a smart home device that sends positioning success feedback information may be determined as the second smart home device based on the angular distance information between the user and the device carried in the positioning success feedback information. Alternatively, a smart home device that sends positioning success feedback information may be randomly determined as the second smart home device.

[0057] Among them, according to the angle distance information between the user and the device carried in the positioning success feedback information, determining a smart home device that sends positioning success feedback information as the second smart home device may include: comparing the distance values ​​in the angle distance information, and determining the smart home device corresponding to the minimum distance value as the second smart home device. Alternatively, preset an angle weight value and a distance weight value, and then, according to the preset angle weight value and the distance weight value, respectively calculate the angle value and the distance value in each angle distance information to obtain a weighted angle distance value, and determine the smart home device corresponding to the minimum weighted angle distance value as the second smart home device.

[0058] Step 203: The played screen image is transmitted to the second smart home device for playback.

[0059] The first smart home device is playing a screen image, and the user is already in the active area of ​​the second smart home device. Therefore, the played screen image can be transmitted to the second smart home device for playback, including: sending one or more of the video, picture and other content, source link, playback progress, etc. to the second smart home device for playback.

[0060] It can be seen that in this embodiment, after the user leaves the effective area of ​​the smart home device that supports screen image transmission, the screen image being played can be transmitted to other smart home devices that support screen image transmission and are located at the user, thereby realizing screen image transmission between smart home devices. In this way, no matter how the user moves in the home environment, he can continue to watch the screen image, realizing a watch-as-you-go experience, which not only improves the intelligence of smart home devices, but also further improves the intelligence of the home environment.

[0061] The operation flow is collected into a specific embodiment below to illustrate the screen image transmission process provided by the embodiment of the present invention.

[0062] In this embodiment, the screen image transmission system can be as follows Figure 1 As shown, it includes: two or more smart home devices that support screen image transmission, wherein the smart home device that is playing the screen image that needs to be transmitted is the first smart home device 100, and the smart home device that locates the user and receives and plays the screen image is the second smart home device 200. Each smart home device stores a device list, which includes identification information of the smart home devices that support screen image transmission, and each smart home device can communicate with each other.

[0063] Figure 3 FIG. 1 is a schematic diagram of a signaling interaction for screen image transmission provided by an embodiment of the present disclosure. Figure 1 , Figure 3 , the process for screen image delivery includes:

[0064] Step 301: The first smart home device in the screen image playback area determines whether the user has left the action area. If so, execute step 302; otherwise, return to step 301.

[0065] The user image information can be obtained through human infrared detection and image recognition, and the user detection can be performed. When it is detected that the user has left, step 302 is executed, otherwise, the process returns to step 301 to continue playing the screen image and performing user detection.

[0066] Step 302: According to the identification information of the smart home devices supporting screen image transmission in the stored device list, the first smart home device sends a location request for finding the user to other smart home devices supporting screen image transmission.

[0067] Step 303: The smart home device that receives the positioning request starts the image acquisition device to obtain the current image information in the effective area and perform image recognition.

[0068] Step 304: The smart home device that determines that the current image information matches the user image information carried in the positioning request generates and sends positioning success feedback information.

[0069] The smart home device that receives the positioning request performs image recognition on the current image information obtained. When the recognized image information includes the user image information carried in the positioning request, it can generate and send successful positioning feedback information. That is, the smart home device that determines that the current image information matches the user image information carried in the positioning request will generate and send successful positioning feedback information.

[0070] Step 305: the first smart home device determines a smart home device that sends a positioning success feedback message as a second smart home device according to the angular distance information between the user and the device carried in the positioning success feedback message.

[0071] Step 306: The first smart home device transmits the played screen image to the second smart home device for playback.

[0072] It can be seen that in this embodiment, when a smart home device plays a screen image, if it determines that the user has left the active area, the screen image being played can be transmitted to other smart home devices that support screen image transmission and are located at the user, thereby realizing screen image transmission between smart home devices. In this way, no matter how the user moves in the home environment, he can continue to watch the screen image, realizing a watch-as-you-go experience, which not only improves the intelligence of smart home devices, but also further improves the intelligence of the home environment.

[0073] According to the above process for screen image transfer, a device for screen image transfer can be constructed.

[0074] Figure 4 Schematic diagram of a device for transmitting screen images provided by an embodiment of the present disclosure. Figure 4 As shown, the device for transferring screen images includes: a sending module 410 , a determining module 420 and a transferring module 430 .

[0075] The sending module 410 is configured to send a location request for finding the user to other smart home devices that support screen image transmission when it is determined that the user in the action area of ​​the first home device has left.

[0076] The determination module 420 is configured to determine one or more smart home devices that send successful positioning feedback information as second smart home devices when receiving successful positioning feedback information, wherein the successful positioning feedback information is generated and sent by the smart home device after finding the user according to the positioning request.

[0077] The transmission module 430 is configured to transmit the played screen image to the second smart home device for playback.

[0078] In some embodiments, it also includes: a communication saving module, which is configured to obtain identification information of smart home devices that support screen image transmission and save it in a device list; and establish a communication connection with other smart home devices.

[0079] In some embodiments, it also includes: an update module configured to notify the smart home device corresponding to each identification information in the device list when the current identification information is added or reduced in the device list.

[0080] In some embodiments, the determination module 420 is specifically configured to determine a smart home device that sends a successful positioning feedback message as a second smart home device based on the angular distance information between the user and the device carried in the successful positioning feedback information; or, to determine each smart home device that sends a successful positioning feedback message as a second smart home device.

[0081] The smart home device used in the screen image transmission system may sometimes be the first smart home device and sometimes be the second smart home device. Therefore, in some embodiments, the screen image transmission device also includes: a collection module and an identification and positioning module.

[0082] The acquisition module is configured to start the image acquisition device to obtain current image information within the effective area when a positioning request is received.

[0083] The identification and positioning module is configured to generate and send positioning success feedback information when the current image information matches the user image information carried in the positioning request.

[0084] Of course, in some embodiments, the device for screen image transmission can receive the screen image and play it.

[0085] The following describes in detail the screen image transmission process of the device for screen image transmission applied to smart home equipment.

[0086] In this embodiment, the smart home device has the function of the first smart home device and also has the function of the second smart home device.

[0087] Figure 5 Schematic diagram of a device for transmitting screen images provided by an embodiment of the present disclosure. Figure 5 As shown, the device for transmitting screen images includes: a sending module 410 , a determining module 420 , a transmitting module 430 , a storing and communicating module 440 , an updating module 450 , a collecting module 460 and an identifying and positioning module 470 .

[0088] The communication saving module 440 obtains the identification information of the smart home device supporting screen image transmission and saves it in the device list; and can establish communication connections with other smart home devices. When the current identification information is added or reduced in the device list, the updating module 450 can notify the smart home device corresponding to each identification information in the device list.

[0089] In this way, when the smart home device is playing the screen image, if it is determined that the user in the effective area has left, the sending module 410 can send a location request for finding the user to other smart home devices that support screen image transmission based on the device list saved in the communication module 440.

[0090] In this way, when receiving the positioning success feedback information, the determination module 420 can determine a smart home device that sends the positioning success feedback information as the second smart home device according to the angular distance information between the user and the device carried in the positioning success feedback information. Thus, the transmission module 430 can transmit the played screen image to the second smart home device for playback.

[0091] If the smart home device receives a positioning request for finding a user, the acquisition module 460 can start the image acquisition device to obtain the current image information within the effective area; and when the current image information matches the user image information carried in the positioning request, the identification and positioning module 470 can generate and send a successful positioning feedback message, so that the smart home device that sent the positioning request can transmit the screen image.

[0092] Of course, the smart home device can play the transmitted screen image after receiving it.

[0093] It can be seen that in this embodiment, the device for screen image transmission can transmit the screen image being played to other smart home devices that support screen image transmission and are located to the user after the user in the effective area leaves, thereby realizing screen image transmission between smart home devices. In this way, no matter how the user moves in the home environment, he can continue to watch the screen image, realizing a watch-as-you-go experience, which not only improves the intelligence of smart home devices, but also further improves the intelligence of the home environment.

[0094] The embodiment of the present disclosure provides a device for screen image transmission, the structure of which is as follows: Figure 6 As shown, including:

[0095] The processor 1000 and the memory 1001 may also include a communication interface 1002 and a bus 1003. The processor 1000, the communication interface 1002, and the memory 1001 may communicate with each other through the bus 1003. The communication interface 1002 may be used for information transmission. The processor 1000 may call the logic instructions in the memory 1001 to execute the method for screen image transmission of the above embodiment.

[0096] In addition, the logic instructions in the above-mentioned memory 1001 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product.

[0097] The memory 1001 is a computer-readable storage medium that can be used to store software programs and computer executable programs, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 1000 executes the functional application and data processing by running the program instructions / modules stored in the memory 1001, that is, the method for screen image transmission in the above method embodiment is implemented.

[0098] The memory 1001 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the terminal smart home device, etc. In addition, the memory 1001 may include a high-speed random access memory and may also include a non-volatile memory.

[0099] An embodiment of the present disclosure provides a device for screen image transmission, including: a processor and a memory storing program instructions, wherein the processor is configured to execute a method for screen image transmission when executing the program instructions.

[0100] An embodiment of the present disclosure provides a smart home device, including the above-mentioned device for screen image transmission.

[0101] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured to execute the above-mentioned method for screen image transmission.

[0102] An embodiment of the present disclosure provides a computer program product, which includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the above-mentioned method for screen image transmission.

[0103] The computer-readable storage medium mentioned above may be a transient computer-readable storage medium or a non-transitory computer-readable storage medium.

[0104] The terminal device may be, for example, a mobile device, a computer, or a vehicle-mounted device built into a floating vehicle, or any combination thereof. In some embodiments, the mobile device may include, for example, a mobile phone, a smart home device, a wearable device, a smart mobile device, a virtual reality device, or any combination thereof.

[0105] The technical solution of the embodiment of the present disclosure can be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for enabling a computer smart home device (which can be a personal computer, a server, or a network smart home device, etc.) to perform all or part of the steps of the method described in the embodiment of the present disclosure. The aforementioned storage medium can be a non-transient storage medium, including: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, and other media that can store program codes, or a transient storage medium.

[0106] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible changes. Unless explicitly required, individual components and functions are optional, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. The scope of the embodiments of the present disclosure includes the entire scope of the claims, and all available equivalents of the claims. When used in this application, although the terms "first", "second", etc. may be used in this application to describe each element, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, without changing the meaning of the description, the first element can be called the second element, and similarly, the second element can be called the first element, as long as all occurrences of the "first element" are renamed consistently and all occurrences of the "second element" are renamed consistently. The first element and the second element are both elements, but may not be the same element. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and claims, unless the context clearly indicates otherwise, the singular forms "a", "an" and "the" are intended to include the plural forms as well. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of one or more associated listings. In addition, when used in this application, the term "comprise" and its variants "comprises" and / or comprising refer to the presence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups of these. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the presence of other identical elements in the process, method or smart home device including the elements. In this article, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can refer to the description of the method part.

[0107] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods for each specific application to implement the described functions, but such implementations should not be considered to exceed the scope of the embodiments of the present disclosure. The technicians may clearly understand that, for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above may refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0108] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, smart home devices, etc.) can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units can be only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, each functional unit in the embodiment of the present disclosure may be integrated in a processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit.

[0109] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to the embodiment of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowchart and the block diagram in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in a different order from the order disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A method for screen image transmission, characterized in that: include: When it is determined that the user in the action area of ​​the first smart home device has left, the identification information of the smart home device supporting screen image transmission is obtained and saved in the device list; a communication connection is established with other smart home devices, and a location request for finding the user is sent to other smart home devices supporting screen image transmission; In the case of receiving positioning success feedback information, determining one or more smart home devices that sent the positioning success feedback information as second smart home devices, wherein the positioning success feedback information is generated and sent by the smart home device after finding the user according to the positioning request; transmitting the played screen image to the second smart home device for playback; The step of determining one or more smart home devices that send the positioning success feedback information as the second smart home device includes: determining a smart home device that sends the positioning success feedback information as the second smart home device based on the angular distance information between the user and the device carried in the positioning success feedback information.

2. The method according to claim 1, characterized in that Also includes: When the current identification information is added or reduced in the device list, the smart home device corresponding to each identification information in the device list is notified.

3. The method according to claim 1, characterized in that The generating and sending the positioning success feedback information after finding the user according to the positioning request includes: When receiving the positioning request, starting an image acquisition device to acquire current image information within the effective area; When the current image information matches the user image information carried in the positioning request, the positioning success feedback information is generated and sent.

4. A device for screen image transmission, characterized in that: include: A sending module, configured to send a location request for finding the user to other smart home devices supporting screen image transmission when it is determined that the user in the action area of ​​the first home device has left; A storage communication module is configured to obtain identification information of a smart home device that supports screen image transmission and save it in a device list; Establish communication connections with other smart home devices; The determination module is configured to, upon receiving positioning success feedback information, determine one or more smart home devices that send the positioning success feedback information as the second smart home device, wherein the positioning success feedback information is generated and sent by the smart home device after finding the user according to the positioning request; the determination module is specifically configured to determine a smart home device that sends positioning success feedback information as the second smart home device according to the angular distance information between the user and the device carried in the positioning success feedback information; The transmission module is configured to transmit the played screen image to the second smart home device for playback.

5. The device according to claim 4, characterized in that Also includes: A collection module is configured to start an image collection device to obtain current image information within an effective area when receiving the positioning request; The identification and positioning module is configured to generate and send the positioning success feedback information when the current image information matches the user image information carried in the positioning request.

6. A device for screen image transmission, the device comprising a processor and a memory storing program instructions, characterized in that: The processor is configured to perform the method for screen image transmission according to any one of claims 1 to 3 when executing the program instructions.

7. A smart home device, characterized in that: include: An apparatus for screen image transmission as claimed in claim 4, 5 or 6.

8. A system for screen image transmission, characterized in that: include: Two or more smart home devices supporting screen image transmission, wherein: The first smart home device is configured to, when it is determined that a user in the effective area has left, obtain identification information of a smart home device that supports screen image transmission and save it in a device list; establish a communication connection with other smart home devices, send a location request for finding the user to other smart home devices that support screen image transmission, and when receiving feedback information of successful positioning, determine one or more smart home devices that send the feedback information of successful positioning as second smart home devices, and send the played screen image to the second smart home device; determining one or more smart home devices that send the feedback information of successful positioning as the second smart home device includes: determining a smart home device that sends the feedback information of successful positioning as the second smart home device according to the angular distance information between the user and the device carried in the feedback information of successful positioning; The second smart home device is configured to receive the positioning request, generate and send the positioning success feedback information after finding the user according to the positioning request, and receive and play the screen image.