Self-adaptation method and device for screen-to-screen intercom

Abstract

This invention discloses an adaptive method and apparatus for screen-to-screen intercom. The method includes: responding to a first predetermined operation performed by a user on a first target central control device, controlling the first target central control device to send a screen-to-screen intercom request to a second target central control device, causing the second target central control device to establish a communication connection with the first target central control device in response to the screen-to-screen intercom request; controlling multiple camera devices on the first target central control device to capture the user's image, obtaining multiple first images and performing recognition to obtain multiple first recognition results; identifying the camera device corresponding to an image with a correct first recognition result as the target camera device, and controlling other camera devices to turn off; controlling the target camera device to capture the user's image in real time, and sending the captured image to the second target central control device for display, until the screen-to-screen intercom ends. This invention solves the technical problem of poor user experience caused by the inability of existing central control devices to guarantee image quality during screen-to-screen intercom.

Description

Technical Field

[0001] This invention relates to the field of smart home technology, and more specifically, to a self-adaptive method and device for screen-to-screen intercom. Background Technology

[0002] In today's society, smart homes are becoming increasingly common. With advancements in chip performance and iterations in voice recognition algorithms, voice recognition is becoming widely used in daily life. In a smart home system, the central control unit serves as the hub for interaction with the user and control of smart sub-devices; its user experience significantly impacts the overall experience of the smart home system.

[0003] Currently available smart central control systems all have visualization, image input, and network transmission capabilities, but they lack image self-adaptation capabilities in terms of screen-to-screen intercom functionality.

[0004] There is currently no effective solution to the above problems. Summary of the Invention

[0005] This invention provides an adaptive method and apparatus for screen-to-screen intercom, which at least solves the technical problem that the central control equipment in the prior art cannot guarantee the quality of human images when conducting screen-to-screen intercom, resulting in a poor user experience.

[0006] According to one aspect of the present invention, a self-adaptive method for screen-to-screen intercom is provided, wherein multiple central control devices each include multiple camera devices, at least one of the multiple camera devices being a wide-angle camera device. The method includes: responding to a user's first predetermined operation on a first target central control device, controlling the first target central control device to send a screen-to-screen intercom request to a second target central control device, such that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device, wherein the second target central control device is a central control device other than the first target central control device; controlling the multiple camera devices of the first target central control device to acquire the user's image, obtaining multiple first images, and recognizing the multiple images to obtain multiple first recognition results; determining the camera device corresponding to an image with a correct first recognition result as a target camera device, and controlling the camera devices other than the target camera device in the first target central control device to turn off; controlling the target camera device to acquire the user's image in real time, and sending the image acquired by the target camera device to the second target central control device for display, until the screen-to-screen intercom ends.

[0007] Optionally, after recognizing multiple first human images and obtaining multiple first recognition results, the screen-to-screen intercom self-adaptation method further includes: if multiple recognition results are incorrect, controlling the first target central control device to issue a movement reminder to remind the user to adjust the distance between the user and the first target central control device.

[0008] Optionally, after controlling the camera devices other than the target camera device in the first target central control device to turn off, the screen-to-screen intercom self-adaptation method further includes: if the recognition result of the user's image captured by the target camera device is incorrect, controlling the camera devices other than the target camera device in the first target central control device to turn on; controlling multiple camera devices of the first target central control device to capture the user's image to obtain multiple second images, and recognizing the multiple second images to obtain multiple second recognition results; determining the camera device corresponding to an image with a correct second recognition result as the target camera device, and controlling the camera devices other than the target camera device in the first target central control device to turn off.

[0009] Optionally, sending the human image captured by the target camera device to the second target central control device for display includes: performing background blurring processing on the human image captured by the target camera device to obtain a processed human image; and sending the processed human image to the second target central control device for display.

[0010] Optionally, the self-adaptive method for screen-to-screen intercom further includes: collecting the user's audio during screen-to-screen intercom; performing noise reduction processing on the audio to obtain a noise-reduced frequency; and sending the noise-reduced frequency to the second target central control device for playback.

[0011] Optionally, the central control device further includes a human infrared sensor, and the screen-to-screen intercom self-adaptation method further includes: during screen-to-screen intercom, controlling the human infrared sensor of the first target central control device to acquire the user's body temperature data and display the body temperature data.

[0012] Optionally, after the camera devices other than the target camera device in the first target central control device are turned off, the screen-to-screen intercom self-adaptation method further includes: responding to a second predetermined operation by the user, turning on the camera device corresponding to the second predetermined operation, wherein the second predetermined operation is the operation of turning on the camera device; responding to a third predetermined operation by the user, turning off the camera device corresponding to the third predetermined operation, wherein the third predetermined operation is the operation of turning off the camera device; and identifying an turned-on camera device as the target camera device.

[0013] According to another aspect of the present invention, a screen-to-screen intercom self-adaptive device is also provided. Multiple central control devices each include multiple camera devices, at least one of which is a wide-angle camera device. The device includes: a first control unit, configured to, in response to a user performing a first predetermined operation on a first target central control device, control the first target central control device to send a screen-to-screen intercom request to a second target central control device, such that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device. The first target central control device is the central control device operated by the user, and the second target central control device is any device other than the first target central control device. The system comprises: a central control device; a second control unit, configured to control multiple camera devices of the first target central control device to acquire the user's image, obtain multiple first images, and identify the multiple images to obtain multiple first identification results; a third control unit, configured to identify the camera device corresponding to an image with a correct first identification result as the target camera device, and control the camera devices other than the target camera device in the first target central control device to turn off; and a fourth control unit, configured to control the target camera device to acquire the user's image in real time, and send the image acquired by the target camera device to the second target central control device for display until the intercom ends.

[0014] Optionally, the screen-to-screen intercom self-adaptation device further includes: a fifth control unit, used to control the first target central control device to issue a movement reminder after recognizing multiple first human images and obtaining multiple first recognition results, in the case that multiple recognition results are incorrect, so as to remind the user to adjust the distance between the user and the first target central control device.

[0015] Optionally, the screen-to-screen intercom self-adaptation device further includes: a sixth control unit, configured to control the camera devices other than the target camera device in the first target central control device to turn on when the recognition result of the user's image captured by the target camera device is incorrect after controlling the camera devices other than the target camera device in the first target central control device to turn off; a seventh control unit, configured to control multiple camera devices in the first target central control device to capture the user's image to obtain multiple second images, and to recognize multiple second images to obtain multiple second recognition results; and an eighth control unit, configured to identify the camera device corresponding to an image with a correct second recognition result as the target camera device, and to control the camera devices other than the target camera device in the first target central control device to turn off.

[0016] Optionally, the fourth control unit includes: a processing module for blurring the background of the human image captured by the target camera device to obtain a processed human image; and a sending module for sending the processed human image to the second target central control device for display.

[0017] Optionally, the screen-to-screen intercom self-adaptive device further includes: a data acquisition unit for acquiring the user's audio during screen-to-screen intercom; a noise reduction processing unit for performing noise reduction processing on the audio to obtain a noise-reduced frequency; and a transmission unit for sending the noise-reduced frequency to the second target central control device for playback.

[0018] Optionally, the central control device further includes a human infrared sensor. The screen-to-screen intercom self-adaptation device also includes an eighth control unit, used to control the human infrared sensor of the first target central control device to acquire the user's body temperature data and display the body temperature data during screen-to-screen intercom.

[0019] Optionally, the screen-to-screen intercom self-adaptation device further includes: an activation unit, configured to activate the camera corresponding to the second predetermined operation in response to a second predetermined operation by the user after the camera other than the target camera in the first target central control device is turned off, wherein the second predetermined operation is the operation of activating the camera; a deactivation unit, configured to deactivate the camera corresponding to the third predetermined operation in response to a third predetermined operation by the user, wherein the third predetermined operation is the operation of deactivating the camera; and a determination unit, configured to determine an activated camera as the target camera.

[0020] According to another aspect of the present invention, a computer program product is also provided, including a computer program that, when executed by a processor, implements any of the above-described screen-to-screen intercom self-adaptation methods.

[0021] According to another aspect of the present invention, an Internet of Things (IoT) system is also provided, comprising: a plurality of central control devices, one or more processors, a memory, and one or more programs, wherein each of the plurality of central control devices includes a plurality of camera devices, at least one of the plurality of camera devices is a wide-angle camera device, the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include an adaptive method for performing any of the screen-to-screen intercom methods described above.

[0022] According to another aspect of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored program, wherein, when the program is executed, it controls the device where the computer-readable storage medium is located to execute any of the above-described screen-to-screen intercom self-adaptation methods.

[0023] In this embodiment of the invention, when the first target central control device and the second target central control device establish a communication connection for screen-to-screen intercom, multiple camera devices of the first target central control device are controlled to capture and identify the user's image. The camera device corresponding to the image with the correct identification result is then identified as the target camera device, while the other camera devices are turned off. Only the image of the user captured by the target camera device is sent to the second target central control device for display until the screen-to-screen intercom ends. Since at least one of the multiple camera devices is a wide-angle camera, a complete image is captured. Enabling the camera device with the correct identification result ensures the image quality for screen-to-screen intercom, thereby solving the technical problem of poor user experience caused by the inability to guarantee image quality when the central control device performs screen-to-screen intercom in the prior art. Attached Figure Description

[0024] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0025] Figure 1 This is a hardware structure block diagram of a mobile terminal for a screen-to-screen intercom self-adaptation method according to an embodiment of the present invention.

[0026] Figure 2 This is a flowchart of the screen-to-screen intercom self-adaptation method according to an embodiment of the present invention;

[0027] Figure 3 This is a flowchart of an optional screen-to-screen intercom self-adaptation method according to an embodiment of the present invention;

[0028] Figure 4 This is a schematic diagram of a screen-to-screen intercom self-adaptive device according to an embodiment of the present invention. Detailed Implementation

[0029] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0030] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0031] As described in the background section, existing central control devices cannot guarantee image quality during screen-to-screen intercom, resulting in a poor user experience. To address these shortcomings, embodiments of the present invention provide a self-adaptive method and apparatus for screen-to-screen intercom, a computer program product, an Internet of Things system, an electronic device, a computer-readable storage medium, and a processor.

[0032] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.

[0033] The methods and embodiments provided in this invention can be executed on a mobile terminal, a computer terminal, or a similar computing device. Taking running on a mobile terminal as an example, Figure 1 This is a hardware structure block diagram of a mobile terminal for a screen-to-screen intercom self-adaptation method according to an embodiment of the present invention. Figure 1 As shown, a mobile terminal may include one or more ( Figure 1 Only one is shown in the diagram. A processor 102 (which may include, but is not limited to, a microprocessor MCU or a programmable logic device FPGA, etc.) and a memory 104 for storing data are also shown. The mobile terminal may further include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that... Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the mobile terminal described above. For example, the mobile terminal may also include components that are more... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown.

[0034] The memory 104 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the screen-to-screen intercom self-adaptation method in this embodiment of the invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, thereby implementing the above-described method. The memory 104 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to the mobile terminal via a network. Examples of the aforementioned networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. The transmission device 106 is used to receive or send data via a network. Specific examples of the aforementioned networks may include wireless networks provided by the mobile terminal's communication provider. In one example, the transmission device 106 includes a network interface controller (NIC), which can be connected to other network devices via a base station to communicate with the Internet. In one example, the transmission device 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0035] According to an embodiment of the present invention, a method embodiment of an adaptive method for screen-to-screen intercom is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0036] Figure 2 This is a flowchart of the self-adaptive method for screen-to-screen intercom according to an embodiment of the present invention, as follows: Figure 2 As shown, the method includes the following steps:

[0037] Step S202: In response to the user's first predetermined operation on the first target central control device, the first target central control device is controlled to send a screen-to-screen intercom request to the second target central control device, so that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device. The second target central control device is a central control device other than the first target central control device.

[0038] It should be noted that the aforementioned central control device is an intelligent device used to control the operation and management of the entire screen intercom system. It typically includes a main controller, various sensors, and actuators. It can exchange data and perform control operations with various components in the screen intercom system through network connections and communication protocols.

[0039] In this embodiment, communication connections between different central control devices can be realized, allowing users to conveniently perform screen intercom operations. By performing a predetermined operation on the first target central control device, the user can trigger the first target central control device to send a screen intercom request to the second target central control device, establishing a communication connection. Users can communicate with other central control devices in real time, achieving more convenient communication and collaboration, improving user experience, enhancing the interconnectivity between devices, and making the screen intercom function more flexible and intelligent.

[0040] Figure 3 This is a flowchart of an optional screen-to-screen intercom self-adaptation method according to an embodiment of the present invention, such as... Figure 3 As shown, a user triggers the screen-to-screen intercom function (i.e., the first predetermined operation) on any smart central control unit (i.e., the first target central control device) and selects a target smart central control unit. The smart central control unit (i.e., the first target central control device) sends a screen-to-screen intercom request command packet to the target smart central control unit (i.e., the second target central control device). After receiving the screen-to-screen intercom request, the target smart central control unit reminds the user of the screen-to-screen intercom request through a visual interface. After confirmation, it responds to the initiator (i.e., the first target central control device) with a request response packet and establishes a screen-to-screen intercom communication link with the requester (i.e., the first target central control device).

[0041] It should be noted that the smart central control unit in the home is connected to the same smart home system through network configuration, maintaining network connectivity.

[0042] Step S204: Control multiple camera devices of the first target central control device to capture the user's image, obtain multiple first images, and recognize the multiple images to obtain multiple first recognition results.

[0043] In this embodiment, the multiple camera devices controlling the first target central control device to capture the user's image can help the system more accurately identify the user's identity, improve the security and convenience of the intercom system, and achieve simultaneous identification of multiple people by obtaining multiple first images and recognizing multiple images, thereby improving the system's ability to identify users and its security. The multiple first recognition results can help the system make more accurate self-adaptive decisions and provide more personalized services.

[0044] It should be noted that the aforementioned central control unit uses a dual-camera combination of a standard focal length camera and a wide-angle camera, combined with an image recognition model and an adaptive strategy algorithm to achieve adaptive control of the intercom image on each screen.

[0045] like Figure 3As shown, after establishing the screen-to-screen intercom communication link, the intelligent central control unit participating in the screen-to-screen intercom each turns on its dual cameras and collects user data. The collected user image data (i.e., multiple first portraits) are then input into the portrait recognition processing model to obtain portrait recognition information (i.e., multiple first recognition results).

[0046] Step S206: Identify the camera device corresponding to a human image with a correct first recognition result as the target camera device, and control the camera devices other than the target camera device in the first target central control device to shut down.

[0047] In this embodiment, the intelligence and automation of the system can be improved, enabling the system to automatically determine the target camera device based on the correct human image in the first recognition result, and shut down other unrelated camera devices. This effectively saves system resources and improves the security and efficiency of the system, avoids manual control of multiple camera devices, reduces human error and negligence, enhances the intelligence level of the system, and provides users with a more convenient and faster user experience.

[0048] Taking dual cameras as an example, such as Figure 3 As shown, based on the output of the facial recognition processing model (i.e., the first recognition result), the camera with the best facial recognition result (i.e., the target camera device) is selected as the facial data input channel, and the data obtained by this channel is used as the intercom facial data for transmission. The other unused camera is turned off until it is woken up again or the intercom ends.

[0049] Step S208: Control the target camera device to capture the user's image in real time, and send the captured image to the second target central control device for display until the screen-to-screen intercom ends.

[0050] In this embodiment, the target camera device captures the user's image in real time and sends it to the second target central control device for display, which can realize the functions of real-time monitoring and communication. The image is then sent to the central control device for display, thereby realizing the intercom function. Users can conveniently communicate and watch the other party's real-time image, which improves the interactive experience of intercom. In addition, it can adapt to the user's needs, making the intercom process more intelligent and convenient.

[0051] As described above, in this embodiment of the invention, when the first target central control device and the second target central control device establish a communication connection for screen-to-screen communication, multiple camera devices of the first target central control device are controlled to capture and identify the user's image. The camera device corresponding to the image with the correct identification result is then identified as the target camera device. All other camera devices are turned off, and only the image of the user captured by the target camera device is sent to the second target central control device for display until the screen-to-screen communication ends. Since at least one of the multiple camera devices is a wide-angle camera device, it ensures the acquisition of a complete image. Enabling the camera device with the correct identification result ensures the image quality of the screen-to-screen communication.

[0052] The technical solutions provided by the embodiments of the present invention solve the technical problem that the existing central control equipment cannot guarantee the quality of human images when conducting screen-to-screen intercom, resulting in a poor user experience.

[0053] According to the above embodiments of the present invention, after recognizing multiple first human images and obtaining multiple first recognition results, the screen-to-screen intercom self-adaptation method further includes: if multiple recognition results are incorrect, controlling the first target central control device to issue a movement reminder to remind the user to adjust the distance to the first target central control device.

[0054] In this embodiment, the recognition accuracy and user experience of the intelligent central control device can be effectively improved. By controlling the central control device to issue movement reminders, users can adjust their distance from the device in a timely manner, and more accurately recognize user commands or voice, thereby improving efficiency and convenience. At the same time, it can also help users better understand the working principle of the device, improve users' operating skills and interactive experience, and effectively improve the user experience and functionality of the device.

[0055] That is, if all cameras are unable to obtain good facial information of the user, a reminder will be sent to the user via pop-up window and voice, reminding the user to adjust the distance from the central control (i.e., the first target central control device) so that any camera can obtain the user's facial information.

[0056] According to the above embodiments of the present invention, after controlling the camera devices other than the target camera device in the first target central control device to turn off, the self-adaptation method of the screen-to-screen intercom further includes: if the recognition result of the user's image collected by the target camera device is incorrect, controlling the camera devices other than the target camera device in the first target central control device to turn on; controlling multiple camera devices of the first target central control device to collect the user's image to obtain multiple second images, and recognizing the multiple second images to obtain multiple second recognition results; determining the camera device corresponding to an image with a correct second recognition result as the target camera device, and controlling the camera devices other than the target camera device in the first target central control device to turn off.

[0057] In this embodiment, the accuracy and efficiency of facial recognition can be improved. When the recognition result of the target camera device is incorrect, the system can promptly activate other camera devices to re-acquire and recognize the image, thereby finding the correct facial image and identifying the corresponding camera device as the target camera device. This avoids erroneous operations caused by misidentification, improves the system's intelligence level and user experience, and saves energy. The camera device is only activated when needed, avoiding unnecessary energy waste. This further enhances the system's intelligence and user experience, enabling more efficient monitoring and management.

[0058] Specifically, if a user's location changes during the screen-to-screen intercom process, causing the originally activated camera to be unable to capture the user's image, the deactivated camera is activated to capture image data (i.e., multiple second images) and input into the model for recognition to obtain image recognition information (i.e., multiple second recognition results). If the acquisition is successful, the other camera is deactivated; if it cannot be acquired, the user is prompted to adjust their position.

[0059] According to the above embodiments of the present invention, sending the image of a person captured by the target camera device to the second target central control device for display includes: performing background blurring processing on the image of the person captured by the target camera device to obtain a processed image; and sending the processed image to the second target central control device for display.

[0060] In this embodiment, the background blurring process of the human image captured by the target camera device can improve the clarity and aesthetics of the human image, making the display effect more professional and attractive. At the same time, sending the processed human image to the second target central control device for display can realize the functions of real-time monitoring and remote communication, thereby improving the practicality and convenience of the system.

[0061] In other words, the screen-to-screen intercom function has a privacy protection mechanism. When users are making screen-to-screen intercoms, they can enable the privacy protection mechanism to make the transmitted images pre-processed with background blurring before being transmitted to the target central control (i.e., the second target central control device) for display.

[0062] According to the above embodiments of the present invention, the self-adaptive method of the screen-to-screen intercom further includes: collecting the user's audio during the screen-to-screen intercom process; performing noise reduction processing on the audio to obtain a noise-reduced frequency; and sending the noise-reduced frequency to a second target central control device for playback.

[0063] In this embodiment, by collecting the user's audio and performing noise reduction processing, the call quality and clarity can be improved. Noise reduction processing can remove background noise, making the call clearer. Sending the noise-reduced audio to the second target central control device for playback can ensure the accuracy and integrity of the intercom content transmission, improve the user experience of the screen intercom system, enhance the intercom effect, improve call quality, and enable users to conduct intercom communication more smoothly.

[0064] Specifically, the screen-to-screen intercom function has ambient noise reduction. When a large noise signal is detected in the input audio, the input audio will be processed for ambient noise reduction before being transmitted to the target central control (i.e., the second target central control device) for playback.

[0065] According to the above embodiments of the present invention, the central control device further includes a human infrared sensor, and the screen-to-screen intercom self-adaptation method further includes: during the screen-to-screen intercom process, controlling the human infrared sensor of the first target central control device to acquire the user's body temperature data and display the body temperature data.

[0066] In this embodiment, by controlling the human infrared sensor of the first target central control device to acquire the user's body temperature data, real-time monitoring and display of the user's body temperature can be achieved. This helps to monitor the user's health status, detect abnormalities in a timely manner, and ensure the safety of the user and the environment. At the same time, through the self-adaptive function of the intelligent central control system, corresponding adjustments can be made according to the user's body temperature data, such as adjusting the air conditioning temperature and reminding the user to wear a mask, thereby improving the intelligence of the system and the user experience, and effectively enhancing the functionality and practicality of the screen intercom system.

[0067] It should be noted that the aforementioned central control screen is equipped with a human infrared sensor. The central control screen obtains the body temperature data of the person being interviewed through the human infrared sensor and displays the body temperature data of the person being interviewed on the administrator's central control terminal. The human infrared sensor is a device that can sense human body heat radiation, thereby realizing automatic control. It is usually installed on the central control equipment and determines the presence and activity status of the person by detecting human body heat radiation, thereby realizing intelligent control functions.

[0068] In addition, it should be noted that more physiological feature data can be obtained and displayed by adding other physiological feature detection modules, thus expanding the functionality further.

[0069] According to the above embodiments of the present invention, after the camera devices other than the target camera device in the first target central control device are turned off, the screen-to-screen intercom self-adaptation method further includes: responding to a second predetermined operation by the user, turning on the camera device corresponding to the second predetermined operation, the second predetermined operation being the operation of turning on the camera device; responding to a third predetermined operation by the user, turning off the camera device corresponding to the third predetermined operation, the third predetermined operation being the operation of turning off the camera device; and identifying an turned-on camera device as the target camera device.

[0070] In this embodiment, remote control and operation of the camera device by the user can be realized, allowing the user to conveniently turn the camera device on or off through the screen intercom system. The user can quickly control the camera device, improving the system's intelligence and convenience. By identifying an active camera device as the target camera device, the system can better track and record the user's operations, ensuring that the user's operations are accurate and effective, improving the system's adaptability, and making it easier for the user to manage and control the camera device, thereby improving the overall system performance and user experience.

[0071] The technical solution provided by the above embodiments of the present invention solves the problem that, due to the limitations of cameras, it is impossible to automatically adapt the captured human image, resulting in an inability to clearly see the image of the person being spoken to during screen-to-screen intercom. Simultaneously, it has the beneficial effect of automatically acquiring the image information of the person being spoken to during screen-to-screen intercom use through the coordinated operation of dual cameras, image recognition, and an adaptive algorithm.

[0072] As can be seen from the above, in this embodiment of the invention, in order to solve the problem that the user's image cannot be obtained due to the mismatch between the user and the central control when using a smart central control for screen-to-screen intercom, a method of collaborative control of dual cameras, image recognition and self-adaptive algorithm is provided, so that the user's image input and display can be self-adaptive during screen-to-screen intercom.

[0073] That is, the technical solution provided by the embodiments of the present invention takes into account a variety of factors, adopts a suitable dual-camera configuration and advanced image recognition technology, and can accurately acquire and display the image information of the intercom person through an adaptive algorithm.

[0074] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0075] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this application.

[0076] According to embodiments of the present invention, a screen-to-screen intercom self-adaptation device for implementing the above-described screen-to-screen intercom self-adaptation method is also provided. Figure 4 This is a schematic diagram of a screen-to-screen intercom self-adaptive device according to an embodiment of the present invention, as shown below. Figure 4 As shown, the device includes: a first control unit 401, a second control unit 403, a third control unit 405, and a fourth control unit 407. The self-adaptive device for this screen-to-screen intercom will be described below.

[0077] The first control unit 401 is used to respond to a first predetermined operation performed by a user on a first target central control device, and control the first target central control device to send a screen-to-screen intercom request to a second target central control device, so that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device. The first target central control device is the central control device operated by the user, and the second target central control device is a central control device other than the first target central control device.

[0078] The second control unit 403 is used to control multiple camera devices of the first target central control device to collect the user's image, obtain multiple first images, and recognize the multiple images to obtain multiple first recognition results.

[0079] The third control unit 405 is used to identify the camera device corresponding to a human image with a correct first recognition result as the target camera device, and control the camera devices other than the target camera device in the first target central control device to shut down.

[0080] The fourth control unit 407 is used to control the target camera device to capture the user's image in real time and send the image captured by the target camera device to the second target central control device for display until the screen-to-screen intercom ends.

[0081] It should be noted that the first control unit 401, the second control unit 403, the third control unit 405 and the fourth control unit 407 mentioned above correspond to steps S202 to S208 in the above embodiments. The four modules and the corresponding steps implement the same instances and application scenarios, but are not limited to the content disclosed in the above embodiments.

[0082] As can be seen from the above, in the scheme described in the above embodiments of the present invention, when the first target central control device and the second target central control device establish a communication connection for screen-to-screen communication, multiple camera devices of the first target central control device are controlled to collect and identify the user's image, thereby identifying the camera device corresponding to the image with the correct first identification result as the target camera device, and turning off the other camera devices. Only the image of the user collected by the target camera device is sent to the second target central control device for display until the screen-to-screen communication ends. Since at least one of the multiple camera devices is a wide-angle camera device, it ensures that the complete image of the person is captured. By turning on the camera device with the correct identification result, the image quality of the screen-to-screen communication is guaranteed.

[0083] The technical solutions provided by the embodiments of the present invention solve the technical problem that the existing central control equipment cannot guarantee the quality of human images when conducting screen-to-screen intercom, resulting in a poor user experience.

[0084] In an optional embodiment, the screen-to-screen intercom self-adaptation device further includes: a fifth control unit, used to control the first target central control device to issue a movement reminder after recognizing multiple first human images and obtaining multiple first recognition results, in the case that multiple recognition results are incorrect, so as to remind the user to adjust the distance to the first target central control device.

[0085] In an optional embodiment, the screen-to-screen intercom self-adaptation device further includes: a sixth control unit, configured to control the cameras other than the target camera in the first target central control device to turn on when the recognition result of the user's image captured by the target camera is incorrect after the camera devices other than the target camera in the first target central control device are turned off; a seventh control unit, configured to control multiple camera devices of the first target central control device to capture the user's image to obtain multiple second images, and to recognize the multiple second images to obtain multiple second recognition results; and an eighth control unit, configured to identify the camera device corresponding to an image with a correct second recognition result as the target camera device, and to control the cameras other than the target camera in the first target central control device to turn off.

[0086] In one optional embodiment, the fourth control unit includes: a processing module for blurring the background of the human image captured by the target camera device to obtain a processed human image; and a sending module for sending the processed human image to the second target central control device for display.

[0087] In one optional embodiment, the screen-to-screen intercom self-adaptive device further includes: a data acquisition unit for acquiring the user's audio during screen-to-screen intercom; a noise reduction processing unit for performing noise reduction processing on the audio to obtain a noise-reduced frequency; and a transmission unit for sending the noise-reduced frequency to a second target central control device for playback.

[0088] In an optional embodiment, the central control device further includes a human infrared sensor. The screen-to-screen intercom self-adaptation device also includes an eighth control unit, used to control the human infrared sensor of the first target central control device to acquire the user's body temperature data and display the body temperature data during the screen-to-screen intercom process.

[0089] In one optional embodiment, the screen-to-screen intercom self-adaptation device further includes: an activation unit, configured to activate the camera corresponding to the second predetermined operation in response to a second predetermined operation by the user after the camera other than the target camera in the first target central control device is turned off; a deactivation unit, configured to deactivate the camera corresponding to the third predetermined operation in response to a third predetermined operation by the user; and a determination unit, configured to determine an activated camera as the target camera.

[0090] According to another aspect of the present invention, a computer program product is also provided, including a computer program that, when executed by a processor, implements the screen-to-screen intercom self-adaptation method described above.

[0091] According to another aspect of the present invention, an Internet of Things (IoT) system is also provided, comprising: a plurality of central control devices, one or more processors, a memory, and one or more programs, wherein the plurality of central control devices each include a plurality of camera devices, at least one of the plurality of camera devices being a wide-angle camera device, the one or more programs being stored in the memory and configured to be executed by the one or more processors, and the one or more programs including an adaptive method for performing screen-to-screen intercom for performing any of the above.

[0092] According to another aspect of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored program, wherein, when the program is executed, it controls the device where the computer-readable storage medium is located to execute the screen-to-screen intercom self-adaptation method described above.

[0093] Optionally, in this embodiment, the computer-readable storage medium may be located in any computer terminal in a group of computer terminals in a computer network, or in any communication device in a group of communication devices.

[0094] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: in response to a first predetermined operation performed by a user on a first target central control device, controlling the first target central control device to send a screen-to-screen intercom request to a second target central control device, causing the second target central control device to establish a communication connection with the first target central control device in response to the screen-to-screen intercom request, wherein the second target central control device is a central control device other than the first target central control device; controlling multiple camera devices of the first target central control device to capture the user's image, obtaining multiple first images, and recognizing the multiple images to obtain multiple first recognition results; determining the camera device corresponding to an image with a correct first recognition result as the target camera device, and controlling the camera devices other than the target camera device in the first target central control device to turn off; controlling the target camera device to capture the user's image in real time, and sending the image captured by the target camera device to the second target central control device for display, until the screen-to-screen intercom ends.

[0095] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: if multiple identification results are incorrect, control the first target central control device to issue a movement reminder to remind the user to adjust the distance to the first target central control device.

[0096] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: if the recognition result of the user's image captured by the target camera device is incorrect, control the camera devices other than the target camera device in the first target central control device to turn on; control multiple camera devices of the first target central control device to capture the user's image, obtain multiple second images, and recognize the multiple second images to obtain multiple second recognition results; determine the camera device corresponding to an image with a correct second recognition result as the target camera device, and control the camera devices other than the target camera device in the first target central control device to turn off.

[0097] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: blurring the background of the human image captured by the target camera device to obtain a processed human image; and sending the processed human image to the second target central control device for display.

[0098] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: during screen-to-screen intercom, acquiring the user's audio; performing noise reduction processing on the audio to obtain a noise-reduced frequency; and sending the noise-reduced frequency to a second target central control device for playback.

[0099] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: during screen-to-screen intercom, controlling the human infrared sensor of the first target central control device to acquire the user's body temperature data and display the body temperature data.

[0100] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for performing the following steps: in response to a second predetermined operation by a user, turning on the camera device corresponding to the second predetermined operation, wherein the second predetermined operation is the operation of turning on the camera device; in response to a third predetermined operation by a user, turning off the camera device corresponding to the third predetermined operation, wherein the third predetermined operation is the operation of turning off the camera device; and determining an turned-on camera device as the target camera device.

[0101] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0102] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0103] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual couplings, direct couplings, or communication connections may be through some interfaces; indirect couplings or communication connections between units or modules may be electrical or other forms.

[0104] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0105] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0106] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0107] The above are merely preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A self-adaptive method for screen-to-screen intercom, characterized in that, Multiple central control devices include multiple camera units. At least one of the plurality of camera devices is a wide-angle camera device, and the method includes: In response to a user’s first predetermined operation on a first target central control device, the first target central control device is controlled to send a screen-to-screen intercom request to a second target central control device, so that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device, wherein the second target central control device is the central control device other than the first target central control device; Multiple camera devices of the first target central control device are controlled to capture the user's image, resulting in multiple first images, and the multiple images are identified to obtain multiple first identification results; The camera device corresponding to a human image with a correct first recognition result is identified as the target camera device, and the camera devices other than the target camera device in the first target central control device are controlled to turn off; The target camera device is controlled to capture the user's image in real time, and the image captured by the target camera device is sent to the second target central control device for display until the screen-to-screen intercom ends.

2. The method according to claim 1, characterized in that, After recognizing multiple first portraits and obtaining multiple first recognition results, the method further includes: If multiple identification results are incorrect, the first target central control device is controlled to issue a movement reminder to remind the user to adjust the distance between the user and the first target central control device.

3. The method according to claim 1, characterized in that, After shutting down the camera devices other than the target camera device in the first target central control device, the method further includes: If the recognition result of the user's image captured by the target camera device is incorrect, the camera devices other than the target camera device in the first target central control device shall be turned on. Multiple camera devices of the first target central control device are controlled to capture the user's image, resulting in multiple second images, and the multiple second images are identified to obtain multiple second identification results; The camera device corresponding to the human image with the correct second recognition result is identified as the target camera device, and the camera devices other than the target camera device in the first target central control device are controlled to be turned off.

4. The method according to any one of claims 1 to 3, characterized in that, Sending the human image captured by the target camera to the second target central control device for display includes: The human image captured by the target camera device is subjected to background blurring processing to obtain the processed human image; The processed human image is sent to the second target central control device for display.

5. The method according to any one of claims 1 to 3, characterized in that, The method further includes: During the screen-to-screen intercom process, the user's audio is collected; The audio is subjected to noise reduction processing to obtain the noise-reduced audio. The noise-reduced audio is sent to the second target central control device for playback.

6. The method according to any one of claims 1 to 3, characterized in that, The central control device also includes a human infrared sensor, and the method further includes: During the screen-to-screen intercom, the human infrared sensor of the first target central control device acquires the user's body temperature data and displays the body temperature data.

7. The method according to any one of claims 1 to 3, characterized in that, After shutting down the camera devices other than the target camera device in the first target central control device, the method further includes: In response to the user's second predetermined operation, the camera device corresponding to the second predetermined operation is activated; In response to the user's third predetermined operation, the camera device corresponding to the third predetermined operation is turned off; The target camera device is identified as an activated camera device.

8. A self-adaptive device for screen-to-screen intercom, characterized in that, Multiple central control devices include multiple camera units. At least one of the plurality of camera devices is a wide-angle camera device, the device comprising: A first control unit is configured to respond to a first predetermined operation performed by a user on a first target central control device, and control the first target central control device to send a screen-to-screen intercom request to a second target central control device, so that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device, wherein the first target central control device is the central control device operated by the user, and the second central control device is the central control device other than the first target central control device; The second control unit is used to control multiple camera devices of the first target central control device to acquire the user's image, obtain multiple first images, and identify the multiple images to obtain multiple first identification results; The third control unit is used to identify the camera device corresponding to a human image with a correct first recognition result as the target camera device, and to control the camera devices other than the target camera device in the first target central control device to turn off; The fourth control unit is used to control the target camera device to capture the user's image in real time, and send the image captured by the target camera device to the second target central control device for display until the screen-to-screen intercom ends.

9. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1 to 7.

10. An Internet of Things (IoT) system, characterized in that, include: A plurality of central control devices, one or more processors, a memory, and one or more programs, wherein each of the plurality of central control devices includes a plurality of camera devices, at least one of the plurality of camera devices being a wide-angle camera device, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs including methods for performing any one of claims 1 to 7.

Images