Self-adaption method and device for screen-to-screen talkback

Abstract

The invention discloses a self-adaption method and a self-adaption device for screen-to-screen talkback. The method comprises the following steps: in response to a first predetermined operation of a user acting on first target central control equipment, controlling the first target central control equipment to send a screen-screen talkback request to second target central control equipment, so that the second target central control equipment establishes communication connection with the first target central control equipment in response to the screen-screen talkback request; a plurality of camera devices of the first target central control equipment are controlled to collect portraits of the user, a plurality of first portraits are obtained and recognized, and a plurality of first recognition results are obtained; determining the camera device corresponding to the portrait with the correct first recognition result as a target camera device, and controlling the camera devices except the target camera device to be turned off; and controlling the target camera device to collect a portrait of the user in real time, and sending the collected portrait to the second target central control equipment for display until the screen-screen intercom is finished. According to the invention, the technical problem of poor experience caused by incapability of ensuring portrait quality during screen-to-screen talkback of central control equipment in the prior art is solved.

Description

Technical Field

[0001] The present invention relates to the field of smart home technology, and in particular to a self-adaptation method and device for screen-to-screen intercom. Background Art

[0002] Nowadays, smart homes have entered every household. With the improvement of chip performance and the iteration of voice recognition algorithms, voice recognition has begun to be widely used in people's daily lives. In the smart home system, the smart central control is the control center for interacting with users and smart sub-devices. Its user experience is enough to affect the user's experience of the entire smart home system at home.

[0003] The smart central control systems currently on the market all have the capabilities of visualization, image input and network transmission, but lack the ability of image self-adaptation in terms of screen-to-screen intercom functions.

[0004] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0005] The embodiments of the present invention provide a self-adaptation method and device for screen-to-screen intercom, so as to at least solve the technical problem that the quality of portraits cannot be guaranteed when the central control device in the prior art performs screen-to-screen intercom, resulting in poor experience.

[0006] According to one aspect of an embodiment of the present invention, a self-adaptation method for screen-to-screen intercom is provided, wherein a plurality of central control devices each include a plurality of camera devices, at least one of the plurality of camera devices is a wide-angle camera device, and the method comprises: in response to a first predetermined operation performed by a user on a first target central control device, controlling the first target central control device to send a screen-to-screen intercom request to a second target central control device, so that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device, wherein the second target central control device is a central control device other than the first target central control device; controlling the plurality of camera devices of the first target central control device to capture a portrait of the user to obtain a plurality of first portraits, and identifying the plurality of portraits to obtain a plurality of first identification results; determining the camera device corresponding to a portrait with a correct first identification result as a target camera device, and controlling the cameras other than the target camera device in the first target central control device to be turned off; controlling the target camera device to capture the portrait of the user in real time, and sending the portrait captured by the target camera device to the second target central control device for display until the screen-to-screen intercom ends.

[0007] Optionally, after identifying multiple first portraits and obtaining multiple first identification results, the self-adaptation method of the screen-to-screen intercom also includes: when multiple identification results are incorrect, controlling the first target central control device to issue a moving reminder to remind the user to adjust the distance from the first target central control device.

[0008] Optionally, after controlling the camera devices other than the target camera device in the first target central control device to turn off, the self-adaptation method of the screen intercom also includes: when the recognition result of the user's portrait captured by the target camera device is incorrect, controlling the camera devices other than the target camera device in the first target central control device to turn on; controlling multiple camera devices of the first target central control device to capture the user's portrait to obtain multiple second portraits, and identifying the multiple second portraits to obtain multiple second recognition results; determining the camera device corresponding to a portrait with a correct second recognition result as the target camera device, and controlling the camera devices other than the target camera device in the first target central control device to turn off.

[0009] Optionally, sending the portrait captured by the target camera device to the second target central control device for display includes: blurring the background of the portrait captured by the target camera device to obtain a processed portrait; and sending the processed portrait to the second target central control device for display.

[0010] Optionally, the self-adaptation method of the screen-to-screen intercom also includes: during the screen-to-screen intercom process, collecting the audio of the user; performing noise reduction processing on the audio to obtain noise-reduced audio; and sending the noise-reduced audio to the second target central control device for playback.

[0011] Optionally, the central control device also includes a human infrared sensor, and the self-adaptation method of the screen-to-screen intercom also includes: during the screen-to-screen intercom process, controlling the human infrared sensor of the first target central control device to obtain the body temperature data of the user, and displaying the body temperature data.

[0012] Optionally, after controlling the camera devices other than the target camera device in the first target central control device to be turned off, the self-adaptation method of the screen intercom also includes: in response to a second predetermined operation of the user, turning on the camera device corresponding to the second predetermined operation, the second predetermined operation is an operation of turning on the camera device; in response to a third predetermined operation of the user, turning off the camera device corresponding to the third predetermined operation, the third predetermined operation is an operation of turning off the camera device; and determining one of the turned-on camera devices as the target camera device.

[0013] According to another aspect of an embodiment of the present invention, a self-adaptive device for screen-to-screen intercom is also provided, wherein multiple central control devices each include multiple camera devices, at least one of the multiple camera devices is a wide-angle camera device, and the device includes: a first control unit, for responding to a first predetermined operation performed by a user on a first target central control device, controlling the first target central control device to send a screen-to-screen intercom request to a second target central control device, so that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device, the first target central control device being the central control device operated by the user, and the second target central control device being all other central control devices other than the first target central control device the central control device; a second control unit, used to control the multiple camera devices of the first target central control device to capture the user's portrait, obtain multiple first portraits, and identify the multiple portraits to obtain multiple first identification results; a third control unit, used to determine the camera device corresponding to the portrait with a correct first identification result as the target camera device, and control the camera devices other than the target camera device in the first target central control device to be turned off; a fourth control unit, used to control the target camera device to capture the user's portrait in real time, and send the portrait captured by the target camera device to the second target central control device for display until the screen intercom ends.

[0014] Optionally, the self-adaptive device of the screen-to-screen intercom also includes: a fifth control unit, for controlling the first target central control device to issue a moving reminder to remind the user to adjust the distance from the first target central control device after recognizing multiple first human portraits and obtaining multiple first recognition results if all of the multiple recognition results are incorrect.

[0015] Optionally, the self-adaptive device of the screen-to-screen intercom also includes: a sixth control unit, used to control the camera devices other than the target camera device in the first target central control device to turn on when the recognition result of the portrait of the user captured by the target camera device is incorrect after the camera devices other than the target camera device in the first target central control device are controlled to be turned off; a seventh control unit, used to control multiple camera devices of the first target central control device to capture the portrait of the user, obtain multiple second portraits, and recognize the multiple second portraits to obtain multiple second recognition results; an eighth control unit, used to determine the camera device corresponding to the portrait with a correct second recognition result as the target camera device, and control the camera devices other than the target camera device in the first target central control device to turn off.

[0016] Optionally, the fourth control unit includes: a processing module, used to blur the background of the portrait captured by the target camera device to obtain a processed portrait; and a sending module, used to send the processed portrait to the second target central control device for display.

[0017] Optionally, the self-adaptive device for screen-to-screen intercom also includes: a collection unit, used to collect the audio of the user during the screen-to-screen intercom process; a noise reduction processing unit, used to perform noise reduction processing on the audio to obtain noise-reduced audio; and a sending unit, used to send the noise-reduced audio to the second target central control device for playback.

[0018] Optionally, the central control device also includes a human infrared sensor, and the self-adaptive device of the screen-to-screen intercom also includes: an eighth control unit, used to control the human infrared sensor of the first target central control device to obtain the body temperature data of the user and display the body temperature data during the screen-to-screen intercom process.

[0019] Optionally, the self-adaptive device of the screen-to-screen intercom also includes: a turning on unit, for responding to a second predetermined operation of the user after the camera devices other than the target camera device in the first target central control device are turned off, to turn on the camera device corresponding to the second predetermined operation, wherein the second predetermined operation is an operation to turn on the camera device; a turning off unit, for responding to a third predetermined operation of the user, to turn off the camera device corresponding to the third predetermined operation, wherein the third predetermined operation is an operation to turn off the camera device; and a determining unit, for determining a turned-on camera device as the target camera device.

[0020] According to another aspect of an embodiment of the present invention, a computer program product is also provided, including a computer program, and when the computer program is executed by a processor, the self-adaptation method of screen-to-screen intercom described in any one of the above is implemented.

[0021] According to another aspect of an embodiment of the present invention, there is also provided an Internet of Things system, comprising: a plurality of central control devices, one or more processors, a memory, and one or more programs, wherein the plurality of central control devices each comprise a plurality of cameras, at least one of the plurality of cameras being a wide-angle camera, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising a self-adaptation method for executing any one of the above-described screen-to-screen intercoms.

[0022] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is further provided, the computer-readable storage medium comprising a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute any one of the above-mentioned screen-to-screen intercom self-adaptation methods.

[0023] In an embodiment of the present invention, when a first target central control device establishes a communication connection with a second target central control device for screen-to-screen intercom, multiple cameras of the first target central control device are controlled to capture and identify a user's portrait, thereby determining a camera corresponding to a portrait with a correct first recognition result as a target camera, and other cameras are turned off, and only the target camera is retained to capture the user's portrait and send it to the second target central control device for display until the screen-to-screen intercom ends. Since at least one of the multiple cameras is a wide-angle camera, it is guaranteed that a complete portrait is obtained, and a camera with a correct recognition result is turned on, thereby ensuring the portrait quality of the screen-to-screen intercom, thereby solving the technical problem that the central control device in the prior art cannot ensure the portrait quality when performing screen-to-screen intercom, resulting in a poor experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0025] Figure 1 It is a hardware structure block diagram of a mobile terminal of a self-adaptation method for screen-to-screen intercom according to an embodiment of the present invention;

[0026] Figure 2 is a flow chart of a self-adaptation method for screen-to-screen intercom according to an embodiment of the present invention;

[0027] Figure 3 is a flow chart of an optional self-adaptation method for screen-to-screen intercom according to an embodiment of the present invention;

[0028] Figure 4 It is a schematic diagram of a self-adaptive device for screen-to-screen intercom according to an embodiment of the present invention. DETAILED DESCRIPTION

[0029] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0030] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0031] As introduced in the background technology, the central control device in the prior art cannot guarantee the quality of the portrait when performing screen-to-screen intercom, resulting in a poor experience. In view of the above defects, an adaptive method and device for screen-to-screen intercom, a computer program product, an Internet of Things system, an electronic device, a computer-readable storage medium, and a processor are provided in an embodiment of the present invention.

[0032] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present invention.

[0033] The method embodiments provided in the embodiments of the present invention can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a mobile terminal as an example, Figure 1 FIG. 1 is a hardware structure block diagram of a mobile terminal for a self-adaptation method of screen-to-screen intercom according to an embodiment of the present invention. Figure 1 As shown, the mobile terminal may include one or more ( Figure 1 Only one is shown in the figure) a processor 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the mobile terminal may also include a transmission device 106 and an input / output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the mobile terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0034] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the self-adaptation method of screen-to-screen intercom in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, the above method is implemented. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories can be connected to the mobile terminal via a network. Examples of the above-mentioned network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof. The transmission device 106 is used to receive or send data via a network. The above-mentioned specific examples of the network may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0035] According to an embodiment of the present invention, a method embodiment of a self-adaptation method for screen-to-screen intercom is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0036] Figure 2 is a flow chart of a self-adaptation method for screen-to-screen intercom according to an embodiment of the present invention. Figure 2 As shown, the method comprises the following steps:

[0037] Step S202, in response to a first predetermined operation performed by a user on the first target central control device, controls the first target central control device to send a screen-to-screen intercom request to the second target central control device, so that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device, and the second target central control device is a central control device other than the first target central control device.

[0038] It should be noted that the above-mentioned central control device is an intelligent device used to control the operation and management of the entire screen intercom system. It usually includes a main controller, various sensors, actuators and other equipment. It can exchange data and control operations with various components in the screen intercom system through network connections and communication protocols.

[0039] In this embodiment, communication connection between different central control devices can be achieved, so that users can conveniently perform screen intercom operations. By performing a predetermined operation on the first target central control device, the user can trigger the first target central control device to send a screen intercom request to the second target central control device to establish a communication connection. The user can communicate with other central control devices in real time to achieve more convenient communication and collaboration, which can improve user experience, enhance the interconnection between devices, and make the screen intercom function more flexible and intelligent.

[0040] Figure 3 is a flow chart of an optional self-adaptation method for screen-to-screen intercom according to an embodiment of the present invention, such as Figure 3 As shown, the user triggers the screen-to-screen intercom function (i.e., the first predetermined operation) on any smart central control (i.e., the first target central control device), and selects the target smart central control. The smart central control (i.e., the first target central control device) initiates a screen-to-screen intercom request command packet to the target smart central control (i.e., the second target central control device). After receiving the screen-to-screen intercom request, the target smart central control reminds the user of the screen-to-screen intercom request through a visual interface, responds to the request response packet to the initiator (i.e., the first target central control device) after confirmation, and establishes a screen-to-screen intercom communication link with the requester (i.e., the first target central control device).

[0041] It should be noted that the smart central control in the home is connected to the same smart home system through the distribution network, so that the network link remains connected.

[0042] Step S204, controlling multiple camera devices of the first target central control device to capture the user's portrait to obtain multiple first portraits, and identifying the multiple portraits to obtain multiple first identification results.

[0043] In this embodiment, controlling multiple camera devices of the first target central control device to capture user portraits can help the system identify the user's identity more accurately, improve the security and convenience of the intercom system, and by obtaining and identifying multiple first portraits, multiple people can be identified simultaneously, thereby improving the system's recognition and security of users. The multiple first recognition results obtained can help the system make more accurate adaptive decisions and provide more personalized services.

[0044] It should be noted that the above-mentioned central control adopts a dual-camera combination of a normal focal length camera and a wide-angle camera, combined with an image recognition model and an adaptive strategy algorithm to perform adaptive control of the screen-to-screen intercom portrait.

[0045] like Figure 3As shown, after the screen-to-screen intercom communication link is established, the intelligent central control participating in the screen-to-screen intercom turns on the dual cameras respectively, and collects user data, and respectively transmits the collected user image data (i.e., multiple first portraits) to the portrait recognition processing model to obtain portrait recognition information (i.e., multiple first recognition results).

[0046] Step S206: determine the camera device corresponding to the portrait with the correct first recognition result as the target camera device, and control the camera devices other than the target camera device in the first target central control device to be turned off.

[0047] In this embodiment, the intelligence and automation level of the system can be improved, so that the system can automatically determine the target camera device based on the correct portrait in the first recognition result, and turn off other irrelevant cameras, thereby effectively saving system resources and improving the security and efficiency of the system, avoiding manual control of multiple cameras, reducing errors and negligence in human operation, improving the intelligence level of the system, and providing users with a more convenient and quicker user experience.

[0048] Take dual cameras as an example. Figure 3 As shown, according to the output result of the portrait recognition processing model (i.e., the first recognition result), the camera with the best portrait recognition result (i.e., the target camera device) is selected as the portrait data input channel, and the data obtained by this channel is used as the screen-to-screen intercom portrait data for transmission, and the other unused camera is turned off until it is woken up again or the screen-to-screen intercom ends.

[0049] Step S208, controlling the target camera device to capture the user's portrait in real time, and sending the portrait captured by the target camera device to the second target central control device for display until the screen-to-screen intercom ends.

[0050] In this embodiment, the target camera device is controlled to capture the user's portrait in real time and send it to the second target central control device for display, which can realize the functions of real-time monitoring and communication, and send it to the central control device for display, thereby realizing the intercom function. The user can conveniently communicate through intercom, and can also watch the other party's real-time picture in real time, which improves the interactive experience of the intercom. In addition, it can also adapt according to the needs of the user, making the intercom process more intelligent and convenient.

[0051] From the above, it can be seen that in an embodiment of the present invention, when a first target central control device establishes a communication connection with a second target central control device for screen-to-screen intercom, multiple cameras of the first target central control device are controlled to capture and identify the user's portrait, so that a camera corresponding to a portrait with a correct first recognition result is determined as the target camera, and other cameras are turned off, and only the target camera is retained to capture the user's portrait and send it to the second target central control device for display until the screen-to-screen intercom ends. Since at least one of the multiple cameras is a wide-angle camera, it is guaranteed to obtain a complete portrait, and a camera with a correct recognition result is turned on to ensure the portrait quality of the screen-to-screen intercom.

[0052] The technical solution provided by the embodiment of the present invention solves the technical problem that the quality of the portrait cannot be guaranteed when the central control device in the prior art performs screen-to-screen intercom, resulting in a poor experience.

[0053] According to the above embodiment of the present invention, after identifying multiple first portraits and obtaining multiple first recognition results, the self-adaptation method of the screen intercom also includes: when the multiple recognition results are incorrect, controlling the first target central control device to issue a moving reminder to remind the user to adjust the distance from the first target central control device.

[0054] In this embodiment, the recognition accuracy and user experience of the smart central control device can be effectively improved. By controlling the central control device to issue a mobile reminder, the user can adjust the distance from the device in time and more accurately recognize the user's instructions or voice, thereby improving usage efficiency and convenience. At the same time, it can also help users better understand the working principle of the device, improve the user's operating skills and interactive experience of the device, and effectively improve the user experience and functionality of the device.

[0055] That is, if all cameras cannot obtain good portrait information of the user, a reminder will be sent to the user through a pop-up window and voice, reminding the user to adjust the distance from the central control (i.e., the first target central control device) so that any camera can obtain the user's portrait information.

[0056] According to the above embodiment of the present invention, after controlling the camera devices other than the target camera device in the first target central control device to be turned off, the self-adaptation method of the screen intercom also includes: when the recognition result of the user's portrait captured by the target camera device is incorrect, controlling the camera devices other than the target camera device in the first target central control device to be turned on; controlling multiple camera devices of the first target central control device to capture the user's portrait to obtain multiple second portraits, and identifying the multiple second portraits to obtain multiple second recognition results; determining the camera device corresponding to a portrait with a correct second recognition result as the target camera device, and controlling the camera devices other than the target camera device in the first target central control device to be turned off.

[0057] In this embodiment, the accuracy and efficiency of portrait recognition can be improved. When the recognition result of the target camera device is incorrect, the system can promptly start other cameras to re-capture and recognize the correct portrait and determine its corresponding camera device as the target camera device, which can avoid erroneous operations caused by misidentification, improve the intelligence level of the system and user experience, and at the same time, save energy. The camera device is only turned on when needed to avoid unnecessary energy waste, which can improve the intelligence level of the system and user experience, and achieve more efficient monitoring and management.

[0058] Specifically, during the screen-to-screen intercom process, if the user's position changes and the originally turned-on camera cannot obtain the user's portrait, the turned-off camera obtains the portrait data (i.e., multiple second portraits) and inputs it into the model for recognition to obtain portrait recognition information (i.e., multiple second recognition results). If the acquisition is successful, the other camera is turned off. If it cannot be obtained, the user is prompted to adjust the position.

[0059] According to the above embodiment of the present invention, sending the portrait captured by the target camera device to the second target central control device for display includes: blurring the background of the portrait captured by the target camera device to obtain a processed portrait; and sending the processed portrait to the second target central control device for display.

[0060] In this embodiment, the background of the portrait captured by the target camera device is blurred, which can improve the clarity and aesthetics of the portrait, making the display effect more professional and attractive. At the same time, the processed portrait is sent to the second target central control device for display, which can realize the functions of real-time monitoring and remote communication, thereby improving the practicality and convenience of the system.

[0061] That is, the screen-to-screen intercom function has a privacy protection mechanism. When conducting screen-to-screen intercom, the user can turn on the privacy protection mechanism so that the transmitted image is pre-processed with background blur before being transmitted to the target central control (i.e., the second target central control device) for display.

[0062] According to the above embodiment of the present invention, the self-adaptation method of the screen-to-screen intercom also includes: during the screen-to-screen intercom process, collecting the user's audio; performing noise reduction processing on the audio to obtain noise-reduced audio; and sending the noise-reduced audio to the second target central control device for playback.

[0063] In this embodiment, by collecting the user's audio and performing noise reduction processing on it, the call quality and clarity can be improved. Through noise reduction processing, background noise can be removed to make the call clearer. The noise-reduced audio is sent to the second target central control device for playback, which can ensure the accuracy and completeness of the intercom content transmission, improve the user experience of the screen intercom system, enhance the intercom effect, improve the call quality, and allow users to communicate more smoothly during intercom.

[0064] Specifically, the screen-to-screen intercom function has ambient sound noise reduction. When a large noise signal is detected in the input audio, the input audio will be processed for ambient sound noise reduction before being transmitted to the target central control (i.e., the second target central control device) for playback.

[0065] According to the above embodiment of the present invention, the central control device also includes a human infrared sensor, and the self-adaptation method of the screen-to-screen intercom also includes: during the screen-to-screen intercom process, controlling the human infrared sensor of the first target central control device to obtain the user's body temperature data and display the body temperature data.

[0066] In this embodiment, by controlling the human infrared sensor of the first target central control device to obtain the user's body temperature data, real-time monitoring and display of the user's body temperature can be achieved, which can help monitor the user's health status, detect abnormal situations in time, and ensure the safety of the user and the environment. At the same time, through the self-adaptive function of the intelligent central control system, corresponding adjustments can be made according to the user's body temperature data, such as adjusting the air-conditioning temperature, reminding users to wear masks, etc., thereby improving the intelligence of the system and user experience, and can effectively improve the functionality and practicality of the screen intercom system.

[0067] It should be noted that the above-mentioned central control screen is equipped with a human infrared sensor. The central control screen obtains the body temperature data of the interlocutor through the human infrared sensor and displays the body temperature data of the interlocutor on the administrator's central control terminal. Among them, the human infrared sensor is a device that can sense the thermal radiation of the human body and thus realize automatic control. It is usually installed on the central control equipment, and judges the presence and activity status of the person by detecting the thermal radiation of the human body, thereby realizing intelligent control functions.

[0068] In addition, it should be noted that other physiological characteristic detection modules can be added to obtain more physiological characteristic data for display, thereby expanding more functions.

[0069] According to the above embodiment of the present invention, after controlling the camera devices other than the target camera device in the first target central control device to be turned off, the self-adaptation method of the screen intercom also includes: in response to a second predetermined operation of the user, turning on the camera device corresponding to the second predetermined operation, the second predetermined operation is an operation of turning on the camera device; in response to a third predetermined operation of the user, turning off the camera device corresponding to the third predetermined operation, the third predetermined operation is an operation of turning off the camera device; and determining a turned-on camera device as the target camera device.

[0070] In this embodiment, the user can remotely control and operate the camera device, so that the user can conveniently turn on or off the camera device through the screen intercom system. The user can quickly control the camera device, which improves the intelligence and convenience of the system. By identifying a turned-on camera device as a target camera device, the system can better track and record the user's operations, ensure that the user's operations are accurate and effective, and improve the system's adaptability, allowing the user to more conveniently manage and control the camera device, thereby improving the overall performance of the system and user experience.

[0071] The technical solution provided by the above embodiment of the present invention solves the problem that the image of the interlocutor cannot be well seen during screen-to-screen intercom due to the limitation of the camera and the inability to self-adapt the recording of the portrait. At the same time, it has the beneficial effect of self-adaptively obtaining the image information of the interlocutor when using the intelligent central control screen-to-screen intercom through the coordinated operation of dual cameras, image recognition, and self-adaptation algorithm.

[0072] From the above, it can be seen that in an embodiment of the present invention, in order to solve the problem that when using an intelligent central control for screen-to-screen intercom, the user's image cannot be obtained due to the incompatibility of the distance between the user and the central control, a method of collaborative control of dual cameras, image recognition and self-adaptive algorithm is provided, so that the user image input and display can be self-adaptive during the screen-to-screen intercom process.

[0073] That is, the technical solution provided by the embodiment of the present invention comprehensively considers various factors, adopts a suitable dual-camera configuration, and advanced image recognition technology, and can accurately obtain and display the image information of the interlocutor through a self-adaptive algorithm.

[0074] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0075] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods of each embodiment of the present application.

[0076] According to an embodiment of the present invention, a self-adaptation device for screen-to-screen intercom for implementing the self-adaptation method for screen-to-screen intercom is also provided. Figure 4 is a schematic diagram of a self-adapting device for screen-to-screen intercom according to an embodiment of the present invention. Figure 4 As shown, the device includes: a first control unit 401, a second control unit 403, a third control unit 405 and a fourth control unit 407. The self-adaptive device for screen-to-screen intercom is described below.

[0077] The first control unit 401 is used to control the first target central control device to send a screen-to-screen intercom request to the second target central control device in response to a first predetermined operation performed by a user on the first target central control device, so that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device. The first target central control device is a central control device operated by the user, and the second target central control device is a central control device other than the first target central control device.

[0078] The second control unit 403 is used to control the multiple camera devices of the first target central control device to capture the user's portrait, obtain multiple first portraits, and recognize the multiple portraits to obtain multiple first recognition results.

[0079] The third control unit 405 is used to determine the camera device corresponding to the portrait with the correct first recognition result as the target camera device, and control the camera devices other than the target camera device in the first target central control device to be turned off.

[0080] The fourth control unit 407 is used to control the target camera device to capture the user's portrait in real time, and send the portrait captured by the target camera device to the second target central control device for display until the screen-to-screen intercom ends.

[0081] It should be noted here that the above-mentioned first control unit 401, second control unit 403, third control unit 405 and fourth control unit 407 correspond to steps S202 to S208 in the above-mentioned embodiments, and the four modules are the same as the instances and application scenarios implemented by the corresponding steps, but are not limited to the contents disclosed in the above-mentioned embodiments.

[0082] From the above, it can be seen that in the scheme recorded in the above-mentioned embodiment of the present invention, when the first target central control device and the second target central control device establish a communication connection for screen-to-screen intercom, the multiple cameras of the first target central control device are controlled to capture the user's portrait and identify it, so that the camera corresponding to a portrait with a correct first recognition result is determined as the target camera, and the other cameras are turned off, and only the target camera is retained to capture the user's portrait and send it to the second target central control device for display until the screen-to-screen intercom ends. Since at least one of the multiple cameras is a wide-angle camera, it is guaranteed to obtain a complete portrait, and a camera with a correct recognition result is turned on to ensure the portrait quality of the screen-to-screen intercom.

[0083] The technical solution provided by the embodiment of the present invention solves the technical problem that the quality of the portrait cannot be guaranteed when the central control device in the prior art performs screen-to-screen intercom, resulting in a poor experience.

[0084] In an optional embodiment, the self-adaptive device of the screen-to-screen intercom also includes: a fifth control unit, which is used to control the first target central control device to issue a moving reminder to remind the user to adjust the distance from the first target central control device after recognizing multiple first portraits and obtaining multiple first recognition results if the multiple recognition results are incorrect.

[0085] In an optional embodiment, the self-adaptive device of the screen-to-screen intercom further includes: a sixth control unit, used to control the camera devices other than the target camera device in the first target central control device to turn on when the recognition result of the user's portrait captured by the target camera device is incorrect after the camera devices other than the target camera device in the first target central control device are controlled to be turned off; a seventh control unit, used to control multiple camera devices of the first target central control device to capture the user's portrait, obtain multiple second portraits, and recognize the multiple second portraits to obtain multiple second recognition results; an eighth control unit, used to determine the camera device corresponding to a portrait with a correct second recognition result as the target camera device, and control the camera devices other than the target camera device in the first target central control device to turn off.

[0086] In an optional embodiment, the fourth control unit includes: a processing module, used to blur the background of the portrait captured by the target camera device to obtain a processed portrait; and a sending module, used to send the processed portrait to the second target central control device for display.

[0087] In an optional embodiment, the self-adaptive device for screen-to-screen intercom also includes: a collection unit, used to collect the user's audio during the screen-to-screen intercom process; a noise reduction processing unit, used to perform noise reduction processing on the audio to obtain noise-reduced audio; and a sending unit, used to send the noise-reduced audio to a second target central control device for playback.

[0088] In an optional embodiment, the central control device also includes a human infrared sensor, and the self-adaptive device of the screen-to-screen intercom also includes: an eighth control unit, which is used to control the human infrared sensor of the first target central control device to obtain the user's body temperature data and display the body temperature data during the screen-to-screen intercom process.

[0089] In an optional embodiment, the self-adaptive device of the screen-to-screen intercom also includes: a turning on unit, which is used to respond to a second predetermined operation of the user after the camera devices other than the target camera device in the first target central control device are turned off, and turn on the camera device corresponding to the second predetermined operation, wherein the second predetermined operation is an operation to turn on the camera device; a turning off unit, which is used to respond to a third predetermined operation of the user, and turn off the camera device corresponding to the third predetermined operation, wherein the third predetermined operation is an operation to turn off the camera device; and a determining unit, which is used to determine a turned-on camera device as a target camera device.

[0090] According to another aspect of an embodiment of the present invention, a computer program product is also provided, including a computer program, and when the computer program is executed by a processor, the self-adaptation method of screen-to-screen intercom described in any one of the above is implemented.

[0091] According to another aspect of an embodiment of the present invention, there is also provided an Internet of Things system, comprising: a plurality of central control devices, one or more processors, a memory, and one or more programs, wherein the plurality of central control devices each comprise a plurality of cameras, at least one of the plurality of cameras being a wide-angle camera, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising a self-adaptive method for screen-to-screen intercom for executing any one of the above items.

[0092] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored program, wherein when the program is running, the device where the computer-readable storage medium is located is controlled to execute any one of the above-mentioned self-adaptation methods for screen-to-screen intercom.

[0093] Optionally, in this embodiment, the computer-readable storage medium may be located in any one of the computer terminals in a computer terminal group in a computer network, or in any one of the communication devices in a communication device group.

[0094] Optionally, in this embodiment, the computer-readable storage medium is configured to store program codes for executing the following steps: in response to a first predetermined operation performed by a user on a first target central control device, controlling the first target central control device to send a screen-to-screen intercom request to a second target central control device, so that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device, and the second target central control device is a central control device other than the first target central control device; controlling multiple cameras of the first target central control device to capture a user's portrait to obtain multiple first portraits, and identifying the multiple portraits to obtain multiple first identification results; determining a camera corresponding to a portrait with a correct first identification result as a target camera, and controlling cameras other than the target camera in the first target central control device to be turned off; controlling the target camera to capture the user's portrait in real time, and sending the portrait captured by the target camera to the second target central control device for display until the screen-to-screen intercom ends.

[0095] Optionally, in this embodiment, the computer-readable storage medium is configured to store program code for executing the following steps: when multiple recognition results are incorrect, controlling the first target central control device to issue a movement reminder to remind the user to adjust the distance from the first target central control device.

[0096] Optionally, in this embodiment, the computer-readable storage medium is configured to store program codes for executing the following steps: when the recognition result of the user's portrait captured by the target camera device is incorrect, controlling the camera devices other than the target camera device in the first target central control device to turn on; controlling multiple camera devices of the first target central control device to capture the user's portrait to obtain multiple second portraits, and identifying the multiple second portraits to obtain multiple second recognition results; determining the camera device corresponding to a portrait with a correct second recognition result as the target camera device, and controlling the camera devices other than the target camera device in the first target central control device to turn off.

[0097] Optionally, in this embodiment, the computer-readable storage medium is configured to store program codes for executing the following steps: blurring the background of a portrait captured by a target camera device to obtain a processed portrait; and sending the processed portrait to a second target central control device for display.

[0098] Optionally, in this embodiment, the computer-readable storage medium is configured to store program codes for executing the following steps: during the screen-to-screen intercom process, collecting the user's audio; performing noise reduction processing on the audio to obtain noise-reduced audio; and sending the noise-reduced audio to a second target central control device for playback.

[0099] Optionally, in this embodiment, the computer-readable storage medium is configured to store program codes for executing the following steps: during the screen-to-screen intercom process, controlling the human infrared sensor of the first target central control device to obtain the user's body temperature data and display the body temperature data.

[0100] Optionally, in this embodiment, the computer-readable storage medium is configured to store program codes for performing the following steps: in response to a second predetermined operation of the user, turning on a camera device corresponding to the second predetermined operation, where the second predetermined operation is an operation of turning on the camera device; in response to a third predetermined operation of the user, turning off a camera device corresponding to the third predetermined operation, where the third predetermined operation is an operation of turning off the camera device; and determining a turned-on camera device as a target camera device.

[0101] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0102] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0103] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0104] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed over multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0105] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0106] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

[0107] The above are only preferred embodiments of the present invention. It should be pointed out that, for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A self-adaptation method for screen-to-screen intercom, characterized in that: The multiple central control devices each include multiple camera devices. At least one of the plurality of camera devices is a wide-angle camera device, and the method comprises: In response to a first predetermined operation performed by a user on a first target central control device, controlling the first target central control device to send a screen-to-screen intercom request to a second target central control device, so that the second target central control device responds to the screen-to-screen intercom request and establishes a communication connection with the first target central control device, and the second target central control device is the central control device other than the first target central control device; Controlling the plurality of camera devices of the first target central control device to capture the portrait of the user to obtain a plurality of first portraits, and recognizing the plurality of portraits to obtain a plurality of first recognition results; Determine the camera device corresponding to the portrait with a correct first recognition result as a target camera device, and control the camera devices other than the target camera device in the first target central control device to be turned off; The target camera device is controlled to capture the user's portrait in real time, and the portrait captured by the target camera device is sent to the second target central control device for display until the screen-to-screen intercom ends.

2. The method according to claim 1, characterized in that After recognizing the plurality of first portraits to obtain a plurality of first recognition results, the method further includes: When the plurality of recognition results are all incorrect, the first target central control device is controlled to issue a movement reminder to remind the user to adjust the distance from the first target central control device.

3. The method according to claim 1, characterized in that After controlling the camera devices other than the target camera device in the first target central control device to be turned off, the method further includes: When the recognition result of the user's portrait captured by the target camera device is incorrect, controlling the camera devices other than the target camera device in the first target central control device to turn on; Controlling the plurality of camera devices of the first target central control device to capture the portrait of the user to obtain a plurality of second portraits, and recognizing the plurality of second portraits to obtain a plurality of second recognition results; The camera device corresponding to the portrait with a correct second recognition result is determined as the target camera device, and the camera devices other than the target camera device in the first target central control device are controlled to be turned off.

4. The method according to any one of claims 1 to 3, characterized in that The method includes sending the portrait captured by the target camera device to the second target central control device for display, including: Performing background blur processing on the portrait captured by the target camera device to obtain a processed portrait; The processed portrait is sent to the second target central control device for display.

5. The method according to any one of claims 1 to 3, characterized in that The method further comprises: During the screen-to-screen intercom process, collecting the user's audio; Performing noise reduction processing on the audio to obtain noise-reduced audio; The noise reduction audio is sent to the second target central control device for playback.

6. The method according to any one of claims 1 to 3, characterized in that The central control device also includes a human infrared sensor, and the method also includes: During the screen-to-screen intercom process, the human infrared sensor of the first target central control device is controlled to obtain the body temperature data of the user and display the body temperature data.

7. The method according to any one of claims 1 to 3, characterized in that After controlling the camera devices other than the target camera device in the first target central control device to be turned off, the method further includes: In response to a second predetermined operation of the user, turning on the camera device corresponding to the second predetermined operation, where the second predetermined operation is an operation of turning on the camera device; In response to a third predetermined operation of the user, turning off the camera device corresponding to the third predetermined operation, wherein the third predetermined operation is an operation of turning off the camera device; A turned-on camera device is determined as the target camera device.

8. A self-adaptive device for screen-to-screen intercom, characterized in that: The multiple central control devices each include multiple camera devices. At least one of the plurality of camera devices is a wide-angle camera device, and the device comprises: A first control unit is configured to control the first target central control device to send a screen-to-screen intercom request to a second target central control device in response to a first predetermined operation performed by a user on the first target central control device, so that the second target central control device establishes a communication connection with the first target central control device in response to the screen-to-screen intercom request, the first target central control device is the central control device operated by the user, and the second target central control device is the central control device other than the first target central control device; a second control unit, configured to control the plurality of camera devices of the first target central control device to capture the portrait of the user, obtain a plurality of first portraits, and recognize the plurality of portraits to obtain a plurality of first recognition results; a third control unit, configured to determine the camera corresponding to the portrait with the correct first recognition result as a target camera, and control the camera devices other than the target camera in the first target central control device to be turned off; The fourth control unit is used to control the target camera device to capture the user's portrait in real time, and send the portrait captured by the target camera device to the second target central control device for display until the screen-to-screen intercom ends.

9. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

10. An Internet of Things system, characterized in that: include: A plurality of central control devices, one or more processors, a memory, and one or more programs, wherein the plurality of the central control devices each include a plurality of cameras, at least one of the plurality of cameras is a wide-angle camera, the one or more programs are stored in the memory and are configured to be executed by the one or more processors, and the one or more programs include a method for executing any one of claims 1 to 7.

Images