Video call method and system based on home cloud box

Abstract

The invention relates to a video call method and system based on a home cloud box. The method comprises the following steps: connecting a home video system, the home cloud box and a vehicle-mounted video system to the Internet; establishing a video call connection between the home video system and the vehicle-mounted video system, and executing a video call; and in the video call process, the home cloud box performs emotion analysis according to the video data to obtain an analysis result, and transmits the analysis result to the home video system and / or the vehicle-mounted video system for display. According to the invention, emotion recognition of the video data is carried out by the home cloud box, and the emotion recognition result is displayed in the video call, so that the flexibility and interestingness of the video call are improved.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a video calling method and system based on a home cloud box. Background Art

[0002] With the development of artificial intelligence technology, current technology has been able to recognize the emotions of people in video content. However, current emotion recognition is usually based on pre-acquired video clips and is rarely used in real-time video calls. In particular, in video calls between home terminals and vehicle systems, due to the limited computing and storage capabilities of home terminals and vehicle systems, emotion recognition and synchronization of emotion recognition results with video data cannot be performed, resulting in low efficiency and poor interest in video communication. Summary of the invention

[0003] The present invention intends to provide a video calling method and system based on a home cloud box to solve the deficiencies in the prior art. The technical problem to be solved by the present invention is achieved through the following technical solutions.

[0004] This application provides the following solutions: According to a first aspect, a video call method based on a home cloud box is provided, the method comprising: connecting a home video system, the home cloud box and a vehicle-mounted video system to the Internet; establishing a video call connection between the home video system and the vehicle-mounted video system, and performing a video call; during the video call, the home cloud box performs sentiment analysis based on video data to obtain an analysis result, and transmits the analysis result to the home video system and / or the vehicle-mounted video system for display.

[0005] According to an achievable method in an embodiment of the present application, the home video system includes a first screen and a first camera; the in-vehicle video system includes a second screen and a second camera; performing sentiment analysis based on the video data to obtain an analysis result, and transmitting the analysis result to the home video system and / or the in-vehicle video system for display includes: acquiring first video data captured by the first camera and / or second video data captured by the second camera; performing sentiment analysis based on the first video data and / or the second video data to obtain an analysis result, and sending the analysis result to the home video system and / or the in-vehicle video system; and displaying the analysis result on the first screen and / or the second screen.

[0006] According to an achievable method in the embodiment of the present application, the method also includes: installing video call software in the home video system and the car video system; registering and logging in the home video system and the car video system in the video call software; and adding devices in the home video system and the car video system in the video call software.

[0007] According to an achievable method in an embodiment of the present application, the emotion analysis includes: one or more of facial emotion recognition, emotion recognition of language tone, and emotion recognition of language and text; the analysis results include: one or more of facial emotion recognition results, emotion recognition results of language tone, and emotion recognition results of language and text.

[0008] According to an achievable method in an embodiment of the present application, the emotion analysis is performed based on the video data to obtain an analysis result, and the analysis result is transmitted to the home video system and / or the car video system for display, including: the analysis result also includes: virtual human animation; the virtual human animation is generated based on one or more of the facial emotion recognition result, the language tone emotion recognition result, and the language and text emotion recognition result; the virtual human animation is displayed on the first screen and / or the second screen.

[0009] According to an achievable method in an embodiment of the present application, the emotion analysis is performed based on the video data to obtain an analysis result, and the analysis result is transmitted to the home video system and / or the car video system for display, including: the analysis result also includes: a dynamic layer; the dynamic layer includes a background animation layer and / or a foreground animation layer; the dynamic layer is generated based on one or more of the facial emotion recognition results, the emotion recognition results of the language tone, and the emotion recognition results of the language and text; the dynamic layer is superimposed on the video data, and the video data is displayed on the first screen and / or the second screen.

[0010] According to an achievable manner in the embodiment of the present application, the method further includes: the home cloud box storing the video data and the analysis results.

[0011] According to a second aspect, a video call system based on a home cloud box is provided, the system comprising: a home video system, a car video system and a home cloud box; connecting the home video system, the home cloud box and the car video system to the Internet; establishing a video call connection between the home video system and the car video system, and performing a video call; during the video call, the home cloud box performs sentiment analysis based on the video data to obtain an analysis result, and transmits the analysis result to the home video system and / or the car video system for display.

[0012] According to a third aspect, an electronic device is provided, comprising: one or more processors; and a memory associated with the one or more processors, the memory being used to store program instructions, and the program instructions, when read and executed by the one or more processors, execute the steps of any one of the methods described in the first aspect.

[0013] According to a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, characterized in that when the program is executed by a processor, the steps of any one of the methods in the first aspect are implemented.

[0014] The embodiments of the present invention include the following advantages: (1) This application applies the home cloud box to video calls between a home video system and a car video system. The home cloud box performs emotion recognition based on video data and transmits the recognition results to the home video system and / or the car video system for display. In this application, the home cloud box collects video data and performs emotion recognition, and displays the emotion recognition results during the video call, which improves the flexibility and fun of the video call.

[0015] (2) This application installs video call software in the home video system and the car video system, and performs operations such as login, registration and device addition. The use of specific video call software reduces technical problems during the call process and improves the quality and security of the video call.

[0016] (3) The emotion recognition in this application includes multiple emotion recognition operations of face, tone and text, which improves the accuracy and comprehensiveness of emotion recognition.

[0017] (4) The emotion recognition result of the present application can be a virtual human animation or a dynamic layer, which is displayed synchronously with the video content. This provides a specific method for synchronously displaying the emotion recognition result and the video content, and improves the fun of video calls. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A system architecture diagram applicable to an embodiment of a video calling method based on a home cloud box provided by the present invention; Figure 2 A flowchart of an embodiment of a video calling method based on a home cloud box provided by the present invention; Figure 3 A schematic block diagram of a video call system based on a home cloud box provided by the present invention; Figure 4 A schematic block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0019] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0020] It should be noted that the above detailed descriptions are exemplary and are intended to provide further explanation of the present application. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by those of ordinary skill in the art to which the present application belongs.

[0021] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit the exemplary embodiments according to the present application. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should also be understood that when the terms "comprise" and / or "include" are used in this specification, it indicates the presence of features, steps, operations, devices, components and / or combinations thereof.

[0022] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein.

[0023] In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units that are not explicitly listed or inherent to these processes, methods, products, or apparatuses.

[0024] For ease of description, spatially relative terms, such as "above", "above", "on the upper surface of", "above", etc., may be used herein to describe the spatial positional relationship between a device or feature and other devices or features as shown in the figure. It should be understood that spatially relative terms are intended to include different orientations of the device in use or operation in addition to the orientation described in the figure. For example, if the device in the accompanying drawings is inverted, the device described as "above other devices or structures" or "above other devices or structures" will be positioned as "below other devices or structures" or "below other devices or structures". Thus, the exemplary term "above" may include both "above" and "below". The device may also be positioned in other different ways, such as rotated 90 degrees or in other orientations, and the spatially relative descriptions used herein are interpreted accordingly.

[0025] In the above detailed description, reference is made to the accompanying drawings, which form a part of this document. In the accompanying drawings, similar symbols typically identify similar components unless the context indicates otherwise. The illustrated embodiments described in the detailed description, drawings, and claims are not meant to be limiting. Other embodiments may be used, and other changes may be made, without departing from the spirit or scope of the subject matter presented herein.

[0026] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

[0027] There are already some video call technologies between home and vehicle ends. These technologies only transmit video content through mobile devices that can access the Internet. The use of home cloud boxes makes it possible to identify and store video content.

[0028] In view of this, the present application provides a new idea. In order to facilitate the understanding of the present application, the system architecture on which the present application is based is first described. Figure 1 An exemplary system architecture to which the embodiments of the present application can be applied is shown. Figure 1 As shown in , the system architecture may include: The home side and the vehicle side transmit videos through the network; the home side includes a home video system and a home cloud box; the home video system and the home cloud box are connected by wireless or wired communication; the vehicle side includes an in-vehicle video system. The home video system can access the Internet through the home cloud box, and then use the in-vehicle video system as the call object to establish a video call connection with the in-vehicle video system and make a video call.

[0029] The home video system includes a first camera and a first screen, wherein the first camera is used to collect video data, and the first screen is used to display the video data. The first screen may include, but is not limited to, a TV screen, a projector, a mobile terminal screen, a smart home device screen, a wearable device screen, a PC (Personal Computer) screen, etc. The first camera may be an independently installed camera device, or may be a camera component provided on a smart home or a mobile terminal, etc.

[0030] The vehicle video system includes a second camera and a second screen, the second camera is used to collect video data, and the second screen is used to display video data. The second screen may include, but is not limited to, a vehicle display screen, a mobile terminal screen located in the vehicle, etc.; the second camera may be: a camera independently installed in the vehicle, a camera component in a driving recorder, a camera component of a mobile terminal located in the vehicle, etc.

[0031] It should be understood that Figure 1 The first screen, the first camera, the home cloud box, the second screen, and the second camera are only illustrative. Any number of the above devices may be provided according to implementation requirements.

[0032] Figure 2 A flowchart of a video call method based on a home cloud box provided in an embodiment of the present application. The method can be performed by Figure 1 The home cloud box in the system shown is executed. Figure 2 As shown in , the method may include the following steps: Step 201: Connect the home video system, the home cloud box, and the car video system to the Internet.

[0033] Step 202: Establish a video call connection between the home video system and the in-vehicle video system, and perform a video call.

[0034] Step 203: During the video call, the home cloud box performs emotion recognition based on the video data to obtain a recognition result, and transmits the recognition result to the home video system and / or the car video system for display.

[0035] As can be seen from the above process, this application applies the home cloud box to video calls between the home video system and the car video system. The home cloud box performs emotion recognition based on the video data and transmits the recognition results to the home video system and / or the car video system for display. In this application, the home cloud box collects video data and performs emotion recognition, and displays the emotion recognition results in the video call, which improves the flexibility and fun of the video call.

[0036] First, the above step 201, namely "connecting the home video system, the home cloud box and the car video system to the Internet" is described in detail in conjunction with the embodiment.

[0037] The home video system is a device located at home that can perform video calls. As an implementable method, the home video system includes a first screen and a first camera. Preferably, the first screen can be a large-screen device at home, such as a smart TV, a projector, etc.; the first camera is a high-definition camera that supports remote access and network connection.

[0038] The home cloud box is a smart home device with intelligent intercommunication and cloud storage functions. It is based on Internet technology and connects to various smart devices through Wi-Fi, Bluetooth, infrared and other methods. Users can control the smart cloud box through mobile phone APP, smart remote control and other devices, thereby remotely controlling various devices at home and realizing intelligent management. The home cloud box usually has the function of a wireless router, which can receive signals from Internet service providers and transmit the signals to smart home appliances through Wi-Fi, so that smart home appliances can connect to the Internet.

[0039] The in-vehicle video system is a device located in the vehicle that can perform video calls. The in-vehicle video system has network connection and video communication functions. As an implementable method, the in-vehicle video system includes a second screen and a second camera. Preferably, the in-vehicle video system can be an in-vehicle display screen, a driving recorder, etc. The in-vehicle video system can have a built-in SIM card and directly connect to the Internet through a mobile data network; it can also be configured with a Wi-Fi connection to access the Internet through a hotspot device such as a smartphone.

[0040] In this application, the home video system can directly access the Internet, for example, the home video system accesses the wireless network through a built-in Wi-Fi module. The home video system can also access the Internet through a home cloud box. The home video system first communicates with the home cloud box, and the home video system and the home cloud box can be wirelessly connected through WIFI, Bluetooth, etc. The home cloud box usually has a built-in wireless router function, which can receive broadband signals from an Internet service provider and extend the Internet connection to the first screen and the first camera through a wireless signal (Wi-Fi).

[0041] As a feasible method, the first screen and the first camera in the home video system can also be connected to the same smart home management platform, through which users can achieve more convenient device interconnection and control.

[0042] The above step 202, namely "establishing a video call connection between the home video system and the vehicle video system, and executing the video call", is described in detail below in conjunction with an embodiment.

[0043] After the home video system and the vehicle video system are connected to the Internet, the home video system and the vehicle video system establish a video connection and perform a video call.

[0044] As an implementable method, before the video call, the home video system and the car video system can install video call software. Among them, the video call software is a video call software that supports cross-platform and multi-device interconnection. Select software with good compatibility and stability that can meet the real-time call requirements between the home large screen and the car video system. More specifically, the home video system and the car video system are registered and logged in to the video call software; the devices in the home video system and the car video system are added in the video call software, and the adding process can be completed by scanning the QR code of the device in the software or entering the serial number of the device. When a real-time call is required, a call request is initiated through the video call software, and the home large screen and the car video system are selected as the call objects. After the call request is received, the two parties can start a real-time call.

[0045] The interconnection and real-time calls between the home video system and the car video system require comprehensive consideration of hardware preparation, software and platform selection, and implementation steps. Through reasonable selection and configuration, the real-time communication needs between the home large screen and the car video system can be easily realized. Specifically, during the device interconnection and real-time calls, attention should be paid to protecting personal privacy and network security. Avoid using unsafe network connections and transmission protocols, and regularly update device software and firmware to fix potential security vulnerabilities. To ensure call quality, a suitable network environment (such as WiFi or a stable 4G / 5G network) should be selected for calls, and calls should be avoided when the signal is unstable or the network is congested. When selecting devices and software, pay attention to checking the compatibility between devices and the software version requirements to ensure that the interconnection and real-time call functions can be smoothly realized.

[0046] The above step 203, i.e. "during the video call, the home cloud box performs emotion recognition based on the video data to obtain a recognition result, and transmits the recognition result to the home video system and / or the car video system for display" is described in detail below in conjunction with the embodiments.

[0047] The video data is the data generated during the video call, wherein both the first camera and the second camera can collect video data. In the present application, emotion recognition can be performed only on the first video data collected by the first camera or the second video data collected by the second camera, or both video data can be recognized. Moreover, the recognition result can be sent only to the home video system or the car video system, or to both video systems at the same time. Similarly, the recognition result can be displayed only on the first screen or the second screen, or on both screens. The above options can be flexibly set by the user according to actual needs, network conditions, screen size and other factors.

[0048] The emotion recognition operation of the video data is performed by the home cloud box, which has certain computing functions, including a graphics processing unit for processing graphics-intensive tasks, integrated artificial intelligence functions, and can perform tasks such as speech recognition, image recognition, and natural language processing. In this application, emotion recognition includes: one or more of: facial emotion recognition, emotion recognition of language tone, and emotion recognition of language and text.

[0049] The main content of facial emotion recognition is expression recognition. General expression recognition can be completed by a single sense organ or by the coordination of multiple sense organs. It is the result of the joint action of overall recognition and feature recognition. The recognition features used are mainly grayscale features, motion features and frequency features. Grayscale features are processed from the grayscale value of the expression image, and different expressions have different grayscale values ​​to obtain the basis for recognition; motion features use the motion information of the main expression points of the face under different expression conditions for recognition; frequency domain features mainly use the difference of expression images under different frequency decompositions, and fast speed is its significant feature.

[0050] Specific expression recognition methods include: first, overall recognition method and local recognition method. The overall recognition method treats the face as a whole and usually uses global features to describe facial expressions. The overall recognition method may use geometric features of the face, such as the position and shape of the eyes, nose and mouth, and the relative distance between them. The advantage of this method is that it is simple to calculate, but it may not capture subtle changes in expression. Local recognition method: Unlike the overall recognition method, the local recognition method focuses on specific areas of the face, such as local features of the eyes, eyebrows or mouth. This method can capture the details of the expression more finely, such as wrinkles at the corners of the eyes or the bends of the corners of the mouth. Local recognition methods usually require more complex algorithms and more computing resources.

[0051] The second is deformation extraction and motion extraction. The deformation extraction method focuses on identifying the deformation of the face under different expression states. This includes the movement of facial muscles and the deformation of the skin surface. For example, expressions can be identified by comparing the difference between neutral expressions and target expressions. The motion extraction method focuses on the movement and dynamic changes between facial feature points. It usually involves tracking the changes of facial feature points over time, such as the closing of eyes and the opening of mouth. The motion extraction method can capture the dynamic characteristics of expressions, which is particularly important for recognizing videos or real-time expression recognition.

[0052] The third is the geometric feature method and the facial feature method. The geometric feature method recognizes expressions by measuring the geometric relationship between facial feature points. This may include the location of feature points such as eyes, nose and mouth, as well as the distance and angle between them. The geometric feature method usually requires precise feature point detection and measurement, and it is very effective for expression recognition in static images. Facial feature method: This method uses facial texture information, such as skin color, texture and lighting changes, to recognize expressions. The facial feature method can capture subtle changes in the face, such as muscle tension and relaxation. This method usually requires advanced image processing techniques, such as Local Binary Patterns (LBP) or Gabor filters, to extract and identify texture information.

[0053] The principle of emotion recognition of language tones is that the language signals of different language tones have different structural characteristics and distribution patterns in terms of their time structure, amplitude structure, fundamental frequency structure and formant structure. Therefore, as long as the structural characteristics and distribution patterns of various specific patterns of language tones in terms of time structure, amplitude structure, fundamental frequency structure and formant structure are measured and identified, and based on this as a basis or template, the emotional content implied in all language tones can be identified.

[0054] Emotion recognition of language and text can be done by extracting voice data from video data, first performing text recognition on the voice data, and then performing emotion recognition on the recognized text. This can be done by using pre-defined emotion dictionaries, which contain words with specific emotional colors and their emotional polarity (positive, negative, or neutral). By identifying the frequency and context of these words in the text, the emotional tendency of the text can be evaluated. Emotion recognition can also be done through machine learning methods, using trained machine learning models.

[0055] The present application performs one or more recognition operations of facial emotion recognition, language tone emotion recognition, and language and text emotion recognition, and accordingly obtains one or more facial emotion recognition results, language tone emotion recognition results, and language and text emotion recognition results.

[0056] The emotion recognition results in the present application can be displayed on the home video system and / or the in-vehicle video system, wherein the display can be performed in a variety of ways, for example, the emotion recognition results can be directly displayed in the form of text on the first screen and the second screen, or can be displayed through a specific module in the video call software, for example, a pop-up window, etc.

[0057] As an implementable method, the recognition results of the present application can be displayed in the form of layers. Specifically, the recognition results also include a dynamic layer, and the dynamic layer is generated based on one or more of the facial emotion recognition results, the language tone emotion recognition results, and the language and text emotion recognition results; the dynamic layer is superimposed on the video data, and the video data is displayed on the first screen and / or the second screen.

[0058] The dynamic layer includes a background animation layer and / or a foreground animation layer; the background animation layer can be a background dynamic image corresponding to the emotion, for example, a fireworks dynamic image is generated when the user is happy, a rain dynamic image is generated when the user is sad, etc. The foreground animation layer can be superimposed in front of the user's video image, for example, a crown dynamic image is generated when the user is happy, etc.

[0059] As another feasible method, the recognition results of the present application can also be displayed in the form of a virtual human. Specifically, the recognition results also include: virtual human animation; the virtual human animation is generated based on one or more of the facial emotion recognition results, the language tone emotion recognition results, and the language and text emotion recognition results; the virtual human animation is displayed on the first screen and / or the second screen.

[0060] Virtual human animation can be used to present a virtual human in a video when it is inconvenient for the user to display his or her real video image, so as to replace the user's actual image. Virtual human animation generates a virtual human with corresponding emotions based on one or more of the facial emotion recognition results, the emotion recognition results of the language tone, and the emotion recognition results of the language text. The emotion of the virtual human can be expressed through the facial expression and body movements of the virtual human.

[0061] For the generation of virtual humans, an expression library can be pre-set, which stores virtual human video data corresponding to various expressions. By calling the data in the expression library in real time, the real-time generation of virtual human animation can be realized. It can also be realized through a machine learning model, by inputting one or more of the facial emotion recognition results, the emotion recognition results of the language tone, and the emotion recognition results of the language and text into the machine learning model, and the model generates virtual human animation.

[0062] In this application, the home cloud box also has a storage function, which can store the video data and the recognition results. The relevant data can be stored locally in the home cloud box or uploaded to the cloud for storage.

[0063] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0064] According to an embodiment of another aspect, a video calling system based on a home cloud box is provided. Figure 3 A schematic block diagram of a video call system based on a home cloud box according to an embodiment is shown, Figure 3 As shown, the device 300 includes: a home video system 301, a home cloud box 302 and a car video system 303; The home video system 301, the home cloud box 302 and the car video system 303 are connected to the Internet.

[0065] The home video system 301 establishes a video call connection with the in-car video system 303 and performs a video call.

[0066] During the video call, the home cloud box 302 performs emotion recognition based on the video data to obtain a recognition result, and transmits the recognition result to the home video system 301 and / or the vehicle video system 303 for display.

[0067] As an implementable method, the home video system 301 includes a first screen and a first camera; the car video system 303 includes a second screen and a second camera; the home cloud box 302 can be configured to: obtain the first video data collected by the first camera and / or the second video data collected by the second camera; perform emotion recognition based on the first video data and / or the second video data to obtain a recognition result, and send the recognition result to the home video system 301 and / or the car video system 303; and display the recognition result on the first screen and / or the second screen.

[0068] As an implementable method, the device 300 can also be configured to: install video call software in the home video system 301 and the car video system 303; register and log in the home video system 301 and the car video system 303 in the video call software; add the devices in the home video system 301 and the car video system 303 in the video call software.

[0069] As an implementable method, emotion recognition includes: one or more of facial emotion recognition, emotion recognition of language tone, and emotion recognition of language and text; the recognition results include: one or more of facial emotion recognition results, emotion recognition results of language tone, and emotion recognition results of language and text.

[0070] As an implementable method, when the home cloud box 302 performs emotion recognition based on video data to obtain a recognition result and transmits the recognition result to the home video system 301 and / or the in-vehicle video system 303 for display, it can be configured as follows: the recognition result also includes: virtual human animation; the virtual human animation is generated based on one or more of the facial emotion recognition result, the language tone emotion recognition result, and the language and text emotion recognition result; and the virtual human animation is displayed on the first screen and / or the second screen.

[0071] As an implementable method, when the home cloud box 302 performs emotion recognition based on video data to obtain a recognition result and transmits the recognition result to the home video system 301 and / or the vehicle video system 303 for display, it can be configured as follows: the recognition result also includes: a dynamic layer; the dynamic layer includes a background animation layer and / or a foreground animation layer; the dynamic layer is generated based on one or more of the facial emotion recognition result, the language tone emotion recognition result, and the language and text emotion recognition result; the dynamic layer is superimposed on the video data, and the video data is displayed on the first screen and / or the second screen.

[0072] As an implementable manner, the home cloud box 302 may be configured to store the video data and the recognition results.

[0073] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the unit described as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place, or it may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative work.

[0074] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for identification, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0075] In addition, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of any one of the methods in the aforementioned method embodiments are implemented.

[0076] And an electronic device, comprising: one or more processors; and A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of the method described in any one of the aforementioned method embodiments.

[0077] The present application also provides a computer program product, including a computer program, which implements the steps of any one of the methods in the aforementioned method embodiments when executed by a processor.

[0078] in, Figure 4 The architecture of the electronic device is shown as an example, which may include a processor 410, a video display adapter 411, a disk drive 412, an input / output interface 413, a network interface 414, and a memory 420. The processor 410, the video display adapter 411, the disk drive 412, the input / output interface 413, the network interface 414, and the memory 420 may be communicatively connected via a communication bus 430.

[0079] The processor 410 may be implemented by a general-purpose CPU, a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, etc., and is used to execute relevant programs to implement the technical solutions provided in this application.

[0080] The memory 420 can be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 420 can store an operating system 421 for controlling the operation of the electronic device 400, and a basic input and output system (BIOS) 422 for controlling the low-level operation of the electronic device 400. In addition, a web browser 423, a data storage management system 424, and a video call system 425 based on a home cloud box, etc. can also be stored. The above-mentioned video call system 425 based on a home cloud box can be an application program that specifically implements the operations of the aforementioned steps in the embodiment of the present application. In short, when the technical solution provided by the present application is implemented by software or firmware, the relevant program code is stored in the memory 420 and is called and executed by the processor 410.

[0081] The input / output interface 413 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0082] The network interface 414 is used to connect to a communication module (not shown) to achieve communication interaction between the device and other devices. The communication module can achieve communication through a wired method (such as USB, network cable, etc.) or a wireless method (such as mobile network, WIFI, Bluetooth, etc.).

[0083] The bus 430 comprises a pathway for transmitting information between the various components of the device (eg, the processor 410 , the video display adapter 411 , the disk drive 412 , the input / output interface 413 , the network interface 414 , and the memory 420 ).

[0084] It should be noted that, although the above device only shows a processor 410, a video display adapter 411, a disk drive 412, an input / output interface 413, a network interface 414, a memory 420, a bus 430, etc., in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include components necessary for implementing the solution of the present application, and does not necessarily include all the components shown in the figure.

[0085] It can be known from the description of the above implementation methods that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present application can be essentially or partly contributed to the prior art in the form of a computer program product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present application or certain parts of the embodiments.

[0086] The technical solution provided by the present application is described in detail above. The principle and implementation method of the present application are described in detail using specific examples. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as limiting the present application.

Claims

1. A video calling method based on a home cloud box, characterized in that: The method comprises: connecting the home video system, the home cloud box and the car video system to the internet; Establishing a video call connection between the home video system and the in-vehicle video system, and performing a video call; During the video call, the home cloud box performs emotion recognition based on the video data to obtain a recognition result, and transmits the recognition result to the home video system and / or the in-vehicle video system for display.

2. The method according to claim 1, characterized in that The home video system includes a first screen and a first camera; the vehicle video system includes a second screen and a second camera; The performing emotion recognition according to the video data to obtain a recognition result, and transmitting the recognition result to the home video system and / or the vehicle video system for display comprises: Acquire first video data captured by the first camera and / or second video data captured by the second camera; Perform emotion recognition based on the first video data and / or the second video data to obtain a recognition result, and send the recognition result to the home video system and / or the in-vehicle video system; The recognition result is displayed on the first screen and / or the second screen.

3. The method according to claim 1, characterized in that The method further comprises: Installing video call software in the home video system and the in-car video system; Registering and logging in the home video system and the car video system in the video call software; Add the devices of the home video system and the car video system to the video calling software.

4. The method according to claim 1, characterized in that: The emotion recognition includes: one or more of: facial emotion recognition, language tone emotion recognition, and language and text emotion recognition; The recognition result includes: one or more of: a facial emotion recognition result, a language tone emotion recognition result, and a language and text emotion recognition result.

5. The method according to claim 4, characterized in that The performing emotion recognition according to the video data to obtain a recognition result, and transmitting the recognition result to the home video system and / or the vehicle video system for display comprises: The recognition result also includes: virtual human animation; The virtual human animation is generated according to one or more of the facial emotion recognition result, the language tone emotion recognition result, and the language and text emotion recognition result; The virtual human animation is displayed on the first screen and / or the second screen.

6. The method according to claim 4, characterized in that The performing emotion recognition according to the video data to obtain a recognition result, and transmitting the recognition result to the home video system and / or the vehicle video system for display comprises: The recognition result also includes: a dynamic layer; The dynamic layer includes a background animation layer and / or a foreground animation layer; The dynamic layer is generated according to one or more of the facial emotion recognition result, the language tone emotion recognition result, and the language and text emotion recognition result; The dynamic layer is superimposed on the video data, and the video data is displayed on the first screen and / or the second screen.

7. The method according to claim 1, characterized in that The method also includes: the home cloud box storing the video data and the recognition result.

8. A video call system based on a home cloud box, characterized in that: The system comprises: a home video system, a car video system and a home cloud box; Connecting the home video system, the home cloud box and the in-vehicle video system to the Internet; Establishing a video call connection between the home video system and the in-vehicle video system, and performing a video call; During the video call, the home cloud box performs emotion recognition based on the video data to obtain a recognition result, and transmits the recognition result to the home video system and / or the in-vehicle video system for display.

9. An electronic device, characterized in that: include: one or more processors; as well as A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of the method described in any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images