Television interaction system and method

By using the vertical cavity surface emission laser array module and photodetection module in the television system, the user's pupil positioning, identity and emotions are identified, and the problem of emotional intelligent interaction in the prior art is solved, and efficient emotional user interaction is achieved.

CN119835469APending Publication Date: 2025-04-15SHENZHEN KONKA ELECTRONIC TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411893129.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-20
Publication Date
2025-04-15

AI Technical Summary

Technical Problem

The prior art cannot realize the intelligent two-way interaction function with emotion, especially in the interaction between TV and users, which lacks the ability to express emotions and recognize users' emotions.

Method used

The vertical cavity surface emission laser array module and photoelectric detection module are used to transmit and receive optical signals to determine the time of light flight and electrical signals, thereby identifying the user's pupil positioning, identity and emotions, generating corresponding control instructions, and controlling the display screen to interact emotionally with the user.

Benefits of technology

It realizes emotional intelligent two-way interaction between TV and users, and can conduct personalized interactions based on the user's identity and emotions, improving the sense of reality and user experience of the interaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119835469A_ABST
    Figure CN119835469A_ABST
Patent Text Reader

Abstract

The invention discloses a television interaction system and method. The system comprises a display screen, a terminal computing power module, a vertical cavity surface emitting laser array module and a photoelectric detection module, wherein the vertical cavity surface emitting laser array module and the photoelectric detection module are arranged on the side edge of the display screen; the vertical cavity surface emitting laser array module is used for emitting optical signals to a user; the photoelectric detection module is used for receiving light signals reflected by a user and determining light flight time and electric signals according to the light signals; the terminal computing power module is used for determining user pupil positioning, user identity and user emotion according to the light flight time and the electric signal, and determining a first control instruction according to the user pupil positioning, the user identity and the user emotion; the display screen is used for interacting with a user according to the first control instruction. According to the method, the user pupil positioning, the user identity and the user emotion are acquired, so that interaction with the user is realized according to the user pupil positioning, the user identity and the user emotion, and the problem that the intelligent bidirectional interaction function with emotion cannot be achieved in the prior art is effectively solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of television, and in particular to a television interaction system and method. Background Art

[0002] Television is an indispensable part of the home, providing users with rich entertainment and information services. With the development of Internet of Things technology and AI (intelligent) technology, the function of television has gradually evolved from simple audio and video information display to the integration of semiconductor integration. Television is a large-size display device that is convenient for the layout of complex circuit modules and has a large-size display immersion. It also occupies an important position in home life. Therefore, it is inherently advantageous to develop television into the main control device of home AI. Television is gradually becoming more humanized, and it can better understand user needs during the interaction with users, providing users with the TV videos they need, improving the intelligence of television. Combining AI digital human technology with television can further promote the development of the television broadcasting industry.

[0003] At present, the intelligent interaction process between users and TV sets is initiated by users through remote control or voice or gesture, while TV cannot actively trigger interaction with users and can only execute simple commands. Although there are a few cartoon digital human applications, they can only chat with simple repetitive words. The realism of communication between people comes from focused sight, but the existing digital human facial features are fixed and the emotional expression is dull. Although there are commercial holographic digital humans that can communicate with people at close range, they cannot accurately capture the communication object when they are more than 2 meters away or in scenes with multiple people, and cannot be used in home living room environments. In summary, the existing technology cannot achieve the function of intelligent two-way interaction with emotions.

[0004] Therefore, the existing technology still needs to be improved and developed. Summary of the invention

[0005] The technical problem to be solved by the present invention is to provide a television interaction system and method in view of the above-mentioned defects of the prior art, aiming to solve the problem that the prior art cannot achieve the function of intelligent two-way interaction with emotion.

[0006] The technical solution adopted by the present invention to solve the problem is as follows:

[0007] In a first aspect, an embodiment of the present invention provides a television interactive system, wherein the system comprises: a display screen, a terminal computing power module, and a vertical cavity surface emitting laser array module and a photoelectric detection module arranged on the side of the display screen;

[0008] The vertical cavity surface emitting laser array module is used to transmit optical signals to users;

[0009] The photoelectric detection module is used to receive the light signal reflected by the user and determine the light flight time and the electrical signal according to the light signal;

[0010] The terminal computing module is used to determine the user's pupil location, user identity and user emotion according to the light flight time and the electrical signal, and determine the first control instruction according to the user's pupil location, user identity and user emotion;

[0011] The display screen is used to interact with the user according to the first control instruction.

[0012] In one implementation method, the system also includes a far-field voice module, which is used to interact with the user according to the second control instruction generated by the terminal computing power module based on the user identity and the user emotion.

[0013] In one implementation method, the system further includes: a system main control module and an infrared sensing module;

[0014] The infrared sensing module is used to detect whether a user exists;

[0015] The system main control module is used to wake up the vertical cavity surface emitting laser array module, the photoelectric detection module and the terminal computing power module when the infrared sensing module detects the presence of a user.

[0016] In one implementation method, the vertical cavity surface emitting laser array module includes an addressable circuit substrate and a vertical cavity surface emitting laser array disposed on the addressable circuit substrate.

[0017] In one implementation method, a micro lens array is integrated on the vertical cavity surface emitting laser array.

[0018] In one implementation method, each of the vertical cavity surface emitting laser array modules corresponds to one of the photoelectric detection modules to form a photoelectric detection module.

[0019] In an implementation method, each of the photoelectric detection modules is respectively placed at the upper and lower ends of the left and right sides of the front of the display screen and at the left and right ends of the lower side of the front of the display screen.

[0020] In a second aspect, an embodiment of the present invention further provides a television interaction method, wherein the method comprises:

[0021] Transmitting an optical signal to a user and acquiring the optical signal reflected by the user, and determining the light flight time and the electrical signal according to the optical signal;

[0022] Determine the user's pupil location, user identity, and user emotion based on the light flight time and the electrical signal;

[0023] Determining a first control instruction according to the user pupil location, the user identity, and the user emotion;

[0024] The display screen is controlled to interact with the user according to the first control instruction.

[0025] In an implementation method, determining a first control instruction according to the user pupil location, the user identity, and the user emotion includes:

[0026] Determining the sight focus position of the digital person on the display screen according to the user pupil positioning;

[0027] Determine the digital human expression and digital human action according to the user identity and the user emotion;

[0028] The first control instruction is determined according to the sight focus position, the expression of the digital human and the action of the digital human.

[0029] In one implementation method, the method further includes:

[0030] Determining the digital human voice according to the user identity and the user emotion;

[0031] Determining a second control instruction according to the digital human voice;

[0032] The far-field voice module is controlled to interact with the user according to the second control instruction.

[0033] Beneficial effects of the present invention: The embodiments of the present invention include: a display screen, a terminal computing power module, and a vertical cavity surface emitting laser array module and a photoelectric detection module arranged on the side of the display screen; the vertical cavity surface emitting laser array module is used to emit light signals to the user; the photoelectric detection module is used to receive the light signal reflected by the user, and determine the light flight time and the electrical signal according to the light signal; the terminal computing power module is used to determine the user's pupil location, user identity and user emotions according to the light flight time and the electrical signal, and determine the first control instruction according to the user's pupil location, user identity and user emotions; the display screen is used to interact with the user according to the first control instruction. The present invention obtains the user's pupil location, user identity and user emotions based on the light signal reflected by the user, and interacts with the user according to the user's pupil location, user identity and user emotions, which effectively solves the problem that the prior art cannot achieve the function of intelligent two-way interaction with emotions. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0035] Figure 1 It is a schematic diagram of the internal modules of the television interactive system provided by an embodiment of the present invention.

[0036] Figure 2 It is a schematic diagram of the function implementation flow of each module of the television interactive system provided by an embodiment of the present invention.

[0037] Figure 3 It is a schematic diagram of scanning a human face by a vertical cavity surface emitting laser array module provided in an embodiment of the present invention.

[0038] Figure 4 It is a schematic diagram of a photoelectric detection module provided in an embodiment of the present invention.

[0039] Figure 5 It is a schematic diagram of the position setting of the photoelectric detection module provided in an embodiment of the present invention.

[0040] Figure 6 It is a schematic diagram of user detection provided by an embodiment of the present invention.

[0041] Figure 7 It is a flowchart of a television interaction method provided by an embodiment of the present invention.

[0042] Figure 8 It is a principle block diagram of a terminal provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0043] The present invention discloses a television interactive system and method. To make the purpose, technical solution and effect of the present invention clearer and more specific, the present invention is further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0044] It will be understood by those skilled in the art that, unless expressly stated, the singular forms "one", "said", and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present invention refers to the presence of the features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof. It should be understood that when we refer to an element as being "connected" or "coupled" to another element, it may be directly connected or coupled to the other element, or there may be intermediate elements. In addition, the "connection" or "coupling" used herein may include wireless connection or wireless coupling. The term "and / or" used herein includes all or any unit and all combinations of one or more associated listed items.

[0045] It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as generally understood by those skilled in the art in the art to which the present invention belongs. It should also be understood that terms such as those defined in general dictionaries should be understood to have meanings consistent with the meanings in the context of the prior art, and will not be interpreted with idealized or overly formal meanings unless specifically defined as herein.

[0046] At present, the intelligent interaction process between users and TV sets is initiated by users through remote control or voice or gesture, while TV cannot actively trigger interaction with users and can only execute simple commands. Although there are a few cartoon digital human applications, they can only chat with simple repetitive words. The realism of communication between people comes from focused sight, but the existing digital human facial features are fixed and the emotional expression is dull. Although there are commercial holographic digital humans that can communicate with people at close range, they cannot accurately capture the communication object when they are more than 2 meters away or in scenes with multiple people, and cannot be used in home living room environments. In summary, the existing technology cannot achieve the function of intelligent two-way interaction with emotions.

[0047] In view of the above-mentioned defects of the prior art, the present invention provides a television interactive system, such as Figure 1As shown, it is a structural schematic diagram of a television interactive system provided by an embodiment of the present invention, and the system includes: a display screen 04, a terminal computing power module 03, and a vertical cavity surface emitting laser array module 01 (VCSEL array module, VCSEL: Vertical Cavity Surface Emitting Laser, vertical cavity surface emitting laser) and a photoelectric detection module 02 arranged on the side of the display screen 04; the vertical cavity surface emitting laser array module 01 is used to emit a light signal to the user; the photoelectric detection module 02 is used to receive the light signal reflected by the user, and determine the light flight time and the electrical signal according to the light signal; the terminal computing power module 03 is used to determine the user's pupil location, user identity and user emotion according to the light flight time and the electrical signal, and determine the first control instruction according to the user's pupil location, user identity and user emotion; the display screen 04 is used to interact with the user according to the first control instruction, and the functions of each module are implemented as follows Figure 2 shown.

[0048] For example, when a user walks into the light irradiation range of the vertical cavity surface emitting laser array module 01, the vertical cavity surface emitting laser array module 01 emits each beam of concentrated array light to the user. After the light signal is reflected by the human body, it is coupled into the photoelectric detection module 02 and converted into an electrical signal. At the same time, the photoelectric detection module 02 obtains the light signal and calculates the light flight time. The terminal computing module 03 performs face recognition, emotion recognition, and pupil position positioning on the electrical signal and light flight time returned by the photoelectric detector to obtain the user's pupil positioning, user identity, and user emotion, and generates a first control instruction based on the user's pupil positioning, user identity, and user emotion to control the display screen 04 and the user interaction, for example, setting the line of sight, expression, action, etc. of the digital person on the display screen 04 to achieve emotional intelligent two-way interaction with the user.

[0049] like Figure 3As shown, the array light emitted by the vertical cavity surface emitting laser array module 01 scans the face. When the array light emitted by the vertical cavity surface emitting laser array module 01 contacts the face, according to the three-dimensional surface and skin condition of the face, a large number of light spots are reflected at different depths and intensities. The photodetector array couples these reflected lights, converts the strong and weak signals of the reflected light array into electrical signals, and calculates the light flight time, so that facial features, facial micro-change information, facial muscle change information, blood vessel vibration information, etc. can be captured. According to the captured above information, face recognition, micro-expression recognition, psychological state recognition, and pupil spatial position positioning are performed. In the daily work of the TV, each time the scanning data of the photodetection module 02 enters the terminal computing power module 03, it will continue to perform deep learning. After multiple times, a database will be formed. Each scan can infer the identity, emotional status, pupil position, etc. of the members. When the user's identity is determined to be a family member, the display screen 04 lights up, and the digital person is displayed. The digital person's face is facing the family member and the eyes are focused on the pupil position of the family member.

[0050] In one implementation, the system further includes a far-field voice module 05, and the far-field voice module 05 is used to interact with the user according to the second control instruction generated by the terminal computing power module 03 based on the user identity and the user emotion.

[0051] The far-field voice module 05 is used for voice interaction with the user and is generally used in conjunction with the display screen 04. When the vertical cavity surface emitting laser array module 01 and the photoelectric detection module 02 scan the user, the terminal computing module 03 obtains the user's identity, user emotions, and user pupil location based on the electrical signal and light flight time obtained by the scan. When the user is judged to be a family member, when the display screen 04 lights up and the digital human is displayed, the digital human's face is facing the family member and the eyes are focused on the pupil position of the family member, the far-field voice module 05 enters various chat modes such as comfort, empathy, inquiry, and small talk based on the emotion recognition results.

[0052] During the process of interacting with the user, the far-field voice module 05 also includes receiving user voice information, sending the user voice information to the terminal computing module 03, and receiving a second control instruction generated again by the terminal computing module 03 based on the voice information, thereby continuing to interact with the user according to the second control instruction.

[0053] In one implementation, the system also includes: a system main control module 07 (SOC main chip module, (SOC, System on Chip, system chip integrated circuit, system main control platform)) and an infrared sensing module; the infrared sensing module is used to detect whether a user is present; the system main control module 07 is used to wake up the vertical cavity surface emitting laser array module 01, the photoelectric detection module 02 and the terminal computing power module 03 when the infrared sensing module detects the presence of a user.

[0054] When there is no user in the room, the vertical cavity surface emitting laser array module 01, the photoelectric detection module 02 and the terminal computing module 03 are in a dormant state. At this time, the infrared detection module 06 is used to detect the user. The infrared detection module 06 is installed in the middle of the upper side of the front of the display screen 04, such as Figure 5 As shown. The infrared sensing module is a wide-angle detection module and does not perform precise positioning. When the user enters the door and begins to be sensed by the infrared sensing module, the system main control module 07 is notified to wake up the vertical cavity surface emitting laser array module 01, the photoelectric detection module 02 and the terminal computing module 03 to work.

[0055] In one implementation, the system main control module 07 also interacts with the terminal computing module 03. When the display screen 04 or the far-field voice module 05 receives emotional feedback or voice information from the user during the interaction with the user and sends it to the terminal computing module 03, the terminal computing module 03 generates a third control instruction based on the emotional feedback or voice information and sends it to the system main control module 07. The system main control module 07 performs corresponding operations according to the third control instruction and feeds back the operation results to the terminal computing module 03. For example, the far-field voice module 05 obtains the voice information given by the user to turn on a TV program, turn on music, turn on an application, or tell a joke, close the curtains, change the lighting color temperature, etc. The terminal computing module 03 generates a third control instruction based on the voice information, and the system main control module 07 controls the corresponding device or module to perform the corresponding operation according to the third control instruction.

[0056] In one implementation, the vertical cavity surface emitting laser array module 01 includes an addressable circuit substrate and a vertical cavity surface emitting laser array disposed on the addressable circuit substrate. Among them, the addressable circuit substrate is a circuit substrate with an addressable circuit design. The vertical cavity surface emitting laser array is a group of LED (light emitting diode) arrays with a vertical cavity surface emitting light structure. The LED of the vertical cavity surface emitting laser array is preferably a Micro LED (micro light emitting diode), so that the Micro LED array module can be made into a very small film and is easy to combine with an integrated circuit substrate. Such a small module does not affect the appearance of the overall structure. Each Micro LED chip has an independent control circuit, which can capture the reflection path details of more points of an object through circuit regulation. For example, in addition to the facial features and muscle changes, it can also capture the beating information of the vestibule and neck blood vessels of the face.

[0057] In one implementation, a micro lens array is integrated on the vertical cavity surface emitting laser array. Integrating a micro lens array on the vertical cavity surface emitting laser array can make the vertical cavity surface emitting laser array emit light at a precise angle, gather the emitted light beams, and capture light at a longer distance.

[0058] In one implementation, Figure 4 As shown, each of the vertical cavity surface emitting laser array modules 01 corresponds to one of the photoelectric detection modules 02, forming a photoelectric detection module. The vertical cavity surface emitting laser array module 01 and the photoelectric detection module 02 are arranged in a matching manner to form a photoelectric detection module. The number and shape of the photoelectric detection module 02 correspond to the vertical cavity surface emitting laser array module 01. After adaptation, the array light emitted and returned by the vertical cavity surface emitting laser array module 01 can be coupled into the photodetector.

[0059] In one implementation, Figure 5 As shown, each of the photoelectric detection modules is respectively placed at the upper and lower ends of the left and right sides of the front of the display screen 04 and at the left and right ends of the lower side of the front of the display screen 04. The photoelectric detection modules are arranged on the structural frame of the display screen 04, wherein a set of photoelectric detection modules is respectively arranged at the upper and lower ends of the left and right sides of the front of the structural frame of the display screen 04 and at the left and right ends of the lower side of the front, as shown in FIG. Figure 6 The setting of these six points enables the photoelectric detection module to emit light waves of specific wavelengths in a three-dimensional direction except for some areas on the back of the machine, that is, most areas of the user's living room can be captured and accurately located by the array light of the vertical cavity surface emitting laser array module 01.

[0060] In one implementation, the vertical cavity surface emitting laser array module 01 and the photoelectric detection module 02 are used to scan the face and enter the identity of the family member. The digital portrait design can be carried out through photos of relatives and friends or face scanning, and the digital voice setting can be carried out through voice recording and audio settings, or the digital portrait can be selected. At the beginning of normal use of the TV, the terminal computing module 03 starts deep learning and deduction through the daily face scanning information of family members, which serves as a reference for emotion recognition and instruction recommendation. If the terminal computing module 03 recognizes that the user is not a family member and the emotion recognition is nervous, the system main control module 07 can be used to control the corresponding device to issue an alarm to drive away the voice and notify the family members.

[0061] Based on the above embodiments, the present invention also provides a television interaction method, such as Figure 7 As shown, the method includes:

[0062] Step S100, transmitting an optical signal to a user and acquiring the optical signal reflected by the user, and determining the light flight time and the electrical signal according to the optical signal;

[0063] Step S200, determining the user's pupil location, user identity, and user emotion according to the light flight time and the electrical signal;

[0064] Step S300, determining a first control instruction according to the user pupil location, the user identity and the user emotion;

[0065] Step S400: Control the display screen to interact with the user according to the first control instruction.

[0066] Specifically, when the presence of a user is detected, a light signal is emitted to the user and a light signal reflected by the user is obtained. Due to the different three-dimensionality, clothes, and skin of the human body, the light signal will be reflected at different depths and intensities, so that the user's facial features, facial micro-changes, facial muscle changes, blood vessel vibration information, etc. can be captured. For the convenience of processing, the light signal is converted into an electrical signal, and the electrical signal is deeply learned to obtain the user's identity and user emotions. In addition, while obtaining the light signal reflected by the user, the light flight time is also calculated, and the user's pupil is located based on the light flight time and the electrical signal. A first control instruction is generated based on the user's pupil location, user identity, and user emotion to control the display screen to interact with the user.

[0067] In one implementation, determining the first control instruction according to the user pupil location, the user identity, and the user emotion includes:

[0068] Step S301, determining the sight focus position of the digital human on the display screen according to the user pupil positioning;

[0069] Step S302, determining the digital human expression and digital human action according to the user identity and the user emotion;

[0070] Step S303: determining the first control instruction according to the sight focus position, the expression of the digital human and the action of the digital human.

[0071] Specifically, the focus position of the digital human on the display screen is determined according to the user's pupil positioning, the expression and action of the digital human are determined according to the user's identity and the user's emotion, and the focus position of the digital human, the expression of the digital human and the action of the digital human are generated into a first control instruction to control the digital human on the display screen, so as to realize the visual interaction and emotional interaction between the digital human and the user. For example, when the user is a home user and the user's emotion is happy, the expression and action of the digital human are also set to be relaxed and happy.

[0072] In one implementation, the method further includes:

[0073] Determining the digital human voice according to the user identity and the user emotion;

[0074] Determining a second control instruction according to the digital human voice;

[0075] The far-field voice module is controlled to interact with the user according to the second control instruction.

[0076] In simple terms, the digital human voice (comfort, inquiry, chat, etc.) is determined according to the user's identity and user's emotions, and the second control instruction is generated according to the digital human voice, thereby controlling the far-field voice module to interact with the user. When the user's identity is not a family member and the user's emotion is nervous, the far-field voice module can issue a warning to the user.

[0077] Based on the above embodiment, the present invention further provides a terminal, whose principle block diagram can be shown as follows: Figure 8 As shown. The terminal includes a processor, a memory, a network interface, and a display screen connected through a system bus. Among them, the processor of the terminal is used to provide computing and control capabilities. The memory of the terminal includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the terminal is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a television interaction method is implemented. The display screen of the terminal can be a liquid crystal display screen or an electronic ink display screen.

[0078] Those skilled in the art will understand that Figure 8The principle block diagram shown in the figure is only a block diagram of a partial structure related to the scheme of the present invention, and does not constitute a limitation on the terminal to which the scheme of the present invention is applied. The specific terminal may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0079] In one implementation, the terminal has one or more programs stored in its memory, and is configured to be executed by one or more processors, wherein the one or more programs include instructions for performing a television interaction method.

[0080] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present invention can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0081] In summary, the present invention discloses a television interaction system and method, the system comprising: a display screen, a terminal computing power module, and a vertical cavity surface emitting laser array module and a photoelectric detection module arranged on the side of the display screen; the vertical cavity surface emitting laser array module is used to emit light signals to the user; the photoelectric detection module is used to receive the light signal reflected by the user, and determine the light flight time and the electrical signal according to the light signal; the terminal computing power module is used to determine the user's pupil location, user identity and user emotions according to the light flight time and the electrical signal, and determine the first control instruction according to the user's pupil location, user identity and user emotions; the display screen is used to interact with the user according to the first control instruction. The present invention obtains the user's pupil location, user identity and user emotions based on the light signal reflected by the user, and interacts with the user according to the user's pupil location, user identity and user emotions, which effectively solves the problem that the prior art cannot achieve the function of intelligent two-way interaction with emotions.

[0082] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.

Claims

1. A television interactive system, characterized in that: The system comprises: a display screen, a terminal computing power module, and a vertical cavity surface emitting laser array module and a photoelectric detection module arranged on the side of the display screen; The vertical cavity surface emitting laser array module is used to transmit optical signals to users; The photoelectric detection module is used to receive the light signal reflected by the user and determine the light flight time and the electrical signal according to the light signal; The terminal computing module is used to determine the user's pupil location, user identity and user emotion according to the light flight time and the electrical signal, and determine the first control instruction according to the user's pupil location, user identity and user emotion; The display screen is used to interact with the user according to the first control instruction.

2. The television interactive system according to claim 1, characterized in that: The system also includes a far-field voice module, which is used to interact with the user according to the second control instruction generated by the terminal computing power module based on the user identity and the user emotion.

3. The television interactive system according to claim 1, characterized in that: The system also includes: a system main control module and an infrared sensing module; The infrared sensing module is used to detect whether a user exists; The system main control module is used to wake up the vertical cavity surface emitting laser array module, the photoelectric detection module and the terminal computing power module when the infrared sensing module detects the presence of a user.

4. The television interactive system according to claim 1, characterized in that: The vertical cavity surface emitting laser array module comprises an addressable circuit substrate and a vertical cavity surface emitting laser array arranged on the addressable circuit substrate.

5. The television interactive system according to claim 4, characterized in that: A micro lens array is integrated on the vertical cavity surface emitting laser array.

6. The television interactive system according to claim 1, characterized in that: Each of the vertical cavity surface emitting laser array modules corresponds to one of the photoelectric detection modules, forming a photoelectric detection module.

7. The television interactive system according to claim 6, characterized in that: Each of the photoelectric detection modules is respectively placed at the upper and lower ends of the left and right sides of the front of the display screen and at the left and right ends of the lower side of the front of the display screen.

8. A television interaction method of a television interaction system according to any one of claims 1 to 7, comprising: Transmitting an optical signal to a user and acquiring the optical signal reflected by the user, and determining the light flight time and the electrical signal according to the optical signal; Determine the user's pupil location, user identity, and user emotion based on the light flight time and the electrical signal; Determining a first control instruction according to the user pupil location, the user identity, and the user emotion; The display screen is controlled to interact with the user according to the first control instruction.

9. The television interaction method according to claim 8, characterized in that: Determining a first control instruction according to the user pupil location, the user identity, and the user emotion includes: Determining the sight focus position of the digital person on the display screen according to the user pupil positioning; Determine the digital human expression and digital human action according to the user identity and the user emotion; The first control instruction is determined according to the sight focus position, the expression of the digital human and the action of the digital human.

10. The television interaction method according to claim 9, characterized in that: The method further comprises: Determining the digital human voice according to the user identity and the user emotion; Determining a second control instruction according to the digital human voice; The far-field voice module is controlled to interact with the user according to the second control instruction.