Display device and method for character recognition and display

Through the display device of the smart TV, screenshots and comparison of facial feature information, identifying and displaying relevant data of the characters in the screenshot, the problem of limited person information in the smart TV is solved, the scope of user experience and content recognition is improved, and the identification data is increased sharing function.

CN114945102BActive Publication Date: 2024-11-08HISENSE VISUAL TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210510868.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-07-14
Publication Date
2024-11-08
Estimated Expiration
2040-07-14

AI Technical Summary

Technical Problem

The limited information of the person recognized in the screenshots of smart TVs has led to a decrease in user experience, especially the amateur faces identified in social scenes without relevant data display, which reduces the scope and interest of content recognition.

Method used

The controller of the display device receives recognition instructions, takes screenshots and obtains the facial feature information to be identified in the screenshot image, compares it with the pre-stored facial feature information in the server, and obtains matching reliability. If the reliability does not exceed the pre-set reliability, Then obtain similar facial features information, further obtain amateur recognition data, and display it on the display interface, and generate sharing controls to share recognition data.

Benefits of technology

It enriches the recognition range of people in the screenshot image, improves the user experience, adds the sharing function of identifying data, adds interest, and meets users' information needs for more faces.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114945102B_ABST
    Figure CN114945102B_ABST
Patent Text Reader

Abstract

The present application discloses a display device and a method for character recognition display, wherein the display device comprises: a display, a controller, the controller is communicatively connected with the display, and the controller is configured to: receive a recognition instruction for generating a screenshot image; obtain facial feature information to be recognized in the screenshot image; obtain similar facial feature information when the matching confidence between the pre-stored facial feature information in the database and the facial feature information to be recognized does not exceed the preset confidence; obtain amateur recognition data, the amateur recognition data comprises display data corresponding to the facial feature information to be recognized and the similar facial feature information respectively; generate a sharing control that uniquely matches the facial feature information to be recognized; and control the display to display the amateur recognition data and the sharing control on the display interface. The present application greatly enriches the recognition range of characters in the screenshot image, and, by adding the sharing function of the recognition data, adds interest to the user.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application submitted to the State Intellectual Property Office on July 14, 2020, with application number "202010673447.0". Technical Field

[0002] The present application relates to the field of display technology, and in particular to a display device and a method for character recognition and display. Background Art

[0003] Smart TV is a TV product that can realize two-way human-computer interaction and integrates multiple functions such as audio and video, entertainment, and data. In order to meet the diverse needs of users, operators are committed to developing various convenient functions that are easy for users to use, so as to enhance the user experience of smart TV.

[0004] Currently, when users browse movies through smart TVs, they can use the remote control to take screenshots of the current display interface. Smart TVs can upload screenshots to servers so that the server can identify the characters in the screenshots. If the server can obtain relevant cast and crew information based on the characters in the screenshots, the smart device can obtain the relevant cast and crew information and display it. If the server cannot obtain relevant cast and crew information based on the characters in the screenshots, the smart TV will not have relevant data to display, which reduces the fun of users using smart TVs and reduces the user experience. Summary of the invention

[0005] The present application provides a display device and a method for character recognition display to solve the technical problem in the prior art that the user experience is reduced due to the limited data displayed by smart TVs based on screenshots.

[0006] In order to solve the above technical problems, the embodiments of the present application disclose the following technical solutions:

[0007] In some embodiments of the present application, a display device is disclosed, and the display device includes:

[0008] monitor,

[0009] A controller is communicatively connected to the display, and the controller is configured to:

[0010] Receiving a recognition instruction, wherein the recognition instruction is used to take a screenshot of a display interface displayed on the display and generate a screenshot image;

[0011] Obtaining facial feature information to be identified in the screenshot image;

[0012] When the matching confidence between the pre-stored facial feature information in the database and the facial feature information to be identified does not exceed a preset confidence, similar facial feature information is obtained, wherein the similar facial feature information refers to pre-stored facial feature information whose matching confidence with the facial feature information to be identified meets the condition, and the database refers to a collection of a plurality of pre-stored facial feature information in the server;

[0013] Obtaining amateur recognition data, wherein the amateur recognition data refers to display data corresponding to the person recognized in the screenshot image, and the amateur recognition data includes display data corresponding to the facial feature information of the person to be recognized and display data corresponding to the facial feature information of the similar person;

[0014] Generate a sharing control that uniquely matches the facial feature information of the person to be identified, the sharing control being used to share the amateur identification data;

[0015] The display is controlled to display the amateur recognition data and the sharing control on a display interface.

[0016] In some embodiments of the present application, a method for character recognition display is disclosed, the method comprising:

[0017] Receiving a recognition instruction, wherein the recognition instruction is used to take a screenshot of a display interface displayed on the display and generate a screenshot image;

[0018] Obtaining facial feature information to be identified in the screenshot image;

[0019] When the matching confidence between the pre-stored facial feature information in the database and the facial feature information to be identified does not exceed a preset confidence, similar facial feature information is obtained, wherein the similar facial feature information refers to pre-stored facial feature information whose matching confidence with the facial feature information to be identified meets the condition, and the database refers to a collection of a plurality of pre-stored facial feature information in the server;

[0020] Obtaining amateur recognition data, wherein the amateur recognition data refers to display data corresponding to the person recognized in the screenshot image, and the amateur recognition data includes display data corresponding to the facial feature information of the person to be recognized and display data corresponding to the facial feature information of the similar person;

[0021] Generate a sharing control that uniquely matches the facial feature information of the person to be identified, the sharing control being used to share the amateur identification data;

[0022] The display is controlled to display the amateur recognition data and the sharing control on a display interface.

[0023] Compared with the prior art, the beneficial effects of this application are:

[0024] The present application provides a display device and a method for character recognition display. If a user is interested in a character in the current display interface of the display, the display device can first send a recognition command. After receiving the recognition command, the controller in the display device takes a screenshot of the current display interface and generates a screenshot image, and obtains the facial feature information of the character to be recognized based on the screenshot image. The facial feature information to be recognized is compared with a number of pre-stored facial feature information in the database one by one to obtain each matching confidence. When the matching confidence does not exceed the preset confidence, the pre-stored facial feature information that meets the matching confidence condition is obtained as similar facial feature information, and the relevant data in the amateur recognition data is further obtained based on the facial feature information in the screenshot image and the compared similar facial feature information. The amateur recognition data is displayed on the floating layer of the display interface to improve the user's experience. In addition, the controller can also generate a sharing control that uniquely matches the facial feature information to be recognized, and the sharing control is also displayed on the floating layer of the display interface. Through the sharing control, the user can use the mobile terminal to share the amateur recognition data. This application greatly enriches the recognition range of people in screenshot images, and adds fun to users by adding a sharing function for recognition data.

[0025] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the implementation methods in the embodiments of the present application or the related technologies, the following is a brief introduction to the drawings required for use in the embodiments or the related technology descriptions. Obviously, the drawings described below are some embodiments of the present application, and a person skilled in the art can also obtain other drawings based on these drawings.

[0027] Figure 1 Schematic diagram of an operation scenario between a display device and a control device according to some embodiments is exemplarily shown in FIG.

[0028] Figure 2 exemplarily shows a hardware configuration block diagram of a display device 200 according to some embodiments;

[0029] Figure 3 exemplarily shows a hardware configuration block diagram of a control device 100 according to some embodiments;

[0030] Figure 4 exemplarily shows a schematic diagram of software configuration in a display device 200 according to some embodiments;

[0031] Figure 5exemplarily shows a schematic diagram of an icon control interface display of an application in a display device 200 according to some embodiments;

[0032] Figure 6 A flowchart of a method for character recognition display according to some embodiments is exemplarily shown in FIG.

[0033] Figure 7 A flowchart of a method for obtaining amateur recognition data according to some embodiments is exemplarily shown in FIG.

[0034] Figure 8 exemplarily shows a display interface diagram of amateur recognition data according to some embodiments;

[0035] Fig. 9 exemplarily shows a display interface diagram of amateur recognition data according to some embodiments;

[0036] Fig.10 exemplarily shows a display interface diagram of amateur recognition data of a mobile terminal according to some embodiments;

[0037] Fig.11 The figure shows an exemplary display interface diagram of a similar star details page according to some embodiments. DETAILED DESCRIPTION

[0038] In order to make the purpose, implementation mode and advantages of the present application clearer, the exemplary implementation mode of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0039] Based on the exemplary embodiments described in this application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the claims attached to this application. In addition, although the disclosure in this application is introduced according to one or several exemplary examples, it should be understood that each aspect of the disclosure can also constitute a complete implementation method separately.

[0040] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0041] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise indicated. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, for example, they can be implemented in an order other than those given in the diagrams or descriptions of the embodiments of this application.

[0042] In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such products or devices.

[0043] The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0044] The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can usually wirelessly control the electronic device within a short distance. It is generally connected to the electronic device using infrared and / or radio frequency (RF) signals and / or Bluetooth, and may also include functional modules such as WiFi, wireless USB, Bluetooth, motion sensors, etc. For example: a handheld touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

[0045] The term "gesture" used in this application refers to a user's behavior of expressing an intended idea, action, purpose, or result through a change in hand shape or hand movement.

[0046] Figure 1 FIG. 2 is a schematic diagram showing an operation scenario between a display device and a control device according to an embodiment. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through the mobile terminal 300 and the control apparatus 100 .

[0047] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, etc., to control the display device 200 wirelessly or in a wired manner. The user may input user commands through buttons on the remote controller, voice input, control panel input, etc. to control the display device 200. For example, the user may input corresponding control commands through the volume plus and minus keys, channel control keys, up / down / left / right movement keys, voice input keys, menu keys, power on / off keys, etc. on the remote controller to realize the function of controlling the display device 200.

[0048] In some embodiments, a mobile terminal, a tablet computer, a computer, a laptop computer, and other smart devices may also be used to control the display device 200. For example, an application running on the smart device is used to control the display device 200. The application may be configured to provide the user with various controls in an intuitive user interface (UI) on a screen associated with the smart device.

[0049] In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and realize connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. For example, it is possible to establish a control instruction protocol with the mobile terminal 300 and synchronize the remote control keyboard to the mobile terminal 300, and realize the function of controlling the display device 200 by controlling the user interface on the mobile terminal 300. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to realize the synchronous display function.

[0050] like Figure 1 It is also shown that the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. For example, the display device 200 receives software program updates or accesses a remotely stored digital media library by sending and receiving information and interacting with an electronic program guide (EPG). The server 400 may be a cluster or multiple clusters, and may include one or more types of servers. Other network service content such as video on demand and advertising services is provided through the server 400.

[0051] The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size, and resolution are not limited. It is understood by those skilled in the art that the display device 200 may be modified in performance and configuration as required.

[0052] In addition to providing a broadcast receiving television function, the display device 200 may also provide an intelligent network television function that provides a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0053] Figure 2 Schematically shows a hardware configuration block diagram of a display device 200 according to an exemplary embodiment.

[0054] In some embodiments, the display device 200 includes at least one of a controller 250, a tuner and demodulator 210, a communicator 220, a detector 230, an input / output interface 255, a display 275, an audio output interface 285, a memory 260, a power supply 290, a user interface 265, and an external device interface 240.

[0055] In some embodiments, the display 275 is a component for receiving the image signal outputted from the first processor and displaying video content and images as well as a menu control interface.

[0056] In some embodiments, the display 275 includes a display screen component for presenting images and a driving component for driving image display.

[0057] In some embodiments, the displayed video content may be from broadcast television content, or may be various broadcast signals received through wired or wireless communication protocols, or may be from various image content sent from a network server via a network communication protocol.

[0058] In some embodiments, the display 275 is used to present a user manipulation UI interface generated in the display device 200 and used to control the display device 200 .

[0059] In some embodiments, depending on the type of display 275, a driving component for driving the display is also included.

[0060] In some embodiments, the display 275 is a projection display, and may also include a projection device and a projection screen.

[0061] In some embodiments, the communicator 220 is a component for communicating with an external device or an external server according to various communication protocol types. For example, the communicator may include at least one of a Wifi chip, a Bluetooth communication protocol chip, a wired Ethernet communication protocol chip, other network communication protocol chips or a near field communication protocol chip, and an infrared receiver.

[0062] In some embodiments, the display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the content providing device through the communicator 220 .

[0063] In some embodiments, the user interface 265 may be used to receive infrared control signals from the control device 100 (eg, an infrared remote controller, etc.).

[0064] In some embodiments, the detector 230 is a signal used by the display device 200 to collect external environment or interact with the outside.

[0065] In some embodiments, the detector 230 includes a light receiver, a sensor for collecting ambient light intensity, and can adaptively display parameter changes by collecting ambient light.

[0066] In some embodiments, the detector 230 may also include an image collector, such as a camera, a webcam, etc., which can be used to collect external environment scenes, as well as to collect user attributes or gestures for interacting with the user. It can adaptively change display parameters and recognize user gestures to achieve the function of interacting with the user.

[0067] In some embodiments, the detector 230 may also include a temperature sensor or the like, such as by sensing the ambient temperature.

[0068] In some embodiments, the display device 200 can adaptively adjust the display color temperature of the image. For example, when the temperature is high, the display device 200 can be adjusted to display a cooler color temperature of the image, or when the temperature is low, the display device 200 can be adjusted to display a warmer color temperature of the image.

[0069] In some embodiments, the detector 230 may also be a sound collector, such as a microphone, which can be used to receive the user's voice, for example, including a voice signal of a control instruction of the user to control the display device 200, or collect environmental sounds to identify the type of environmental scene, so that the display device 200 can adaptively adapt to the environmental noise.

[0070] In some embodiments, Figure 2 As shown, the input / output interface 255 is configured to perform data transmission between the controller 250 and other external devices or other controllers 250, such as receiving video signal data and audio signal data, or command instruction data from external devices.

[0071] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more interfaces such as a high-definition multimedia interface HDMI interface, an analog or digital high-definition component input interface, a composite video input interface, a USB input interface, an RGB port, etc. It is also possible that the above multiple interfaces form a composite input / output interface.

[0072] In some embodiments, Figure 2As shown, the tuner-demodulator 210 is configured to receive broadcast television signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and demodulate audio and video signals from multiple wireless or wired broadcast television signals. The audio and video signals may include television audio and video signals carried in the television channel frequency selected by the user, as well as EPG data signals.

[0073] In some embodiments, the frequency demodulated by the tuner-demodulator 210 is controlled by the controller 250, which can send a control signal based on the user's selection to make the modem respond to the TV signal frequency selected by the user and modulate and demodulate the TV signal carried by the frequency.

[0074] In some embodiments, the broadcast television signal can be classified into terrestrial broadcast signals, cable broadcast signals, satellite broadcast signals, or Internet broadcast signals according to different broadcasting formats of the television signal. Or it can be classified into digital modulation signals, analog modulation signals, etc. according to different modulation types. Or it can be classified into digital signals, analog signals, etc. according to different signal types.

[0075] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. In this way, the set-top box outputs the TV audio and video signals modulated and demodulated from the received broadcast TV signals to the main device, and the main device receives the audio and video signals through the first input / output interface.

[0076] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 can control the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 275, the controller 250 can perform operations related to the object selected by the user command.

[0077] In some embodiments, the object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object may include, for example, displaying a page, document, image, etc. connected to the hyperlink, or executing a program corresponding to the icon. User commands for selecting UI objects may be commands inputted through various input devices (e.g., a mouse, keyboard, touchpad, etc.) connected to the display device 200 or voice commands corresponding to voices spoken by the user.

[0078] like Figure 2As shown, the controller 250 includes at least one of a random access memory 251 (Random Access Memory, RAM), a read-only memory 252 (Read-Only Memory, ROM), a video processor 270, an audio processor 280, other processors 253 (for example: a graphics processor (Graphics Processing Unit, GPU), a central processing unit 254 (Central Processing Unit, CPU), a communication interface (Communication Interface), and a communication bus 256 (Bus). The communication bus connects various components.

[0079] In some embodiments, RAM 251 is used to store temporary data for the operating system or other running programs.

[0080] In some embodiments, ROM 252 is used to store various system startup instructions.

[0081] In some embodiments, ROM 252 is used to store a basic input / output system, called Basic Input Output System (BIOS), which is used to complete the power-on self-test of the system, the initialization of each functional module in the system, the basic input / output driver of the system, and the booting of the operating system.

[0082] In some embodiments, when a power-on signal is received, the display device 200 starts to power on, and the CPU runs the system startup instruction in the ROM 252, and copies the temporary data of the operating system stored in the memory to the RAM 251, so as to start or run the operating system. After the operating system is started, the CPU copies the temporary data of various application programs in the memory to the RAM 251, so as to start or run various application programs.

[0083] In some embodiments, the CPU processor 254 is used to execute operating system and application instructions stored in the memory, and to execute various applications, data and content according to various interactive instructions received from external input, so as to finally display and play various audio and video contents.

[0084] In some exemplary embodiments, the CPU processor 254 may include multiple processors. The multiple processors may include a main processor and one or more sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode and / or the operation of displaying the picture in the normal mode. The one or more sub-processors are used for an operation in the standby mode and the like.

[0085] In some embodiments, the graphics processor 253 is used to generate various graphic objects, such as icons, operation menus, and user input command display graphics, etc. It includes an operator that performs operations by receiving various interactive instructions input by the user and displays various objects according to display attributes. It also includes a renderer that renders various objects obtained based on the operator, and the rendered objects are used to be displayed on the display.

[0086] In some embodiments, the video processor 270 is configured to receive an external video signal and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal, and obtain a signal that can be directly displayed or played on the display device 200.

[0087] In some embodiments, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc.

[0088] Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module demultiplexes it into video signals and audio signals.

[0089] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

[0090] The image synthesis module, such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator according to the user input or itself with the scaled video image to generate an image signal for display.

[0091] The frame rate conversion module is used to convert the input video frame rate, such as converting the 60Hz frame rate to 120Hz frame rate or 240Hz frame rate. The usual format is implemented by interpolation.

[0092] The display formatting module is used to receive the frame rate converted video output signal and change the signal to conform to the display format signal, such as outputting RGB data signal.

[0093] In some embodiments, the graphics processor 253 can be integrated with the video processor or can be separately configured. When integrated, it can perform processing of graphic signals output to the display. When separately configured, it can perform different functions respectively, such as GPU + FRC (Frame Rate Conversion) architecture.

[0094] In some embodiments, the audio processor 280 is used to receive an external audio signal, and perform decompression and decoding, as well as noise reduction, digital-to-analog conversion, and amplification processing according to the standard codec protocol of the input signal to obtain a sound signal that can be played in a speaker.

[0095] In some embodiments, the video processor 270 may include one or more chips. The audio processor may also include one or more chips.

[0096] In some embodiments, the video processor 270 and the audio processor 280 may be separate chips, or may be integrated with the controller into one or more chips.

[0097] In some embodiments, the audio output receives the sound signal output by the audio processor 280 under the control of the controller 250, such as the speaker 286, and in addition to the speaker carried by the display device 200 itself, can be output to the external audio output terminal of the generating device of the external device, such as an external audio interface or a headphone interface, etc., and can also include a short-range communication module in the communication interface, for example, a Bluetooth module for Bluetooth speaker sound output.

[0098] The power supply 290, under the control of the controller 250, uses the power input from the external power supply to provide power supply support for the display device 200. The power supply 290 may include a built-in power supply circuit installed inside the display device 200, or may be an external power supply installed on the display device 200 to provide a power interface for an external power supply in the display device 200.

[0099] The user interface 265 is used to receive a user input signal, and then send the received user input signal to the controller 250. The user input signal may be a remote control signal received by an infrared receiver, and may receive various user control signals through a network communication module.

[0100] In some embodiments, the user inputs a user command through the control device 100 or the mobile terminal 300 , the user input interface is based on the user input, and the display device 200 responds to the user input through the controller 250 .

[0101] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 275, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command through a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.

[0102] In some embodiments, the "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.

[0103] The memory 260 includes storing various software modules for driving the display device 200. For example, the various software modules stored in the first memory include at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

[0104] The basic module is a bottom-level software module used for signal communication between various hardware in the display device 200 and sending processing and control signals to the upper-level modules. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis management.

[0105] For example, the speech recognition module includes a speech analysis module and a speech instruction database module. The display control module is a module for controlling the display to display image content, and can be used to play multimedia image content and UI interface information. The communication module is a module for controlling and communicating data with external devices. The browser module is a module for executing data communication between browsing servers. The service module is a module for providing various services and various applications. At the same time, the memory 260 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effects of focus objects.

[0106] Figure 3 Schematically shows a configuration block diagram of the control device 100 according to an exemplary embodiment. Figure 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0107] The control device 100 is configured to control the display device 200, and can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200. For example, the user operates the channel increase and decrease keys on the control device 100, and the display device 200 responds to the channel increase and decrease operations.

[0108] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0109] In some embodiments, Figure 1 As shown, the mobile terminal 300 or other smart electronic device can play a similar function to the control device 100 after installing the application for controlling the display device 200. For example, the user can install the application to realize the function of the physical button of the control device 100 through various function keys or virtual buttons of the graphical user interface provided on the mobile terminal 300 or other smart electronic device.

[0110] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.

[0111] The communication interface 130, under the control of the controller 110, realizes the communication of control signals and data signals with the display device 200. For example, the received user input signal is sent to the display device 200. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.

[0112] The user input / output interface 140 includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144. For example, the user can input user commands through voice, touch, gesture, pressing, and other actions. The input interface converts the received analog signal into a digital signal, and the digital signal into a corresponding command signal, and sends it to the display device 200.

[0113] The output interface includes an interface for sending received user commands to the display device 200. In some embodiments, it can be an infrared interface or a radio frequency interface. For example, in the case of an infrared signal interface, the user input command needs to be converted into an infrared control signal according to an infrared control protocol, and then sent to the display device 200 via an infrared sending module. For another example, in the case of a radio frequency signal interface, the user input command needs to be converted into a digital signal, and then modulated according to a radio frequency control signal modulation protocol, and then sent to the display device 200 by a radio frequency sending terminal.

[0114] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, which can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.

[0115] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0116] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller, and can be a battery and related control circuits.

[0117] In some embodiments, the system may include a kernel, a command parser (shell), a file system, and an application. The kernel, shell, and file system together form the basic operating system structure, which allows users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts the hardware, initializes hardware parameters, etc., runs and maintains virtual memory, schedulers, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. After startup, the application is compiled into machine code to form a process.

[0118] See also Figure 4 In some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.

[0119] In some embodiments, at least one application is running in the application layer, and these applications may be window programs, system settings programs, clock programs, camera applications, etc. provided by the operating system; or they may be applications developed by third-party developers, such as hi-view programs, karaoke programs, magic mirror programs, etc. In specific implementation, the application packages in the application layer are not limited to the above examples, and may actually include other application packages, which are not limited in the embodiments of the present application.

[0120] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Applications can access system resources and obtain system services during execution through the API interface.

[0121] like Figure 4 As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application package currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop components on the user interface.

[0122] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit of the application (including switching the user interface currently displayed in the display window to the system desktop), opening, and backing (including switching the user interface currently displayed in the display window to the parent user interface of the currently displayed user interface), etc.

[0123] In some embodiments, the window manager is used to manage all window programs, such as obtaining the display size, determining whether there is a status bar, locking the screen, capturing the screen, controlling display window changes (for example, shrinking the display window, shaking the display, distorting the display, etc.), etc.

[0124] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0125] In some embodiments, the kernel layer is a layer between hardware and software. Figure 4As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensor, pressure sensor, etc.), etc.

[0126] In some embodiments, the core layer further includes a power driver module for performing power management.

[0127] In some embodiments, Figure 4 The software programs and / or modules corresponding to the software architecture in Figure 2 or Figure 3 in the first memory or the second memory shown.

[0128] In some embodiments, taking the magic mirror application (photographing application) as an example, when the remote control receiving device receives the input operation of the remote control, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the input operation into the original input event (including the value of the input operation, the timestamp of the input operation and other information). The original input event is stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer, identifies the control corresponding to the input event according to the current position of the focus, and the input operation is a confirmation operation. The control corresponding to the confirmation operation is the control of the magic mirror application icon. The magic mirror application calls the interface of the application framework layer to start the magic mirror application, and then starts the camera driver by calling the kernel layer to realize the capture of static images or videos through the camera.

[0129] In some embodiments, for a display device with a touch function, taking a split-screen operation as an example, the display device receives an input operation (such as a split-screen operation) performed by a user on the display screen, and the kernel layer can generate a corresponding input event according to the input operation, and report the event to the application framework layer. The activity manager of the application framework layer sets the window mode (such as a multi-window mode) and the window position and size corresponding to the input operation. The window management of the application framework layer draws the window according to the settings of the activity manager, and then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display screen.

[0130] In some embodiments, Figure 5 As shown in , the application layer includes at least one application that can display a corresponding icon control in the display, such as: a live TV application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control, etc.

[0131] In some embodiments, the live TV application can provide live TV through different signal sources. For example, the live TV application can use input from cable TV, wireless broadcast, satellite service, or other types of live TV services to provide TV signals. And, the live TV application can display video of the live TV signal on the display device 200.

[0132] In some embodiments, the video on demand application can provide videos from different storage sources. Unlike the live TV application, the video on demand provides video display from certain storage sources. For example, the video on demand can come from the server side of the cloud storage, from the local hard disk storage containing the stored video programs.

[0133] In some embodiments, the media center application can provide an application for playing various multimedia contents. For example, the media center can be a service provided by a user to access various images or audios through the media center application, which is different from live TV or video on demand.

[0134] In some embodiments, the application center can provide and store various applications. The application can be a game, an application, or some other application related to a computer system or other device but can be run on a smart TV. The application center can obtain these applications from different sources, store them in a local storage, and then run them on the display device 200.

[0135] In order to enhance the user experience of smart TVs, smart TVs usually have the function of taking screenshots and identifying the characters in the screenshots. Current smart TVs can only obtain relevant cast and crew information of the characters in the screenshots, that is, only when the characters in the screenshots are actors can relevant information be obtained for display. With the introduction and promotion of social TV, especially the increase of cameras in smart TVs, users can not only watch their current screen directly through the camera, but also see more faces other than actors when chatting with relatives and friends in social scenes (such as video calls), that is, more amateur faces. For the amateurs in the screenshots, smart TVs do not have relevant data to display. In order to enrich the content recognition scope of smart TVs, the embodiments of the present application provide a display device and a method for character recognition and display. It should be noted that the display device in the present application refers not only to smart TVs, but also to computers, tablet computers, etc.

[0136] The display device 200 in the embodiment of the present application can increase content recognition and obtain more displayable data through screenshots. The controller 250 in the display device 200 is connected to the display 275 in communication and is configured to perform the process of character recognition display. The process of character recognition display provided by the embodiment of the present application is described below in conjunction with the accompanying drawings.

[0137] Figure 6 FIG. 4 is a flow chart showing a method for character recognition and display according to some embodiments. Figure 6 , the method comprises the following steps:

[0138] S610: Receive a recognition instruction, where the recognition instruction is used to take a screenshot of a display interface displayed on a display and generate a screenshot image.

[0139] In the embodiment of the present application, when the user is watching the media displayed by the display device 200, if he wants to know more about the person information in the current display interface, he can send an identification instruction to the display device 200. That is, after receiving the identification instruction, the controller 250 in the display device 200 can know that the user wants to know the information of the person in the current display interface in the display according to the identification instruction.

[0140] In one implementation, the user can send the identification command using a "screenshot" button set on the remote control, or a specific button in the remote control that is bound to the screenshot function, for example, a favorite button bound to the screenshot function or a live button bound to the screenshot function. When the user wants to take a screenshot while watching media resources, the identification command is sent through the "screenshot" button on the remote control, or a specific button bound to the screenshot function.

[0141] In another implementation, the user can issue a recognition command through voice input. For example, the user long presses the voice input key on the remote control and says "Who is this person?" After receiving the user's voice input, the controller 250 first uploads the user's voice input information to the server 400. The server 400 parses the voice input information, and when the voice input information is parsed as the user wants to know the information of the person in the current display interface, it sends a screenshot instruction to the display device 200, and the display device 200 takes a screenshot of the current display interface of the display 275 according to the screenshot instruction.

[0142] In the embodiment of the present application, the controller receives a recognition command issued by the user through the screenshot button of the remote control or voice input, and takes a screenshot of the display interface displayed on the display according to the recognition command and generates a screenshot image, and then obtains the recognition data in the screenshot image through subsequent steps to display it on the display 275. It should be noted that the screenshot image in the present application can be captured from film and television programs, variety shows, news programs, etc., and can also be captured from video calls, user-made videos, etc.

[0143] S620: Obtaining facial feature information to be identified in the screenshot image.

[0144] In the embodiment of the present application, after the display device 200 obtains the screenshot image, it sends the screenshot image to the server 400, and the server 400 receives the screenshot image and extracts the facial feature information to be identified in the screenshot image based on the image content recognition technology, wherein the facial feature information to be identified includes extraction of facial features such as forehead, eyebrows, eyes, nose, mouth and chin. When extracting the facial feature information to be identified, the present application can also mark the location information of each facial feature.

[0145] It should be noted that the display device 200 and the server 400 in the present application may also be the same device, that is, the functions that can be realized by the display device 200 and the server 400 can all be realized by the same device, and the specific process will not be repeated here.

[0146] S630: When the matching confidence between the pre-stored facial feature information in the database and the facial feature information to be identified does not exceed a preset confidence, similar facial feature information is obtained.

[0147] In the embodiment of the present application, a database is provided in the server 400, and a plurality of pre-stored facial feature information is stored in the database, and the database can be regarded as a collection of a plurality of pre-stored facial feature information in the server. Among them, the plurality of pre-stored facial feature information refers to the facial feature information of celebrities. As the name implies, celebrities generally refer to highly respected people with lofty abilities in all walks of life, such as actors, singers, artists, etc. Celebrities are well known to most people. After extracting the facial feature information to be identified in the screenshot image, the server 400 will compare the facial feature information to be identified with the plurality of pre-stored facial feature information in the database one by one, and obtain a plurality of matching confidences respectively.

[0148] In some embodiments, a preset confidence level is set in the server 400. When the multiple matching confidence levels obtained do not exceed the preset confidence level, it can be determined that the matching confidence level between the facial feature information to be identified and the pre-stored facial feature information of each celebrity in the database is relatively low, so the facial feature information to be identified can be considered as facial feature information corresponding to an ordinary person, wherein an ordinary person is an ordinary person in life, and an ordinary person can be understood as a person who is not known by others except relatives and friends. For example, the preset confidence level is set to 98%. If there is no pre-stored facial feature information with a matching confidence level of 98% or more between the facial feature information to be identified and the pre-stored facial feature information, it can be determined that the facial feature information to be identified is extracted from an ordinary person's face. At this time, the server 400 obtains the pre-stored facial feature information that meets the matching confidence level conditions with the facial feature information to be identified from the database as similar facial feature information. For example, the server 400 may sort multiple matching confidences in descending order and select similar facial feature information. The server 400 may feed back the similar facial feature information to the display device 200, and the controller 250 obtains the similar facial feature information, wherein the similar facial feature information refers to the pre-stored facial feature information that is ranked before N in terms of matching confidence with the facial feature information to be identified, where N is greater than or equal to 1. That is to say, when obtaining similar facial feature information, at least the first one is selected from the arranged matching confidences, and the pre-stored facial feature information corresponding to the matching confidence is used as the similar facial feature information.

[0149] In some embodiments, when the matching confidence between any pre-stored facial feature information in the database and the facial feature information to be identified exceeds a preset confidence, standard facial feature information is obtained, wherein the standard facial feature information refers to the pre-stored facial feature information with the highest matching confidence with the facial feature information to be identified. In other words, when any one of the multiple matching confidences obtained exceeds the preset confidence, it can be determined that the facial feature information to be identified has a high matching confidence with the pre-stored facial feature information of a celebrity in the database, so the facial feature information to be identified can be considered as the facial feature information corresponding to the celebrity. At this time, the server 400 can select the pre-stored facial feature information with the highest matching confidence as the standard facial feature information, and the server 400 can feed the standard facial feature information back to the display device 200, and the controller 250 obtains the standard facial feature information. For example, the preset confidence is set to 98%. If the facial feature information to be identified and the pre-stored facial feature information have a matching confidence level of 98% or more, then it can be determined that the facial feature information to be identified is extracted from a celebrity face, and the celebrity corresponding to the pre-stored facial feature information with a matching confidence level of 98% or more is the celebrity identified in the screenshot image.

[0150] It should be noted that the preset confidence level can be set according to the accuracy of the algorithm. Only when the facial feature information to be identified and the pre-stored facial information are from the same person, the matching confidence level between the two can reach above the preset confidence level, up to 100%. If the facial feature information to be identified of an ordinary person matches the facial feature information pre-stored in the database, the matching confidence level may be lower than 50%.

[0151] In some embodiments, after selecting the standard facial feature information, the server 400 can know which celebrity the standard facial feature information is extracted from based on the standard facial feature information, and search for the profile information and related media resources corresponding to the standard facial feature information based on the celebrity. After searching for the corresponding profile information and related media resources, the server 400 feeds the data back to the display device 200, which is acquired by the controller 250. For example, after acquiring the facial feature data to be identified from the screenshot image, the facial feature data to be identified matches the pre-stored facial feature information extracted from Zhang San in the database, then it can be determined that the person in the screenshot image is Zhang San, and then Zhang San's profile information is obtained, such as Zhang San, born in Shanghai, a male pop singer, film and television actor, and music producer in mainland China, and graduated from Glion Hotel Management School. At the same time, the relevant media resources in which Zhang San participated are obtained. In addition, Zhang San's news and gossip, etc. can also be obtained.

[0152] The above describes the recognition process when the screenshot image contains only one person. Of course, when the screenshot image contains multiple people, in the display device provided in the embodiment of the present application, the controller is configured as follows:

[0153] Acquire the facial feature information of multiple characters to be identified respectively, and acquire the matching confidence result of each character respectively, wherein the matching confidence result includes the matching confidence of each pre-stored facial feature information in the database and the facial feature information to be identified. For each character in the screenshot image, compare its matching confidence result with the preset confidence. When the matching confidence result is that there is pre-stored facial feature information exceeding the preset confidence, acquire the corresponding standard facial feature information; or, when the matching confidence result is that there is no pre-stored facial feature information exceeding the preset confidence, acquire the corresponding similar facial feature information. It should be noted that for the multiple characters in the screenshot image, it is possible that all of them are amateur faces, all of them are celebrity faces, and some of them are amateur faces and the other part are celebrity faces. Whether it is a celebrity face or an amateur face, it is sufficient to obtain the corresponding similar facial feature information or standard facial feature information, and further obtain the corresponding display data based on the similar facial feature information and / or standard facial feature information.

[0154] S640: Obtaining amateur recognition data.

[0155] In the embodiment of the present application, after obtaining the similar facial feature information, the controller 250 further obtains the amateur recognition data. The amateur recognition data refers to the display data corresponding to the person recognized in the screenshot image, and the amateur recognition data includes the display data corresponding to the facial feature information of the person to be recognized and the display data corresponding to the similar facial feature information.

[0156] The following is a flow chart of the method for obtaining amateur recognition data with reference to the accompanying drawings.

[0157] Figure 7 A flow chart of a method for obtaining amateur identification data according to some embodiments is exemplarily shown in FIG. Figure 7 , steps S710 to S740 illustrate the process:

[0158] S710: Obtain a thumbnail of a person's head portrait captured from the screenshot image according to the position information of the facial features.

[0159] In an embodiment of the present application, when extracting the facial feature information to be identified, the position information of the facial features such as the forehead, eyebrows, eyes, nose, mouth and chin is also marked. The position information of the facial features can be used to know the position information of the person in the entire screenshot image. The controller 250 can capture a thumbnail of the person's portrait from the screenshot image, that is, cut out the image based on the person's position information to obtain a thumbnail of the person's portrait.

[0160] S720: Obtain appearance data generated after comparing the facial feature information to be identified with the facial feature template.

[0161] In an embodiment of the present application, the appearance data of the corresponding person can be obtained based on the facial feature information to be identified. Based on the public aesthetics, standard facial features recognized by the public can be obtained. For example, for the nose, a high nose bridge is generally considered to be more beautiful than a short nose bridge, and for the eyes, double eyelids are generally considered to be more beautiful than single eyelids. The server 400 can compare the extracted facial feature information to be identified with the preset facial feature template to obtain the corresponding appearance score, appearance ranking, age estimation, etc. For different servers, the obtained appearance data may be different. The server 400 feeds the obtained appearance data back to the display device 200.

[0162] In some embodiments, based on the facial feature information of the person to be identified, the facial data of the corresponding person can be obtained, for example, the facial features are small, the temperament is unique and beautiful, the appearance is dignified, etc.

[0163] S730: Add a corresponding character identifier to the character portrait thumbnail according to the appearance data.

[0164] In the embodiment of the present application, the appearance data of the corresponding person, such as appearance score, appearance ranking and age estimation, etc., can be obtained based on the facial feature information to be identified. The server 400 adds a corresponding character identification to the corresponding character avatar thumbnail according to the appearance data. For example, for a male around 45 years old, his character identification name can be "handsome guy", and for a female around 70 years old, his character identification name can be "grandma", etc. After obtaining the corresponding character identification, the server 400 can feed it back to the display device 200 along with the appearance data.

[0165] S740: Determine similar stars through the similar facial feature information, and obtain profile information and related media resources corresponding to the similar stars.

[0166] In the embodiment of the present application, similar celebrities can be determined based on similar facial feature information. Since the similar facial feature information is extracted from pre-stored facial feature information, each similar facial feature information can have a corresponding celebrity, and the celebrity is the similar celebrity. The server 400 searches for the corresponding profile information and related media resources based on the similar celebrity, and feeds the data back to the display device 200, which is acquired by the controller 250.

[0167] The above-mentioned amateur recognition data include character avatar thumbnails, appearance data, character identification, similar celebrities, corresponding profile information and related media resources, etc. Among the above-mentioned data, some data are directly obtained by the controller 250 in the display device 200, and some data are indirectly obtained by the controller 250 through the server 400.

[0168] S650: Generate a sharing control that uniquely matches the facial feature information to be identified.

[0169] In the embodiment of the present application, the controller 250 generates a character string based on the character identification, in combination with the timestamp, server domain name and display device identification of the screenshot image, wherein the server refers to the server that extracts the facial feature information in the screenshot image, and generates a QR code based on the character string. The QR code is used as a sharing control to share the amateur recognition data. When the user wants to obtain the amateur recognition data from the display device 200, the QR code can be scanned by a mobile terminal with a camera such as a mobile phone, iPad and notebook. The server 400 obtains the corresponding amateur recognition data based on the request of the mobile terminal and feeds it back to the mobile terminal, thereby realizing the sharing of amateur recognition data. If the mobile terminal wants to obtain the amateur recognition data, it needs to obtain the time point of the screenshot through the timestamp of the screenshot image, obtain which server to access through the server domain name, and clarify which display device generates the screenshot image through the display device identification. When the mobile terminal wants to obtain the amateur recognition data, it can request the server by scanning the QR code.

[0170] S660: Control the display to display the amateur recognition data and the sharing control on a display interface.

[0171] In an embodiment of the present application, after acquiring the amateur recognition data, the controller 250 controls the display 275 to pop up an information floating layer on the current display interface, and the information floating layer includes a character area, a similarity area, an appearance area and a sharing area, wherein the character area contains one or more character controls, and the character control contains the character avatar thumbnail. Figure 8 FIG. 4 exemplarily shows a display interface diagram of amateur recognition data according to some embodiments, Fig. 9 FIG. 2 shows an exemplary display interface diagram of amateur recognition data according to some embodiments. Figure 8 and Fig. 9 On the right side of the current display interface of the display 275, a "content identification" information floating layer pops up, and the "content identification" information floating layer is sequentially provided with a character area, a similarity area, a face area, a facial area, and a sharing area. In the character area, a character avatar thumbnail is displayed, and the character avatar thumbnail is a character control. Below the character avatar thumbnail is a character identifier corresponding to the character avatar thumbnail, such as Figure 8 In the character area, when the focus is moved to different character controls by using the left / right direction buttons on the remote control, the controller 250 controls the similar area, appearance area, face area and sharing area below to display the amateur recognition data and sharing controls of different characters identified in the screenshot image. The user moves the focus to the similar area, appearance area, face area and sharing area by using the up / down direction buttons on the remote control. The similar area displays the similar stars, such as Figure 8 The similarity between the ordinary person in the screenshot image and each similar star is displayed below the similar star. The appearance area is used to display the appearance data, such as Figure 8 In the screenshot, the beauty score of the amateur is 87, the beauty ranking is 83%, and the estimated age is 46. The face evaluation is displayed in the face area. In the sharing area, a sharing control is displayed, and a text prompt "Scan the code with your mobile phone to obtain the recognition result" is set.

[0172] Fig.10 FIG. 4 exemplarily shows a display interface diagram of amateur recognition data of a mobile terminal according to some embodiments. Fig.10 In the example, when the user scans the sharing control in the sharing area through the mobile terminal, the display screen of the mobile terminal displays the corresponding Fig.10 The display interface shown.

[0173] In the embodiment of the present application, Figure 8The similar area in the information floating layer includes multiple star controls, and the multiple star controls correspond to multiple similar stars. After the similar area obtains focus and is selected, the controller 250 controls the information floating layer to jump to the similar star details page, wherein the similar star details page includes the similar area, the introduction area and the media area, the introduction area is used to display the introduction information, and the media area is used to display related media. Fig.11 , Fig.11 FIG. 4 shows an exemplary display interface diagram of a similar star detail page according to some embodiments, such as Fig.11 As shown in , a similar star details page is displayed through a floating layer of "similar stars". In the similar star details page, a similar area, a profile area and a media area are sequentially arranged. In the similar area, when the focus moves to different star controls, the controller 250 controls the profile information and related media of different similar stars to be displayed in the profile area and the media area. That is, when the focus moves to different star portraits, the profile information and related media of the corresponding star are displayed in the profile area and the media area below. Fig.11 Only three similar stars are shown. Based on the number of similar facial features selected, multiple similar stars can be set here. In the similar area, the focus can be moved to different star controls by pressing the left / right direction buttons on the remote control. In addition, an entertainment area can be set on the similar star details page, and gossip news about the corresponding star can be displayed in the entertainment area.

[0174] In this application, the display device can obtain amateur recognition data based on the screenshot image, and display the amateur recognition data on the floating layer of the display interface to improve the user experience. In addition, the controller 250 can also generate a sharing control that uniquely matches the facial feature information to be identified, and the sharing control is also displayed on the floating layer of the display interface. Through the sharing control, the user can use the mobile terminal to share the amateur recognition data. This application greatly enriches the recognition range of people in the screenshot image, and by adding the sharing function of the recognition data, it adds fun to the user.

[0175] Based on the same inventive concept as the above-mentioned display device, the embodiment of the present application also provides a method for character recognition display, the method comprising: the controller 2550 receives a recognition instruction, the recognition instruction is used to screenshot the display interface displayed by the display 275 and generate a screenshot image. The controller 250 obtains the facial feature information to be identified in the screenshot image, and compares the facial feature information to be identified with the facial information pre-stored in the database one by one. When the matching confidence of the pre-stored facial feature information in the database and the facial feature information to be identified does not exceed the preset confidence, the controller 250 obtains similar facial feature information, wherein the similar facial feature information refers to the pre-stored facial feature information whose matching confidence with the facial feature information to be identified meets the condition, and the database refers to a collection of several pre-stored facial feature information in the server. The controller 250 obtains the amateur recognition data, wherein the amateur recognition data refers to the display data corresponding to the person identified in the screenshot image, and the amateur recognition data includes the display data corresponding to the facial feature information to be identified, and the display data corresponding to the similar facial feature information. The controller 250 generates a sharing control that uniquely matches the facial feature information to be identified, the sharing control is used to share the amateur recognition data, and controls the display 275 to display the amateur recognition data and the sharing control on a display interface.

[0176] In some embodiments, when the controller 250 compares the facial feature information to be identified with the pre-stored facial information in the database one by one, when the matching confidence between any pre-stored facial feature information in the database and the facial feature information to be identified exceeds a preset confidence, standard facial feature information is obtained, wherein the standard facial feature information refers to the pre-stored facial feature information with the highest matching confidence with the facial feature information to be identified. The controller 250 obtains the profile information and related media resources corresponding to the standard facial feature information.

[0177] Since the above embodiments are all described by citing and combining with other embodiments, different embodiments have the same parts, and the same and similar parts between the embodiments in this specification can be referred to each other. No further detailed description is given here.

[0178] It should be noted that, in this specification, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a circuit structure, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such circuit structure, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the circuit structure, article or device including the element.

[0179] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the disclosure of the invention herein. The present application is intended to cover any variations, uses or adaptations of the present invention, which follow the general principles of the present application and include common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the content of the claims.

[0180] The above-described embodiments of the present application do not constitute a limitation on the protection scope of the present application.

Claims

1. A display device, characterized in that: The display device comprises: monitor, A controller is communicatively connected to the display, and the controller is configured to: In response to an instruction to identify at least one object in a display screen, taking a screenshot of a display interface displayed on the display and generating a screenshot image; Acquire the facial feature information of the person to be identified in the screenshot image and send it to the server, so that the server compares the facial feature information of the person to be identified with a plurality of facial feature information pre-stored in a database to obtain a matching confidence, and determine the object whose matching confidence reaches a preset confidence as a celebrity, and determine the object whose matching confidence does not reach the preset confidence as an ordinary person; If the object is determined to be a celebrity, obtaining profile data about the celebrity; If the object is determined to be an amateur, obtaining screenshot information corresponding to the amateur in the display interface and amateur identification data; Control the display to pop up an information floating layer on the current display interface, wherein the information floating layer includes a character area, a similarity area, an appearance area, and a sharing area, wherein the character area includes one or more character controls, and the character control includes a character avatar thumbnail captured from the screenshot image; When the focus moves to different character controls, control the display of amateur recognition data of different characters recognized in the screenshot image; The similarity area is used to display similar celebrities; the appearance area is used to display appearance data.

2. The display device according to claim 1, characterized in that The controller is also configured to: The facial feature information of the person to be identified in the screenshot image is obtained and sent to the server, so that when the matching confidence between the facial feature information pre-stored in the database of the server and the facial feature information to be identified does not exceed the preset confidence, similar facial feature information is obtained, wherein the similar facial feature information refers to pre-stored facial feature information whose matching confidence with the facial feature information to be identified meets the conditions, and the similar facial feature information is used to obtain corresponding display data, and the database refers to a collection of several pre-stored facial feature information in the server, and the pre-stored facial feature information refers to facial feature information of celebrities.

3. The display device according to claim 2, characterized in that The facial feature information to be identified includes location information of the facial features; The controller executes the step of obtaining screenshot information corresponding to an amateur in the display interface and amateur identification data, including: According to the position information of the facial features, obtaining a thumbnail of the head portrait of the person captured from the screenshot image; Obtaining appearance data generated by comparing the facial feature information of the person to be identified with the facial feature template; According to the appearance data, adding a corresponding character identifier to the character portrait thumbnail; Similar celebrities are determined through the similar facial feature information, and profile information and related media resources corresponding to the similar celebrities are obtained.

4. The display device according to claim 1, characterized in that The similarity area includes a plurality of celebrity controls, and the plurality of celebrity controls correspond to a plurality of similar celebrities respectively. The controller is further configured to: After the similar area acquires focus and is selected, the information floating layer is controlled to jump to a similar celebrity details page, wherein the similar celebrity details page includes the similar area, a profile area, and a media asset area, the profile area is used to display profile information, and the media asset area is used to display related media assets; When the focus moves to different celebrity controls, the display of profile information and related media assets of different similar celebrities is controlled.

5. The display device according to claim 1, characterized in that The controller executes the step of receiving and identifying instructions, including: Receiving a recognition command issued by a user by pressing a screenshot button on a remote control; or, Receive a recognition instruction issued by the user through voice input.

6. A method for character recognition display, characterized in that: The method comprises: In response to an instruction to identify at least one object in a display screen, taking a screenshot of the display interface and generating a screenshot image; Acquire the facial feature information of the person to be identified in the screenshot image and send it to the server, so that the server compares the facial feature information of the person to be identified with a plurality of facial feature information pre-stored in a database to obtain a matching confidence, and determine the object whose matching confidence reaches a preset confidence as a celebrity, and determine the object whose matching confidence does not reach the preset confidence as an ordinary person; If the object is determined to be a celebrity, obtaining profile data about the celebrity; If the object is determined to be an amateur, obtaining screenshot information corresponding to the amateur in the display interface and amateur identification data; Popping up an information floating layer on the current display interface, the information floating layer includes a character area, a similarity area, an appearance area and a sharing area, wherein the character area includes one or more character controls, and the character control includes a character avatar thumbnail captured from the screenshot image; When the focus moves to different character controls, control the display of amateur recognition data of different characters recognized in the screenshot image; The similarity area is used to display similar celebrities; the appearance area is used to display appearance data.