A display device

Abstract

This application provides a display device that can display video chat content simultaneously with video playback content. Specifically, it includes a camera configured to receive image data; a display configured to show a user interface; a second controller electrically connected to the camera, configured to detect the camera's status and decode the image data acquired by the camera; and a first controller communicating with the display, configured to execute the user interface presentation: upon detecting that a user has launched a camera-related application stored on the first controller, a flag bit is written to the second controller to indicate the camera's operating status. This application uses a camera installed within the display device to capture video chat content and ensures that the camera-related applications on the first and second controllers do not conflict when using the camera.

Description

Technical Field

[0001] This application relates to display technology. More specifically, it relates to a dual-chip display device with a camera. Background Technology

[0002] Currently, display devices are receiving widespread attention from users because they can provide playback of audio, video, and images. With the development of big data and artificial intelligence, users' functional demands for display devices are increasing daily. For example, users might want to simultaneously display multiple video chat feeds; or, in a game scenario, to see real-time images of participants; or, in educational applications, to interact remotely with parents / teachers in real-time while learning the content on the screen. However, current display devices, especially home devices like smart TVs, lack built-in cameras, making it impossible to fulfill these scenarios.

[0003] Therefore, there is an urgent need for a display device that can display traditional television images while also enabling multi-channel video calls, providing users with a better user experience. Summary of the Invention

[0004] This application provides a display device that displays video chat content simultaneously with video playback content. Specifically, it includes...

[0005] A camera configured to receive image data;

[0006] A display configured to show a user interface;

[0007] A second controller electrically connected to the camera is configured to detect the state of the camera and decode the image data acquired by the camera.

[0008] A first controller, which communicates with the display, is configured to execute the presentation of the user interface:

[0009] Upon detecting that a user has launched a camera-related application stored on the first controller, a flag is written to the second controller to mark the operating status of the camera.

[0010] Compared with the prior art, the beneficial technical effects of the technical solution proposed in the exemplary embodiments of this application include: this application acquires video chat content through a camera installed in a display device, and ensures that the camera-related applications of the first controller and the second controller do not conflict when using the camera. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 The diagram illustrates an operational scenario between a display device and a control device according to an embodiment.

[0013] Figure 2 The diagram illustrates, by way of example, a hardware configuration block diagram of the control device 100 according to an embodiment;

[0014] Figure 3 The diagram illustrates a hardware configuration block diagram of a display device 200 in one embodiment.

[0015] Figure 4 The example shown is based on Figure 3 Hardware architecture block diagram of display device 200;

[0016] Figure 5 The diagram above exemplarily illustrates a functional configuration of a display device 200 according to an embodiment;

[0017] Figure 6a The diagram above exemplarily illustrates a software configuration schematic of a display device 200 according to an embodiment;

[0018] Figure 6b The diagram illustrates, by way of example, a configuration diagram of an application in a display device 200 according to an embodiment;

[0019] Figure 7 The diagram illustrates a hardware configuration block diagram of a display device 200 in one embodiment.

[0020] Figures 8a-8b The diagram illustrates, by way of example, a user interface in a display device 200 according to an embodiment;

[0021] Figure 9 The diagram illustrates, exemplarily, a display device 200 in an embodiment that simultaneously displays live streaming content and video chat content;

[0022] Figure 10 The diagram illustrates, exemplarily, a display device 200 in an embodiment that simultaneously displays on-demand playback content and video chat content;

[0023] Figures 11a-11b A schematic diagram of the system architecture for camera sharing control;

[0024] Figure 12 A flowchart illustrating the process of the N chip for camera sharing control calling camera data acquisition;

[0025] Figure 13 Logic flowchart for N chip to call the camera for camera sharing control;

[0026] Figure 14 The logic flowchart for chip A, which controls camera sharing, when calling the camera. Detailed Implementation

[0027] To make the objectives, technical solutions, and advantages of the exemplary embodiments of this application clearer, the technical solutions in the exemplary embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described exemplary embodiments are only some embodiments of this application, and not all embodiments.

[0028] To facilitate user operation, display devices typically include various external device interfaces to connect different peripheral devices or cables for corresponding functions. However, if a high-resolution camera is connected to one of these interfaces, and the display device's hardware system lacks a hardware interface for receiving the high-resolution camera's data, then the data received by the camera will not be displayed on the screen.

[0029] Furthermore, due to hardware limitations, traditional display devices only support one hardware decoding resource and typically can only support video decoding at a maximum resolution of 4K. Therefore, when watching online TV while video chatting, in order to avoid reducing the clarity of the online video, hardware decoding resources (usually the GPU in the hardware system) are needed to decode the online video. In this case, the only option is to use the general-purpose processor (such as the CPU) in the hardware system to perform software decoding of the video chat screen.

[0030] Using software decoding to process video chat footage significantly increases the CPU's data processing load. When the CPU's data processing load is too heavy, issues such as screen stuttering or choppy playback may occur. Furthermore, due to limitations in CPU data processing capabilities, multi-channel video calls are typically not supported when using CPU software decoding to process video chat footage. When a user wants to simultaneously video chat with multiple other users in the same chat environment, access may be blocked.

[0031] Based on the above considerations, in order to overcome the above-mentioned shortcomings, this application discloses a dual hardware system architecture to realize multi-channel video chat data (at least one local video channel).

[0032] The concepts involved in this application will first be explained with reference to the accompanying drawings. It should be noted that the following explanation of each concept is only to make the content of this application easier to understand and does not imply any limitation on the scope of protection of this application.

[0033] The term "module" as used in the embodiments of this application can refer to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code capable of performing the functions associated with that element.

[0034] The term "remote control" as used in the embodiments of this application refers to a component of an electronic device (such as the display device disclosed in this application) that can wirelessly control the electronic device over a relatively short distance. This component typically connects to the electronic device using infrared and / or radio frequency (RF) signals and / or Bluetooth, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control replaces most of the physical built-in hard buttons in a typical remote control device with a user interface on a touchscreen.

[0035] The term "gesture" as used in the embodiments of this application refers to user behavior in which a user expresses an expected idea, action, purpose, and / or result through a change in hand shape or hand movement.

[0036] The term "hardware system" as used in the embodiments of this application can refer to a physical component with computing, control, storage, input, and output functions, composed of mechanical, optical, electrical, and magnetic devices such as integrated circuits (ICs) and printed circuit boards (PCBs). In the embodiments of this application, the hardware system is also commonly referred to as a motherboard or chip.

[0037] Figure 1 The diagram illustrates an operational scenario between a display device and a control device according to an embodiment. Figure 1 As shown, the user can operate the display device 200 through the control device 100.

[0038] The control device 100 can be a remote control 100A, which can communicate with the display device 200 via infrared, Bluetooth, ZigBee, or other short-range communication methods to control the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, or control panel input. For example, users can input corresponding control commands through volume up / down buttons, channel control buttons, up / down / left / right movement buttons, voice input buttons, menu buttons, and power buttons on the remote control to achieve the function of controlling the display device 200.

[0039] The control device 100 can also be a smart device, such as a mobile terminal 100B, tablet computer, computer, laptop computer, etc., which can communicate with the display device 200 through a local area network (LAN), wide area network (WAN), wireless local area network (WLAN), or other networks, and control the display device 200 through an application corresponding to the display device 200. For example, the display device 200 can be controlled using an application running on the smart device. This application can provide the user with various controls through an intuitive user interface (UI) on the screen associated with the smart device.

[0040] For example, both the mobile terminal 100B and the display device 200 can install software applications, enabling them to connect and communicate via network communication protocols, thereby achieving one-to-one control operations and data communication. For instance, the mobile terminal 100B and the display device 200 can establish a control command protocol, synchronizing the remote control keyboard to the mobile terminal 100B. By controlling the user interface on the mobile terminal 100B, the display device 200 can be controlled. Alternatively, audio and video content displayed on the mobile terminal 100B can be transmitted to the display device 200 for synchronized display.

[0041] like Figure 1 As shown, the display device 200 can also communicate with the server 300 via various communication methods. In various embodiments of this application, the display device 200 may be allowed to communicate with the server 300 via a local area network, a wireless local area network, or other networks. The server 300 may provide the display device 200 with various content and interactive features.

[0042] For example, display device 200 interacts by sending and receiving information, as well as with an Electronic Program Guide (EPG), receiving software updates, or accessing a remotely stored digital media library. Server 300 can be a group or multiple groups, and can be one or more types of servers. Other network services, such as video-on-demand and advertising services, are provided through server 300.

[0043] Display device 200 can be a liquid crystal display, an OLED (Organic Light Emitting Diode) display, a projection display device, or a smart TV. The specific type, size, and resolution of the display device are not limited. Those skilled in the art will understand that display device 200 can be modified in terms of performance and configuration as needed.

[0044] In addition to providing broadcast television reception functionality, display device 200 can also be equipped with smart network television functionality that provides computer support. Examples include network television, smart television, and Internet Protocol Television (IPTV).

[0045] like Figure 1 The display device may be connected to or equipped with a camera to display the images captured by the camera on the display interface of this display device or other display devices, thereby enabling interactive chat between users. Specifically, the images captured by the camera can be displayed in full screen, half screen, or any selectable area on the display device.

[0046] As an optional connection method, the camera is connected to the back cover of the monitor via a connecting plate and is fixedly installed on the upper center of the back cover of the monitor. As an installable method, it can be fixedly installed in any position on the back cover of the monitor, as long as its image acquisition area is not blocked by the back cover. For example, the image acquisition area is oriented in the same direction as the display device.

[0047] As an alternative connection method, the camera can be raised and lowered to the display back cover via a connecting plate or other conceivable connector. The connector is equipped with a lifting motor. When the user wants to use the camera or an application needs to use the camera, it is raised above the display. When the camera is not in use, it can be recessed into the back cover to protect the camera from damage.

[0048] As one embodiment, the camera used in this application can be 16 megapixels to achieve ultra-high-definition display. In practical use, cameras with higher or lower resolutions than 16 megapixels can also be used.

[0049] When a camera is installed on a display device, the content displayed in different application scenarios can be integrated in various ways, thereby achieving functions that traditional display devices cannot achieve.

[0050] For example, a user can watch a video program while simultaneously engaging in a video chat with at least one other user. The video program can serve as a background image, with the video chat window displayed on top of it. This feature can be figuratively described as "watch and chat simultaneously."

[0051] Optionally, in the "watch and chat" scenario, at least one video chat can be conducted across devices while watching live or online videos.

[0052] In another example, a user can video chat with at least one other user while learning through an educational app. For instance, a student can remotely interact with a teacher while studying content within an educational application. This feature could be figuratively called "learn while chatting."

[0053] In another example, a user can video chat with other players while playing a card game. For instance, players can remotely interact with each other while participating in a game within the app. This feature could be figuratively called "watch and play."

[0054] Optionally, the game scene can be integrated with the video footage, and the portraits in the video footage can be cut out and displayed in the game screen to improve the user experience.

[0055] Optionally, in motion-sensing games (such as ball games, boxing games, running games, dancing games, etc.), human postures and movements are acquired through cameras, limb detection and tracking, and detection of key points of the human skeleton are performed. These data are then integrated with the animations in the game to realize games in scenarios such as sports and dance.

[0056] In another example, a user can interact with at least one other user via video and voice in a karaoke app. This feature could be figuratively called "singing while watching." Preferably, when at least one user enters the app in a chat context, multiple users can collaboratively record a song.

[0057] In another example, users can open their local camera to capture images and videos; figuratively, this function could be called "looking in a mirror."

[0058] In other examples, more functions may be added or the aforementioned functions may be removed. This application does not specifically limit the functions of the display device.

[0059] Figure 2 The diagram illustrates a configuration block diagram of the control device 100 according to an exemplary embodiment. Figure 3 As shown, the control device 100 includes a controller 110, a communicator 130, a user input / output interface 140, a memory 190, and a power supply 180.

[0060] The control device 100 is configured to control the display device 200 and to receive user input commands, converting the commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200. For example, if the user operates the channel up / down keys on the control device 100, the display device 200 will respond with the channel up / down operation.

[0061] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be equipped with various applications to control the display device 200 according to user needs.

[0062] In some embodiments, such as Figure 1 As shown, the mobile terminal 100B or other smart electronic devices can perform similar functions to the control device 100 after installing the application on the control display device 200. For example, users can install the application and use the various function keys or virtual buttons on the graphical user interface provided on the mobile terminal 100B or other smart electronic devices to achieve the functions of the physical buttons on the control device 100.

[0063] The controller 110 includes a processor 112, RAM 113 and ROM 114, a communication interface, and a communication bus. The controller 110 is used to control the operation of the control device 100, as well as the communication and cooperation between internal components and the external and internal data processing functions.

[0064] Under the control of the controller 110, the communicator 130 enables communication of control signals and data signals with the display device 200. For example, it sends received user input signals to the display device 200. The communicator 130 may include at least one of the following communication modules: WIFI module 131, Bluetooth module 132, NFC module 133, etc.

[0065] User input / output interface 140, wherein the input interface includes at least one of the following: microphone 141, touchpad 142, sensor 143, button 144, etc. For example, the user can realize the user command input function through voice, touch, gesture, pressing and other actions. The input interface converts the received analog signal into a digital signal, and the digital signal into a corresponding command signal, and sends it to the display device 200.

[0066] The output interface includes an interface for sending received user commands to the display device 200. In some embodiments, this can be an infrared interface or a radio frequency (RF) interface. For example, with an infrared signal interface, the user input command needs to be converted into an infrared control signal according to an infrared control protocol, and then sent to the display device 200 via an infrared transmitting module. Similarly, with an RF signal interface, the user input command needs to be converted into a digital signal, then modulated according to an RF control signal modulation protocol, and finally sent to the display device 200 via an RF transmitting terminal.

[0067] In some embodiments, the control device 100 includes at least one of a communicator 130 and an output interface. The communicator 130, configured in the control device 100, may be a module such as WIFI, Bluetooth, or NFC, which can encode user input commands via WIFI, Bluetooth, or NFC protocols and send them to the display device 200.

[0068] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller 110. The memory 190 can also store various control signal commands input by the user.

[0069] The power supply 180 provides power to the various components of the control device 100 under the control of the controller 110. It may include a battery and related control circuitry.

[0070] Figure 3 The diagram illustrates a hardware configuration block diagram of the hardware system in the display device 200 according to an exemplary embodiment.

[0071] When adopting a dual hardware system architecture, the structural relationships of the hardware systems can be... Figure 3 As shown. For ease of description, in the following dual-hardware system architecture, one hardware system will be referred to as the first hardware system or first chip, N system, N chip, or first controller, and the other hardware system will be referred to as the second hardware system or second chip, A system, A chip, or second controller. Chip A includes the controller of chip A and various modules connected to the controller of chip A through various interfaces. Chip N includes the controller of chip N and various modules connected to the controller of chip N through various interfaces. Chip A and chip N can each have an independent operating system installed, thus creating two independent but interconnected subsystems in the display device 200.

[0072] The following is combined with Figure 4 The dual hardware system architecture of this application will be further explained. It should be noted that... Figure 4 This is merely an illustrative example of the dual-hardware system architecture of this application and does not imply any limitation on the application. In practical applications, both hardware systems may include more or fewer hardware or interfaces as needed.

[0073] Figure 4 The example shown is based on Figure 3 Hardware architecture block diagram of display device 200. (See diagram below.) Figure 4 As shown, the hardware system of the display device 200 may include an A chip and an N chip, as well as modules connected to the A chip or the N chip through various interfaces.

[0074] The N chip may include a tuner / demodulator 220, a communicator 230, an external device interface 250, a controller 210, a memory 290, a user input interface, a video processor 260-1, an audio processor 260-2, a display 280, an audio output interface 272, and a power supply. In other embodiments, the N chip may include more or fewer modules.

[0075] The tuner / demodulator 220 is used to amplify, mix, and resonate the received broadcast television signals via wired or wireless means, thereby demodulating the audio and video signals carried in the frequency of the television channel selected by the user from multiple wireless or wired broadcast television signals, as well as additional information (such as EPG data signals). Depending on the television signal broadcasting standard, the signal path of the tuner / demodulator 220 can be various, such as terrestrial broadcasting, cable broadcasting, satellite broadcasting, or internet broadcasting; and depending on the modulation type, the signal adjustment method can be digital modulation or analog modulation; and depending on the type of received television signal, the tuner / demodulator 220 can demodulate analog signals and / or digital signals.

[0076] The tuner 220 is also used to respond to the television channel frequency selected by the user and the television signal carried by that frequency, as selected by the user and controlled by the controller 210.

[0077] In some other exemplary embodiments, the tuner 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio and video signals after modulation and demodulation, which are then input to the display device 200 via the external device interface 250.

[0078] The communicator 230 is a component used to communicate with external devices or external servers according to various communication protocol types. For example, the communicator 230 may include a WIFI module 231, a Bluetooth communication protocol module 232, a wired Ethernet communication protocol module 233, and other network communication protocol modules or near-field communication protocol modules such as an infrared communication protocol module.

[0079] The display device 200 can establish a connection for control signals and data signals with an external control device or content providing device via a communicator 230. For example, the communicator can receive control signals from the remote controller 100 according to the controller's control.

[0080] The external device interface 250 is a component that provides data transmission between the N-chip controller 210 and the A-chip and other external devices. The external device interface can be connected to external devices such as set-top boxes, gaming devices, and laptops via wired / wireless connections, and can receive data such as video signals (e.g., motion pictures), audio signals (e.g., music), and additional information (e.g., EPG) from external devices.

[0081] The external device interface 250 may include one or more of the following: an HDMI terminal 251, a Composite Video Blanking Synchronization (CVBS) terminal 252, an analog or digital component terminal 253, a Universal Serial Bus (USB) terminal 254, and a Red, Green, and Blue (RGB) terminal (not shown in the figure). This application does not limit the number or type of external device interfaces.

[0082] The controller 210 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as operating systems and / or various applications) stored in the memory 290.

[0083] like Figure 4 As shown, the controller 210 includes a read-only memory (RAM) 213, a random access memory (ROM) 214, a graphics processor (GPU) 216, a CPU processor (CPU) 212, a communication interface 218, and a communication bus. The RAM 213, ROM 214, GPU 216, CPU processor 212, and communication interface 218 are connected to each other via the bus.

[0084] ROM 213 is used to store various system startup instructions. For example, when a power-on signal is received, the display device 200 starts up, the CPU processor 212 executes the system startup instructions in the ROM, copies the operating system stored in memory 290 to RAM 214, and then starts running the operating system. After the operating system has started, the CPU processor 212 copies various application programs from memory 290 to RAM 214, and then starts running the various application programs.

[0085] The graphics processor 216 is used to generate various graphical objects, such as icons, operation menus, and graphics displayed based on user input commands. It includes an arithmetic logic unit (ALU) that performs calculations based on various user-input interactive commands and displays various objects according to display attributes. It also includes a renderer that generates various objects based on the ALU's results and displays the rendered results on the monitor 280.

[0086] CPU processor 212 is used to execute operating system and application instructions stored in memory 290, as well as various interactive instructions received from external input, to execute various applications, data, and content, so as to ultimately display and play various audio and video content.

[0087] In some exemplary embodiments, the CPU processor 212 may include multiple processors. These multiple processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the display device 200 in a pre-power-on mode and / or to display a screen in normal mode. The multiple or one sub-processors are used to perform an operation in a standby mode or other state.

[0088] The communication interface may include a first interface 218-1 to an nth interface 218-n. These interfaces may be network interfaces that are connected to external devices via a network.

[0089] The controller 210 can control the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to be displayed on the display 280, the controller 210 can perform operations related to the object selected by the user command.

[0090] The object can be any of the optional objects, such as a hyperlink or an icon. Operations related to the selected object include, for example, displaying links to hyperlinked pages, documents, images, etc., or executing operations corresponding to the icon. User commands for selecting UI objects can be input via various input devices connected to the display device 200 (e.g., mouse, keyboard, touchpad, etc.) or voice commands corresponding to spoken commands by the user.

[0091] The memory 290 includes various software modules for driving and controlling the display device 200. These software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

[0092] The basic module is a low-level software module used for signal communication between various hardware components in the display device 200 and for sending processing and control signals to higher-level modules. The detection module is a management module used to collect various information from various sensors or user input interfaces, perform digital-to-analog conversion, and analyze and manage the data.

[0093] For example: the voice recognition module includes a voice parsing module and a voice command database module. The display control module is used to control the display 280 to display image content, and can be used to play multimedia image content and UI interface information. The communication module is used for control and data communication with external devices. The browser module is used to perform data communication with browser servers. The service module is used to provide various services and applications.

[0094] Meanwhile, the memory 290 is also used to store received external data and user data, images of various items in various user interfaces, and visual renderings of the focus object.

[0095] The user input interface is used to send user input signals to the controller 210, or to transmit signals output from the controller to the user. For example, a control device (e.g., a mobile terminal or remote control) can send user input signals such as power switch signals, channel selection signals, and volume adjustment signals to the user input interface, which then forwards them to the controller; or, the control device can receive output signals such as audio, video, or data output from the user input interface after processing by the controller, and display the received output signals or output the received output signals as audio or vibration.

[0096] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 280, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0097] The video processor 260-1 is used to receive video signals and perform video data processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard encoding and decoding protocol of the input signal, so as to obtain a video signal that can be directly displayed or played on the monitor 280.

[0098] For example, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, etc.

[0099] The demultiplexing module is used to demultiplex the input audio and video data streams. For example, if the input is MPEG-2, the demultiplexing module will demultiplex it into video signals and audio signals.

[0100] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

[0101] Image compositing modules, such as image synthesizers, are used to overlay and blend GUI signals generated by a graphics generator based on user input or its own data with scaled video images to generate displayable image signals.

[0102] The frame rate conversion module is used to convert the frame rate of the input video, such as converting the frame rate of an input video of 24Hz, 25Hz, 30Hz, or 60Hz to 60Hz, 120Hz, or 240Hz. The input frame rate can be related to the source video stream, and the output frame rate can be related to the display's refresh rate. Inputs in common formats are implemented using methods such as frame interpolation.

[0103] The display formatting module is used to change the signal output by the frame rate conversion module into a signal that conforms to a display format, such as converting the signal output by the frame rate conversion module to output RGB data signals.

[0104] Display 280 is used to receive image signals input from video processor 260-1 and to display video content, images, and a menu control interface. Display 280 includes a display component for presenting the image and a driving component for driving the image display. The displayed video content may be video from a broadcast signal received by tuner 220, or video content input from a communicator or external device interface. Display 220 also displays the user interface (UI) generated in display device 200 and used to control display device 200.

[0105] Depending on the type of display 280, it may also include a driving component for driving the display. Alternatively, if the display 280 is a projection display, it may also include a projection device and a projection screen.

[0106] The audio processor 260-2 is used to receive audio signals, perform decompression and decoding according to the standard encoding and decoding protocol of the input signals, as well as audio data processing such as noise reduction, digital-to-analog conversion and amplification, to obtain an audio signal that can be played in the speaker 272.

[0107] The audio output interface 270 is used to receive audio signals output by the audio processor 260-2 under the control of the controller 210. The audio output interface may include a speaker 272, or an external audio output terminal 274 for outputting to an external device, such as an external audio terminal or headphone output terminal.

[0108] In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.

[0109] In addition, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips or integrated with the controller 210 into one or more chips.

[0110] The power supply, under the control of the controller 210, provides power to the display device 200 from an external power source. The power supply may be a built-in power circuit installed inside the display device 200, or it may be an external power source, such as a power interface within the display device 200 that provides an external power supply.

[0111] Similar to the N chip, such as Figure 4 As shown, chip A may include a controller 310, a communicator 330, a detector 340, and a memory 390. In some embodiments, it may also include a user input interface, a video processor, an audio processor, a display, and an audio output interface. In some embodiments, a power supply independently powering chip A may also be present.

[0112] The communicator 330 is a component used to communicate with external devices or external servers according to various communication protocol types. For example, the communicator 330 may include a WIFI module 331, a Bluetooth communication protocol module 332, a wired Ethernet communication protocol module 333, and other network communication protocol modules or near-field communication protocol modules such as an infrared communication protocol module.

[0113] The communicator 330 of chip A and the communicator 230 of chip N also interact with each other. For example, the WiFi module 231 of chip N is used to connect to an external network and establish network communication with an external server, etc. The WiFi module 331 of chip A is used to connect to the WiFi module 231 of chip N, but does not establish a direct connection with an external network, etc. Therefore, for the user, a display device as described in the above embodiment only displays a WiFi account.

[0114] Detector 340 is a component of display device A chip used to collect signals from the external environment or interact with the external environment. Detector 340 may include a light receiver 342, a sensor for collecting ambient light intensity, which can adapt to changes in display parameters by collecting ambient light; it may also include an image acquisition device 341, such as a camera, which can be used to collect external environmental scenes and to collect user attributes or user interaction gestures, which can adaptively change display parameters and recognize user gestures to achieve interactive functions with the user.

[0115] The external device interface 350 provides a component for data transmission between the controller 310 and the N chip or other external devices. The external device interface can connect to external devices such as set-top boxes, gaming devices, and laptops via wired or wireless connections.

[0116] The controller 310 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as installed third-party applications) stored in the memory 390 and by interacting with the N chip.

[0117] like Figure 4 As shown, the controller 310 includes a read-only memory (ROM) 313, a random access memory (RAM) 314, a graphics processor 316, a CPU processor 312, a communication interface 318, and a communication bus. The ROM 313, RAM 314, graphics processor 316, CPU processor 312, and communication interface 318 are connected to each other via the bus.

[0118] ROM 313 stores various system startup instructions. CPU processor 312 executes the system startup instructions in ROM, copying the operating system stored in memory 390 to RAM 314 to begin running the operating system. After the operating system has started, CPU processor 312 copies various application programs from memory 390 to RAM 314, and then begins running these applications.

[0119] CPU processor 312 is used to execute operating system and application instructions stored in memory 390, and to communicate, transmit and interact with N chip, such as signals, data and instructions, and to execute various applications, data and content according to various interactive instructions received from external input, so as to ultimately display and play various audio and video content.

[0120] The communication interface may include a first interface 318-1 to an nth interface 318-n. These interfaces may be network interfaces that are connected to external devices via a network, or network interfaces that are connected to the N chip via a network.

[0121] The controller 310 can control the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to be displayed on the display 280, the controller 210 can perform operations related to the object selected by the user command.

[0122] The graphics processor 316 is used to generate various graphical objects, such as icons, operation menus, and graphics displayed based on user input commands. It includes an arithmetic logic unit (ALU) that performs calculations based on various user-input interactive commands and displays various objects according to display attributes. It also includes a renderer that generates various objects based on the ALU's results and displays the rendered results on the monitor 280.

[0123] Both the graphics processor 316 of chip A and the graphics processor 216 of chip N can generate various graphical objects. The difference is that if application 1 is installed on chip A and application 2 is installed on chip N, when the user is in the interface of application 1 and performs user input commands within application 1, the graphical object is generated by the graphics processor 316 of chip A. When the user is in the interface of application 2 and performs user input commands within application 2, the graphical object is generated by the graphics processor 216 of chip N.

[0124] Figure 5 The diagram illustrates a functional configuration of a display device according to an exemplary embodiment.

[0125] like Figure 5 As shown, the memory 390 of chip A and the memory 290 of chip N are used to store the operating system, applications, content, and user data, respectively. Under the control of the controller 310 of chip A and the controller 210 of chip N, they drive the system operation of the display device 200 and respond to various user operations. The memory 390 of chip A and the memory 290 of chip N may include volatile and / or non-volatile memory.

[0126] For the N chip, memory 290 is specifically used to store the running program of the controller 210 in the display device 200, as well as various applications built into the display device 200, various applications downloaded by the user from external devices, various graphical user interfaces related to the applications, various objects related to the graphical user interfaces, user data information, and various internal data supporting the applications. Memory 290 is used to store system software such as the operating system (OS) kernel, middleware, and applications, as well as input video and audio data, and other user data.

[0127] The memory 290 is specifically used to store drivers and related data for the video processor 260-1 and audio processor 260-2, display 280, communication interface 230, tuner / demodulator 220, input / output interface, etc.

[0128] In some embodiments, memory 290 may store software and / or programs representing an operating system (OS), including, for example, a kernel, middleware, application programming interfaces (APIs), and / or applications. Exemplarily, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, APIs, or applications), and the kernel may provide interfaces to allow middleware and APIs, or applications, to access controllers to control or manage system resources.

[0129] For example, memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907, a communication control module 2908, an optical receiving module 2909, a power control module 2910, an operating system 2911, and other application programs 2912, a browser module, etc. Controller 210 executes various functions such as broadcast television signal reception and demodulation, television channel selection control, volume selection control, image control, display control, audio control, external command recognition, communication control, optical signal reception, power control, a software control platform supporting various functions, and a browser function by running various software programs stored in memory 290.

[0130] The memory 390 includes various software modules for driving and controlling the display device 200. These software modules stored in the memory 390 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules. Since the memory 390 and memory 290 have similar functions, relevant details can be found in memory 290 and will not be elaborated upon here.

[0131] For example, memory 390 includes an image control module 3904, an audio control module 2906, an external command recognition module 3907, a communication control module 3908, an optical receiving module 3909, an operating system 3911, and other application programs 3912, a browser module, etc. Controller 210 executes various functions such as image control, display control, audio control, external command recognition, communication control, optical signal receiving, power control, a software control platform supporting various functions, and a browser function by running various software programs stored in memory 290.

[0132] The difference lies in that the external instruction recognition module 2907 of the N chip and the external instruction recognition module 3907 of the A chip can recognize different instructions.

[0133] For example, since image receiving devices such as cameras are connected to chip A, the external command recognition module 3907 of chip A may include an image recognition module 2907-1. The image recognition module 3907-1 stores an image database. When the camera receives an external image command, it establishes a correspondence with the command in the image database to control the display device. Similarly, since voice receiving devices and remote controls are connected to chip N, the external command recognition module 2907 of chip N may include a voice recognition module 2907-2. The image recognition module 2907-2 stores a voice database. When voice receiving devices receive external voice commands, they establish a correspondence with the command in the voice database to control the display device. Likewise, the control device 100, such as a remote control, is connected to chip N, and the button command recognition module interacts with the control device 100.

[0134] Figure 6a The diagram illustrates a configuration block diagram of the software system in the display device 200 according to an exemplary embodiment.

[0135] For N chips, such as Figure 6a As shown, the operating system 2911 includes execution software for handling various basic system services and for implementing hardware-related tasks, and acts as a medium for data processing between applications and hardware components.

[0136] In some embodiments, a portion of the operating system kernel may include a suite of software for managing display device hardware resources and providing services to other programs or software code.

[0137] In other embodiments, a portion of the operating system kernel may include one or more device drivers. A device driver can be a set of software code within the operating system that helps operate or control devices or hardware associated with the display device. The driver may contain code that operates video, audio, and / or other multimedia components. Examples include drivers for displays, cameras, Flash, WiFi, and audio.

[0138] The accessibility module 2911-1 is used to modify or access the application to enable accessibility of the application and operability of its displayed content.

[0139] The communication module 2911-2 is used for connecting to other peripherals via relevant communication interfaces and communication networks.

[0140] User interface module 2911-3 provides objects for displaying the user interface, which can be accessed by various applications to enable user operability.

[0141] Control application 2911-4 is used to control process management, including runtime applications, etc.

[0142] The event transmission system 2914 can be implemented within the operating system 2911 or in the application 2912. In some embodiments, it is implemented both within the operating system 2911 and in the application 2912, and is used to listen for various user input events and to implement a set of or more predefined operations based on the identification results of various events or sub-events that represent various events.

[0143] Among them, the event listening module 2914-1 is used to listen for user input interface input events or sub-events.

[0144] The event recognition module 2914-1 is used to input various event definitions into various user input interfaces, identify various events or sub-events, and transmit them to the processor to execute one or more sets of corresponding processing programs.

[0145] Here, an event or sub-event refers to the input detected by one or more sensors in the display device 200, as well as the input from external control devices (such as control device 100). Examples include various voice input sub-events, gesture recognition sub-events, and sub-events of remote control button commands input from the control device. For instance, one or more sub-events in a remote control include various forms, including but not limited to one or a combination of button presses (up / down / left / right), confirmation button, and button press / hold. It also includes operations of non-physical buttons, such as moving, pressing, and releasing.

[0146] The interface layout management module 2913 directly or indirectly receives user input events or sub-events from the event transmission system 2914, and uses them to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, as well as the size or position and hierarchy of containers and other execution operations related to the interface layout.

[0147] Since the operating system 3911 of chip A and the operating system 2911 of chip N have similar functions, please refer to the operating system 2911 for relevant details, and will not be repeated here.

[0148] like Figure 6b As shown, the application layer of the display device contains various applications that can be executed on the display device 200.

[0149] The application layer 2912 of the N chip may include, but is not limited to, one or more applications, such as video-on-demand applications, application centers, and games. The application layer 3912 of the A chip may include, but is not limited to, one or more applications, such as live TV applications and media center applications. It should be noted that the applications included on the A chip and the N chip are determined based on the operating system and other design considerations, and this invention does not require specific limitations or divisions regarding the applications included on the A chip and the N chip.

[0150] A live TV application can provide live television from various signal sources. For example, a live TV application can provide television signals from cable television, terrestrial broadcasting, satellite services, or other types of live TV services. Furthermore, the live TV application can display the video of the live TV signal on display device 200.

[0151] Video-on-demand (VOD) applications can provide video from various storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, VOD can come from cloud storage servers or from local hard drive storage containing pre-stored video programs.

[0152] Media Center applications are applications that provide playback of various multimedia content. For example, Media Center provides services that allow users to access various images or audios, unlike live TV or video-on-demand.

[0153] The application center provides a storage space for various applications. An application can be a game, an application, or other applications related to a computer system or other device but capable of running on a display device. The application center obtains these applications from various sources, stores them in local storage, and then makes them available for execution on the display device 200.

[0154] like Figure 7 As shown, chip A and chip N can connect, communicate, and receive power through multiple different types of interfaces. The interface types between chip A and chip N can include general-purpose input / output (GPIO), USB, HDMI, UART, etc. Chip A and chip N can use one or more of these interfaces for communication or power transfer. For example... Figure 7 As shown, in a dual hardware system architecture, the N chip can be powered by an external power supply, while the A chip can be powered by the N chip without an external power supply.

[0155] In addition to the interface used to connect to the N chip, the A chip may also include interfaces for connecting other devices or components, such as... Figure 7 The image shows an MIPI (mobile industry processor interface) interface, Bluetooth interface, USB interface, etc., used for connecting a camera.

[0156] Similarly, in addition to the interface for connecting to the N chip, the N chip may also include a VBY interface for connecting the display TCON (Timer Control Register), an i2S interface for connecting the power amplifier (AMP) and the speaker; as well as an IR / Key interface, a USB interface, a Wi-Fi interface, a Bluetooth interface, an HDMI interface, a Tuner interface, etc.

[0157] In one embodiment, users can also watch live video while video chatting. For the N chip, this can be achieved through... Figure 7 The devices shown, such as HDMI 2.0 external set-top boxes, provide live TV, and therefore generally use N chips to display live video.

[0158] Live TV is directly decoded by the set-top box or the broadcasting company, without requiring the N chip's hardware decoding resources. Therefore, when watching live TV and video chatting simultaneously, the N chip's hardware resources can decode the data received by the camera.

[0159] In one embodiment, a user can watch online videos and video chat simultaneously. In this scenario, the network or a third-party application provides on-demand videos, and the data of these videos requires hardware decoding resources. Data received from the camera also requires hardware decoding. Therefore, to realize the application scenario of watching online videos and video chatting simultaneously, the data received from the camera and the online video resources need to be decoded on two separate chips.

[0160] When the data received by the camera is hardware decoded by the N chip, the A chip can also hardware decode the video-on-demand. Therefore, in the application setup, the A chip is used to store and run third-party video-on-demand applications. For example... Figure 7 The HDMI cable between chip A and chip N is used to transmit on-demand video or data from third-party applications. This HDMI cable is invisible to the user.

[0161] Therefore, as Figure 7 The hardware architecture shown enables either watching live TV while video chatting or watching online TV while video chatting, without affecting the hardware decoding capabilities of both chip A and chip N.

[0162] In addition, such as Figure 7 As shown, a USB cable can be used to connect chip A and chip N. This USB cable is used to transmit video data received by the camera to chip N for hardware decoding and display on the monitor. Of course, the USB cable is just one example of a data connection method; other optional data connection methods can also be used between chip A and chip N. A camera is connected to chip A; the connection between chip A and the camera can be via a MIPI interface or a USB interface.

[0163] In scenarios involving simultaneous online and video chatting, on-demand resources from third-party video applications in chip A are transmitted to chip N via HDMI cable and ultimately displayed on the monitor. Data received by chip A from the camera is transmitted to chip N via USB cable, decoded, and then displayed on the monitor.

[0164] Because chip A and chip N can each have their own independent operating system installed, the display device 200 contains two independent but interconnected subsystems. For example, both chip A and chip N can independently install Android and various apps, enabling each chip to perform certain functions and allowing chip A and chip N to work together to achieve a specific function.

[0165] Figure 8a The diagram illustrates a user interface in a display device 200 according to an exemplary embodiment. Figure 8a As shown, the user interface includes multiple view display areas, for example, a first view display area 201 and a second view display area 202, wherein the second view display area includes a layout of one or more different items. The user interface also includes a selector that indicates the selected item, and the position of the selector can be moved by user input to change the selected item.

[0166] It should be noted that multiple view display areas can present the application's display screen. For example, the first view display area 201 can present video chat project content, wherein the first video display area 201 includes a local view display area for displaying data acquired by the local camera and a remote view display area. The second view display area 202 can present application layer project content (such as live video, web video, VOD display, application screen, etc.).

[0167] like Figure 8b In some embodiments, the user can turn off the video content in the local view display area, retaining only the remote video data in the remote view display area and the content in the third view display area. In this case, upon detecting that the user has turned off the local view display area, the camera automatically turns off. Alternatively, the motor lowers to the initial position.

[0168] Optional, for Figure 8a , 8b Different view display areas have different display priorities, and the display priority of view display areas with different priorities is different. For example, the local view display area 2011 and the remote view display area 2012 have a higher priority than the second view display area 202. When the user uses the selector and switches screens in the second view display area 202, the screen display in the first view display area 201 is not obscured. Also, when the size and position of the third view display area change according to the user's selection, the size and position of the first view display area 201 and the second view display area 202 are not affected.

[0169] It can also display screens with the same priority level. In this case, the selector can switch between the first view display area and the second view display area, and when the size and position of the first view display area change, the size and position of the second view display area can change accordingly.

[0170] As an example, the first and second view display areas can present video chat project content, while the second view display area can present application layer project content (such as live video, web video, VOD display, application screen, etc.).

[0171] like Figure 9-10 In some embodiments, when a user opens a video chat application, the video chat interface is displayed in the first view display area, and the live content is displayed in the second view display area via an external device connected via HDMI 2.0; when a user inputs an instruction to switch to on-demand video is received, the on-demand content is displayed in the second view display area via a second controller connected via HDMI 1.0.

[0172] like Figure 11a and 11b The camera is mounted on chip A, and some applications that use the camera are stored on chip A, while others are stored on chip N. Therefore, the two chips need to enable camera sharing.

[0173] In some embodiments, chip A connects to a camera with a physical MIPI interface. In other embodiments, it may also be a camera with an interface such as USB. A node named / dev / video0 is configured on chip A, which indicates the camera input interface on chip A.

[0174] When the camera-related application software on chip A wants to open the camera, it actually opens the / dev / video0 node on chip A. It then sets up the image capture to a specific resolution, such as 1080P, and transmits it to chip N for display via a USB cable or other connection.

[0175] When the camera-related application software of the N chip uses the physical camera of the A chip, the A chip can be regarded as a camera connected via a USB interface, and the A chip can be regarded as a slave device (USB camera device) and the N chip can be regarded as a master device (USB camera host).

[0176] A and N are connected via a physical USB cable. This allows the N chip to recognize that a USB camera device has been connected, and it will generate a / dev / video0 node. However, due to the limited capabilities of N, the A end needs to perform H.264 encoding or use other encoding methods before transmitting the encoded data to N. The N end then decodes and displays the image.

[0177] When the application software related to the N chip camera uses the camera, it actually opens the N chip's / dev / video0 node. To enable the N chip's / dev / video0 node to receive data sent from the camera by the A chip, a virtual camera, i.e., a gadget camera, needs to be implemented on the A chip. To implement a gadget camera, the uvc-gadget (USB video class) application needs to be implemented on the A chip as a driver.

[0178] In the uvc-gadget application, the first step is to virtualize the / dev / videoX output node on chip A. Then, the uvc events need to be initialized, which involves filling the probe and coit of uvc_device and registering the setup, data, streamon, and streamoff of the UVC events into the driver via VIDIOC_SUBSCRIBE_EVENT. After that, the UVC events are processed in a loop, and the data obtained from / dev / video0 on chip A is output to / dev / videoX. Then, the data is transmitted to chip N via the USB bus.

[0179] Figure 12 A flowchart illustrating the process of the N chip, which controls camera sharing, calling for camera data acquisition.

[0180] The uvc-gadget application on chip A reads data from the MIPI camera at node video0 on chip A via, for example, the V4L2 interface, and then transmits it to chip N via the USB bus.

[0181] V4L2 is short for Video4linux2 (Video for Linux two), which is the kernel driver for video devices in Linux. V4L2 is an API interface in the Linux operating system used to capture image, video and audio data, mainly for capturing data from USB cameras.

[0182] For the N chip, A is equivalent to a USB camera device. By reading / dev / video0 of the N chip, the data of the MIPI camera skin of the A chip can be read normally. If the N chip has limited capabilities, the video data can be pre-trimmed according to the needs of the N end and the camera data that the N chip can process can be transmitted.

[0183] Generally, V4L2 video data acquisition involves the following steps: First, opening the video device file and initializing the video acquisition parameters, setting the video image acquisition window, pixel size, and format via the V4L2 interface; second, allocating several video acquisition frame buffers and mapping these frame buffers from kernel space to user space for application reading / processing of video data; third, queuing the allocated frame buffers in the video acquisition input queue and starting video acquisition; fourth, the driver begins video data acquisition, the application retrieves frame buffers from the video acquisition output queue, processes them, and then puts the frame buffers back into the video acquisition input queue, continuously acquiring video data in a loop; fifth, stopping video acquisition.

[0184] In a dual-hardware system chip sharing a single camera, to prevent chip A from accessing the camera while chip N is using it, this application discloses a method for allocating camera access.

[0185] Figure 13 The logic flowchart for the N chip, which is used for camera sharing control, when calling the camera.

[0186] In one embodiment, when no application is currently using the camera, the camera application is opened on the N chip, and a flag is written to the A chip via dual-system communication (the camera node currently used by N is recorded in the attribute value sys.camera.nova_used), marking that N is currently using the camera node Video0. For example, sys.camera.nova_used = 0. When the N chip is not using the camera, the flag is reset on the A chip, marking that N is not currently using any camera node, sys.camera.nova_used = -1;

[0187] Similarly, when the camera application is opened on chip A, a flag is written to chip A (the camera node currently used by N is saved in the attribute value sys.camera.aml_used), marking that A is currently using the camera node Video0, such as sys.camera.aml_used = 0; when the camera is closed and released, the flag is reset, marking that A is not currently using any camera node, sys.camera.aml_used = -1.

[0188] Figure 14 Logic flowchart of the A chip for camera sharing control calling the camera;

[0189] If an application on chip N has already opened and is using the camera, when an application on chip A opens and uses the camera, when the application on chip A calls the camera's frame layer interface, the camera's frame layer will first retrieve the value from the camera's attribute sys.camera.nova_used to obtain the already occupied camera node usedCameraId, and indicate that the camera is currently occupied.

[0190] When an external camera is connected to chip A via an external USB interface, and an application on chip A attempts to use the camera, the camera's frame layer interface is accessed. The frame layer first retrieves the value from the camera's `sys.camera.nova_used` attribute to obtain the currently occupied camera node's `usedCameraId`. The application on chip A then compares this ID with the ID of the camera node it requests to open. If they match, it indicates the camera is currently occupied; otherwise, it allows opening the camera with the specified `cameraId`. If the application on chip A does not specify a camera ID when accessing the camera, the frame layer will default to opening the rear camera. In this case, it needs to iterate through the entire list of camera IDs. If the current `used CameraId` is for a rear camera, it searches for the next rear camera. If not found, it indicates the camera being opened is occupied; if a new rear camera is found, it opens that new rear camera.

[0191] This application provides a display device that can display video chat content simultaneously with video playback content. Specifically, it includes a camera configured to receive image data; a display configured to show a user interface; a second controller electrically connected to the camera, configured to detect the camera's status and decode the image data acquired by the camera; and a first controller communicating with the display, configured to execute the user interface presentation: upon detecting that a user has launched a camera-related application stored on the first controller, a flag bit is written to the second controller to indicate the camera's operating status. This application uses a camera installed within the display device to capture video chat content and ensures that the camera-related applications on the first and second controllers do not conflict when using the camera.

[0192] Based on the exemplary embodiments shown in this application, all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of this application. Furthermore, although the disclosures in this application are presented by way of one or more exemplary examples, it should be understood that each aspect of these disclosures can constitute a complete technical solution on its own.

[0193] It should be understood that the terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate, for example, to allow implementation in orders other than those given in the embodiments illustrated or described in this application.

[0194] Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that includes a series of components is not necessarily limited to those that are explicitly listed, but may include other components that are not explicitly listed or that are inherent to such product or device.

[0195] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A display device, characterized in that, include: A camera configured to receive image data; A display configured to show a user interface; A second controller electrically connected to the camera is configured to detect the state of the camera and decode the image data acquired by the camera. A first controller, communicating with the display, is configured to execute the presentation of the user interface. Upon detecting that a user has launched a camera-related application stored on the first controller, a flag is written to the second controller to mark the operating status of the camera; In addition, when it is detected that a user launches a camera-related application stored on the first controller, a first output node is virtualized on the second controller so that data collected from the camera is transmitted to the first controller via the USB bus through the first output node; Each of the first controller and the second controller has an independent operating system installed.

2. The display device according to claim 1, characterized in that, The second controller is further configured as follows: Open the video device file, initialize the video capture parameters, and set the video image capture window, capture pixel size, and format; Allocate several frame buffers for video capture and map the frame buffers from kernel space to user space; The frame buffer is queued in the video capture input queue, and video capture is started.

3. The display device according to claim 1, characterized in that, The second controller is configured as follows: When the user launches the camera-related application stored on the first controller, the V4L2 input interface of the second controller is opened.

4. The display device according to claim 1, characterized in that, The second controller is configured as follows: When no application is currently using the camera, when the first controller opens a camera-related application, the first controller writes the flag bit sys.camera.nova_used = 0 on the second controller via dual-system communication to indicate that the first controller is currently using the camera node Video0. When the first controller is not using the camera, the flag bit sys.camera.nova_used = -1 is reset on the second controller to indicate that the first controller is not using any camera node.

5. A method for sharing data transmission from a camera, applied to a display device, characterized in that, The display device includes a camera, a display, a first controller, and a second controller. The camera is connected to the second controller, and the first controller is connected to the display. The method includes: When a user launches a camera-related application stored on the first controller, a flag is written to the second controller to mark the operating status of the camera; In addition, when it is detected that a user launches a camera-related application stored on the first controller, a first output node is virtualized on the second controller so that data collected from the camera is transmitted to the first controller via the USB bus through the first output node; Each of the first controller and the second controller has an independent operating system installed.

6. The method according to claim 5, characterized in that, The step of writing a flag bit on the second controller to mark the operating status of the camera when the user launches a camera-related application stored on the first controller includes: When no application is currently using the camera, when the first controller opens a camera-related application, the first controller writes the flag bit sys.camera.nova_used = 0 on the second controller via dual-system communication to indicate that the first controller is currently using the camera node Video0. When the first controller is not using the camera, the flag bit sys.camera.nova_used = -1 is reset on the second controller to indicate that the first controller is not using any camera node.

7. A computer storage medium, characterized in that, The computer storage medium stores computer-executable instructions for causing the computer to perform the method according to any one of claims 5 to 6.

Images