Display device and display method

Abstract

A display device and a display method, the display device comprising a display; a controller connected with the display and a camera accessed to the display device respectively, the controller being configured to: receive an opening indication of the camera; determine a display proportion of an image captured by the camera on the display according to an installation position of the camera and a display mode of the display, the display proportion being used to represent an aspect ratio of the image when displayed on the display; and display the image captured by the camera on the display with the display proportion.

Description

[0001] This application claims priority to Chinese Patent Application No. 202011363628.X, filed on November 27, 2020, entitled "Display Device and Display Method"; and Chinese Patent Application No. 202110901318.7, filed on August 6, 2021, entitled "A Method for Determining the Preview Direction of a Camera and a Display Device"; and Chinese Patent Application No. 202110902251.9, filed on August 6, 2021, entitled "A Method for Capturing Images with a Camera and a Display Device", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of display device technology, and more particularly to a display device and display method. Background Technology

[0003] With the development of smart TVs, smart rotating TVs are gradually appearing in users' lives. Smart rotating TVs include both landscape and portrait modes, allowing users to conveniently watch TV programs from different angles.

[0004] In related technologies, the camera of a smart rotating TV can be fixed to the TV itself or installed in other locations such as a TV cabinet. Because smart rotating TVs operate in both landscape and portrait modes, the image captured by the camera may not be displayed at the correct angle in one mode, or the displayed area may be off-center from the center of the TV screen. Summary of the Invention

[0005] In a first aspect, embodiments of this application provide a display device, including:

[0006] monitor;

[0007] The controller is connected to both the display and the camera connected to the display device, and is configured to:

[0008] Receive the camera's activation instruction;

[0009] Based on the installation location of the camera and the display mode of the display, the display ratio of the image captured by the camera on the display is determined. The display ratio is used to characterize the aspect ratio of the image when it is displayed on the display.

[0010] The image captured by the camera is displayed on the monitor at the specified display ratio.

[0011] Secondly, embodiments of this application provide a display method, the method comprising:

[0012] Receives a notification to turn on the camera;

[0013] Based on the installation location of the camera and the display mode of the display, the display ratio of the image captured by the camera on the display is determined. The display ratio is used to characterize the aspect ratio of the image when it is displayed on the display.

[0014] The image captured by the camera is displayed on the monitor at the specified display ratio.

[0015] Thirdly, this application also provides an electronic device, comprising:

[0016] Memory and processor;

[0017] The memory is used to store the executable instructions of the processor;

[0018] The processor is configured to execute the method described in the second aspect by executing the executable instructions.

[0019] Fourthly, the present invention also provides a non-transitory computer-readable storage medium storing computer instructions, having thereon stored a computer program that, when executed by a processor, implements any of the possible methods in the second aspect. Attached Figure Description

[0020] To more clearly illustrate the implementation methods in the embodiments of this application or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings.

[0021] Figure 1A An application scenario diagram of a display device provided for some embodiments of this application;

[0022] Figure 1B A rear view of a display device provided for some embodiments of this application;

[0023] Figure 2 A hardware configuration block diagram of the control device 100 in FIG1 provided for some embodiments of this application;

[0024] Figure 3 Figure 1 shows a hardware configuration block diagram of the display device 200 provided for some embodiments of this application;

[0025] Figure 4A block diagram illustrating the architecture configuration of the operating system in the memory of a display device 200 provided in some embodiments of this application;

[0026] Figure 5 A user interface provided for some embodiments of this application;

[0027] Figures 6a-6d The diagram illustrates, by way of example, the mounting location of an exemplary camera according to some embodiments;

[0028] Figure 7 The diagram illustrates a flow chart of a display method according to some embodiments;

[0029] Figure 8 The diagram illustrates a flowchart of another display method according to some embodiments;

[0030] Figure 9 The diagram illustrates a flowchart of another display method according to some embodiments;

[0031] Figure 10 The diagram illustrates a camera type interface according to some embodiments;

[0032] Figure 11 The diagram illustrates a flowchart of yet another display method according to some embodiments;

[0033] Figure 12 The diagram illustrates, exemplarily, different camera types according to some embodiments;

[0034] Figures 13-20 The image shown is an example of a photograph captured by a camera in the related art.

[0035] Figure 21 The flowchart of a method for determining the camera preview direction is illustrated in the example;

[0036] Figure 22 A schematic diagram of a user interface is shown in the figure;

[0037] Figure 23 Another user interface diagram is shown as an example;

[0038] Figure 24 The flowchart of a method for capturing images with a camera is illustrated in the example below;

[0039] Figure 25 An example of a user interface diagram is shown in the figure. Detailed Implementation

[0040] To make the objectives, implementation methods and advantages of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the described exemplary embodiments are only some embodiments of this application, and not all embodiments.

[0041] A rotating TV is a new type of smart TV, mainly consisting of a monitor and a rotating assembly. The monitor is fixed to a wall or stand using the rotating assembly, and its angle can be adjusted to accommodate different aspect ratios. For example, monitors are often placed horizontally to display videos with aspect ratios of 16:9 or 18:9. When the video aspect ratio is 9:16 or 9:18, a horizontally placed monitor needs to scale the image, resulting in black areas on the sides. Therefore, the rotating assembly allows the monitor to be placed vertically to accommodate 9:16 or 9:18 aspect ratio videos.

[0042] To facilitate the display of target media asset details pages in different screen orientations (portrait and landscape) and improve the user viewing experience, this application provides a display device, a details page display method, and a computer storage medium. The display device may be a rotating television. It should be noted that the method provided in this embodiment is not only applicable to rotating televisions but also to other display devices, such as computers and tablets.

[0043] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities and do not necessarily imply a specific order or sequence, unless otherwise indicated. It should be understood that such terms can be used interchangeably where appropriate, for example, to implement the application in a sequence other than those given in the embodiments illustrated or described herein.

[0044] Furthermore, the terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclusively include, for example, a product or device that includes a series of components is not necessarily limited to those that are explicitly listed, but may include other components that are not explicitly listed or that are inherent to such product or device.

[0045] As used in this application, the term "module" means any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code capable of performing the functions associated with that element.

[0046] As used in this application, the term "remote control" refers to a component of an electronic device (such as the display device disclosed in this application) that typically allows for wireless control of the electronic device over a short distance. It generally uses infrared and / or radio frequency (RF) signals and / or Bluetooth to connect to the electronic device, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control replaces most of the physical built-in hard buttons in a typical remote control device with a user interface on a touchscreen.

[0047] As used in this application, the term "gesture" refers to user behavior in which a user expresses an expected idea, action, purpose, and / or result through a change in hand shape or hand movement.

[0048] Figure 1 illustrates an exemplary operational scenario between a display device and a control device according to an embodiment. As shown in Figure 1, a user can operate the display device 200 via a mobile terminal 300 and a control device 100.

[0049] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via other wired means. Users can input user commands through buttons on the remote control, voice input, control panel input, etc., to control the display device 200. For example, users can input corresponding control commands through volume up / down buttons, channel control buttons, up / down / left / right movement buttons, voice input buttons, menu buttons, power on / off buttons, etc., to achieve the function of controlling the display device 200.

[0050] In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices can also be used to control the display device 200. For example, an application running on the smart device can be used to control the display device 200. This application can be configured to provide the user with various controls in an intuitive user interface (UI) on the screen associated with the smart device.

[0051] Display device 200 can be an LCD monitor, OLED monitor, or projection display device. The specific type, size, and resolution of the display device are not limited. Those skilled in the art will understand that display device 200 can be modified in terms of performance and configuration as needed.

[0052] In some embodiments, such as Figure 1BAs shown, the display device 200 includes a rotating component 276, a controller 250, a display 275, and a rotating component 276 connected to a back panel. The rotating component 276 can rotate the display screen. From the perspective of viewing the front of the display device, the rotating component 276 can rotate the display screen to a portrait state, that is, a state in which the vertical side of the screen is longer than the horizontal side, or it can rotate the screen to a landscape state, that is, a state in which the horizontal side of the screen is longer than the vertical side.

[0053] Figure 2 An exemplary configuration block diagram of the control device 100 is shown. For example... Figure 2 As shown, the control device 100 includes a controller 110, a memory 120, a communicator 130, a user input interface 140, a user output interface 150, and a power supply 160.

[0054] Figure 3 The diagram illustrates, for example, a hardware configuration block diagram of a display device 200. (As shown...) Figure 3 As shown, the display device 200 may include, but is not limited to, at least one of the following: tuner 210, communicator 220, detector 230, external device interface 240, controller 250, memory 260, user interface 265, video processor 270, display 275, rotating component 276, monitoring component 277, audio processor 280, audio output interface 285, and power supply 290.

[0055] The rotating assembly 276 may include components such as a drive motor and a rotating shaft. The drive motor can be connected to the controller 250 and is controlled by the controller 250 to output a rotation angle. One end of the rotating shaft is connected to the power output shaft of the drive motor, and the other end is connected to the display 275, so that the display 275 can be fixedly mounted on a wall or bracket through the rotating assembly 276.

[0056] The rotating assembly 276 may also include other components, such as transmission components and detection components. The transmission component can adjust the rotational speed and torque output by the rotating assembly 276 through a specific transmission ratio, and can be a gear transmission. The detection component can consist of sensors mounted on the rotating shaft, such as angle sensors and attitude sensors. These sensors can detect parameters such as the rotation angle of the rotating assembly 276 and send the detected parameters to the controller 250, so that the controller 250 can determine or adjust the state of the display device 200 based on the detected parameters. In practical applications, the rotating assembly 276 may include, but is not limited to, one or more of the above-mentioned components.

[0057] Monitoring component 277 is used to monitor the rotation information of rotating component 276 and output the component rotation information to the controller. Monitoring component 277 can be set independently or integrated within the controller.

[0058] Detector 230 is a component of display device 200 used to collect signals from the external environment or to interact with the outside world. Detector 230 may include a sound acquisition unit 231, such as a microphone, which can be used to receive the user's voice, such as voice signals of the user's control commands to the display device 200; or, it can collect ambient sounds to identify the type of environmental scene, enabling the display device 200 to adapt to ambient noise.

[0059] In some other exemplary embodiments, the detector 230 may also include an image acquisition device 232, such as a camera or webcam, which can be used to acquire external environmental scenes to adaptively change the display parameters of the display device 200; and to acquire user attributes or user interaction gestures to realize the function of interaction between the display device and the user.

[0060] External device interface 240 is a component that provides data transmission between the controller 250 and the display device 200 and external devices. External device interface 240 can be connected to external devices such as set-top boxes, gaming devices, and laptops via wired / wireless means, and can receive data such as video signals (e.g., moving images), audio signals (e.g., music), and additional information (e.g., EPG) from external devices.

[0061] The external device interface 240 may include one or more of the following: an HDMI terminal 241, a composite video blanking synchronization (CVBS) terminal 242, an analog or digital component terminal 243, a universal serial bus (USB) terminal 244, a component terminal (not shown in the figure), and a red, green and blue (RGB) terminal (not shown in the figure).

[0062] The controller 250 controls the operation of the display device 200 and responds to user operations by running various software control programs (such as operating systems and various applications) stored in the memory 260.

[0063] like Figure 3 As shown, the controller 250 includes a random access memory (RAM) 251, a read-only memory (ROM) 252, a graphics processor 253, a CPU processor 254, a communication interface 255, a communication bus 256, a rotation processor 257, and an animation processor 258. The RAM 251, ROM 252, graphics processor 253, CPU processor 254, communication interface 255, rotation processor 257, and animation processor 258 are connected via the communication bus 256. The functions of the rotation processor 257 and animation processor 258 will be described in detail in subsequent embodiments.

[0064] Figure 4The diagram illustrates an example of the architecture configuration of the operating system in the memory of the display device 200. The operating system architecture, from top to bottom, consists of the application layer, middleware layer, and kernel layer.

[0065] The application layer includes both built-in system applications and non-system applications. It is responsible for direct interaction with the user. The application layer can include multiple applications, such as settings applications, e-post applications, and media center applications. These applications are primarily developed based on the Android system and can be written in Java / C++. These applications can also be implemented as web applications, running on the WebKit engine, and specifically developed and executed using HTML5, Cascading Style Sheets (CSS), and JavaScript.

[0066] The middleware layer provides standardized interfaces to support operation in various environments and systems. For example, the middleware layer can be implemented as the Multimedia and Hypermedia Information Coding Experts Group (MHEG) middleware related to data broadcasting, as DLNA middleware related to communication with external devices, or as middleware providing the browser environment for applications running within display devices.

[0067] The kernel layer provides core system services, such as file management, memory management, process management, network management, and system security and permission management. The kernel layer can be implemented as a kernel based on various operating systems, such as a kernel based on the Linux operating system.

[0068] The kernel layer also provides communication between system software and hardware, and provides device driver services for various hardware, such as: providing display drivers for the 275 monitor, providing camera drivers for the camera, providing button drivers for the remote control, providing WiFi drivers for the WiFi module, providing audio drivers for the audio output interface, and providing power management drivers for the power management (PM) module, etc.

[0069] Figure 3 In this system, the user interface 265 receives various user interactions. Specifically, it is used to send user input signals to the controller 250, or to transmit output signals from the controller 250 to the user. For example, the remote control 100A can send user input signals such as power switch signals, channel selection signals, and volume adjustment signals to the user interface 265, which then forwards them to the controller 250; or, the remote control 100A can receive output signals such as audio, video, or data output from the user interface 265 after processing by the controller 250, and display the received output signals or output the received output signals as audio or vibration.

[0070] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, controls, menus, tabs, text boxes, dialog boxes, status bars, channel bars, and widgets.

[0071] Alternatively, users can input user commands by entering specific sounds or gestures, and the user interface 265 can receive user input commands by recognizing the sounds or gestures through sensors.

[0072] Figure 5 An example is shown of content that can be presented on a user interface, which may include, but is not limited to, at least one of live TV, video-on-demand (VOD), media center, application center, and game applications. The application center may include applications that require the use of a camera.

[0073] Currently, with the development of smart TVs, smart rotating TVs are gradually appearing in users' field of vision. Smart rotating TVs include landscape and portrait modes, allowing users to conveniently watch TV programs from different angles.

[0074] In related technologies, the camera of a smart rotating TV can be fixed to the TV or placed independently on a TV cabinet or other location. Because smart rotating TVs can operate in both landscape and portrait modes, the image captured by the camera may not be displayed at the correct angle in one mode, or the displayed area may be off-center from the TV's screen.

[0075] This application provides a display device and display method, which determines an appropriate display ratio to display the image captured by the camera by determining the installation position of the camera and the display mode of the monitor, so as to avoid the image captured by the camera not being accurately displayed on a rotating TV.

[0076] It should be noted that the camera involved in the embodiments of this application can be installed on a display device as part of the display device, or it can be externally connected to the display device. The embodiments of this application do not impose any restrictions on this.

[0077] It is understood that the above display method can be implemented using the display device provided in the embodiments of this application. The technical solutions of the embodiments of this application will be described in detail below using a display device integrated or installed with relevant execution code as an example. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0078] This application provides a display method, relating to the specific process of displaying images captured by a camera in a smart rotating television. This display method can be implemented by a display device, or by a controller within the display device.

[0079] In this embodiment, when a user needs to play images captured by the camera on a display device, the user can input a camera activation instruction to the display device. Alternatively, when the user turns on the camera, the camera will send an activation instruction to the display device.

[0080] This application does not limit how the camera activation instruction is input to the display device. In some embodiments, the user can input the camera activation instruction to the display device by clicking a button on the remote control.

[0081] Subsequently, in this embodiment of the application, upon receiving an activation instruction, the display device can determine the installation location of the camera based on the type of camera and the serial bus port connected to the camera.

[0082] The camera type can include a first type and a second type. The first type may be, for example, a freestanding type, while the second type may be, for example, a plug-in type. It should be understood that a camera with a base and external leads is of the first type, and first-type cameras are typically mounted on a TV cabinet. It should be understood that a camera that is fully embedded in the TV and can rotate with the TV is of the second type, and second-type cameras are typically located at the top of the horizontal or vertical screen of the monitor.

[0083] In some embodiments, the camera type can be input by the user. For example, if a camera is detected connected to a display device, the display device controls the screen to display a camera type interface. The user then inputs the camera type in the camera type interface. After receiving the user-inputted camera type, the display device can save the camera type locally.

[0084] It should be understood that, in the embodiments of this application, the serial bus port of the camera can be located at the top of the horizontal screen of the display device or the top of the vertical screen of the monitor, and the embodiments of this application do not limit this.

[0085] In some embodiments, the display device can determine the serial bus port of the connected camera by the filename under the USB path. The filename is related to the type of the connected device. For example, after the camera is plugged into the display device, a device node can be added to the display device's camera directory. Subsequently, if the filename under the USB path is found to meet the format vid eoX, it is determined that the camera is connected to that USB port. Here, X represents a format such as 0 or 1.

[0086] Below are some methods for determining the installation location of a camera based on its type and the serial bus port it is connected to.

[0087] In the first case, if the camera type is Type 1, then it is determined that the camera is not installed on the display device.

[0088] In the first case, if the camera type is type two and the serial bus port connected to the camera is located at the top of the landscape screen of the monitor, then the camera is determined to be installed at the top of the landscape screen of the monitor.

[0089] In the first case, if the camera type is type two and the serial bus port connected to the camera is located at the top of the monitor's vertical screen, then the camera is determined to be installed at the top of the monitor's vertical screen.

[0090] In related technologies, rotating TVs are used in various scenarios because their displays can rotate. For user convenience, current rotating TVs have ports for connecting external cameras. These ports include a first port and a second port. The first port is located at the top of the display when it is in landscape mode, and the second port is located at the top of the display when it is in portrait mode, i.e., on one side of the display when it is in landscape mode.

[0091] For example, Figures 6a-6d An exemplary schematic diagram illustrates the installation location of a camera according to some embodiments. For example... Figures 6a-6d The cameras shown are all Type II cameras. Figure 6a In this example, the display device's monitor is set to landscape mode, and the camera is mounted at the top of the screen. Figure 6b In this example, the display device's monitor is in landscape mode, and the camera is mounted at the top of the monitor's vertical screen. Figure 6c In this example, the display device's monitor is in portrait mode, and the camera is mounted at the top of the monitor's horizontal screen. Figure 6d In this case, the display device's monitor is in portrait mode, and the camera is mounted at the top of the monitor's portrait screen.

[0092] In this embodiment of the application, after determining the installation location of the camera, the display ratio of the image captured by the camera on the display can be determined according to the installation location of the camera and the display mode of the display.

[0093] The aspect ratio is used to characterize the aspect ratio of an image displayed on a monitor and can be determined by the resolution. The aspect ratio can include a first aspect ratio and a second aspect ratio, where the first aspect ratio is used to display landscape images and the second aspect ratio is used to display portrait images. For example, the first aspect ratio can be 16:9 or 9:16.

[0094] The following explains how to determine the display ratio.

[0095] In some embodiments, if the camera is not installed on the display device and the display mode is landscape, or, or, the camera is installed at the top of the vertical screen of the display, the display mode is landscape and the camera does not support the second display ratio, or, the camera is installed at the top of the horizontal screen of the display and the display mode is landscape, then it is determined that the image captured by the camera is displayed on the display at a first display ratio, the first display ratio being used to display the landscape image.

[0096] If the camera is installed at the top of the screen in landscape mode and the screen is in portrait mode, the image captured by the camera will be rotated 90 degrees and displayed at the first display ratio.

[0097] In some embodiments, if the camera is not installed on the display device and the display mode is portrait mode, or if the camera is installed at the top of the display screen and the display mode is portrait mode, the image captured by the camera is cropped and the cropped image is displayed at a second display ratio, the second display ratio being used to display the portrait image;

[0098] In some embodiments, if the camera is mounted at the top of the vertical screen of the display, the display mode is vertical screen display, and the camera supports the second display ratio, then the image captured by the camera is displayed at the second display ratio.

[0099] In some embodiments, if the camera is mounted at the top of the vertical screen of the display, the display mode is landscape, and the camera supports the second display ratio, then the image captured by the camera is rotated 90 degrees and displayed at the second display ratio.

[0100] The following explains the situation where the display device rotates during the display process.

[0101] If not installed on a display device, when the monitor rotates from landscape mode to portrait mode, the image captured by the camera is cropped to meet the second display ratio, thus changing the display ratio from the first to the second. When the monitor rotates from portrait to landscape mode, the display ratio changes from the second to the first.

[0102] If the camera is mounted at the top of the monitor's landscape orientation, when the monitor rotates from landscape to portrait mode, the image captured by the camera will be rotated 90 degrees and displayed at the first display ratio. When the monitor rotates from portrait to landscape mode, the image captured by the camera will be displayed at the first display ratio.

[0103] If the camera is mounted at the top of the monitor's portrait orientation, when the monitor rotates from portrait to landscape mode, the image captured by the camera will be rotated 90 degrees and displayed in a second aspect ratio. When the monitor rotates from landscape to portrait mode, the image captured by the camera will be displayed in a second aspect ratio.

[0104] It should be noted that if the camera is installed at the top of the monitor in portrait mode, but the camera does not support a second display ratio, the display ratio can be determined as if the camera were not installed on a display device.

[0105] In this embodiment of the application, when the display ratio of the image captured by the camera on the display is determined, the display device can display the image captured by the camera on the display at the display ratio.

[0106] The display method provided in this application embodiment involves the display device first receiving a user-input instruction to activate the camera. Secondly, the display device determines the display ratio of the image captured by the camera on the display based on the camera's installation location and the display mode. Finally, the display device displays the image captured by the camera on the display at the specified display ratio. Compared to existing technologies, this application embodiment determines a suitable display ratio for displaying the image captured by the camera based on the camera's installation location and the display mode, thus avoiding inaccurate display of the image captured by the camera on a rotating television.

[0107] Figure 7 An exemplary flowchart of a display method according to some embodiments is shown, such as... Figure 7 As shown, the method includes:

[0108] S301, Receive camera activation instruction.

[0109] S302. Determine the display ratio of the image captured by the camera on the monitor based on the camera's installation location and the monitor's display mode.

[0110] S303. Display the image captured by the camera on the monitor at a display scale.

[0111] Based on the above embodiments, the following provides a detailed explanation of how to determine the display ratio of the image captured by the camera on the monitor. Figure 8 An exemplary flowchart of another display method according to some embodiments is shown, such as Figure 8 The method includes:

[0112] S401, Receive user input indicating that the camera should be turned on.

[0113] S402. Obtain the type of camera, the serial bus port connected to the camera, and the display ratio supported by the camera.

[0114] S403. Determine if the camera type is Type 1.

[0115] If yes, proceed to step S404; otherwise, proceed to step S407.

[0116] S404. Determine if the monitor's display mode is landscape.

[0117] If yes, proceed to step S405; otherwise, proceed to step S406.

[0118] S405. Display the image captured by the camera at the first display ratio.

[0119] S406. Crop the image captured by the camera and display the cropped image at a second display ratio.

[0120] S407. Determine if the USB port connected to the camera is a landscape port.

[0121] If yes, proceed to step S408; otherwise, proceed to step S411.

[0122] S408. Determine whether the monitor's display mode is landscape.

[0123] If yes, proceed to step S409; otherwise, proceed to step S410.

[0124] S409. Display the image captured by the camera at the first display scale.

[0125] S410. Rotate the image captured by the camera by 90 degrees and display the image captured by the camera at the first display ratio.

[0126] S411. Determine if the camera supports a second display ratio.

[0127] If yes, proceed to step S412; otherwise, proceed to step S404.

[0128] S412. Determine whether the monitor's display mode is portrait mode.

[0129] If yes, proceed to step S413; otherwise, proceed to step S414.

[0130] S413. Display the image captured by the camera at a second display scale.

[0131] S414. Rotate the image captured by the camera by 90 degrees and display the image captured by the camera at the second display ratio.

[0132] Based on the above embodiments, the following explains how the display device obtains the type of the accessed camera. Figure 9 An example is shown as a flowchart of another display method according to some embodiments, such as Figure 9 The method includes:

[0133] S501. If a camera is detected to be connected to a display device, control the display to show the camera type interface.

[0134] S502, Receive the type of camera input by the user.

[0135] S503. Store the camera type in the memory of the display device.

[0136] This application does not limit how to detect the connection of a camera to a display device. In some embodiments, after detecting a USB insertion event, the display device can obtain the number of cameras connected to its system. If the number of connected cameras is greater than 0, it is determined that a camera is connected to the display device.

[0137] It should be understood that in some embodiments, when it is determined that a camera is connected to the display device, the display device can directly control the monitor to display the camera type interface. In other embodiments, when it is determined that a camera is connected to the display device, it is also necessary to determine whether the display device has recorded the type of the camera. If the type of the camera has not been recorded, the monitor is controlled to display the camera type interface.

[0138] For example, the display device can determine the camera type by obtaining the attributes corresponding to the camera's insertion record. If the attribute corresponding to the camera's insertion record is 0, it is determined that the display device has not recorded the camera type, and in this case, the display can be controlled to show the camera type interface. If the attribute corresponding to the camera's insertion record is not 0, it is determined that the display device has recorded the camera type, and in this case, it is not necessary to control the display to show the camera type interface.

[0139] It should be understood that the camera type interface in this application embodiment is used for users to select the type of camera. For example, Figure 10 The diagram illustrates a camera type interface according to some embodiments, such as... Figure 10 The camera type interface displays schematic diagrams of two types of cameras, namely the second type and the first type. Under each of these schematic diagrams, there are corresponding controls. Users can input the type of camera to the display device by triggering the controls.

[0140] Based on the above embodiments, the following describes the situation where the camera type interface is displayed under startup navigation, startup animation, or audio mode. Figure 11 The diagram illustrates a flowchart of yet another display method according to some embodiments, such as... Figure 11 The method includes:

[0141] S601. Determine if a camera is connected to the display device.

[0142] If not, proceed to step S602; if yes, proceed to step S603.

[0143] S602, Waiting for camera insertion response.

[0144] S603. Determine if the device is in startup navigation mode.

[0145] If not, proceed to step S604; if yes, poll step S603 every 3 seconds.

[0146] S604. Confirm if the boot animation is playing.

[0147] If not, proceed to step S605; if yes, poll step S604 every 3 seconds.

[0148] S605. Determine if you are in audio mode.

[0149] If yes, proceed to step S606; otherwise, proceed to step S607.

[0150] S606, Exit audio mode.

[0151] S607, Display camera type interface.

[0152] The display method provided in this application embodiment involves the display device first receiving a user-input instruction to activate the camera. Secondly, the display device determines the camera's installation location based on the camera type and the serial bus port connected to the camera. Thirdly, the display device determines the display ratio of the image captured by the camera on the display based on the camera's installation location and the display mode. Finally, the display device displays the image captured by the camera on the display at the specified display ratio. Compared to existing technologies, this application embodiment determines a suitable display ratio for displaying the image captured by the camera based on the camera's installation location and the display mode, thus avoiding inaccurate display of the image captured by the camera on a rotating television.

[0153] The following will provide an exemplary description of this application in a more concrete and vivid manner.

[0154] The display device supports the insertion of different camera types via ports, including through-hole and stand-alone types, such as... Figure 12 As shown, the plug-in type camera 51 means that the camera rotates with the monitor, while the stand-alone type camera 52 means that the camera and the port are connected through the transmission line 53, and the stand-alone type camera does not rotate when the monitor rotates.

[0155] Figure 13-19 The image displayed shows pictures taken by the camera under different conditions. Figure 13-19 The images in the image were captured while the position of the subject remained unchanged. Figure 13 The image shown is displayed when the screen is in landscape mode, the camera is inserted into the first port, and the camera type is a through-hole type. The image is displayed normally. Figure 14 The image shown is displayed when the screen is in landscape mode, the camera is inserted into the first port, and the camera type is a standing type. It can be seen that the image is displayed normally and has not been rotated. In this embodiment, the placement of the standing camera can be arbitrarily set. For example, after capturing the image... Figure 14 When viewing images, a seated camera and Figure 13 The position of the in-line camera is the same. Figure 14 The text only indicates the existence of seated cameras, but does not imply that they capture images. Figure 14 The image in the image shows the position of the seated camera.

[0156] Figure 15 The image shown is displayed when the screen is in landscape mode, the camera is inserted into the second port, and the camera type is a through-hole type. It can be seen that the image cannot be displayed normally and has been rotated.

[0157] In this embodiment, because the cameras are located at the first port and the second port, and their positions relative to the person are different, the shooting ranges of the cameras located at the first port and the second port are also different. For example, Figure 14 The figures in the video did not exceed the boundaries of the display screen. Figure 15 If a character extends beyond the display interface boundary, the user can adjust the character's position to ensure the character remains entirely within the display interface.

[0158] Figure 16 The image shown is displayed when the screen is in landscape mode, the camera is inserted into the second port, and the camera type is a standing type. The image captured by the camera shows that the image is displayed normally and there is no rotation. Figure 17 The image shows the screen in portrait mode, with the camera inserted into the first port. The camera is a through-hole type. The image captured by the camera shows that the image cannot be displayed normally and has been rotated. Figure 18 The image shows the screen in portrait mode, with the camera inserted into the first port. The camera is a standing type, and the image captured by the camera can be seen to be displayed normally without rotation. Figure 19 The image shows the screen in portrait mode, the camera inserted into the second port, and the camera type is a direct-plug type. The image captured by the camera can be seen to be displayed normally without rotation. Figure 20 The image shows the screen in portrait mode, with the camera inserted into the second port. The camera is a standing type, and the image captured by the camera can be seen to be displayed normally without rotation.

[0159] In summary, it can be seen that when the screen is in landscape mode, the camera is inserted into the second port, and the camera type is a through-hole type; and when the screen is in portrait mode, the camera is inserted into the first port, and the camera type is a through-hole type, the image cannot be displayed correctly in both cases. It should be noted that... Figure 15 and Figure 17 The image flipping direction in the example is merely one example. In some embodiments, the abnormal situation may also include other flipping directions, for example, Figure 15 As shown, the direction of the camera on the display device is taken as positive. Figure 15 The direction of the portrait of the person in the image is opposite to that of the camera relative to the display device. In some embodiments, the direction of the portrait of the person is in the same direction as that of the camera relative to the display device.

[0160] It should be noted that the solution involved in this application is for when only one camera is inserted into the display device, and not for the case of two cameras. When there are two cameras, the user is prompted to unplug one of the cameras, or to select one of the cameras to take pictures according to the preset method.

[0161] To address the aforementioned technical problems, this application provides a method for determining the camera preview direction. This method enables the image captured by the camera to be displayed normally on the monitor when the screen is in landscape mode, the camera is inserted into the second port, and the camera type is a through-hole type; and when the screen is in portrait mode, the camera is inserted into the first port, and the camera type is a through-hole type.

[0162] In some embodiments, the method, such as Figure 21 As shown, it includes:

[0163] S701: Receives a command to launch a preset application and determines whether a camera is inserted into the display device.

[0164] In some embodiments, the instruction to launch a preset application may be a camera application. The control device moves the focus on the display device to a control of the preset application, and then presses the confirmation button on the control device to generate the instruction to launch the preset application. After launching the preset application, the user interface displays as shown below. Figure 22 As shown, the preview box of the user interface displays an image captured by the camera. In some embodiments, the user can use a control device to move the focus to the camera control to take a photo.

[0165] If a camera is plugged into the display device, the port information of the camera plugged into the display device is determined, wherein the port information includes a first port or a second port. When a camera is plugged into the display device, the specific port in the display device into which the camera is plugged is determined.

[0166] If no camera is plugged into the display device, the monitor will display a prompt message indicating that a camera has been plugged in. This prompt message can be in any form, including images, text, or sound. For example,... Figure 23 As shown, the message indicates that no camera has been detected. Please check if the camera is currently connected.

[0167] In some embodiments, a first preset file is generated upon detecting that a camera is inserted into the display device. The step of determining whether a camera is inserted into the display device includes: determining whether a first preset file exists; if a first preset file exists, then it is determined that a camera is inserted into the display device; if a first preset file does not exist, then it is determined that no camera is inserted into the display device. In this embodiment, when a camera is inserted into the display device, a first preset file is automatically generated. When executing the step of determining whether a camera is inserted into the display device, the existence of a first preset file is directly determined. If it exists, then it is determined that a camera is inserted into the display device; if it does not exist, then no camera is inserted into the display device. This application may also use other methods to determine whether a camera is inserted into the display device, and this application does not specifically limit the method used.

[0168] In some embodiments, port information, screen status, and rotation status are obtained, wherein the port information is used to indicate the port into which the camera is inserted, the screen status is used to indicate whether the screen is placed horizontally or vertically, and the rotation status is used to indicate whether the image has been rotated.

[0169] In some embodiments, upon detecting that a camera is inserted into a display device, a second preset file is generated. The step of determining the port information of the display device into which the camera is inserted includes: determining whether a second preset file exists; if a second preset file exists, determining the port information based on the filename of the second preset file. In this embodiment, when a camera is inserted into a display device, a second preset file is automatically generated based on the inserted port. The filename of the second preset file is generated based on the port, and the filename of the second preset file is different when inserted into different ports. When the port information is a first port, the filename of the second preset file is the first filename; when the port information is a second port, the filename of the second preset file is the second filename. The step of determining the port information based on the filename of the second preset file includes: determining whether a second preset file with the first filename exists; if it exists, determining the port information as the first port; if it does not exist, determining the port information as the second port.

[0170] In some embodiments, the step of determining the rotation state includes: acquiring an image captured by a camera; and determining the rotation state of the image based on the image, wherein the rotation state includes whether rotation has occurred or not. In some embodiments, the step of determining the rotation state of the image based on the image includes: extracting features from the image, inputting the features into a preset classifier, and determining the rotation state of the image.

[0171] In this embodiment, the preset classifier is trained using sample data. In some embodiments, the image features are texture features, which refer to the outline of an object. The sample data includes the texture features and rotation state of the object when rotation occurs. The preset classifier is trained using this sample data. It should be noted that in this embodiment, rotation only refers to a 90° rotation.

[0172] In some embodiments, texture features of the image are extracted and input into a preset classifier to obtain the rotation state of the image.

[0173] In some embodiments, the number of preset classifiers can be multiple. For example, a first preset classifier and a second preset classifier are included. First, the features of the image are extracted and input into the first preset classifier to obtain the rotation state of the image. To avoid inaccurate determination of the rotation state of the image using the first preset classifier, the image corresponding to the rotation state determined by the first preset classifier is selected as the image where rotation has occurred. The features of the image corresponding to the second preset classifier are then extracted and input into the second preset classifier to obtain the rotation state of the image. If the second preset classifier still determines that the image has rotated, then the final determination of the image's rotation state is that rotation has occurred. This can accurately determine the rotation state of the image.

[0174] In this embodiment of the application, the display device further includes a gyroscope, which is used to determine the screen state, and the screen state is used to indicate whether the screen is placed horizontally or vertically.

[0175] In this embodiment of the application, before displaying the image on the user interface, the image captured by the camera is adjusted so that the image can be displayed normally on the user interface, avoiding image rotation that would affect the user's experience.

[0176] In some embodiments, S702, the camera type is determined based on the port information, screen state, and rotation state.

[0177] In some embodiments, the step of determining the camera type based on the port information, screen state, and rotation state includes:

[0178] The screen state includes landscape or portrait mode; the rotation state includes rotation or no rotation; the camera type includes in-wall or stand-alone type. In some embodiments, the in-wall camera can be an external camera, while in other embodiments, the in-wall camera can be a camera built into the display device.

[0179] If the port information is the first port, the screen state is portrait mode, and the image is rotated, then the camera type is determined to be a through-hole type.

[0180] If the port information is a second port, the screen state is landscape mode, and the image is rotated, then the camera type is determined to be a through-hole type.

[0181] If the port information is the first port, the screen state is landscape mode, and the image has not been rotated, then the camera type is determined to be a preset type, which includes a plug-in type or a stand-up type.

[0182] If the port information is the second port, the screen state is landscape mode, and the image has not been rotated, then the camera type is determined to be a seated type.

[0183] If the port information is the first port, the screen state is portrait mode, and the image has not been rotated, then the camera type is determined to be a seated type.

[0184] If the port information is the second port, the screen state is portrait mode, and the image has not been rotated, then the camera type is determined to be a preset type.

[0185] In some embodiments, S703, based on the camera type, port information and screen state, controls the camera to capture an image so that the captured image is displayed normally on the display, wherein normal display on the display means that the image has not been rotated.

[0186] In some embodiments, the step of controlling the camera to capture images based on the camera type, port information, and screen state includes:

[0187] If the camera type is a standing type and the screen state is landscape, the camera is controlled to capture images according to a preset preview image ratio of m:n. Upon receiving a monitor rotation command, the screen state is changed and the monitor is rotated to portrait mode. When a monitor rotation command is received, the screen state is changed to portrait mode. In some embodiments, a rotation control is provided on the user interface. The user can move the focus to the rotation control using a control device and press the confirmation button on the control device to generate the monitor rotation command. When the monitor screen state is portrait mode, it is determined whether the camera supports a preview image ratio of n:m. If it does, the camera is controlled to capture images according to the preview image ratio of n:m. If it does not support it, the image captured by the camera according to the preset preview image ratio is cropped according to the preview image ratio of n:m to retain the captured image content to the maximum extent, and the cropped image is displayed on the monitor. For example, the monitor ratio is m:n, the monitor size is 1920:1080, the preset preview image ratio is m:n, m is 16, and n is 9. When the monitor screen is in portrait mode and does not support a 9:16 preview image ratio, the image will be cropped according to the preset preview image ratio of 16:9, and the preview image ratio of the cropped image will be 9:16. The cropped image will then be displayed on the monitor. It should be noted that in some embodiments, the image method can be used to display the cropped image in full screen.

[0188] In this embodiment, the camera's supported preview image ratio is pre-stored. For example, when the camera supports a preview image ratio of n:m, the image ratio captured by the camera is n:m. However, due to differences in camera performance, some cameras cannot support a preview image ratio of n:m. Therefore, when the screen is in landscape mode and a monitor rotation command is received, the monitor is rotated to portrait mode. Since the camera does not support a preview image ratio of n:m, the image captured by the camera needs to be processed and displayed on the monitor. In this embodiment, the image captured by the camera is cropped according to the preview image ratio of n:m, and the cropped image is displayed on the monitor, thus meeting the requirement of the monitor to display an n:m ratio.

[0189] If the camera type is a standing type and the screen state is portrait mode, determine whether the camera supports a preview image ratio n:m. If it does, control the camera to capture an image according to the preview image ratio n:m; if it does not support it, crop the image captured by the camera according to the preset preview image ratio n:m and display the cropped image on the display. Receive a display rotation command, control the screen state to change, and rotate the display to landscape mode, control the camera to capture an image according to the preset preview ratio m:n, and display the captured image on the display.

[0190] If the camera type is a through-hole type, the port information is the first port, and the screen state is portrait mode, the image captured by the camera according to a preset preview image ratio m:n is rotated by a preset angle and displayed on the monitor. For example, the preset angle is 90°. After rotating by the preset angle, the image is displayed normally on the monitor without rotation. Upon receiving a monitor rotation command, the screen state is changed and the monitor is rotated to landscape mode. The camera is then controlled to capture an image according to the preset preview image ratio m:n, and the captured image is displayed on the screen.

[0191] If the camera type is a plug-in type, the port information is the first port, and the screen state is landscape mode, control the camera to capture images according to the preset preview image ratio m:n; receive the display rotation command, change the screen state and rotate the display to portrait mode, and display the image captured by the camera according to the preset preview image ratio m:n after rotating it by a preset angle on the display.

[0192] If the camera type is a through-hole type and the port information is a second port, determine whether the camera supports a preview image ratio of n:m. If it does, determine whether the screen state is portrait mode. If the screen state is portrait mode, control the camera to capture an image according to the preview image ratio of n:m; receive a monitor rotation command, change the screen state and rotate the monitor to landscape mode, and display the image captured by the camera according to the preview image ratio of n:m after rotating it by a preset angle on the monitor; if the screen state is landscape mode, display the image captured by the camera according to the preview image ratio of n:m after rotating it by a preset angle on the monitor, receive a monitor rotation command, change the screen state and rotate the monitor to portrait mode, control the camera to capture an image according to the preview image ratio of n:m, and display the image on the monitor.

[0193] If not supported, determine if the screen is in portrait mode. If the screen is in portrait mode, crop the image captured by the camera according to the preset preview image ratio (n:m) and display the cropped image on the monitor. Receive a monitor rotation command, change the screen state and rotate the monitor to landscape mode, control the camera to capture an image according to the preset preview image ratio (m:n), rotate the image by a preset angle, and display the rotated image on the monitor. If the screen is in landscape mode, crop the image captured by the camera according to the preset preview image ratio (m:n) to obtain an image with an n:m ratio, rotate the cropped image by a preset angle, and display it on the monitor. Receive a monitor rotation command, change the screen state and switch the monitor to portrait mode, rotate the image in the opposite direction by a preset angle, and display it on the monitor. In some embodiments, the cropped and rotated image is displayed full-screen on the monitor.

[0194] In the above embodiments, a method for determining the preview direction of a camera and a display device are disclosed. This application embodiment adjusts the image captured by the camera based on the camera type, port information, and screen state to ensure the image is displayed correctly on the display, thereby improving the user experience. The method includes: receiving an instruction to launch a preset application; acquiring port information, screen state, and rotation state, wherein the port information indicates the port into which the camera is inserted, the screen state indicates whether the screen is positioned horizontally or vertically, and the rotation state indicates whether the image has rotated; determining the camera type based on the port information, screen state, and rotation state; and controlling the camera to capture an image based on the camera type, port information, and screen state.

[0195] Another way to ensure error-free images in this application is to remind the user in advance which port to insert the device into, thus preventing image errors. For example, based on the current landscape orientation of the monitor, the user is reminded to insert the device into the port along the longer side (the top of the screen at this time); based on the current portrait orientation of the monitor, the user is reminded to insert the device into the port along the shorter side (the top of the screen at this time).

[0196] In other words, how to select a camera and how to ensure that the image captured by the camera is not rotated when displayed on the monitor are problems that urgently need to be solved by those skilled in the art.

[0197] This application provides a method for capturing images with a camera. This method can display the images captured by the cameras normally on the display when multiple cameras are inserted into a display device, and the images are displayed on the display without being rotated.

[0198] The method, such as Figure 24 As shown, it includes:

[0199] S801. Receive an instruction to start a preset application, obtain the order in which the cameras are inserted into the ports on the display device and the screen status, wherein the screen status is used to indicate whether the screen is placed horizontally or vertically.

[0200] In some embodiments, the preset application can be a camera application. The control device moves the focus on the display device to a control of the preset application, and pressing the confirmation button on the control device generates a command to launch the preset application. After launching the preset application, the user interface displays as shown below. Figure 22 As shown, the preview box of the user interface displays an image captured by the camera. In some embodiments, the user can use a control device to move the focus to the camera control to take a photo.

[0201] In some embodiments, the step of determining the order in which the ports on the display device are inserted by the camera includes:

[0202] A preset service is activated to determine whether a camera is inserted into the display device and to monitor port insertion information, including whether a camera is inserted into the port and whether the camera is removed from the port. In this embodiment, the preset service can be a background service (GlobalUI).

[0203] In some embodiments, a first preset file is generated upon detecting that a camera is inserted into the display device. The step of determining whether a camera is inserted into the display device includes: determining whether a first preset file exists; if a first preset file exists, then it is determined that a camera is inserted into the display device; if a first preset file does not exist, then it is determined that no camera is inserted into the display device. In this embodiment, when a camera is inserted into the display device, a first preset file is automatically generated. When executing the step of determining whether a camera is inserted into the display device, the existence of a first preset file is directly determined. If it exists, then it is determined that a camera is inserted into the display device; if it does not exist, then no camera is inserted into the display device. This application may also use other methods to determine whether a camera is inserted into the display device, and this application does not specifically limit the method used.

[0204] If no camera is plugged into the display device, the monitor will display a prompt message indicating that a camera has been plugged in. This prompt message can be in any form, including images, text, or sound. For example,... Figure 23 As shown, the message indicates that no camera has been detected. Please check if the camera is currently connected.

[0205] In some embodiments, if a camera is inserted into the display device, and both the first and second ports are plugged in, the display is controlled to show a prompt to unplug the camera. The form of this prompt is not limited; for example, such as... Figure 25 As shown, the message indicates that to ensure optimal usage, please ensure the camera is always plugged into the top center of the screen.

[0206] In some embodiments, if a camera is inserted into the display device, the order in which the ports on the display device are inserted by the camera is determined. When a camera is detected being inserted into a port, or when a camera is detected being removed from a port, the order in which the ports on the display device are inserted by the camera is updated. When a camera is detected being removed from a port or inserted into a port, an image is captured using the camera corresponding to the port in the updated order that is in a preset order, based on the screen state.

[0207] When a camera is inserted into a display device, the port information of the camera into the display device is first determined. This port information includes a first port and / or a second port, and the insertion order corresponding to each port is also determined. When a camera is detected inserted into the first port, the insertion order for that port is determined. Similarly, when a camera is detected inserted into the second port, the insertion order for that port is determined.

[0208] In some embodiments, upon detecting that a camera is inserted into a display device, a second preset file is generated. The step of determining the port information of the display device into which the camera is inserted includes: determining whether a second preset file exists; if a second preset file exists, determining the port information based on the filename of the second preset file. In this embodiment, when a camera is inserted into a display device, a second preset file is automatically generated based on the inserted port. The filename of the second preset file is generated based on the port; when inserted into different ports, the filename of the second preset file is different. When the port information is a first port, the filename of the second preset file is the first filename; when the port information is a second port, the filename of the second preset file is the second filename. The step of determining the port information based on the filename of the second preset file includes: determining whether a second preset file with the first filename exists; if it exists, determining the port information as the first port; if it does not exist, determining the port information as the second port.

[0209] In some embodiments, the second preset file includes a first identifier. When a camera is inserted into a display device, the cameras are configured with the first identifier in the order of insertion. For example, when the first camera is inserted into the display device, its first identifier (videox) is configured as 0; when the second camera is inserted, its first identifier is configured as 1. When the first camera is removed from the display device and the third camera is inserted, its first identifier is configured as 2.

[0210] Ports on the display device are configured with a second identifier (logicalID), which is determined based on the first identifier (videox) of the camera inserted into the port. The second identifier includes a third identifier (LandscapeID) and a fourth identifier (PortraitID), where the third identifier is the identifier of the first port and the fourth identifier is the identifier of the second port. For example, a camera with a first identifier of 0 is inserted into the first port, in which case the third identifier (LandscapeID) is 0; a camera with a first identifier of 1 is inserted into the second port, in which case the fourth identifier (PortraitID) is 1. Simultaneously, when a camera is inserted into a port on the display device, the order in which the camera is inserted is determined using a fifth identifier. This fifth identifier includes a sixth identifier (LandscapeInsertID) and a seventh identifier (PortraitInsertID), where the fifth identifier indicates the insertion order of the first port and the sixth identifier indicates the insertion order of the second port. For example, the port where the camera is first inserted is the first port, in which case the corresponding sixth identifier is 0; the port where the camera is second inserted is the second port, in which case the corresponding seventh identifier is 1. When the camera in the port with the sixth identifier (0) is unplugged, the seventh identifier of the port that originally had the seventh identifier (1) will be changed from 1 to 0, and the sixth identifier will be changed from 0 to the default value of -1. It should be noted that the fifth identifier is a non-negative number, and the smaller the value, the earlier the corresponding port was inserted.

[0211] The following scenarios determine the sixth and seventh identifiers, ultimately determining the order in which the ports are inserted by the camera. In some embodiments, the port in the preset order is the port that is first in the sequence.

[0212] Scenario 1: The display device is powered on and no camera is inserted. A camera is then inserted. If the camera is inserted into the first port, the first identifier is X, the corresponding third identifier is X, and the sixth identifier (representing the insertion order) is 0. The second port is not inserted; in this case, the first identifier is set to the default value of -1, the fourth identifier is -1, and the seventh identifier (representing the insertion order) is -1. Since the sixth identifier is non-negative, the first port is inserted as the first port in the insertion order.

[0213] Scenario 2: The display device is powered on, and a camera is already inserted. Another camera is then inserted. If the already inserted camera is on port 1, and the newly inserted camera is on port 2, then port 1's first identifier is X, its corresponding third identifier is X, and its sixth identifier (representing the insertion order) is 0. Port 2's first identifier is X+1, its corresponding fourth identifier is X+1, and its seventh identifier (representing the insertion order) is 1. Since both the sixth and seventh identifiers are non-negative, and the sixth identifier is less than the seventh identifier, port 1 is determined to be the first port in the insertion order.

[0214] Scenario 3: The display device is powered on and a camera is already plugged in; the camera is then removed. In this case, the third, fourth, sixth, and seventh identifiers are all at their default values ​​of -1, indicating that the port that was inserted first in the sequence does not exist.

[0215] Scenario 4: The display device is powered on and two cameras are already inserted. After the display device is powered on, one camera is removed. If the camera from the first port is removed, the third identifier is set to the preset value -1, the sixth identifier is set to the preset value -1, the fourth identifier is set to X, and the seventh identifier is set to 0. Ultimately, the second port is determined as the first port in the insertion order.

[0216] In this embodiment, the order in which the camera is inserted into the port is monitored in real time, and the camera corresponding to the first port is used to capture an image.

[0217] S802. Based on the screen state, capture an image using the camera corresponding to the port in the preset order. In this embodiment, the camera supports a first preview image ratio m:n and a second preview image ratio n:m.

[0218] In some embodiments, the step of capturing images using cameras corresponding to ports in a preset order in the insertion sequence, based on the screen state, includes:

[0219] If the port in the preset order of insertion is the first port, and the screen state is landscape, then the camera is controlled to capture an image according to the first preview image ratio m:n; a display rotation command is received, the screen state is changed, and the display is rotated to portrait mode, so that the image captured by the camera according to the first preview image ratio m:n is rotated by a preset angle and displayed on the display. For example, in the first preview image ratio m:n, m is 16 and n is 9.

[0220] If the port in the preset order of the insertion sequence is the first port and the screen state is portrait mode, then the image captured by the camera according to the first preview image ratio m:n is rotated by a preset angle and displayed on the monitor; upon receiving a monitor rotation command, the screen state is changed, and the monitor is rotated to landscape mode, and the image captured by the camera according to the first preview image ratio m:n is displayed on the monitor.

[0221] If the port in the preset order of insertion is the second port, and the screen state is landscape, the image captured by the camera according to the second preview image ratio n:m is rotated by a preset angle and displayed on the monitor; upon receiving a monitor rotation command, the screen state is changed, and the monitor is rotated to portrait mode, displaying the image captured by the camera according to the second preview image ratio n:m on the monitor. For example, in the second preview image ratio n:m, n is 9 and m is 16.

[0222] If the port in the preset order of the insertion sequence is the second port, and the screen state is portrait mode, control the camera to capture an image according to the second preview image ratio n:m; receive the display rotation command, change the screen state, and rotate the display to landscape mode, and display the image captured by the camera according to the second preview image ratio n:m after rotating it by a preset angle on the display.

[0223] In the above embodiments, a method for capturing images with a camera and a display device are disclosed. This application embodiment utilizes cameras located at ports in a preset order, combined with the screen state, to adjust the images captured by the cameras so that the images are displayed normally on the display, improving the user experience. The method includes: receiving an instruction to launch a preset application; obtaining the order in which the cameras are inserted into the ports on the display device and the screen state, wherein the screen state indicates whether the screen is positioned horizontally or vertically; and capturing images using the cameras corresponding to the ports located in the preset order according to the screen state.

[0224] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media that can store program code, such as ROM, RAM, magnetic disk, or optical disk.

[0225] This application also provides a program that, when executed by a processor, performs the display method provided in the above method embodiments.

[0226] This application also provides a program product, such as a computer-readable storage medium, which stores instructions that, when run on a computer, cause the computer to execute the display method provided in the above-described method embodiments.

[0227] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of the present invention is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)).

[0228] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A display device, characterized in that, include: monitor; The data port is used to connect external devices; The controller is configured as follows: In response to an instruction to launch a preset application, the screen status and the connection order of the data ports are obtained; the screen status is used to indicate whether the display is in landscape or portrait mode, and the connection order is the order in which the data ports establish connections with the camera; Detect the target port that is in the preset order in the connection sequence, and start the target camera connected to the target port; The installation position of the target camera is detected, and a display ratio is generated based on the installation position and the screen state; The installation location is obtained based on the camera type of the target camera and the data port connected to the target camera, and the display ratio is the aspect ratio of the image when it is displayed on the monitor; Based on the screen state, control the target camera to capture an image according to the preview image ratio; and, based on the screen state, rotate the image by a preset angle, scale the image according to the display ratio, and control the display to display the image; Receive rotation command from the display; In response to the rotation command, the screen state is switched and the display is rotated; and the image is rotated by a preset angle according to the screen state, and the display is controlled to display the image.

2. The display device according to claim 1, characterized in that, The controller is configured to control the target camera to capture images according to the preview image ratio. Detect the port type of the target port; The preview image ratio is queried based on the port type.

3. The display device according to claim 1, characterized in that, The controller is also configured to: The insertion information of the data port is monitored to generate the connection sequence; the insertion information includes information about whether the camera is inserted into or removed from the data port. When the insertion information exists in the data port, detect the order in which the data port was inserted by the camera; And, when the data port is plugged into a camera, and / or when the monitoring camera is unplugged from the data port, the connection order is updated.

4. The display device according to claim 1, characterized in that, The controller is also configured to: Receives a notification to turn on the camera; In response to the activation instruction, the step of detecting the installation position of the target camera is performed.

5. The display device according to claim 4, characterized in that, The controller is configured to detect the installation location of the target camera. Detect the camera type; If the camera type is a first type, then the target camera is marked as a first installation location, which indicates that the camera is not installed on the display device; If the camera type is the second type, then the location of the data port connected to the target camera is obtained, and the installation location of the target camera is detected based on the data port location.

6. The display device according to claim 5, characterized in that, If the camera type is the first type, the controller is also configured to: Analyze the screen state; If the screen is in portrait mode, the image is cropped, and the display is controlled to show the cropped image according to the display ratio.

7. The display device according to claim 5, characterized in that, If the camera type is type two, the controller is configured as follows: Analyze the data port location; If the data port is located at the top of the horizontal screen of the display, the target camera is marked as the second mounting position, which indicates that the target camera is mounted at the top of the horizontal screen of the display. If the data port is located at the top of the vertical screen of the display, the target camera is marked as the third mounting position, which indicates that the target camera is mounted at the top of the vertical screen of the display.

8. The display device according to claim 7, characterized in that, The controller performs the parsing of the data port location and is also configured to: Detect device files in the preset path; The device file name is parsed from the device file. The serial bus port location of the target camera is obtained based on the device file name.

9. The display device according to claim 1, characterized in that, The controller is also configured to: Monitor the rotation status of the image and the port information of the target port; If the port information is the first port, the screen state is portrait mode, and the image is rotated, then the output camera type of the target camera is a through-hole type. If the port information is the second port, the screen state is landscape mode, and the image is rotated, then the output camera type of the target camera is a through-hole type.

10. The display device according to claim 9, characterized in that, The controller is also configured to: Extract the texture features of the image; The texture features are input into a preset classifier; The rotation state of the image is output through the preset classifier.

11. The display device according to claim 10, characterized in that, The preset classifier includes a first preset classifier and a second preset classifier, and the controller is further configured to: Extract the features corresponding to the first preset classifier and the features corresponding to the second preset classifier from the texture features; The features corresponding to the first preset classifier are input into the first preset classifier, and the features corresponding to the second preset classifier are input into the second preset classifier; When the output result of the first preset classifier is the same as the output result of the second preset classifier, the output result is output as the rotation state of the image.

12. The display device according to claim 9, characterized in that, The controller is also configured to: Listen for insertion information on the data port; When a camera is inserted into the data port, a first preset file and a second preset file are generated; the first preset file is used to indicate that there is an inserted camera in the display device, and the second preset file is used to indicate the port information of the data port.

13. The display device according to claim 12, characterized in that, The controller is also configured to: Obtain the second preset file; Parse the filename of the second preset file, and query the port information of the target port according to the filename of the second preset file.

14. The display device according to claim 13, characterized in that, The second preset file includes a first identifier, and the data port includes a second identifier; the controller is further configured to: Listen for insertion information on the data port; When the target camera is inserted into the data port, a first identifier is generated and the first identifier is stored in the second preset file; The second identifier is marked in the data port according to the first identifier; the second identifier includes a third identifier, a fourth identifier and a fifth identifier, the third identifier is used to characterize the first port, the fourth identifier is used to characterize the second port, and the fifth identifier is used to characterize the connection order.

15. The display device according to claim 12, characterized in that, When a first preset file exists on the display device, the controller is further configured to: Detect the display interface shown on the display; If the display interface is a preset interface, monitor the playback process of the preset interface, and control the display to show the camera type interface when the preset interface finishes playing. If the display interface is not the preset interface, exit the display interface and control the display to show the camera type interface.

16. The display device according to claim 9, characterized in that, When the port information is the first port and the screen state is portrait mode, the controller is further configured as follows: Detect the camera type of the target camera; When the camera type is a through-hole type, the target camera is controlled to capture an image according to a first preview image ratio; and the image is rotated by a preset angle and the display is controlled to display the image; the width of the first preview image ratio is greater than its height; Receive rotation commands from the display; In response to the rotation command, the screen state is switched and the display is rotated to landscape mode; and the camera is controlled to capture an image according to the first preview image ratio, and the display is controlled to display the image.

17. The display device according to claim 16, characterized in that, When the port information is a second port and the camera type is a through-hole type, the controller is also configured as follows: Detect the preview image ratio supported by the target camera, and when the target camera supports a second preview image ratio, detect the screen state; The width of the second preview image is smaller than its height; If the screen is in portrait mode, control the target camera to capture an image according to the ratio of the second preview image, and control the display to display the image; Receive rotation commands from the display; In response to the rotation command, the screen state is switched and the display is rotated to landscape mode; the camera is controlled to capture an image according to the ratio of the first preview image; and the image is rotated by a preset angle and the display is controlled to display the image.

18. The display device according to claim 17, characterized in that, When the port information is a second port and the camera type is a through-hole type, the controller is also configured as follows: Detect the preview image ratio supported by the target camera, and when the target camera supports a second preview image ratio, detect the screen state; If the screen is in landscape mode, control the target camera to capture an image according to the ratio of the second preview image; and rotate the image by a preset angle and control the display to show the image. Receive display rotation commands; In response to the rotation command, the screen state is switched and the display is rotated to portrait mode, and the display is controlled to show the image.

19. The display device according to claim 17, characterized in that, When the port information is a second port and the camera type is a through-hole type, the controller is also configured as follows: When the target camera does not support the second preview image ratio, the screen state is detected; If the screen is in landscape mode, control the camera to capture an image at the ratio of the first preview image; crop the image to the ratio of the second preview image; rotate the image by a preset angle, and control the display to show the image; Receive display rotation commands; In response to the rotation command, the screen state is switched and the display is rotated to portrait mode, the image is rotated in the opposite direction by a preset angle, and the display is controlled to show the image.

20. A display method, characterized in that, include: In response to a command to launch a preset application, obtain the screen status and the connection order of the data ports; The screen status is used to indicate whether the display is placed horizontally or vertically, and the connection sequence is the order in which the data port establishes a connection with the camera; Detect the target port that is in the preset order in the connection sequence, and start the target camera connected to the target port; The installation position of the target camera is detected, and a display ratio is generated based on the installation position and the screen state; The installation location is obtained based on the camera type of the target camera and the data port connected to the target camera, and the display ratio is the aspect ratio of the image when it is displayed on the monitor; Based on the screen state, control the target camera to capture an image according to the preview image ratio; and, based on the screen state, rotate the image by a preset angle, scale the image according to the display ratio, and control the display to display the image; Receive rotation command from the display; In response to the rotation command, the screen state is switched and the display is rotated; and the image is rotated by a preset angle according to the screen state, and the display is controlled to display the image.

Images