Method and system for remote evaluation of electronic device

Abstract

Disclosed are a method and a system for a remote evaluation of an electronic device. The method for evaluating a display device from a remote location, according to at least one embodiment of various embodiments of the present disclosure, may comprise the steps of: logging in from a terminal performing a remote evaluation on the display device; a first server, which communicates with the terminal, providing a target device list for a remote evaluation according to the login of the terminal; the first server acquiring, from the terminal, a signal for selecting the display device from the provided target device list for the remote evaluation; and a second server, which communicates with the first server, returning corresponding data in response to an input for the remote evaluation of the display device from the first server.

Description

Remote evaluation method and system for electronic devices

[0001] The present disclosure relates to a remote evaluation method and system for an electronic device.

[0002] As display devices rapidly evolve, the demand for high-performance, high-spec applications is increasing.

[0003] To this end, verification and evaluation are being conducted to determine whether the display device satisfies the requirements for such high-performance, high-spec applications.

[0004] However, in the past, the display device was directly delivered to a remote location to be verified or determined, which had the problem of requiring a lot of time and manpower for the verification or determination.

[0005] The present disclosure provides a method and system for efficiently evaluating an electronic device remotely.

[0006] A method for evaluating a display device from a remote location according to at least one embodiment among various embodiments of the present disclosure may include the steps of: logging in from a terminal performing remote evaluation of the display device; providing a list of target devices for remote evaluation in response to the login of the terminal from a first server communicating with the terminal; obtaining, in the first server, the display device selection signal from the list of target devices for remote evaluation provided from the terminal; and returning, in a second server communicating with the first server, corresponding data in response to an input for remote evaluation of the display device from the first server.

[0007] According to at least one embodiment among the various embodiments of the present disclosure, the first server may further include a step of obtaining login information of the terminal and determining whether login is successful.

[0008] According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server in a second server communicating with the first server may include the step of the second server returning stream information for an image sensor that generates an AV stream for the display device with the remote evaluation-related information.

[0009] According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server in a second server communicating with the first server may further include the step of transmitting, in the second server, an AV stream of an image sensor for a device corresponding to the device selection signal to the first server.

[0010] According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server in a second server communicating with the first server may further include the step of obtaining, in the second server, an input signal of the terminal for an AV stream of an image sensor for a device corresponding to the device selection signal transmitted to the first server.

[0011] According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server in a second server communicating with the first server may further include the step of generating a key code corresponding to the acquired input signal of the terminal in the second device.

[0012] According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server, in a second server communicating with the first server, may further include the step of transmitting, in the second device, the generated keycode to the display device.

[0013] A remote evaluation system for a display device according to at least one embodiment among various embodiments of the present disclosure may include: a terminal for performing a remote evaluation of the display device; a first server communicating with the terminal and providing a list of target devices for remote evaluation to the terminal; and a second server communicating with the first server and returning corresponding data in response to an input for remote evaluation of the display device from the first server.

[0014] According to at least one embodiment of the various embodiments of the present disclosure, the first server can obtain login information of the terminal and determine whether login is successful.

[0015] According to at least one embodiment of the various embodiments of the present disclosure, the second server may return stream information about an image sensor that generates an AV stream for the display device with the remote evaluation related information.

[0016] According to at least one embodiment of the various embodiments of the present disclosure, the second server can transmit an AV stream of an image sensor for a device corresponding to the device selection signal to the first server.

[0017] According to at least one embodiment of the various embodiments of the present disclosure, the second server can obtain an input signal of the terminal for an AV stream of an image sensor for a device corresponding to the device selection signal transmitted to the first server.

[0018] According to at least one embodiment of the various embodiments of the present disclosure, the second device can generate a key code corresponding to the input signal of the acquired terminal.

[0019] According to at least one embodiment of the various embodiments of the present disclosure, the second device can transmit the generated keycode to the display device.

[0020] According to at least one of the various embodiments of the present disclosure, there is an advantage in that an electronic device can be efficiently evaluated remotely.

[0021] Figure 1 is a schematic diagram of a remote evaluation system according to the present disclosure.

[0022] FIG. 2 is a drawing showing an example of a block diagram of the entire configuration of a remote evaluation system according to the present disclosure.

[0023] Figure 3 is a block diagram of a DCC system according to the present disclosure.

[0024] Figure 4 is a block diagram of a DCC server machine according to the present disclosure.

[0025] FIG. 5 is a diagram illustrating a device power control process within a DCC system according to the present disclosure.

[0026] FIG. 6 is a diagram illustrating an input control process of a display device in a DCC system according to the present disclosure.

[0027] FIG. 7 is a diagram illustrating an AV real-time streaming process of a display device in a DCC system according to the present disclosure.

[0028] FIG. 8 is a diagram illustrating a control process for an image sensor in a DCC system according to the present disclosure.

[0029] FIG. 9 is a diagram illustrating a process of recording an AV stream of a display device and uploading it to a file server in a DCC system according to the present disclosure.

[0030] FIG. 10 is a diagram showing the data flow of a remote evaluation system according to the present disclosure.

[0031] Hereinafter, embodiments related to the present disclosure will be described in more detail with reference to the drawings. The suffixes "module" and "part" used for components in the following description are assigned or used interchangeably solely for the convenience of writing the specification, and do not in themselves have distinct meanings or roles.

[0032] Disclosed herein is a remote evaluation system for an electronic device according to at least one of the various embodiments of the present disclosure.

[0033] Here, the term "electronic device" may be a concept that includes all types of devices capable of processing digital signals, such as display devices including TVs or digital signage (Digital Signage or Digital Information Display), mobile terminals such as smartphones and tablet PCs, and vehicles.

[0034] However, for convenience of explanation, in this specification, the electronic device is described using a display device as an example. However, this is merely an example, and the present disclosure is not limited thereto.

[0035] Meanwhile, this specification relates to a remote evaluation system for a display device. For convenience of explanation, the description is based on a server-client relationship. However, this is merely an example, and the present disclosure is not limited thereto.

[0036] Meanwhile, even if some of the various components described as being included in the electronic device remote evaluation system, such as the server described below, are described as programs or software, it may mean that it includes hardware in which the software is embedded or included.

[0037] Meanwhile, the term "evaluation" used in this specification may be used not only in the general sense of evaluation, but also as a term that can be replaced with or encompass the concept of certification for specific purposes, etc. Therefore, the interpretation of the term should not be limited by its dictionary definition.

[0038] In relation to the above, the specific purpose may include, for example, evaluating or certifying whether a specific application operates properly without a problem on the display device, evaluating or certifying whether there is no problem in the operation of a first application in relation to a second application produced, distributed and installed by a third party on the display device, evaluating or certifying whether the target application operates properly without a problem such as a conflict or malfunction in relation to the OS (Operating System) (e.g., WebOS) of the display device, etc. The opposite of the above may also be included in the specific purpose.

[0039] Hereinafter, various embodiments of a remote evaluation system (or remote authentication system) for a display device according to the present disclosure (hereinafter referred to as a “remote evaluation system” for convenience) will be described with reference to the attached drawings.

[0040] Figure 1 is a schematic diagram of a remote evaluation system (1) according to the present disclosure.

[0041] FIG. 2 is a drawing showing an example of a block diagram of the entire configuration of a remote evaluation system (1) according to the present disclosure.

[0042] Referring to Fig. 1, the remote evaluation system (1) is configured to include a client (10, 20) and a server (30).

[0043] A client can contain multiple clients.

[0044] For convenience of explanation, the present disclosure will be described using two clients, a first client (10) and a second client (20), as examples. However, the present disclosure is not limited thereto, and at least one more client may be included.

[0045] The first client (10) may represent a client requesting a remote evaluation.

[0046] The first client (10) may represent a client that owns or manufactures a display device that is the subject of remote evaluation.

[0047] On the other hand, the second client (20) may represent a client that performs remote evaluation at the request of the first client (10).

[0048] For example, the second client (20) may represent a client that performs operations such as testing, evaluating, and authenticating a display device that is the target of remote evaluation from a remote location.

[0049] The first client (10) may be located in Korea (KR), and the second client (20) may be located in a remote location, for example, the United States (US). However, geographic information or location information, such as the region to which these clients belong, is provided for convenience of explanation, and the present disclosure is not limited thereto.

[0050] In this specification, a client may include a terminal including a fixed terminal such as a PC or a mobile terminal such as a smartphone.

[0051] Alternatively, the first client (10) may be a display device to be evaluated, and the second client (20) may be a device including evaluation software such as an application or program for evaluating the display device.

[0052] The server (30) provides a network that supports various communication protocols for remote evaluation between the first client (10) and the second client (20).

[0053] The server (30) may support various functions between the two clients (10, 20) through the network provided above.

[0054] As described above, the second client (20) may be located remotely from the first client (10). Accordingly, the server (30) may provide software / hardware, such as a communication network, functions, or applications, for remote evaluation of the target display device between clients located in different regions.

[0055] The remote evaluation system (1) will be described in more detail with reference to Fig. 2.

[0056] In particular, in Fig. 2, the detailed configuration of the server (30) is shown.

[0057] Referring to FIG. 2, the server (30) may include a first server (100) and a second server (200). However, this distinction is made for convenience, and the configuration may differ from that shown. For example, a component of the first server (100) may be a component of the second server (200) rather than the first server (100), and vice versa.

[0058] Additionally, even if components of the first or second server are depicted in FIG. 2, they may be omitted as needed. Conversely, components not depicted in FIG. 2 may also be added as needed.

[0059] Meanwhile, even if it is described as a single component of the first server (100) or the second server (200) in FIG. 2, it may be implemented in a module form by combining with other components, or vice versa.

[0060] The first server (100) may be a server that directly interacts with clients, i.e., the first client (10) and the second client (20).

[0061] The first server (100) may be implemented in the form of a cloud that provides computing resources, such as Amazon Web Services (AWS). However, this is merely an example, and the present disclosure is not limited thereto.

[0062] Meanwhile, unlike the first server (100), the second server (200) can be implemented in the form of a local server for security and controllability.

[0063] For this reason, the second server (200) may be located relatively closer to the first client (10) than to the second client (20) or in the same area or space. However, this is only an example and is not limited thereto.

[0064] Referring to FIG. 2, the first server (100) may be configured to include at least one of a system frontend server (110, 120), a system backend server (130), a DCC (Device Control Center) proxy server (150), etc.

[0065] Referring to FIG. 2, the system front server may include a first system front server (110) communicating with a first client (10) and a second system front server (120) communicating with a second client (20).

[0066] Basically, a system front server can represent a server that provides the UI front-end logic of a remote evaluation system.

[0067] The system front server can access user information and DCC through the system back server (130).

[0068] These system front-end servers are preferably operated in regions, such as the country / region of the primary server, to ensure fast UI response and minimal latency. However, this is not limited to this.

[0069] The system back server (130) can exchange data with one or both of the first system front server (110) and the second system front server (120).

[0070] The system back server (130) may represent an intermediate server connecting the DCC server (200) and the system front server.

[0071] The system back server (130) manages user information and DCC site information, and can call an appropriate DCC API according to a request from the system front server and return the result.

[0072] It operates as a single instance on AWS to synchronize user information and DCC site information, and processes all requests from TART Frontend Servers operating in each region.

[0073] For example, the system back server (130) can receive both data obtained by communicating with the first client (10) from the first system front server (110) and data obtained by communicating with the first client (10) from the first system front server (110).

[0074] The system back server (130) may have or include a database built internally.

[0075] According to an embodiment, the system back server (130) may also be divided into a first system back server (not shown) and a second system back server (not shown) to correspond to the system front server, and configured to exchange data with the first system front server (110) and the second system front server (120), respectively.

[0076] If the first server (100) is primarily a component within the remote evaluation system (1), i.e., a server that supports a network between clients, the second server (200) may be a server that handles processing or control of various requests resulting from mutual data exchange between clients through the first server (100), i.e., a DCC (Device Control Center) server.

[0077] Meanwhile, in order to support the DCC function by a second client (20) located at a remote location based on the first client (10), the first server (100) may include a DCC proxy server (150) as described above.

[0078] In this process, the first server (100) may further include a DCC gateway (140) for connection between the second client (20) and the DCC proxy server (150). This DCC gateway (140) may not necessarily be an essential component.

[0079] Depending on the embodiment, the DCC gateway (140) and the DCC proxy server (150) may be built as separate servers.

[0080] Communication can be made between the first client (10) and the first system front server (110) based on REST (Representational State Transfer).

[0081] Communication can be made between the second client (20) and the second system front server (120) based on REST (Representational State Transfer).

[0082] Communication can be made between the second client (20) and the DCC gateway (140) based on the websocket standard protocol.

[0083] In addition to the first system front server (110), the first client (10) can communicate with a DCC server (e.g., the second DCC server (220)) within the second server (200). At this time, communication between the first client (10) and the DCC server (220) can also be performed based on the websocket standard protocol.

[0084] Meanwhile, from the perspective of the location of each configuration, for example, it is preferable that the second system front server (120) and DCC gateway (140) be placed in a location close to or in the area where the second client (20) belongs rather than the first client (10).

[0085] In addition, the first system front server (110), the system back server (130), and the DCC proxy server (150) are preferably placed in a location close to or in the region where the first client (10) belongs, rather than in the second client (20).

[0086] In the above, at least one of the system back server (130) and the DCC proxy server (140) can be placed in an appropriate location considering the efficiency of the remote evaluation system (1), without considering the location relationship with the clients (10, 20), for example.

[0087] As described above, the second server (200) performs DCC functions or performs processing operations related to DCC.

[0088] The second server (200) may be configured to include at least one of a DCC server and a transmission server (230).

[0089] A DCC server may include, for example, multiple DCC servers. For example, as illustrated in FIG. 2, the DCC server may include a first DCC server (210) and a second DCC server (220).

[0090] The first DCC server (210) communicates with the system back server (130).

[0091] For example, the first DCC server (210) can obtain data transmitted from at least one of the first client (10) and the second client (20) to the system back server (130) via each system front server (110, 120) and perform DCC processing.

[0092] Meanwhile, the second DCC server (220) can obtain data from at least one of the DCC proxy server (150), the system back server (130), and the first client (10) and perform DCC processing.

[0093] The first DCC server (210) and the second DCC server (220) can each be connected to a send server (230).

[0094] In addition to what is described in this specification regarding each component illustrated in FIG. 2, basic information may be cited or referenced from publicly known information related to the component.

[0095] Figure 3 is a block diagram of a DCC system according to the present disclosure.

[0096] Figure 4 is a block diagram of a DCC server machine according to the present disclosure.

[0097] Referring to Figure 3, the DCC system can be divided into an external module (external system) and an internal module (internal system) based on the network.

[0098] The external module may include, for example, a first server (100) and a storage server (310).

[0099] At this time, the first server (100) as an external module may include a second system front server (120) that communicates with a second client (20) and a system back server (130) that communicates with the second system front server (120).

[0100] As an external module, the storage server (310) may represent a server that stores a large amount of data produced by the DCC server.

[0101] Data stored in such storage servers (310) may include media files storing AV streams of a display device being photographed by an image sensor described below, firmware files for remote evaluation / certification, etc.

[0102] It is desirable for the storage server (310) to provide sufficient storage space for DCC operations. For this reason, the storage server (310) may be separated into a separate machine, for example.

[0103] Meanwhile, the description of the first server (100) as an external module refers to the content described above in FIG. 2, and redundant description is omitted here.

[0104] On the other hand, the internal module may include at least one of, for example, a DCC server machine (330), a power supply unit (340), a subnet for a test unit (350), etc.

[0105] Referring to FIG. 3, the internal module may further include a router, for example, a first router (320), that supports transmitting and receiving data between the external module and the DCC server machine (330) via a network.

[0106] The first router (320) is a main router connected to the network and can form the main network of the DCC system.

[0107] The network components configured by the first router (320) may include the aforementioned DCC server machine (330), power supply unit (340), second router (e.g., sub router) (351), etc.

[0108] Multiple (for example, up to 10 or more) sub-networks can be configured within a single DCC network.

[0109] These sub-networks and the sub-router therefor, i.e. the second router (351), may be included therein for the subnet (350) for the aforementioned test unit.

[0110] Most of the traffic by the first router (320) may be forwarded to a reverse proxy server (410 in FIG. 4) running within, for example, a DCC server machine (330).

[0111] The first router (320) may, for example, support only wired connections, but is not limited thereto.

[0112] The DCC server machine (330) may represent a server machine that runs software services required for DCC operation.

[0113] Referring to FIG. 4, the DCC server machine (330) is described in more detail.

[0114] The service driven by the DCC server machine (330) may include at least one of the reverse proxy server (410), DCC server (420), DBMS (430), web socket tunnel server (440), etc., as shown in FIG. 4.

[0115] The reverse proxy server (410) may be a type of gateway proxy server deployed in front of the DCC service for security and performance benefits. Here, for security purposes, Secure Sockets Layer (SSL), a standard security technology for protecting data communications, may be applied. Alternatively, for security purposes, a single entry point may be established, integrating the point where external interactions within the system or network are managed into a single point. This allows for efficient security management, reduced complexity, simplified management, and improved system-wide stability. Alternatively, both of the aforementioned methods may be utilized for security purposes.

[0116] The reverse proxy server (410) can forward all traffic to the appropriate server module according to predefined routing rules when the first router (320) forwards all traffic via port forwarding. In this case, the Hypertext Transfer Protocol (HTTP) without SSL and the WebSocket (WS) protocol can be used.

[0117] The reverse proxy server (410) is, for example, one of the open source web server software, and can be widely used as a reverse proxy server, load balancer, cache server, etc. as well as a web server, but is not limited thereto.

[0118] The DCC server (420) may represent a server responsible for controlling and managing various hardware devices placed within the DCC system.

[0119] The DCC server (420) can provide a REST API (Application Programming Interface) used by the system back server (130) in FIG. 2 or 3.

[0120] Such a DCC server (420) may be, for example, a nest.js-based service module. However, the present disclosure is not limited thereto.

[0121] DBMS (Database Management Server) (430) may represent a database server for storing various setting information of devices within the DCC system.

[0122] DBMS (430) can be used, for example, but is not limited to, MySQL, one of the open source relational database management systems (RDMBS).

[0123] A web socket tunnel server (440) may represent a service module that converts web socket traffic into general socket traffic.

[0124] The websocket tunnel server (440) can be used to create an ADB interface tunnel for screen mirroring and remote control of the terminal described below.

[0125] For example, the websocket tunnel server (440) uses websockify, an open source project and proxy server software that converts TCP-based protocols into websocket protocols using websocket, but is not limited thereto.

[0126] Referring to FIG. 4, the DCC server machine (330) may further include a VNC (Virtual Network Computing) tunnel server (450).

[0127] The VNC tunnel server (450) may represent a VNC client service module implemented in HTML, JavaScript, etc.

[0128] The VNC tunnel server (450) can be used, for example, to create a tunnel for remote desktop access of a terminal as described below.

[0129] For example, the VNC tunnel server (450) may be used as an open source project, noVNC, which allows access to and control of a remote desktop screen via a web browser, but is not limited thereto.

[0130] Referring again to FIG. 3, the power supply unit (340) may include a power supply control unit for controlling power to at least one device.

[0131] The power supply unit (340) may be a Power Distribution Unit (PDU).

[0132] Meanwhile, the objects whose power supply is controlled by the power supply device (340) may include a hub (353), a display device (355), an AV receiver (357), etc. included within the subnet (350).

[0133] Next, the configuration of the subnet (350) will be described in detail with reference to Fig. 3.

[0134] The subnet (350) may include at least one of a second router (351), a hub (353), a display device (355), an AV receiver (357), an image sensor (359), first to fifth terminals (361, 363, 365, 367, 369), a UIRT (371), etc.

[0135] The second router (351) may represent a router for configuring a subnet, i.e., a subnet, for example, for an independent test unit.

[0136] It is desirable that the second router (351) support wireless, such as Wi-Fi, in addition to wired, in order to support wireless network-based devices.

[0137] Network components of the second router (351) may include a hub (353), a display device (355), an AV receiver (357), an image sensor (359), and first to fifth terminals (361, 363, 365, 367, 369).

[0138] The hub (353) may represent a network hub used to create a network blocking situation of the display device (355).

[0139] For example, if the power supplied to the hub (353) through the power supply (340) is cut off, the network connection of the display device (355) may be disconnected.

[0140] The display device (355) may represent a target of remote evaluation / authentication related to the present disclosure, i.e., a device used for remote evaluation / authentication.

[0141] An AV receiver (357) may represent a type of external audio device.

[0142] The AV receiver (357) is connected to the display device (355) and can receive the display device (355) and transmit it to the image sensor (359).

[0143] The AV receiver (357) can be connected to the display device (355) via HDMI ARC.

[0144] The AV receiver (357) can transmit audio data to the line-in of the image sensor (359) via a 3.5pi AUX cable.

[0145] The image sensor (359) may represent, for example, a device that records images of a predefined image quality in real time and transmits them in various stream formats.

[0146] At this time, the predefined image quality may be various, such as Full High-Definition, 4K, 8K, etc.

[0147] Meanwhile, the various stream formats may include, for example, web sockets, RTSP (Real-Time Streaming Protocol), etc.

[0148] The image sensor (359) can record the screen of the display device (355) and receive audio data from the AV receiver (357) and encode it together to create an AV stream.

[0149] The first to third terminals (361 to 365) may be devices for testing specific functions of the display device (355).

[0150] At this time, for example, if the first terminal (361) is a MacBook, the second terminal (363) is an iPhone, and the third terminal (365) is a Homepod, the specific function may include, for example, an AirPlay (Apple AirPlay) linkage function.

[0151] Meanwhile, the first to third terminals (361 to 365) can be connected to the second router (351) wirelessly, such as via Wi-FI.

[0152] Additionally, the first to third terminals (361 to 365) may be configured to access the terminal's VNC server (not shown) via a web socket tunnel server (440) running within the DCC server machine (330).

[0153] The fourth terminal (367) may represent a device for testing the DIAL linkage function of the display device (355) in a predefined specific application such as YouTube, Netflix, etc.

[0154] The fourth terminal (357) may be configured to access the ADB interface of the terminal via a web socket tunnel server (440) running within the DCC server machine (330).

[0155] The fifth terminal (369) may represent a mini PC for a Linux terminal for running a specific application, for example, YouTube's YTS CLI.

[0156] The fifth terminal (369) can be used because it requires a terminal of a PC running within a local network, such as a display device (355), for SSDP and DIAL linkage.

[0157] Meanwhile, the fifth terminal (369) may be set up separately (prisoner in jail) in an environment where only YTS and simple shell commands can be executed with limited privileges for security purposes.

[0158] UIRT (371) may represent a device for simulating a signal of a remote control device, such as an IR remote control, for example.

[0159] Such UIRT (371) can be connected to, for example, a USB port of a DCC server machine (4400).

[0160] UIRT (371) can cause the same operation as an IR remote control by sending a predefined signal value to the display device (355) from the DCC server (420).

[0161] FIG. 5 is a diagram illustrating a device power control process within a DCC system according to the present disclosure.

[0162] Referring to FIG. 5, a request to power off or authorize a socket to which a specific device is connected can be transmitted from the DCC server (420) of the DCC server machine to the power supply unit (340) via the first router (320). At this time, the request can be transmitted using, for example, a standard protocol for remotely monitoring and managing network management devices. Such a standard protocol may include, but is not limited to, the Simple Network Management Protocol (SNMP).

[0163] Meanwhile, in the above, a specific device may include, for example, a hub (353), a display device (355), an AV receiver (357), etc., as illustrated in FIG. 4.

[0164] Additionally, each of the above devices can be supplied with AC power through a power supply unit (340).

[0165] At this time, the power supply unit (340) can operate as follows.

[0166] The power supply unit (340) can be assigned a unique IP address in the local network.

[0167] The sockets provided by the power supply unit (340) can be used in the same way as general electrical outlets. However, the sockets provided by the power supply unit (340) can also be used to cut off or apply power to specific sockets according to remote control commands transmitted via SNMP.

[0168] The power supply unit (340) can cut off or apply power to the requested socket. Accordingly, the device connected to the socket can immediately have AC power cut off or applied.

[0169] The power supply (340) may, for example, cut off power to the hub (353), causing the display device (355) to lose network connectivity.

[0170] The power supply (340) can physically turn off and then on the power of the display device (355) when the power is cut off and then reapplied. This can be helpful in rebooting the display device (355) in a serious error situation, such as a kernel panic, for example.

[0171] The power supply (340) can create a disconnected state of an external audio device connected to the AV receiver (357) and the display device (355) connected via HDMI ARC without physically disconnecting the device when the power of the AV receiver (357) is cut off.

[0172] FIG. 6 is a diagram illustrating an input control process of a display device (355) within a DCC system according to the present disclosure.

[0173] Referring to FIG. 6, the DCC server (420) within the DCC server machine can be connected to the UIRT (371) in a first manner.

[0174] At this time, the first method may include, for example, a USB (Universal Serial Bus) method, but is not limited thereto.

[0175] UIRT (371) can control the display device (355) via IR (Infrared).

[0176] Meanwhile, the DCC server (420) within the DCC server machine may also directly transmit a remote controller key signal to the display device (355).

[0177] A control command is transmitted from the DCC server (420) within the DCC server machine to the display device (355).

[0178] At this time, the DCC server (420) and the display device (355) within the DCC server machine can be connected via SSH.

[0179] In this way, the DCC server (420) can directly transmit various control commands to the display device (355) via an SSH connection, thereby stably and accurately controlling the display device (355).

[0180] In relation to this, the DCC server (420) can transmit control commands such as IR remote control button and keyboard key events, remote control device and mouse pointer events, direct calls to the Luna Service API, shell commands and script execution, etc. to the display device (355).

[0181] However, if the display device (355) is equipped with mass-produced firmware, SSH connection may be difficult for security reasons, so another method may be used.

[0182] Meanwhile, as described above, the same infrared signal as the remote control device can be transmitted to the display device (355) through the UIRT (371) device connected via USB from the DCC server (420) within the DCC server machine.

[0183] Since this is a method of directly sending physical infrared signals, it has the advantage of being able to create conditions identical to those of operating an actual remote control device.

[0184] Meanwhile, it is also possible to respond to a situation where the DC power of the display device (355) is turned off and then turned on again. Meanwhile, the above SSH connection method may not operate when the DC power is turned on.

[0185] FIG. 7 is a diagram illustrating an AV real-time streaming process of a display device (355) within a DCC system according to the present disclosure.

[0186] Referring to FIG. 7, the image sensor (359) can record the screen of the display device (355) to generate a video stream.

[0187] At this time, the generated video stream may be any one of an H.264 video stream, an H.265 video stream, etc.

[0188] An AV receiver (357) connected to the display device (355) can receive audio output from the display device (355).

[0189] The above display device (355) and AV receiver (357) can be connected, for example, via an HDMI ARC interface. However, this is only an example and is not limited thereto.

[0190] The AV receiver (357) can then transmit the audio analog signal to the line-in port of the image sensor (359). Thus, the image sensor (359) can generate an audio stream.

[0191] At this time, the AV receiver (357) can transmit a signal to the image sensor (359) through a 3.5pi AUX cable interface.

[0192] And in the above, the generated audio stream may include, but is not limited to, an AAC (Advanced Audio Codec) audio stream, which is one of the lossy compression formats, or a FLAC (Free Lossless Audio Codec) audio stream, which is one of the lossless compression formats.

[0193] A real-time AV stream generated by the image sensor (359) can be transmitted to a reverse proxy server (410).

[0194] At this time, the real-time AV stream may be transmitted via a web socket, for example. However, this is only an example and is not limited thereto.

[0195] The reverse proxy server (410) can transmit the received AV stream to a client (e.g., a user terminal (1010 in FIG. 10)).

[0196] At this time, the AV stream can be transmitted to the client by carrying it on WSS (WebSocket over SSL / TLS).

[0197] FIG. 8 is a diagram illustrating a control process for an image sensor (359) in a DCC system according to the present disclosure.

[0198] Referring to FIG. 8, when an API for controlling an image sensor (359) is called by a client, the request may be transmitted to a reverse proxy server (410) via the first router (320).

[0199] In the above, the client may be, for example, a system back server (130). However, this is only an example and is not limited thereto.

[0200] In the above, the network and the first router (320) can be connected via https.

[0201] Therefore, the client can call the API for controlling the image sensor (359) via https.

[0202] In relation to this, the API for controlling the image sensor (359) may include at least one of the following APIs.

[0203] These APIs may include at least one API from among the PTZ API for technology controlling the movement of the image sensor, such as pan, tilt, and zoom, the Focus API for focus adjustment of the image sensor (359), the Preset API for storing the PTZ and Focus values ​​preset to suit the screen of the display device (355) so that the image sensor (359) can be easily returned to the initial position after arbitrary manipulation, and the Video Quality API for easily applying video preset values ​​tailored to the characteristics of the panel (OLED, LCD) of the display device (355), which may be used only for administrators.

[0204] Meanwhile, the reverse proxy server (410) can forward the client's API call request to the DCC server (420).

[0205] At this time, the above transmission may use http, which is a connection method between the reverse proxy server (410) and the DCC server (420), but this is only an example and is not limited thereto.

[0206] The DCC server (420) can call the REST API of the image sensor (359) corresponding to the client's request.

[0207] At this time, http may be used between the DCC server (420) and the image sensor (359) during the above calling process. However, this is only an example and is not limited thereto.

[0208] FIG. 9 is a diagram illustrating a process of recording an AV stream of a display device and uploading it to a file server in a DCC system according to the present disclosure.

[0209] Referring to FIG. 9, when a client calls the image sensor (359) AV stream recording API, the request may be transmitted to the reverse proxy server (410) via the first router (320).

[0210] At this time, the client above may be, for example, a system back server (130). However, this is only an example and is not limited thereto.

[0211] The reverse proxy server (410) can forward the client's API call request to the DCC server (420).

[0212] The DCC server (420) can receive an AV stream from the image sensor (359) and store it as a temporary media file.

[0213] At this time, the DCC server (420) can obtain an AV stream by connecting to the RTSP service port of the image sensor, for example.

[0214] The DCC server (420) can upload temporarily stored media files to the storage server (310).

[0215] In relation to this, it is desirable for the storage server (310) to satisfy the following:

[0216] For example, it is desirable to build a storage server (310) as a file server based on open source Send.

[0217] The DCC server (420) can easily upload large media files to the storage server (310) using the open source ffsend, a CLI tool for the transmission server (230), and store the download URL and password phrase returned in the process in the DBMS (430).

[0218] FIG. 10 is a diagram showing the data flow of a remote evaluation system according to the present disclosure.

[0219] Referring to Fig. 10, the data flow of the remote evaluation system, for example, the control process, can be performed in the following order.

[0220] Hereinafter, the user may represent, for example, a second client (20). And the first server (100) may represent a system front server (120) and a system back server (130). However, the second server (200) will be described separately.

[0221] When a user logs in (S101), the first server (100) receives the user's login request (S103) and determines whether the user's login is successful (S105).

[0222] The first server (100) can output an error message if the user's login fails as a result of the determination in step S105 (S107).

[0223] On the other hand, if the user's login is successful as a result of the determination in step S105, the first server (100) can request a list of permitted devices (S109) and output the list of devices (S111).

[0224] When a user selects a device from the above list (S113), the first server (100) can transmit a connection request to the device selected by the user (S115).

[0225] The DCC server machine (330) of the second server can return stream url information in response to a connection request for a selected device of the first server (100) (S117).

[0226] When the stream url information returned from the DCC server machine (330) of the second server is returned, the first server (100) can request the image sensor stream again (S119).

[0227] The subnet (350) of the second server can determine whether the AV stream of the image sensor is ready (S121).

[0228] The subnet (350) of the second server can output an error message through the first server (100) when the AV stream requested by the first server (100) is not ready (failed) (S123).

[0229] On the other hand, the subnet (350) of the second server can output the device screen through the first server (100) when the AV stream requested by the first server (100) is ready (success) (S125).

[0230] In the case where the AV stream prepared from the image sensor (359) included in the subnet (350) of the second server is output through the first server (100), the user can click the UI of the display device (S127).

[0231] A signal selected, i.e. clicked, from the user's terminal can be acquired from the first server (100) to request remote control of the display device (S129).

[0232] The DCC server machine (330) of the second server can generate and transmit a key code (S131).

[0233] The subnet (350) of the second server transmits an IR signal to the display device (355) via the UIRT (391) (S133), and the display device (355) can receive the transmitted IR signal (S135).

[0234] A method for evaluating a display device from a remote location according to at least one embodiment among various embodiments of the present disclosure may include the steps of a client performing remote evaluation of the display device logging in, a step of providing a list of target devices for remote evaluation according to the login of the client at a first server communicating with the client, a step of obtaining, at the first server, the display device selection signal from the list of target devices for remote evaluation provided from the client, and a step of returning, at a second server communicating with the first server, corresponding data in response to an input for remote evaluation of the display device from the first server.

[0235] According to at least one embodiment among the various embodiments of the present disclosure, the first server may further include a step of obtaining login information of the client and determining whether login is successful.

[0236] According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server in a second server communicating with the first server may include the step of the second server returning stream information for an image sensor that generates an AV stream for the display device with the remote evaluation-related information.

[0237] According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server in a second server communicating with the first server may further include the step of transmitting, in the second server, an AV stream of an image sensor for a device corresponding to the device selection signal to the first server.

[0238] According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server in a second server communicating with the first server may further include the step of obtaining, in the second server, an input signal of the client for an AV stream of an image sensor for a device corresponding to the device selection signal transmitted to the first server.

[0239] According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server in a second server communicating with the first server may further include the step of generating a key code corresponding to the acquired input signal of the client in the second device.

[0240] According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server, in a second server communicating with the first server, may further include the step of transmitting, in the second device, the generated keycode to the display device.

[0241] Even if not specifically mentioned, the order of at least some of the operations disclosed in the present disclosure may be performed simultaneously, in a different order than the order described above, or some may be omitted / added.

[0242] According to one embodiment of the present disclosure, the above-described method can be implemented as processor-readable code on a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices.

[0243] The display device described above is not limited to the configuration and method of the embodiments described above, and the embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made.

[0244] The present disclosure relates to remote evaluation of a display device, and can be applied to remote evaluation or authentication of various devices or systems, and thus has industrial applicability.

Claims

1. In a method for evaluating a display device from a remote location, A step of logging in from a terminal performing remote evaluation of the above display device; A step of providing a list of target devices for remote evaluation according to the login of the terminal from a first server communicating with the terminal; In the first server, a step of obtaining the display device selection signal from the list of target devices for remote evaluation provided from the terminal; and A second server communicating with the first server comprises a step of returning corresponding data in response to an input for remote evaluation of the display device from the first server. Evaluation method.

2. In claim 1, In the first server, further comprising a step of obtaining the login information of the terminal and determining whether the login is successful. Evaluation method.

3. In claim 2, In a second server communicating with the first server, a step of returning corresponding data in response to an input for remote evaluation of the display device from the first server is provided. The second server includes a step of returning stream information about an image sensor that generates an AV (Audio / Video) stream for the display device with the remote evaluation-related information. Evaluation method.

4. In claim 3, In a second server communicating with the first server, a step of returning corresponding data in response to an input for remote evaluation of the display device from the first server is provided. In the second server, further comprising a step of transmitting an AV stream of an image sensor for a device corresponding to the device selection signal to the first server. Evaluation method.

5. In claim 4, In a second server communicating with the first server, a step of returning corresponding data in response to an input for remote evaluation of the display device from the first server is provided. In the second server, further comprising a step of obtaining an input signal of the terminal for an AV stream of an image sensor for a device corresponding to the device selection signal transmitted to the first server. Evaluation method.

6. In claim 5, In a second server communicating with the first server, a step of returning corresponding data in response to an input for remote evaluation of the display device from the first server is provided. In the second device, further comprising a step of generating a key code corresponding to the input signal of the acquired terminal. Evaluation method.

7. In claim 6, In a second server communicating with the first server, a step of returning corresponding data in response to an input for remote evaluation of the display device from the first server is provided. In the second device, further comprising a step of transmitting the generated key code to the display device, Evaluation method.

8. In a remote evaluation system for a display device, A terminal for performing remote evaluation of the above display device; A first server that communicates with the terminal and provides a list of target devices for remote evaluation to the terminal; and A second server communicating with the first server and returning corresponding data in response to input for remote evaluation of the display device of the terminal from the first server, Remote evaluation system.

9. In claim 8, The above first server, Obtaining the login information of the above terminal and determining whether login is successful. Remote evaluation system.

10. In claim 9, The above second server, Returning stream information for an image sensor that generates an AV stream for the display device with the above remote evaluation related information, Remote evaluation system.

11. In claim 10, The above second server, Transmitting an AV stream of an image sensor for a device corresponding to the device selection signal to the first server; Remote evaluation system.

12. In claim 11, The above second server, Obtaining an input signal of the terminal for an AV stream of an image sensor for a device corresponding to the device selection signal transmitted to the first server; Remote evaluation system.

13. In claim 12, The second device above, Generating a key code corresponding to the input signal of the terminal obtained above, Remote evaluation system.

14. In claim 13, The second device above, Transmitting the generated key code to the display device; Remote evaluation system.

Images