WO2025095257A1 - Method and system for remote evaluation of electronic device - Google Patents

Abstract

Disclosed are a method and a system for a remote evaluation of an electronic device. The method for evaluating a display device from a remote location, according to at least one embodiment of various embodiments of the present disclosure, may comprise the steps of: logging in from a terminal performing a remote evaluation on the display device; a first server, which communicates with the terminal, providing a target device list for a remote evaluation according to the login of the terminal; the first server acquiring, from the terminal, a signal for selecting the display device from the provided target device list for the remote evaluation; and a second server, which communicates with the first server, returning corresponding data in response to an input for the remote evaluation of the display device from the first server.

Description

Method and system for remote evaluation of electronic devices

The present disclosure relates to a method and system for remote evaluation of an electronic device.

As display devices rapidly evolve, the demand for high-performance, high-spec applications is increasing.

To this end, verification and evaluation are being conducted to determine whether the display device satisfies the requirements for such high-performance, high-spec applications.

However, since the conventional method involved directly delivering the display device to a remote location to verify or determine the display device, there was a problem in that the verification or determination required a lot of time and manpower.

The present disclosure provides a method and system for efficiently evaluating an electronic device remotely.

A method for evaluating a display device from a remote location according to at least one embodiment of the various embodiments of the present disclosure may include the steps of: logging in from a terminal performing remote evaluation of the display device; providing, at a first server communicating with the terminal, a list of target devices for remote evaluation according to the login of the terminal; obtaining, at the first server, the display device selection signal from the list of target devices for remote evaluation provided from the terminal; and returning, at a second server communicating with the first server, corresponding data in response to an input for remote evaluation of the display device from the first server.

According to at least one embodiment of the various embodiments of the present disclosure, the first server may further include a step of obtaining login information of the terminal and determining whether login is successful.

According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server, at a second server communicating with the first server, may include the step of the second server returning stream information for an image sensor that generates an AV stream for the display device with the remote evaluation related information.

According to at least one embodiment of the various embodiments of the present disclosure, in a second server communicating with the first server, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server may further include the step of transmitting, in the second server, an AV stream of an image sensor for a device corresponding to the device selection signal to the first server.

According to at least one embodiment of the various embodiments of the present disclosure, in a second server communicating with the first server, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server may further include the step of obtaining, in the second server, an input signal of the terminal for an AV stream of an image sensor for a device corresponding to the device selection signal transmitted to the first server.

According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server, in a second server communicating with the first server, may further include the step of generating a keycode corresponding to the acquired input signal of the terminal, in the second device.

According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server, in a second server communicating with the first server, may further include the step of transmitting, in the second device, the generated keycode to the display device.

A remote evaluation system for a display device according to at least one embodiment of the various embodiments of the present disclosure may include: a terminal for performing a remote evaluation for the display device; a first server communicating with the terminal and providing a list of target devices for remote evaluation to the terminal; and a second server communicating with the first server and returning corresponding data in response to an input for remote evaluation of the display device from the first server.

According to at least one embodiment of the various embodiments of the present disclosure, the first server can obtain login information of the terminal and determine whether login is successful.

According to at least one embodiment of the various embodiments of the present disclosure, the second server may return stream information about an image sensor that generates an AV stream for the display device with the remote evaluation related information.

According to at least one embodiment of the various embodiments of the present disclosure, the second server can transmit an AV stream of an image sensor for a device corresponding to the device selection signal to the first server.

According to at least one embodiment of the various embodiments of the present disclosure, the second server can obtain an input signal of the terminal for an AV stream of an image sensor for a device corresponding to the device selection signal transmitted to the first server.

According to at least one embodiment of the various embodiments of the present disclosure, the second device can generate a keycode corresponding to the input signal of the acquired terminal.

According to at least one embodiment of the various embodiments of the present disclosure, the second device can transmit the generated keycode to the display device.

According to at least one of the various embodiments of the present disclosure, there is an advantage in that an electronic device can be efficiently evaluated remotely.

Figure 1 is a schematic diagram of a remote evaluation system according to the present disclosure.

FIG. 2 is a drawing showing an example of a block diagram of the entire configuration of a remote evaluation system according to the present disclosure.

FIG. 3 is a block diagram of a DCC system according to the present disclosure.

FIG. 4 is a block diagram of a DCC server machine according to the present disclosure.

FIG. 5 is a diagram illustrating a device power control process within a DCC system according to the present disclosure.

FIG. 6 is a diagram illustrating an input control process of a display device in a DCC system according to the present disclosure.

FIG. 7 is a diagram illustrating an AV real-time streaming process of a display device in a DCC system according to the present disclosure.

FIG. 8 is a diagram illustrating a control process for an image sensor in a DCC system according to the present disclosure.

FIG. 9 is a diagram illustrating a process of recording AV streams of a display device in a DCC system and uploading them to a file server according to the present disclosure.

FIG. 10 is a diagram showing the data flow of a remote evaluation system according to the present disclosure.

Hereinafter, embodiments related to the present disclosure will be described in more detail with reference to the drawings. The suffixes "module" and "part" used for components in the following description are given or used interchangeably only for the convenience of writing the specification, and do not have distinct meanings or roles in themselves.

Disclosed herein is a remote evaluation system for an electronic device according to at least one of the various embodiments of the present disclosure.

Here, the term “electronic device” may include all forms of devices capable of processing digital signals, such as display devices including TVs or digital signage (Digital Signage or Digital Information Display), mobile terminals such as smartphones and tablet PCs, and vehicles.

However, in this specification, for convenience of explanation, the electronic device is described using a display device as an example. However, this is only one example, and the present disclosure is not limited thereto.

Meanwhile, this specification relates to a remote evaluation system for a display device, and for the convenience of explanation, it is described based on a server-client relationship. However, this is only one example, and the present disclosure is not limited thereto.

Meanwhile, even if some of the various components described as included in the electronic device remote evaluation system, such as the server described below, are described as programs or software, it may mean that it includes hardware in which the software is built or included.

Meanwhile, with respect to the term 'evaluation' used in this specification, it may be a term that is replaced with or includes the concept of evaluation in a general sense as well as the concept of certification for a specific purpose, etc. Therefore, the interpretation of the term should not be limited by the dictionary definition of the term.

In relation to the above, the specific purpose may include, for example, evaluating or certifying whether a specific application operates properly without a problem on the display device, evaluating or certifying whether there is no problem in the operation of a first application in relation to a second application produced, distributed and installed by a third party on the display device, evaluating or certifying whether the target application operates properly without a problem such as a crash or malfunction in relation to the OS (Operating System) (e.g., WebOS) of the display device, etc. The opposite of the above may also be included in the specific purpose.

Hereinafter, various embodiments of a remote evaluation system (or remote authentication system) for a display device according to the present disclosure (hereinafter referred to as a “remote evaluation system” for convenience) will be described with reference to the attached drawings.

Figure 1 is a schematic diagram of a remote evaluation system (1) according to the present disclosure.

FIG. 2 is a drawing showing an example of an overall configuration block diagram of a remote evaluation system (1) according to the present disclosure.

Referring to Fig. 1, the remote evaluation system (1) is configured to include a client (10, 20) and a server (30).

A client can contain multiple clients.

In this disclosure, for convenience of explanation, two clients, a first client (10) and a second client (20), are used as examples. However, this disclosure is not limited thereto, and at least one more client may be included.

The first client (10) may represent a client requesting a remote evaluation.

The first client (10) may represent a client that owns or manufactures a display device that is the subject of remote evaluation.

On the other hand, the second client (20) may represent a client that performs a remote evaluation at the request of the first client (10).

For example, the second client (20) may represent a client that performs operations such as testing, evaluating, and authenticating a display device that is the target of remote evaluation from a remote location.

The first client (10) may be located in Korea (KR), and the second client (20) may be located in a remote location, for example, the United States (US). However, geographical information or location information, such as the region to which these clients belong, is provided for convenience of explanation, and the present disclosure is not limited thereto.

In this specification, a client may include a terminal including a fixed terminal such as a PC or a mobile terminal such as a smartphone.

Alternatively, the first client (10) may be a display device to be evaluated, and the second client (20) may be a device including evaluation software such as an application or program for evaluating the display device.

The server (30) provides a network that supports various communication protocols for remote evaluation between the first client (10) and the second client (20).

The server (30) may support various functions between the two clients (10, 20) via the provided network.

As mentioned above, the second client (20) may be located remotely from the first client (10). Accordingly, the server (30) may provide software/hardware, such as a communication network, functions, or applications, for remote evaluation of the target display device between clients located in different areas.

The remote evaluation system (1) will be described in more detail with reference to Fig. 2.

In particular, Fig. 2 illustrates the detailed configuration of the server (30).

Referring to FIG. 2, the server (30) may include a first server (100) and a second server (200). However, this is for convenience's sake and may be configured differently from what is shown. For example, a component of the first server (100) may be a component of the second server (200) rather than the first server (100), and vice versa.

In addition, even if components of the first or second server are depicted in FIG. 2, they may be omitted if necessary. Conversely, components not depicted in FIG. 2 may also be added if necessary.

Meanwhile, even if it is described as a single component of the first server (100) or the second server (200) in FIG. 2, it may be implemented in a module form by combining with other components, or vice versa.

The first server (100) may be a server that directly interacts with clients, i.e., the first client (10) and the second client (20).

The first server (100) may be implemented in the form of a cloud that provides computing resources, such as AWS (Amazon Web Services), for example. However, this is only one example, and the present disclosure is not limited thereto.

Meanwhile, unlike the first server (100), the second server (200) can be implemented in the form of a local server for security and controllability.

For this reason, the second server (200) may be located relatively closer to the first client (10) than to the second client (20) or in the same area or space. However, this is only an example and is not limited thereto.

Referring to FIG. 2, the first server (100) may be configured to include at least one of a system frontend server (110, 120), a system backend server (130), a DCC (Device Control Center) proxy server (150), etc.

Referring to FIG. 2, the system front server may include a first system front server (110) communicating with a first client (10) and a second system front server (120) communicating with a second client (20).

Basically, a system front server can represent a server that provides the UI front-end logic of a remote evaluation system.

The system front server can access user information and DCC through the system back server (130).

It is desirable, but not limited to, that these system front servers operate server instances by region, such as the country/region of the primary server, to ensure fast UI response and minimal delay.

The system back server (130) can exchange data with one or both of the first system front server (110) and the second system front server (120).

The system back server (130) may represent an intermediate server connecting the DCC server (200) and the system front server.

The system back server (130) manages user information and DCC site information, and can call an appropriate DCC API according to a request from the system front server and return the result.

It operates as a single instance on AWS to synchronize user information and DCC site information and processes all requests from TART Frontend Servers operated in each region.

For example, the system back server (130) can receive both data obtained by communicating with the first client (10) from the first system front server (110) and data obtained by communicating with the first client (10) from the first system front server (110).

The system back server (130) may have or include a database built internally.

According to an embodiment, the system back server (130) may also be divided into a first system back server (not shown) and a second system back server (not shown) to correspond to the system front server, and configured to exchange data with the first system front server (110) and the second system front server (120), respectively.

If the first server (100) is a server that mainly supports a network between clients, i.e., a component within the remote evaluation system (1), the second server (200) may be a server that handles processing or control of various requests, etc. according to mutual data exchange between clients via the first server (100), i.e., a DCC (Device Control Center) server.

Meanwhile, in order to support the DCC function by the second client (20) located at a remote location based on the first client (10), the first server (100) may include a DCC proxy server (150) as described above.

In this process, the first server (100) may further include a DCC gateway (140) for connection between the second client (20) and the DCC proxy server (150). This DCC gateway (140) may not necessarily be an essential component.

Depending on the embodiment, the DCC gateway (140) and the DCC proxy server (150) may be built as separate servers.

Communication can be made between the first client (10) and the first system front server (110) based on REST (Representational State Transfer).

Communication can be made between the second client (20) and the second system front server (120) based on REST (Representational State Transfer).

Communication between the second client (20) and the DCC gateway (140) can be made based on the websocket standard protocol.

The first client (10) can communicate with a DCC server (e.g., the second DCC server (220)) within the second server (200) in addition to the first system front server (110). At this time, communication between the first client (10) and the DCC server (220) can also be made based on the websocket standard protocol.

Meanwhile, from the perspective of the location of each component, for example, it is preferable that the second system front server (120) and the DCC gateway (140) be placed in an area or a location close to the second client (20) rather than the first client (10).

In addition, the first system front server (110), the system back server (130), and the DCC proxy server (150) are preferably placed in an area or a location close to the first client (10) rather than the second client (20).

In the above, at least one of the system back server (130) and the DCC proxy server (140) can be placed in an appropriate location considering the efficiency of the remote evaluation system (1), for example, without considering the location relationship with the clients (10, 20).

The second server (200) performs DCC functions or processing operations related to DCC, as described above.

The second server (200) may be configured to include at least one of a DCC server and a transmission server (230).

The DCC server may include, for example, multiple DCC servers. The DCC server may include, for example, a first DCC server (210) and a second DCC server (220), as illustrated in FIG. 2.

The first DCC server (210) communicates with the system back server (130).

For example, the first DCC server (210) can obtain data transmitted from at least one of the first client (10) and the second client (20) to the system back server (130) through each system front server (110, 120) and perform DCC processing.

Meanwhile, the second DCC server (220) can obtain data from at least one of the DCC proxy server (150), the system back server (130), and the first client (10) and perform DCC processing.

The above first DCC server (210) and second DCC server (220) can each be connected to a send server (230).

In addition to what is described in this specification with respect to each component illustrated in Fig. 2, basic information may be cited or referenced from publicly known information related to the component.

FIG. 3 is a block diagram of a DCC system according to the present disclosure.

FIG. 4 is a block diagram of a DCC server machine according to the present disclosure.

Referring to Figure 3, the DCC system can be divided into an external module (external system) and an internal module (internal system) based on the network.

The external modules may include, for example, a first server (100) and a storage server (310).

At this time, the first server (100) as an external module may include a second system front server (120) that communicates with a second client (20) and a system back server (130) that communicates with the second system front server (120).

As an external module, the storage server (310) may represent a server that stores a large amount of data produced by the DCC server.

Data stored in such storage servers (310) may include media files storing AV streams of a display device being captured by an image sensor described below, firmware files for remote evaluation/certification, etc.

It is desirable for the storage server (310) to provide sufficient storage space for DCC operation. For this reason, the storage server (310) may be separated into a separate machine, for example.

Meanwhile, the description of the first server (100) as an external module refers to the content described above in FIG. 2, and redundant description is omitted here.

On the other hand, the internal module may include at least one of, for example, a DCC server machine (330), a power supply unit (340), a subnet for a test unit (350), etc.

Referring to FIG. 3, the internal module may further include a router, for example, a first router (320), that supports transmitting and receiving data between the external module and the DCC server machine (330) via a network.

The first router (320) is a main router connected to the network and can form the main network of the DCC system.

The network components configured by the first router (320) may include the aforementioned DCC server machine (330), power supply device (340), second router (e.g., sub router) (351), etc.

Multiple (for example, up to 10 or more) sub-networks can be configured within a single DCC network.

This sub-network and the sub-router for it, i.e. the second router (351), may be included therein for the subnet (350) for the aforementioned test unit.

Most of the traffic by the first router (320) may be forwarded to a reverse proxy server (410 in FIG. 4) running within, for example, a DCC server machine (330).

The first router (320) may, for example, support only wired, but is not limited thereto.

The DCC server machine (330) may represent a server machine that runs software services required for DCC operation.

Referring to FIG. 4, the DCC server machine (330) is described in more detail.

The services driven by the above DCC server machine (330) may include at least one of the reverse proxy server (410), DCC server (420), DBMS (430), web socket tunnel server (440), etc., as shown in FIG. 4.

The reverse proxy server (410) may be a type of gateway proxy server deployed in front of the DCC service for security and performance benefits. Here, with respect to security, SSL (Secure Sockets Layer), which is one of the standard security technologies for protecting data communication, may be applied. Or, with respect to security, the entry point may be unified to efficiently process security management, reduce complexity, simplify management, and improve the stability of the entire system by integrating the point that manages interaction with the outside in the system or network into one. Or, both of the above-mentioned may be used with respect to security.

The reverse proxy server (410) can forward all traffic to an appropriate server module according to a predetermined routing rule when the first router (320) forwards all traffic through port forwarding. At this time, the Hypertext Transfer Protocol (HTTP) with SSL removed and the WebSocket (WS) protocol can be used.

The reverse proxy server (410) may use, for example, nginx, which is widely used as one of the open source web server software and can be used in various ways, such as not only a web server but also a reverse proxy server, a load balancer, and a cache server, but is not limited thereto.

The DCC server (420) may represent a server responsible for controlling and managing various hardware devices placed within the DCC system.

The DCC server (420) can provide a REST API (Application Programming Interface) used by the system back server (130) in FIG. 2 or 3.

Such DCC server (420) may be, for example, a nest.js-based service module. However, the present disclosure is not limited thereto.

DBMS (Database Management Server) (430) may represent a database server for storing various setting information of devices within the DCC system.

As DBMS (430), MySQL, one of the open source relational database management systems (RDMBS), can be used, but is not limited thereto.

A websocket tunnel server (440) may represent a service module that converts websocket traffic into general socket traffic.

The websocket tunnel server (440) can be used to create an ADB interface tunnel for screen mirroring and remote control of the terminal as described below.

For example, the websocket tunnel server (440) uses websockify, an open source project and proxy server software that converts TCP-based protocols into websocket protocols using websocket, but is not limited thereto.

Referring to FIG. 4, the DCC server machine (330) may further include a VNC (Virtual Network Computing) tunnel server (450).

The VNC tunnel server (450) may represent a VNC client service module implemented in HTML, JavaScript, etc.

The VNC tunnel server (450) can be used, for example, to create a tunnel for remote desktop access of a terminal as described below.

For example, noVNC, an open source project that allows access to and control a remote desktop screen via a web browser, can be used as a VNC tunnel server (450), but is not limited thereto.

Referring again to FIG. 3, the power supply unit (340) may include a power supply control unit for controlling power to at least one device.

The power supply unit (340) may be a Power Distribution Unit (PDU).

Meanwhile, the target whose power supply is controlled by the power supply device (340) may include a hub (353), a display device (355), an AV receiver (357), etc. included within the subnet (350).

Next, the configuration of the subnet (350) will be described in detail with reference to Fig. 3.

The subnet (350) may include at least one of a second router (351), a hub (353), a display device (355), an AV receiver (357), an image sensor (359), first to fifth terminals (361, 363, 365, 367, 369), a UIRT (371), etc.

The second router (351) may represent a router for configuring a subnet, i.e. a subnet, for example, for an independent test unit.

It is desirable for the second router (351) to support wireless, such as Wi-Fi, in addition to wired, in order to support wireless network-based devices.

Network components of the second router (351) may include a hub (353), a display device (355), an AV receiver (357), an image sensor (359), first to fifth terminals (361, 363, 365, 367, 369), etc.

The hub (353) may represent a network hub used to create a network blocking situation of the display device (355).

For example, if the power supplied to the hub (353) through the power supply (340) is cut off, the network connection of the display device (355) may be disconnected.

The display device (355) may represent a target of remote evaluation/authentication related to the present disclosure, i.e., a device used for remote evaluation/authentication.

The AV receiver (357) may represent a type of external audio device.

The AV receiver (357) is connected to the display device (355) and can receive the display device (355) and transmit it to the image sensor (359).

The AV receiver (357) can be connected to the display device (355) via HDMI ARC.

The AV receiver (357) can transmit audio data to the line-in of the image sensor (359) via a 3.5pi AUX cable.

The image sensor (359) may represent, for example, a device that records images of predefined image quality in real time and transmits them in various stream formats.

At this time, the predefined image quality can be various, such as Full High-Definition, 4K, and 8K.

Meanwhile, the various stream formats may include, for example, web sockets, RTSP (Real-Time Streaming Protocol), etc.

The image sensor (359) can record the screen of the display device (355) and receive audio data from the AV receiver (357) and encode it together to generate an AV stream.

The first to third terminals (361 to 365) may be devices for testing specific functions of the display device (355).

At this time, for example, if the first terminal (361) is a MacBook, the second terminal (363) is an iPhone, and the third terminal (365) is a Homepod, the specific function may include, for example, an AirPlay (Apple AirPlay) linkage function.

Meanwhile, the first to third terminals (361 to 365) can be connected to the second router (351) via a wireless method such as Wi-FI.

Additionally, the first to third terminals (361 to 365) may be configured to access the VNC server (not shown) of the terminals via a web socket tunnel server (440) running within the DCC server machine (330).

The fourth terminal (367) may represent a device for testing the DIAL linkage function of the display device (355) in a predefined specific application such as YouTube, Netflix, etc.

The fourth terminal (357) may be configured to access the ADB interface of the terminal via a web socket tunnel server (440) running within the DCC server machine (330).

The fifth terminal (369) may represent a mini PC for a Linux terminal to run a specific application, for example, YouTube's YTS CLI.

The fifth terminal (369) may be utilized because a terminal of a PC running within a local network, such as a display device (355), is required for SSDP and DIAL interworking.

Meanwhile, the fifth terminal (369) may be set up separately (prisoner in jail) in an environment where only YTS and simple shell commands can be executed with limited privileges for security purposes.

UIRT (371) may represent a device for simulating a signal of a remote control device, such as an IR remote control, for example.

Such UIRT (371) can be connected to, for example, a USB port of a DCC server machine (4400).

UIRT (371) can cause the same operation as an IR remote control by sending a predefined signal value to the display device (355) from the DCC server (420).

FIG. 5 is a diagram illustrating a device power control process within a DCC system according to the present disclosure.

Referring to FIG. 5, a request for power cutoff or authorization of a socket to which a specific device is connected can be transmitted from the DCC server (420) of the DCC server machine to the power supply device (340) via the first router (320). At this time, the transmission of the request can use, for example, a standard protocol for remotely monitoring and managing network management devices. For example, SNMP (Simple Network Management Protocol) can be used as such a standard protocol, but is not limited thereto.

Meanwhile, in the above, a specific device may include, for example, a hub (353), a display device (355), an AV receiver (357), etc., as shown in FIG. 4.

Additionally, each of the above devices can be supplied with AC power through a power supply unit (340).

At this time, the power supply unit (340) can operate as follows.

The power supply unit (340) can be assigned a unique IP address in the local network.

The socket provided by the power supply unit (340) can be used in the same way as a general electrical outlet. However, the socket provided by the power supply unit (340) can also block or apply power to a specific socket according to a remote control command transmitted to SNMP.

The power supply unit (340) can cut off or apply power to the requested socket. Accordingly, the device connected to the socket can immediately have AC power cut off or applied.

The power supply (340) may, for example, cause the display device (355) to lose network connectivity if it cuts off power to the hub (353).

The power supply (340) can physically turn off and then turn on the power of the display device (355) when power is cut off and then reapplied to the display device (355). This can be helpful in rebooting the display device (355) in a serious error situation, such as a kernel panic, for example.

The power supply (340) can create a disconnected situation for an external audio device connected to the AV receiver (357) and the display device (355) connected via HDMI ARC without physically disconnecting the device when power to the AV receiver (357) is cut off.

FIG. 6 is a diagram illustrating an input control process of a display device (355) in a DCC system according to the present disclosure.

Referring to FIG. 6, the DCC server (420) within the DCC server machine can be connected to the UIRT (371) in a first manner.

At this time, the first method may include, for example, a USB (Universal Serial Bus) method, but is not limited thereto.

UIRT (371) can control the display device (355) via IR (Infrared).

Meanwhile, the DCC server (420) within the DCC server machine may also directly transmit a remote controller key signal to the display device (355).

A control command is transmitted from the DCC server (420) within the DCC server machine to the display device (355).

At this time, the DCC server (420) and the display device (355) within the DCC server machine can be connected via SSH.

In this way, the DCC server (420) can directly transmit various control commands to the display device (355) through an SSH connection, thereby stably and accurately controlling the display device (355).

In relation to this, the DCC server (420) can transmit control commands such as IR remote control button and keyboard key events, remote control device and mouse pointer events, direct calls to the Luna Service API, shell commands and script execution, etc. to the display device (355).

However, if mass-produced firmware is installed on the display device (355), SSH connection may be difficult for security reasons, so another method may be used.

Meanwhile, as described above, the same infrared signal as the remote control device can be transmitted to the display device (355) through the UIRT (371) device connected via USB from the DCC server (420) within the DCC server machine.

Since this is a method of directly sending physical infrared signals, it has the advantage of being able to create conditions identical to those of operating an actual remote control device.

Meanwhile, it is also possible to respond to a situation where the DC power of the display device (355) is turned off and then turned on again. Meanwhile, the above SSH connection method may not operate when the DC power is turned on.

FIG. 7 is a diagram illustrating an AV real-time streaming process of a display device (355) within a DCC system according to the present disclosure.

Referring to FIG. 7, the image sensor (359) can record the screen of the display device (355) to generate a video stream.

At this time, the generated video stream can be any one of an H.264 video stream, an H.265 video stream, etc.

An AV receiver (357) connected to the display device (355) can receive audio output of the display device (355).

The above display device (355) and AV receiver (357) can be connected, for example, via an HDMI ARC interface. However, this is only an example and is not limited thereto.

The AV receiver (357) can then transmit the audio analog signal to the line-in port of the image sensor (359). Accordingly, the image sensor (359) can generate an audio stream.

At this time, the AV receiver (357) can transmit a signal to the image sensor (359) through a 3.5pi AUX cable interface.

And in the above, the generated audio stream may include, but is not limited to, an AAC (Advanced Audio Codec) audio stream, which is one of the lossy compression formats, or a FLAC (Free Lossless Audio Codec) audio stream, which is one of the lossless compression formats.

A real-time AV stream generated by the image sensor (359) can be transmitted to a reverse proxy server (410).

At this time, the real-time AV stream may be transmitted, for example, via a web socket. However, this is only an example and is not limited thereto.

The reverse proxy server (410) can transmit the received AV stream to a client (e.g., a user terminal (1010 of FIG. 10)).

At this time, the AV stream can be transmitted to the client by carrying it on WSS (WebSocket over SSL/TLS).

FIG. 8 is a diagram illustrating a control process for an image sensor (359) in a DCC system according to the present disclosure.

Referring to FIG. 8, when an API for controlling an image sensor (359) is called by a client, the request may be transmitted to a reverse proxy server (410) via the first router (320).

In the above, the client may be, for example, a system back server (130). However, this is only an example and is not limited thereto.

In the above, the network and the first router (320) can be connected via https.

Therefore, the client can call the API for controlling the image sensor (359) via https.

In relation to this, the API for controlling the image sensor (359) may include at least one of the following APIs.

These APIs may include at least one API from among the following: a PTZ API for controlling the movement of the image sensor, such as pan, tilt, and zoom; a Focus API for adjusting the focus of the image sensor (359); a Preset API for storing the PTZ and Focus values preset to suit the screen of the display device (355) so that the image sensor (359) can be easily returned to the initial position after arbitrary manipulation; and a Video Quality API for easily applying video preset values tailored to the characteristics of the panel (OLED, LCD) of the display device (355), which may be used only by administrators.

Meanwhile, the reverse proxy server (410) can forward the client's API call request to the DCC server (420).

At this time, the above transmission may use http, which is a connection method between the reverse proxy server (410) and the DCC server (420), but this is only an example and is not limited thereto.

The DCC server (420) can call the REST API of the image sensor (359) corresponding to the client's request.

At this time, http may be used between the DCC server (420) and the image sensor (359) during the above calling process. However, this is only an example and is not limited thereto.

FIG. 9 is a diagram illustrating a process of recording AV streams of a display device in a DCC system and uploading them to a file server according to the present disclosure.

Referring to FIG. 9, when a client calls the image sensor (359) AV stream recording API, the request may be transmitted to the reverse proxy server (410) via the first router (320).

At this time, the client above may be, for example, a system back server (130). However, this is only an example and is not limited thereto.

The reverse proxy server (410) can forward the client's API call request to the DCC server (420).

The DCC server (420) can receive an AV stream from the image sensor (359) and store it as a temporary media file.

At this time, the DCC server (420) can, for example, connect to the RTSP service port of the image sensor to obtain an AV stream.

The DCC server (420) can upload temporarily stored media files to the storage server (310).

In relation to this, it is desirable for the storage server (310) to satisfy the following:

For example, it is desirable to build a storage server (310) as a file server based on open source Send.

The DCC server (420) can easily upload large media files to the storage server (310) using the open source ffsend, a CLI tool for the transmission server (230), and store the download URL and password phrase returned in the process in the DBMS (430).

FIG. 10 is a diagram showing the data flow of a remote evaluation system according to the present disclosure.

Referring to Fig. 10, the data flow of the remote evaluation system, for example, the control process, can be performed in the following order.

Hereinafter, the user may represent, for example, a second client (20). And the first server (100) may represent a system front server (120) and a system back server (130). However, the second server (200) will be described separately.

When a user logs in (S101), the first server (100) receives the user's login request (S103) and determines whether the user's login is successful (S105).

The first server (100) can output an error message if the user's login fails as a result of the determination in step S105 (S107).

On the other hand, if the user's login is successful as a result of the determination in step S105, the first server (100) can request a list of permitted devices (S109) and output the list of devices (S111).

When a user selects a device from the above list (S113), the first server (100) can transmit a connection request to the device selected by the user (S115).

The DCC server machine (330) of the second server can return stream url information in response to a connection request for a selected device of the first server (100) (S117).

When stream url information returned from the DCC server machine (330) of the second server is returned, the first server (100) can request the image sensor stream again (S119).

The subnet (350) of the second server can determine whether the AV stream of the image sensor is ready (S121).

The subnet (350) of the second server can output an error message through the first server (100) when the AV stream requested by the first server (100) is not ready (failed) (S123).

On the other hand, the subnet (350) of the second server can output the device screen through the first server (100) when the AV stream requested by the first server (100) is ready (success) (S125).

In the case where an AV stream prepared from an image sensor (359) included in the subnet (350) of the second server is output through the first server (100), the user can click on the UI of the display device (S127).

A signal selected, i.e. clicked, from the user's terminal can be acquired from the first server (100) to request remote control of the display device (S129).

The DCC server machine (330) of the second server can generate and transmit a key code (S131).

The subnet (350) of the second server transmits an IR signal to the display device (355) via the UIRT (391) (S133), and the display device (355) can receive the transmitted IR signal (S135).

A method for evaluating a display device from a remote location according to at least one embodiment of the various embodiments of the present disclosure may include the steps of a client performing a remote evaluation of the display device logging in, a step of providing a list of target devices for remote evaluation according to the login of the client at a first server communicating with the client, a step of obtaining, at the first server, the display device selection signal from the list of target devices for remote evaluation provided from the client, and a step of returning, at a second server communicating with the first server, corresponding data in response to an input for remote evaluation of the display device from the first server.

According to at least one embodiment of the various embodiments of the present disclosure, the first server may further include a step of obtaining login information of the client and determining whether login is successful.

According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server, at a second server communicating with the first server, may include the step of the second server returning stream information for an image sensor that generates an AV stream for the display device with the remote evaluation related information.

According to at least one embodiment of the various embodiments of the present disclosure, in a second server communicating with the first server, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server may further include the step of transmitting, in the second server, an AV stream of an image sensor for a device corresponding to the device selection signal to the first server.

According to at least one embodiment of the various embodiments of the present disclosure, in a second server communicating with the first server, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server may further include the step of obtaining, in the second server, an input signal of the client for an AV stream of an image sensor for a device corresponding to the device selection signal transmitted to the first server.

According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server, in a second server communicating with the first server, may further include the step of generating a keycode corresponding to the acquired input signal of the client, in the second device.

According to at least one embodiment of the various embodiments of the present disclosure, the step of returning corresponding data in response to an input for remote evaluation of the display device from the first server, in a second server communicating with the first server, may further include the step of transmitting, in the second device, the generated keycode to the display device.

Even if not specifically mentioned, the order of at least some of the operations disclosed in the present disclosure may be performed simultaneously, in a different order than the described order, or some may be omitted/added.

According to one embodiment of the present disclosure, the above-described method can be implemented as a processor-readable code on a medium in which a program is recorded. Examples of the processor-readable medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

The display device described above is not limited to the configuration and method of the embodiments described above, and the embodiments may be configured by selectively combining all or part of the embodiments so that various modifications can be made.

The present disclosure relates to remote evaluation of a display device and can be applied to remote evaluation or authentication of various devices or systems, and thus has industrial applicability.

Claims (14)

In a method for evaluating a display device from a remote location, A step of logging in from a terminal performing remote evaluation on the above display device; A step of providing a list of target devices for remote evaluation according to the login of the terminal from a first server communicating with the terminal; In the first server, a step of obtaining the display device selection signal from the list of target devices for remote evaluation provided from the terminal; and In a second server communicating with the first server, a step is included for returning corresponding data in response to an input for remote evaluation of the display device from the first server. Evaluation method. In claim 1, In the first server, the step of obtaining the login information of the terminal and determining whether the login is successful is further included. Evaluation method. In claim 2, In a second server communicating with the first server, a step of returning corresponding data in response to an input for remote evaluation of the display device from the first server is provided. The second server comprises a step of returning stream information about an image sensor that generates an AV (Audio/Video) stream for the display device with the remote evaluation related information. Evaluation method. In claim 3, In a second server communicating with the first server, a step of returning corresponding data in response to an input for remote evaluation of the display device from the first server is provided. In the second server, further comprising the step of transmitting an AV stream of an image sensor for a device corresponding to the device selection signal to the first server. Evaluation method. In claim 4, In a second server communicating with the first server, a step of returning corresponding data in response to an input for remote evaluation of the display device from the first server is provided. In the second server, the method further comprises the step of obtaining an input signal of the terminal for an AV stream of an image sensor for a device corresponding to the device selection signal transmitted to the first server. Evaluation method. In claim 5, In a second server communicating with the first server, a step of returning corresponding data in response to an input for remote evaluation of the display device from the first server is provided. In the second device, further comprising a step of generating a key code corresponding to the input signal of the acquired terminal. Evaluation method. In claim 6, In a second server communicating with the first server, a step of returning corresponding data in response to an input for remote evaluation of the display device from the first server is provided. In the second device, further comprising a step of transmitting the generated key code to the display device, Evaluation method. In a remote evaluation system for a display device, A terminal for performing remote evaluation of the above display device; A first server that communicates with the terminal and provides a list of target devices for remote evaluation to the terminal; and A second server communicating with the first server and returning corresponding data in response to an input for remote evaluation of the display device of the terminal from the first server. Remote evaluation system. In claim 8, The above first server, Obtaining the login information of the above terminal and determining whether login is successful. Remote evaluation system. In claim 9, The above second server, Returning stream information for an image sensor that generates an AV stream for the display device with the above remote evaluation related information. Remote evaluation system. In claim 10, The above second server, Transmitting an AV stream of an image sensor for a device corresponding to the device selection signal to the first server; Remote evaluation system. In claim 11, The above second server, Obtaining an input signal of the terminal for an AV stream of an image sensor for a device corresponding to the device selection signal transmitted to the first server; Remote evaluation system. In claim 12, The second device, Generating a key code corresponding to the input signal of the terminal acquired above, Remote evaluation system. In claim 13, The second device, Transmitting the generated key code to the display device; Remote evaluation system.

Images