[go: up one dir, main page]

WO2019221423A1 - Dispositif électronique, procédé de commande associé et support d'enregistrement - Google Patents

Dispositif électronique, procédé de commande associé et support d'enregistrement Download PDF

Info

Publication number
WO2019221423A1
WO2019221423A1 PCT/KR2019/005120 KR2019005120W WO2019221423A1 WO 2019221423 A1 WO2019221423 A1 WO 2019221423A1 KR 2019005120 W KR2019005120 W KR 2019005120W WO 2019221423 A1 WO2019221423 A1 WO 2019221423A1
Authority
WO
WIPO (PCT)
Prior art keywords
graphic
signal
processor
video
electronic device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2019/005120
Other languages
English (en)
Korean (ko)
Inventor
오승보
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of WO2019221423A1 publication Critical patent/WO2019221423A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing
    • G06T1/20Processor architectures; Processor configuration, e.g. pipelining
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/28Indexing scheme for image data processing or generation, in general involving image processing hardware

Definitions

  • the present invention relates to an electronic device, a control method thereof, and a recording medium, and more particularly, to an electronic device capable of processing a graphic signal, a control method thereof, and a recording medium.
  • Optical disc playback devices that include Blu-ray discs (BDs) or Ultra high definition (UHD) BDs, that is, electronic devices such as players, correspond to content stored on discs via wired or wireless interfaces.
  • the video signal is processed and provided to an external device such as a television.
  • the video signal provided from the electronic device to the external device includes a video signal and a graphic signal.
  • the graphic signal is embedded in the electronic device in addition to the graphic signal included in the content and is used as an on-screen display (OSD) or user interface (UI). There is a case where the graphic signal is further provided.
  • OSD on-screen display
  • UI user interface
  • the two graphic signals as described above may have different characteristics.
  • a graphic signal included in content may follow a high dynamic range (HDR) format
  • a graphic signal embedded in an electronic device may follow a standard dynamic range (SDR) format.
  • HDR high dynamic range
  • SDR standard dynamic range
  • any one graphic signal may be provided to an external device without being processed according to its characteristics, and there is a problem in that image distortion is not generated because the graphic signal transmitted from the external device is not normally expressed.
  • a display device such as a TV is provided with a configuration for processing graphics signals, and in an environment having a mass production facility that produces both a TV and a player, the same graphic processing unit (IC) is used for both devices, thereby increasing productivity and cost. There is a demand to reduce costs.
  • IC graphic processing unit
  • the present invention has been made to solve the above-mentioned problems.
  • the graphic signal is composed of a plurality of layers
  • an electronic device for enabling parallel graphics processing using a GPU operated by execution of software, a control method thereof, and a recording medium is composed of a plurality of layers.
  • the present invention is to provide an electronic device, a control method and a recording medium suitable for a mass production environment with high productivity and low cost by enabling a hardware chip supporting a single path to be simultaneously used in a playback device and a display device. .
  • An electronic device includes a connection portion connectable to a display device; Storage unit; A video processor which processes a video signal; First and second graphic processing units which process graphic signals; Read identification data from the display device connected through the connection unit, and determine the format of the video signal and the graphic signal that can be supported by the display device based on the identification data, the first graphic processing unit in the first graphic signal and the storage unit Converts any one of the stored second graphic signals corresponding to the determined graphic signal format, and controls the graphic signal of a single layer to be output by mixing the first graphic signal and the second graphic signal, and the video processor in the second graphic processor.
  • a processor configured to receive a video signal output from the first graphic processor and a graphic signal output from the first graphic processor, and to transmit an output signal based on the received video signal and the graphic signal to an external device through the connection unit.
  • the first graphic processor may execute a predetermined program and convert one of the first graphic signal and the second graphic signal according to the format of the graphic signal determined by the executed program.
  • the second graphic processing unit may include at least one processing module capable of processing the graphic signal and an output module outputting the output signal to the connection unit.
  • the processor sets the graphic signal received from the first graphic processor to bypass the at least one processing module of the second graphic processor by the reference to the setting information stored in the storage unit, and transmits the graphic signal to the output module.
  • the second graphic processor sets the second graphic processor to bypass the graphic signal with reference to the setting information from the storage. Or it may include at least one of the user input.
  • the first graphic processor may perform color space conversion and gamma conversion on any one of the first graphic signal and the second graphic signal.
  • the first graphic processor may further perform at least one of animation processing, 2D or 3D graphic processing, geometry coordinate processing, acceleration processing, or transparency adjustment on at least one of the first graphic signal and the second graphic signal.
  • the video signal and the first graphic signal are included in the content, and the first graphic signal includes an IG (interactive graphic) and a presentation graphic (PG), and the second graphic signal is a user interface (UI) or OSD (stored in a storage unit). on screen display).
  • the electronic device may include: an optical disc storage unit storing content including a video signal and a first graphic signal; And a disk loader for reading data from the optical disk storage unit.
  • the video processor converts the video signal to correspond to the determined video signal format according to the determination result, and the second graphic processor may generate the output signal by mixing the changed video signal with the graphic signal output from the first graphic processor. have.
  • the first graphic processor and the second graphic processor may be integrally provided.
  • a control method of an electronic device includes reading identification data from a display device connected through a connection unit, and determining a format of a video signal and a graphic signal supported by the display device based on the identification data; Outputting a video signal to a video processor and outputting a first graphic signal associated with the video signal and a second graphic signal stored in the storage to the first graphic processor; Converting, by the first graphic processor, one of the first graphic signal and the second graphic signal to correspond to the determined graphic signal format; Mixing the first graphic signal with the second graphic signal and outputting a single layer graphic signal to the second graphic processor; Receiving a video signal output from the video processor and a graphic signal output from the first graphic processor in the second graphic processor; And transmitting an output signal based on the received video signal and the graphic signal to the display apparatus through the connection unit.
  • the method may further include executing a predetermined program by the first graphic processor and converting any one of the first graphic signal and the second graphic signal according to the format of the graphic signal
  • the second graphic processing unit includes at least one processing module capable of processing the graphic signal and an output module for outputting an output signal to the connection unit, and referring to the setting information stored in the storage unit, the graphic signal received from the first graphic processing unit. And bypassing at least one processing module of the second graphic processor to be delivered to the output module.
  • the second graphic processor may be configured to refer to the setting information from the storage unit.
  • the method may further include setting the signal to bypass.
  • the event may include at least one of booting the electronic device, input of content including a video signal and a graphic signal, or a user input.
  • the converting may include performing color space conversion and gamma conversion on any one of the first graphic signal and the second graphic signal according to the determination result.
  • performing at least one of animation processing, 2D or 3D graphics processing, geometry coordinate processing, acceleration processing, or transparency adjustment on at least one of the first graphics signal and the second graphics signal; can do.
  • the video signal and the first graphic signal may be included in the content, the first graphic signal may include IG and PG, and the second graphic signal may include a UI or an OSD stored in the storage.
  • the method may further include mixing the converted video signal with a graphic signal output from the first graphic processor to generate an output signal.
  • a non-volatile recording medium readable by a computer in which a program of a method executable by a processor of an electronic device according to an embodiment of the present invention is recorded, the method reads identification data from a display device connected through a connection unit.
  • the parallel graphics processing is performed using a GPU operated by the execution of software, thereby outputting the output device.
  • the distortion of the image does not occur.
  • the present invention can be used in the playback device and the display device at the same time can be used for graphics processing composed of a plurality of layers while supporting a single path, there is an effect to increase productivity and reduce costs in a mass production environment.
  • 1 is an example of a system including an electronic device and an external device according to an embodiment of the present invention.
  • FIG. 2 is a diagram illustrating an example of displaying an image based on a video signal and a graphic signal according to an exemplary embodiment of the present invention.
  • FIG. 3 is a diagram illustrating a process of processing a video signal and a graphic signal composed of a plurality of layers in an electronic device according to an embodiment of the present invention.
  • FIG. 4 is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present invention.
  • FIG. 5 is a block diagram illustrating a configuration of a first graphic processing unit and a second graphic processing unit according to an exemplary embodiment of the present invention.
  • FIG. 6 is a block diagram illustrating a configuration of an external device according to an embodiment of the present invention.
  • FIG. 7 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present invention.
  • FIG. 8 is a diagram illustrating an example in which a video signal and a graphic signal are processed in the first embodiment of the present invention.
  • FIG. 9 is a diagram illustrating an example in which a video signal and a graphic signal are processed in the second embodiment of the present invention.
  • FIG. 10 is a diagram showing an example in which a video signal and a graphic signal are processed in the third embodiment of the present invention.
  • FIG. 11 is a diagram showing an example in which a video signal and a graphic signal are processed in the fourth embodiment of the present invention.
  • the 'module' or 'unit' performs at least one function or operation, and may be implemented in hardware or software or a combination of hardware and software, and integrated into at least one module. Can be implemented.
  • at least one of the plurality of elements refers to not only all of the plurality of elements, but also each one or a combination thereof excepting the rest of the plurality of elements.
  • 1 is an example of a system including an electronic device and an external device according to an embodiment of the present invention.
  • an electronic device 100 provides a content providing device that provides image content (hereinafter, also referred to as content) to at least one external device 200, that is, a source device. device).
  • the electronic device 100 may be provided as a player for playing content on the external device 200.
  • the external device 200 operates as a sync device.
  • the external device 200 is wired or wirelessly connected to the electronic device 100 to process data output from the electronic device 100 and display an image based on the data.
  • the external device 200 may include a video, still image, application, on-screen display (OSD), and a user interface (UI) for controlling various operations based on signals / data stored in an internal or external storage medium. Signal) to display on the screen.
  • OSD on-screen display
  • UI user interface
  • connection method of the electronic device 100 and the external device 200 may use various wired / wireless standard interfaces.
  • the electronic device 100 may play or relay content such as an optical disc playback device such as a Blu-ray Disc, a UHD Blu-ray Disc, or a DVD (digital versatile disc), an AV receiver (audio / video receiver), a set-top box, or a streaming device. It includes an overall device for.
  • the electronic device 100 implemented as a streaming device is provided with a receiver for receiving content provided in the form of a file according to real-time streaming from the outside, and the receiver is included in a communication unit (120 of FIG. 4) described later.
  • the external device 200 is provided with a display (290 of FIG. 6) for displaying an image, and includes a display device such as a television (TV), a mobile device, a laptop or a desktop computer. ) Various devices such as a device (or a monitor connected to a computer main body).
  • a display device such as a television (TV), a mobile device, a laptop or a desktop computer.
  • Various devices such as a device (or a monitor connected to a computer main body).
  • the external device 200 may include a television (TV) for processing a broadcast image based on at least one of a broadcast signal, broadcast information, or broadcast data received from a transmission apparatus of a broadcast station.
  • the same display device is included.
  • the external device 200 may wirelessly receive a radio frequency (RF) signal, that is, a broadcast signal transmitted from a broadcasting station, and for this purpose, a tuner for tuning an antenna and a broadcast signal for receiving a broadcast signal for each channel. It may further include.
  • RF radio frequency
  • a broadcast signal may be received through a terrestrial wave, a cable, a satellite, and the like, and the signal supply source in the present invention is not limited to the electronic device 100 or the broadcast station. That is, any device or station capable of transmitting and receiving data may be included in the signal supply source of the present invention.
  • the standard of the signal received from the external device 200 may be configured in various ways corresponding to the implementation form of the device, for example, high definition multimedia interface (HDMI), composite video, component video. By using a super video, SCART, specifications, etc., video signals can be received by wire.
  • HDMI high definition multimedia interface
  • SCART SCART
  • specifications etc.
  • the external device 200 may receive image content by wireless communication from various devices including the electronic device 100 and a server (not shown). According to an embodiment of the present invention, the external device 200 may perform at least one of wireless communication through an access point (AP) or wireless communication directly connected to another device without an AP. For example, the external device 200 may receive content from the electronic device 100 through a wireless communication such as Wi-Fi or Wi-Fi Direct.
  • AP access point
  • Wi-Fi Wireless Fidelity
  • Wi-Fi Direct Wireless Fidelity
  • the display device provided as the external device 200 may operate as a smart TV or an IP (Internet Protocol TV).
  • Smart TVs can receive and display broadcast signals in real time, and have a web browsing function that enables the display of real-time broadcast signals and the search and consumption of various contents through the Internet. to be.
  • Smart TVs also include an open software platform that can provide interactive services to users. Accordingly, the smart TV may provide a user with an application that provides various contents, for example, a predetermined service, through an open software platform.
  • Such applications are applications that can provide various kinds of services, and include, for example, applications that provide services such as SNS, finance, news, weather, maps, music, movies, games, and e-books.
  • the external device 200 may be a mobile device capable of wireless communication with the electronic device 100.
  • the mobile device can be implemented with a variety of portable digital devices.
  • a smart phone a smart pad such as a tablet, a personal digital assistant (PDA), as well as a head mounted display.
  • PDA personal digital assistant
  • the HMD device provides the user with a virtual reality (VR), mixed reality (MR) or augmented reality (AR) environment in which virtual objects are fused to the real world through the display.
  • VR virtual reality
  • MR mixed reality
  • AR augmented reality
  • the type, number, or connection method of the external device 200 is not limited to that shown in FIG. 1.
  • only the mobile device is provided as the external device 200, or both the display device and the mobile device are provided. It may be provided to include two or more display devices or two or more mobile devices.
  • the display device may receive content from the electronic device 100 through wireless communication, or the mobile device may be connected to the electronic device 100 through a wired interface to receive the content.
  • the video signal provided from the electronic device 100 to the external device 200 includes a video signal and a graphic signal.
  • FIG. 2 is a diagram illustrating an example of displaying an image based on a video signal and a graphic signal according to an exemplary embodiment of the present invention.
  • the video signal 310 is displayed as a main image on the display of the external device 200.
  • the graphic signal 320 corresponds to an OSD or a UI (hereinafter referred to as a graphical user interface (GUI)) displayed for transmitting information to a user or controlling various operations.
  • GUI graphical user interface
  • the image according to the graphic signal 320 is displayed on the display 290 by being overlaid or overlayed on top of the image based on the video signal, or the image based on the video signal 310 is displayed. It may be displayed in a separate area separate from the area.
  • the graphic signal 320 includes a first graphic signal 321 provided in the content and a second graphic signal 322 which is internally embedded in the electronic device 100.
  • the second graphic signal includes a graphic necessary for the operation of the electronic device 100, and the external device 200 may use a graphic for controlling the electronic device 100 as well as a graphic provided from the content.
  • Both the signal 321 and the second graphic signal 322 need to be transmitted to the external device 200. That is, in the present invention, both the graphic signal stored in the content and the graphic signal embedded in the playback apparatus itself are effectively processed and displayed.
  • Data for providing the video signal 310 and the first graphic signal 321 is included in content such as a movie stored in a disc such as BD or DVD or provided in a file form such as streaming.
  • the first graphic signal 321 corresponds to subpictures, subtitles, teletext, and the like included in the content.
  • the first graphic signal may include an interactive graphic (IG) and a presentation graphic (PG).
  • FIG. 2 illustrates an example in which the first graphic signal 321 is displayed in such a manner as to cover at least a part of an area of a video signal according to an on-screen graphic function.
  • the first graphic signal 321 is displayed.
  • the form is not limited to FIG.
  • the entire screen is divided into a video signal area and a graphic signal area by a predetermined ratio such as 1: 1 or 2: 1, and the graphic signal does not cover the video signal area.
  • the first graphic signal 321 may be implemented to be displayed in the separated graphic area.
  • the first graphic signal 321 such as a caption may be displayed to overlap the upper portion of the video signal 310.
  • the second graphic signal 322 is an OSD or UI provided by the electronic device 100 itself and includes a menu item.
  • the second graphic signal 321 is embedded in a storage unit (170 of FIG. 4, for example, a flash memory) of the electronic device 100, which will be described later.
  • the video signal and the first graphic signal are configured to have a corresponding format, i.e., a standard, in accordance with the content format thereof.
  • One of the main factors that determine the quality of the content is the contrast on the screen, and the darkest part (eg black) from the lightest part (eg white) on one screen. As the contrast level distributed to) is subdivided, the image becomes clearer.
  • the high dynamic range (HDR) content is expressed by dividing the brightness level up to 1,000 nits of brightness
  • the standard dynamic range (SDR) content is expressed by dividing the brightness level up to 100 nits of brightness.
  • the content according to the HDR or SDR may further include metadata, which is additional data related to an attribute of the content, for example, brightness (brightness), in addition to the video signal and the graphic signal displayed as an image.
  • the video signal and the graphic signal are configured according to the above content format, i.e., the format. That is, in the case of video signals and graphic signals according to the HDR format, gamma has a value according to ST.2084 standard, and colorimetry or color gamut is based on BT.2020 standard. Can have In addition, in the case of a video signal and a graphic signal according to the SDR format, gamma may have a value according to the ST.1886 standard, and colormetry may have a value according to the BT.709 standard.
  • the image signal processed by the electronic device 100 may include a video signal and a graphic signal, and the graphic signal may be composed of a plurality of layers.
  • FIG. 3 is a diagram illustrating a process of processing a video signal and a graphic signal composed of a plurality of layers in an electronic device according to an embodiment of the present invention.
  • the first graphic signal and the second graphic signal to be processed may have different formats.
  • the video signal 410 and the first graphic signal 421 included in the content have a first format (eg, HDR), and the electronic device 100 is used.
  • the second graphic signal 422 embedded therein may have a second format (eg, SDR).
  • the video signal and the first graphic signal are HDR
  • the second graphic signal is SDR
  • the present invention is not limited thereto.
  • the video signal and the first graphic signal may be SDR
  • the second graphic signal may be HDR
  • the video signal and the first graphic signal are HDR
  • the second graphic signal may be It may be configured according to a low dynamic range (LDR) format.
  • LDR low dynamic range
  • the graphic signal 420 when the graphic signal 420 is composed of a plurality of layers having different formats, the graphic signals 421 and 422 need to be processed in parallel / independently corresponding to the formats. .
  • SoC SoC
  • the graphics processing is performed along a single path configured in series.
  • the electronic device 100 configures a graphic processing unit to process graphic signals composed of a plurality of layers in parallel, so that each graphic signal is processed according to its format, so that graphic distortion does not occur. Do not.
  • the electronic device 100 converts one of the first graphic signal and the second graphic signal to correspond to a predetermined graphic format so that the formats of the two graphic signals match, and then the first graphic signal and the second graphic.
  • the signals may be mixed and transmitted to the external device 200.
  • the converting process of the graphic signal includes changing at least one attribute value of the graphic signal.
  • Attribute values to be changed include gamma characteristics (e.g., ST. 2084 gamma to ST.1886 gamma), color gamut characteristics (e.g., BT.2020 color gamut to BT.709 color gamut) And the like.
  • the electronic device 100 determines a format of a video signal and a graphic signal that can be supported by the external device 200 that receives the signal, and according to the determination result, any one of the first graphic signal and the second graphic signal is determined. One can be converted to correspond to the determined graphic signal format.
  • the electronic device 100 may further convert the video signal corresponding to the determined video signal format according to the determination result.
  • the electronic device 100 converts at least one of the first graphic signal and the second graphic signal to correspond to the default format, regardless of the format supported by the external device 200, thereby converting the format of the two graphic signals. Can be matched.
  • the electronic device 100 may further convert the video signal to correspond to the default format.
  • the term 'content', 'image content' or 'content signal' may refer to a video signal corresponding to the content, and providing, transmitting, receiving, processing or converting the content corresponds to the video signal corresponding to the content. Providing, transmitting, receiving, processing or converting.
  • a video signal or a content signal is defined as a term including a video signal and a graphic signal.
  • FIG. 4 is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present invention.
  • the electronic device 100 may include a connection unit 110, a communication unit 120, a video processing unit 130, a first graphic processing unit 140, and a second graphic processing unit. 150, a user input unit 160, a storage unit 170, and a controller 180.
  • connection unit 110 allows the electronic device 100 and the external device 200 to be wired.
  • the electronic device 100 may transmit an image signal to the external device 200 through a wired connection 110.
  • the connection unit 110 may be implemented as a communication circuitry including a data input / output interface in which a communication module (S / W module, chip, etc.) corresponding to various types of communication protocols and a port are combined. .
  • the connection unit 110 basically transmits a signal to the external device 200, but may be provided to transmit and receive a signal in both directions.
  • connection unit 110 is connected to the external device 200 via an HDMI cable, but the connection method is not limited to HDMI.
  • the external device 200 that is wired to the electronic device 100 through the connection unit 110 may be a display device such as a TV, but the present invention is not limited thereto.
  • the electronic device 100 may be wired to the mobile device through the connection unit 110.
  • the communication unit 120 performs wireless communication with at least one external device 200.
  • the electronic device 100 may wirelessly transmit an image signal to the external device 200 through the communication unit 120.
  • the communication unit 120 may be implemented as communication circuitry including a wireless communication module (S / W module, chip, etc.) corresponding to various types of communication protocols.
  • a wireless communication module S / W module, chip, etc.
  • the communication unit 120 includes a wireless LAN unit.
  • the WLAN unit may be connected to the external device 200 wirelessly through an access point (AP) under the control of the processor 180.
  • the wireless LAN unit includes a Wi-Fi communication module.
  • the communication unit 120 includes a short range communication module that supports direct communication between the electronic device 100 and the external device 200 wirelessly without an AP.
  • the near field communication module includes Wi-Fi Direct, Bluetooth, Bluetooth low energy, radio frequency (RF) communication, infrared communication (IrDA), Zigbee, and UWB ( Ultra Wideband) and at least one of NFC (Near Field Communication).
  • the storage unit 170 may include address information (eg, MAC address or IP address) of the external device 200, which is a communication target device. Can be stored.
  • the communication unit 120 is provided to perform wireless communication with the external device 200 by at least one of the wireless LAN unit and the short-range communication module according to the performance.
  • the electronic device 100 may further include a wired communication module such as Ethernet.
  • the communication unit 120 may further include a communication module by various communication methods such as mobile communication such as LTE, EM communication including a magnetic field, visible light communication, sound wave communication, and the like.
  • the electronic device 100 may receive content including a video signal and a graphic signal from an external server through the communication unit 120 in a real time streaming manner.
  • the electronic device 100 may receive content in a streaming manner by using a service such as Neckflix or YouTube.
  • the video processor 130 performs various preset video / audio processing on the video signal output through the connection unit 110 or the communication unit 120.
  • the video processor 130 is provided to process the video signal of the HDR content or the SDR content, but the type of content processed by the video processor 130 is not limited in the present invention.
  • the video processor 130 includes a video processing module 131 capable of converting a video signal of a first format into a video signal of a second format.
  • the video processing module 131 may be implemented as a video processing block in accordance with an extended color gamut YCC (xvYCC) standard that is capable of converting an HDR video signal into an SDR video signal or converting an SDR video signal into an HDR video signal.
  • xvYCC extended color gamut YCC
  • the type of image processing process performed by the video processing unit 130 of the present invention is not limited.
  • the video processor 130 may include components associated with it.
  • the video processor 130 may further include additional components such as a decoder, a scaler, and an encoder.
  • the decoder, scaler, and encoder may be provided as separate components of the electronic device 100 separated from the video processor 130, and the decoder, scaler, and encoder may process graphic signals as well as video signals. have.
  • the video processor 130 may be implemented as a group of individual components capable of independently performing each of these processes, or may be implemented as a form included in a main system-on-chip (SoC) incorporating various functions.
  • the main SoC may include at least one microprocessor or CPU, which is an example of implementing the processor 180 described later.
  • the video processor 130 may be implemented as an image board in which various chipsets, memories, electronic components, wirings, etc., for performing each of these processes are mounted on a printed circuit board (PCB).
  • PCB printed circuit board
  • the video processing unit 130, the first and second graphic processing units 140 and 150, and the processor 180 may be provided in a single image board in the electronic device 100.
  • this is only an example and may be disposed on a plurality of printed circuit boards communicatively connected to each other.
  • the first graphic processor 140 and the second graphic processor 150 are provided to process the graphic signal.
  • FIG. 5 is a block diagram illustrating a configuration of a first graphic processing unit and a second graphic processing unit according to an exemplary embodiment of the present invention.
  • the first graphic processor 140 may include a geometry processor 141 that performs geometry calculation and a pixel processor 142 that processes pixel values according to a formula. , A compositor for mixing and outputting a cache controller 143 managing a cache memory device, a memory management unit (MMU) 144 that manages / controls the access of the first graphic processor 140, and a graphic signal. (compositor) 145.
  • cache controller 143 becomes a level 2 cache controller.
  • the geometry processor 141 is a vertex shader for processing vertices of an object, a vertex shader command processor, and a polygon that the pixel processor 142 draws.
  • a polygon list builder unit a polygon list builder (PLB) command processor, and the like, for generating a list.
  • geometry processor 141 performs three-dimensional geometry operations.
  • the pixel processor 142 uses an edge list reader using a polygon list reader, a reader state word (RSW) unit that tracks the rendering state of each polygon, a vertex loader, and vertex data.
  • a triangle setup unit that computes coefficients for and computes interpolation equations, registers that divide polygons into fragments using coefficients and equations, and for each fragment
  • a fragment shader that computes primitives for the object, a blending unit that blends the current frame buffer value to the computed fragment value, and a variety of tiles for the tiles written to the frame buffer to be fully rendered into the fragment.
  • Tile buffers for performing an operation may be provided in plural, for example, four.
  • the first graphic processor 140 is implemented as a software, that is, a graphic processing unit (GPU) provided to execute a predetermined program.
  • the first graphic processor 140 may perform various graphic processes by reading a program from the storage unit 170 and executing the program. In this process, data in the storage unit 170 (for example, an expression and a look-up table) may be performed. up table).
  • the first graphics processing unit 140 is implemented as a high performance graphics processing apparatus having a high processing speed.
  • the first graphic processor 140 may include a plurality of cores to process a large amount of data at one time.
  • Graphic processing performed by the first graphic processing unit 140 includes conversion of a graphic signal.
  • the first graphic processor 140 may perform color conversion and gamma conversion as conversion of the graphic signal.
  • Color conversion includes color gamut conversion or color space conversion.
  • the first graphic processor 140 performs color conversion through an mathematical operation.
  • the first graphic processor 140 may perform gamma conversion by replacing a value using the lookup table.
  • the first graphic processor 140 may convert at least one of the first graphic signal and the second graphic signal, thereby matching the format of the first and second graphic signals.
  • the compositor 145 mixes, or mixes, the first graphic signal and the second graphic signal and outputs the same to the second graphic processor 150.
  • the first graphic processor 140 may mix the first graphic signal and the second graphic signal in the compositor 145 with reference to an alpha value representing transparency information.
  • the graphics signal mixed in the compositor 145 is composed of a single layer.
  • the first graphic processor 140 converts and mixes at least one of the first graphic signal and the second graphic signal as described above so that their formats match. Therefore, in the mixed graphic signal output through the compositor 145, distortion such as color may not occur in the display process.
  • the first graphic processor 140 may perform animation processing, two-dimensional (2D) or three-dimensional (3D) graphics processing, geometry coordinate processing, acceleration processing, or transparency adjustment on at least one of the first graphics signal and the second graphics signal. At least one of the following may be performed.
  • the animation processing includes movement processing on the stationary UI item.
  • Transparency adjustment may be performed by alpha blending based on transparency information indicating the degree of transparency of the overlapping graphics. Transparency information is commonly referred to as an alpha value, and the alpha value is an example of 8-bit data that can distinguish the degree of transparency of 0 to 255.
  • the first graphic processing unit 140 generates a graphic signal by performing calculation for various types of graphic processing by executing software, and the generated graphic signal is 2 is output to the graphics processor 150.
  • the graphic signal output to the second graphic processor 150 may be composed of a single layer.
  • the second graphic processor 150 may include a plane processing module (GFXP (graphic plane block) 151, a synchronization module 152, a picture quality enhancement module (GRP_QE) 153, and an output module. (GFXP_OUT block) 154.
  • the output module 154 may be composed of a plurality of blocks, for example, a pre-out block and a post-out block.
  • a processing module including a plane processing module 151, a synchronization module 152, and an image quality enhancement module 153 is defined in the second graphic processing unit 150.
  • the plane processing module 151 is configured to display graphic data in accordance with the display size.
  • the plane processing module 151 receives the vertical synchronization signal and the horizontal synchronization signal of the display so that the graphic data is output in a desired position in real time, and thus the plane and the cursor may be represented.
  • the plane may support full screen.
  • the plane processing module 151 may be configured to display the graphic signal.
  • the resolution is scaled up to correspond to 2160x3840, and graphics data (eg, a cursor) is output at a desired coordinate position in real time.
  • the synchronization module 152 receives a synchronization signal as a reference of the display from the outside, and generates an active signal for the plane and the cursor. In addition, the synchronization module 152 may mix the output corresponding to the plane and the cursor, respectively, and generate one graphic signal. The synchronization module 152 is reset by the vertical synchronization signal, and register updating is performed.
  • the image quality enhancement module 153 performs a process for quality enhancement of graphic data.
  • the image quality enhancement module 153 performs graphics processing based on the signal output from the synchronization signal 152.
  • the image enhancement module 153 includes a de-jagging block for smoothing rough edges of the inclined portion to improve graphic quality, a detail enhancement block for improving graphic sharpness, and color space conversion. And a white balance, brightness, and contrast by adjusting a GMA block for performing color gamut conversion, a gamma block for adjusting a gamma value, and an offset and a gain of an output signal.
  • a conbri block may be provided to perform tuning.
  • the second graphic processor 150 of the electronic device 100 is a hardware configuration in which a graphic signal is processed in a single path, and is implemented to process a graphic signal of a single layer / plane. .
  • the first graphic processing unit 140 processes a graphic signal composed of a plurality of layers, and the processing modules 151, 152, and 153 of the second graphic processing unit 150. ) Is controlled to bypass.
  • the output module 154 receives the graphic signal output from the conbri block of the image quality improvement module 153 and the video signal output from the video processing unit 130, and generates an output signal for each scenario to generate an external device 200. To be provided. When the output module 154 is composed of a plurality of blocks, any one block may be selected as an output corresponding to the scenario.
  • the output module 154 may generate an output signal by performing frame rate conversion.
  • the output signal 154 is an example of the graphic Vx1 output.
  • the output module 154 includes a mixer 155 that mixes, or merges, the video signal and the graphic signal.
  • the mixer 155 when the output module 154 is composed of a plurality of blocks, the mixer 155 is implemented as a mixer PRE_MIX provided in any one block, for example, a preout block.
  • the output module 154 when the electronic device 100 is a Blu-ray playback device, the output module 154 further includes a formatter 156.
  • the formatter 156 When the output module 154 is composed of a plurality of blocks, the formatter 156 is implemented with a formatter PRE_BD_FMT provided in one block, for example, a preout block.
  • the formatter 156 supports a single channel input and has detailed configurations such as YUV to RGB, RGB to RGB, RGB to YUV, Dither, Data Monitor, and YUV Formatter.
  • the second graphic processor 150 operates to bypass the processing modules 151, 152, and 153 by the graphic signal received from the first graphic processor 140.
  • the processor 180 when the processor 180 detects that a predetermined event occurs, the processor 180 bypasses the processing modules 151, 152, and 153 of the second graphic processor 150 with reference to the setting information of the storage unit 170. Set to mode.
  • the processing modules 151, 152, and 153 of the second graphic processor 150 refer to the setting information of the storage 170 directly. Can be set to bypass mode.
  • the event may include booting of the electronic device 100, input of content including a video signal and a graphic signal (for example, reception of content from the outside by streaming), user input (for example, content stored on a disk). User input, etc.) to play the data.
  • content including a video signal and a graphic signal
  • user input for example, content stored on a disk.
  • the plane processing module 151, the synchronization module 152, and the image quality improvement module 153 of the second graphic processor 150 may have a plurality of modes operated in response to each scenario, and the graphic signal corresponds to the setting mode. Control to perform the processing / conversion (e.g., color conversion, gamma conversion, etc.).
  • the present invention is not limited to the above-described embodiment, so that each module 151, 152, 153 in the second graphic processor 150 may operate according to a setting regardless of a mode.
  • each processing module (151, 152, 153) has a bypass mode, the module set to the bypass mode can output to the next block without processing the input graphic signal.
  • the electronic device 100 includes a second graphics processor 150 provided with hardware graphics processing means having a single path configured in series, and is provided by the first graphics processor 140 without distortion. Since the graphic layer can be processed, it can be used in display devices such as TVs. That is, the second graphic processor 150 of the electronic device 100 of the present invention may use a graphic chip for TV. Thus, since the hardware chip widely used in the TV can be applied to the playback apparatus, its utilization is improved.
  • first graphic processor 140 and the second graphic processor 150 may be provided integrally, but are not limited thereto. That is, in one embodiment, the first graphic processor 140 and the second graphic processor 150 may be implemented to be included in a single chip, but in another embodiment, the first graphic processor 140 and the second graphic processor 140 may be implemented. Each 150 may be implemented in the form of a separate chip.
  • the video processor 130, the first graphic processor 140, and the second graphic processor 150 may be integrally provided. Since the integrated graphics chip (SoC) can be used simultaneously in the playback apparatus 200 and the display apparatus 100, it is suitable to apply to a mass production environment.
  • SoC integrated graphics chip
  • the user input unit 160 transmits various preset control commands or unlimited information to the processor 180 by a user's input.
  • the user input unit 160 includes a keypad (or an input panel) including buttons such as a power key and a menu key provided in the main body of the electronic device 100.
  • the user input unit 160 includes an input device for generating a predetermined command / data / information / signal to transmit the electronic device 100 to the electronic device 100 so as to remotely control the electronic device 100.
  • the input device is separated from the main body of the electronic device 100, such as a remote control, to receive a user input.
  • the remote controller may be provided with a touch sensing unit for receiving a user's touch input and / or a motion sensing unit for sensing its own motion by the user.
  • the input device includes a terminal device such as a smart phone installed with a remote control application, and in this case, the user's touch input through the touch screen can be received.
  • the input device may be implemented as an integrated remote controller capable of controlling both the electronic device 100 and the external device 200.
  • the input device may perform wireless communication with the main body of the electronic device 100, and the wireless communication may include Bluetooth, infrared communication, RF communication, WLAN, and Wi-Fi Direct.
  • the user input unit 160 may further include a voice input unit for receiving a voice / sound spoken by the user.
  • the voice input unit may be implemented as a microphone for receiving a voice signal, and may be installed in a main body or a remote controller of the electronic device 100.
  • the storage unit 170 is configured to store various data of the electronic device 100.
  • the storage unit 170 may retain data even when power supplied to the electronic device 100 is cut off, and may be provided as a writable nonvolatile memory (Writable ROM) to reflect changes. That is, the storage unit 170 may be provided with at least one of a flash memory, an EPROM, or an EEPROM.
  • the storage unit 170 may further include a volatile memory such as DRAM or SRAM in which the read or write speed of the electronic device 100 is faster than that of the nonvolatile memory.
  • the data stored in the storage unit 170 includes, for example, an operating system for driving the electronic device 100, and various software, programs, applications, image data, additional data, and the like executable on the operating system.
  • the storage unit 170 stores a second graphic signal, which is a built-in graphic provided by the electronic device 100 itself.
  • the storage unit 170 is a program executed by the first graphic processor 140 to perform the graphic signal conversion
  • the processor 180 is executed by the processing module 151 of the second graphic processor 150.
  • a flash memory for storing a program for mode setting for the second and second 152 and 153.
  • the storage unit 170 includes an optical disc storage medium such as Blu-ray, DVD, etc. in which content is stored.
  • the type of content recorded on the optical disk storage medium is not limited, and an example is an Ultra High Definition (UHD) Blu-ray Disc (BD) in which HDR content is stored.
  • UHD Ultra High Definition
  • BD Blu-ray Disc
  • the electronic device 100 is provided with a disc loader which reads the stored data by rotating the optical disc when content is played back, and uses a laser from a rotating disc, that is, a UHD BD, BD, DVD, etc., to output a video signal and a graphic signal.
  • Read digital content including.
  • the processor 180 controls to operate various components of the electronic device 100.
  • the processor 180 executes a control program (or instruction) to perform such a control operation.
  • the processor 180 includes at least one general-purpose processor that loads at least a part of the control program into the volatile memory from the nonvolatile memory in which the control program is installed, and executes the loaded control program, for example, a CPU (Central Processing) It may be implemented as a unit, an application processor (AP), or a microprocessor.
  • CPU Central Processing
  • AP application processor
  • the processor may include single core, dual core, triple core, quad core, and multiple cores thereof.
  • the processor includes a subprocessor operating in a plurality of processors, for example, a main processor and a sleep mode (for example, only standby power is supplied and does not operate as a content providing device). It may include.
  • the processor, the ROM, and the RAM are interconnected through an internal bus, and the ROM and the RAM are included in the storage 170.
  • the processor which is an example of implementing the processor 180 in the present invention, may be implemented as a form included in a main SoC mounted on a PCB embedded in the electronic device 100.
  • the main SoC may further include a video processor 130, a first graphics processor 140, and / or a second graphics processor 150.
  • the control program may include program (s) implemented in at least one of a BIOS, a device driver, an operating system, firmware, a platform, and an application (application).
  • the application program may be installed or stored in the electronic device 100 at the time of manufacture of the electronic device 100, or may be received based on data received by receiving data of the application program from an external source in future use. It may be installed in the electronic device 100. Data of the application program may be downloaded to the electronic device 100 from an external server such as an application market. Such an external server is an example of the computer program product of the present invention, but is not limited thereto.
  • the operation of the processor 180 may be implemented as a computer program stored in a computer program product (not shown) provided separately from the electronic device 100.
  • the computer program product includes a memory in which instructions corresponding to the computer program are stored, and a processor.
  • the instruction when executed by the processor, converts the video signal or the graphic signal corresponding to the content of the first format into a video signal or the graphic signal corresponding to the content of the second format and transmits the same to the at least one external device 200. It includes.
  • the first graphics processing unit 140 may be implemented as a GPU that can read and execute a control program independently.
  • the GPU 140 executes instructions stored in a memory and corresponds to a graphic signal corresponding to a first type of content. May be converted into a graphic signal corresponding to the content of the second format. Accordingly, the electronic device 100 may process graphics signals in parallel using a GPU operated by execution of software.
  • the electronic device 100 may download and execute a computer program stored in a separate computer program product to perform an operation of the processor 180.
  • FIG. 6 is a block diagram illustrating a configuration of an external device according to an embodiment of the present invention.
  • the external device 200 includes a display device such as a television, and receives the image signal provided from the electronic device 100 so as to be displayed on the display 290.
  • the external device 200 may be a wearable device such as a mobile device such as a smartphone or an HMD device that receives an image signal from the electronic device 100.
  • the configuration shown in FIG. 6 is applicable to the external device 200 implemented in various forms, but some configurations may be added or excluded according to the characteristics of the device itself, or the implementation form of the specific configuration may be different.
  • the implementation manner of the display 290 provided in the external device 200 is not limited.
  • a liquid crystal, a plasma, a light-emitting diode, and an organic light-emitting diode Light emitting diodes, surface-conduction electron-emitters, carbon nano-tubes, nano-crystals and the like can be implemented in various display methods.
  • the display unit may further include additional components (drive units) according to the implementation manner.
  • the display 290 is implemented as a touch screen for detecting a user's touch input.
  • the touch input includes single touch and multi touch, and may include various gestures or motion inputs such as tap, click, and directional drag or flick.
  • the touch screen includes a touch pad positioned on an upper portion of a panel on which an image is displayed.
  • a touch screen displays a user selectable user interface (UI), also referred to as a graphical user interface (GUI).
  • UI user selectable user interface
  • GUI graphical user interface
  • the touch pad and the UI are included in the user input unit 240.
  • the UI may include menu items of the external device 200 or the electronic device 100.
  • the display 290 of the external device 200 displays a video signal, a first graphic signal, and a second graphic signal included in content, and the second graphic signal is wired or wirelessly connected to the electronic device 100.
  • the external device 200 In addition to the display 290, the external device 200 according to an embodiment of the present invention, as shown in FIG. 6, the connection unit 210, the communication unit 220, the image processing unit 230, the graphic processing unit 250, The user input unit 260, the storage unit 270, and the processor 260 are provided. However, not all of the above components are essential components, and therefore, the external device 200 may be implemented in a form in which at least some of the above components are excluded. In addition, in addition to the above-described configuration, the external device 200 may further include an additional component, for example, a tuner for tuning a broadcast signal corresponding to a channel.
  • an additional component for example, a tuner for tuning a broadcast signal corresponding to a channel.
  • the graphic processor 250 of the external device 200 may correspond to an implementation form of the second graphic processor 150 of the electronic device 100.
  • the storage unit 250 may store various information of the external device 200.
  • the storage 250 is provided with an EDID area in which extended display identification data (EDID) is stored.
  • EDID region is implemented by an electrically erasable and programmable read only memory (EEPROM) provided in correspondence with the connection unit 210 of the external device 200, for example, an HDMI interface, and the EEPROM may be formed in the manufacturing process of the external device 200.
  • the EDID may be written while the program / application is installed or executed in the external device 200.
  • the electronic device 100 receives an information package such as a resolution, a horizontal frequency, a vertical frequency, a color gamut, and a luminance range that can be supported from the external device 200 as an EDID, and supports a video signal and a graphic that can be supported by the external device 200. You can determine the format of the signal. The formats of the video signal and the graphic signal that can be supported correspond to a range of video signals that the external device 200 can represent.
  • Protocol for transmitting EDID is a display data channel (DDC) transmission scheme established by VESA.
  • DDC display data channel
  • the external device 200 may have a plurality of ports as the connection unit 210, and an EEPROM in which corresponding EDIDs are stored may be provided for each port.
  • the electronic device 100 and the external device 200 are connected through the respective connection parts 110 and 210, when the EDID request signal is transmitted from the electronic device 100, EDID is loaded from the EPROM of the corresponding port so that both connection parts are connected.
  • the data is transmitted to the electronic device 100 through the 210 and 110.
  • the processor 180 of the electronic device 100 applies a hot plug detect signal to the connection unit 110, that is, the HDMI interface, so that the EDID request signal is transmitted to the external device 200. You can read the information.
  • the electronic device 100 may further receive data on a format of a video signal and a graphic signal which can be supported by the external device 200 wirelessly connected through the communication unit 120.
  • the external device 200 may store data about the range of the image signal that can be expressed in the storage unit 250, that is, identification information, and the method of storing the data may be the same as the EDID corresponding to the connection unit 210. It is not limited to this.
  • each component provided in the external device 200 corresponds to an implementation form of the component having the same name as the electronic device 100. Therefore, the same name is used for a component that performs the same operation as the electronic device 100 in the external device 200, and detailed description thereof will be omitted in order to avoid duplicate description.
  • FIG. 7 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present invention.
  • the electronic device 100 receives a user input for playing predetermined content (501).
  • the processor 180 of the electronic device 300 may receive a user input through a remote controller provided as the user input unit 160, and the received user input may be connected to the reproduced content and the wired or wireless connection of the content. It may include a command to output from the external device 200 (for example, a display device such as a TV).
  • the content to be reproduced is content stored in an optical disc such as a Blu-ray provided as the storage unit 170 and includes a video signal and a first graphic signal according to a predetermined format.
  • a second graphic signal different from the first graphic signal included in the content may be internally embedded.
  • the first graphic signal and the second graphic signal may be composed of a plurality of layers having different formats. Specific examples in which the graphic signal is composed of a plurality of layers will be described in more detail with reference to the embodiments of FIGS.
  • the processor 180 of the electronic device 100 determines a format of a video signal and a graphic signal supported by the wired or wirelessly connected external device 200 (502).
  • the format that can be supported refers to determining whether or not the display range according to its own format can be normally displayed when the video signal and the graphic signal of a predetermined content format are processed by the external device 200 and displayed as an image.
  • the electronic device 100 may determine whether the television connected through the connection unit 110 is an HDR TV or an SDR TV.
  • the processor 180 loads identification data related to the expression range from the storage unit 270 of the connected external device 200 to obtain information of the external signal 200, and based on the obtained information, The format of the video signal and the graphic signal that can be supported in 200 may be determined.
  • the identification data related to the expression range of the external device 200 may be stored in the storage unit 270 at the time of manufacturing the external device 200, such as an EDID, or at a time when a predetermined program / application is installed or executed in the external device 200. Can be recorded / stored in a predetermined area.
  • the time point at which the identification data is loaded is not limited, and may include booting the electronic device 100, booting the external device 100, connecting or establishing a connection with the external device 100, or a user input. Can be.
  • the electronic device 100 converts at least one of the video signal and the first and second graphic signals based on the determination result of step 502 (503).
  • the video signal is converted by the video processor 130
  • the first graphic signal or the second graphic signal is converted by the first graphic processor 140.
  • the first graphic processor 140 may convert one of the first graphic signal and the second graphic signal to correspond to the format of the graphic signal determined in operation 502.
  • the video processor 130 may further convert the video signal to correspond to the format of the video signal determined in step 502.
  • the first graphic processor 140 may convert both the first graphic signal and the second graphic signal to correspond to the format of the graphic signal determined in operation 502.
  • the first graphic processor 140 may be implemented as a high performance GPU capable of high-speed processing of data signals, and the first and second graphic signals may be simultaneously converted and processed by various methods such as simultaneous / time division / parallel. Can be.
  • the video processor 130 may further convert the video signal to correspond to the format of the video signal determined in step 502.
  • the video signal, the first graphic signal, and the second graphic signal may have the same format.
  • the first graphic processor 140 may further perform other graphic processing (eg, animation processing, transparency adjustment, etc.) on the first graphic signal and the second graphic signal in addition to the conversion. Specific examples of converting the graphic signal or the video signal will be described in more detail with reference to the embodiments of FIGS. 8 to 10 to be described later.
  • the first graphic processor 140 mixes the first graphic signal and the second graphic signal and outputs the second graphic signal to the second graphic processor 150 (504).
  • the mixed graphic signal to be output has the same format in step 503, even if it is mixed and output as a graphic signal of a single layer, distortion does not occur in color or the like.
  • the second graphic processor 150 receives the mixed graphic signal from the first graphic processor 140 in step 504, merges the video signal, and merges the video signal to the external device 200 through the connection unit 110 or the communication unit 1200. That is, the second graphic processor 150 receives the video signal output from the video processor 130 and the graphic signal output from the first graphic processor 140, and receives the received video signal and graphic.
  • the output signal (mixed signal) based on the signal is controlled to be transmitted to the external device 200 through the connection unit 110 or the communication unit 120.
  • the mixed graphic signal received from the first graphic processor 140 is It passes through the processing modules 151, 152, and 153 set in the pass mode, that is, bypasses them, and passes them to the mixer 155 of the output module 154, where they are mixed with the video signal.
  • the external device 200 receives the merged signal, that is, the image signal, in step 505 through the connection unit 210 or the communication unit 220, and controls the received image signal to be displayed on the display 290 (506). . Accordingly, both the video signal and the graphic signal are processed and displayed in accordance with the specification of the external device 200.
  • the electronic device 100 determines / determines a format of a video signal and a graphic signal supported by the external device 200, and converts a signal based on the determination result.
  • the present invention is not limited thereto.
  • the electronic device 100 converts at least one of the video signal and the first and second graphic signals into a predetermined default format without determining a format of a signal supported by the external device 200.
  • the video signal, the first graphic signal, and the second graphic signal may be implemented to have the same format.
  • the mixed graphic signal is bypassed by the processing module of the second graphic processor 140 and transferred to the mixer 155 as an example. Since the graphic processing that may be performed by the processor 140 is not limited to the conversion, the second graphic processor 140 may perform post processing on the graphic signal mixed by the compositor 145 so as to perform the mixer 155. Embodiments in the form of () will also be implemented.
  • FIG. 8 is a diagram illustrating an example in which a video signal and a graphic signal are processed in the first embodiment of the present invention.
  • the electronic device 100 that performs the operation in the first embodiment is a playback device in which an SDR graphic signal is embedded, and the external device 200 displaying an image displays an HDR image.
  • Each TV is implemented as a possible TV, and the user may play the HDR content stored in the optical disc 171 in the electronic device 100.
  • the HDR content to be reproduced includes a video signal 610 in HDR format and a graphic signal (first graphic signal) 621 in HDR format.
  • the storage unit 170 of the electronic device 100 includes an SDR type graphic signal (second graphic signal) 622. That is, in the first embodiment, the graphic signal 620 is composed of a plurality of layers having different formats.
  • the processor 180 of the electronic device 100 bypasses the processing modules 151, 152, and 153 of the second graphic processor 150 with reference to setting information of the storage unit 170. Set to.
  • the video signal 610 is transmitted to the video processor 130 with the first graphic signal 621.
  • the two graphic signals 622 are input to the first graphic processor 140.
  • the processor 180 determines the format of the video signal and the graphic signal supported by the external device 200 implemented as the HDR TV as HDR using the identification data acquired from the external device 200.
  • the video processor 130 does not perform conversion on the video signal 610 based on the determination result as described above. That is, since the video signal 610 is configured to have an HDR format that can be supported by the external device 200, the video signal 610 does not need to be converted to a color space or a gamma value. Accordingly, the video signal 610 is processed to bypass the video processing module 131 (for example, the xvYCC processing block) provided to perform the conversion, as shown in FIG. The mixer 155 is transferred to the mixer 155 provided in the output module 154 of the graphic processor 150.
  • the video processing module 131 for example, the xvYCC processing block
  • the video processor 130 of the electronic device 100 of the present invention may be described in detail. As described with reference to FIG. 4, the video signal 610 may not bypass all the blocks in the video processor 130 since the video signal 610 may be implemented to include various video signal processing blocks such as a decoder.
  • the first graphic processor 140 converts the second graphic signal 622 to correspond to the HDR format based on the determination result as described above.
  • the first graphic processor 140 executes a program read from the storage unit 170 to perform color space conversion and gamma conversion. ST.2084 conversion) can be performed separately.
  • the first graphic processor 140 includes a transparency process using an alpha value for the second graphic signal (a process of removing the influence of the alpha value or returning the alpha value to the previous one). ) Can be performed further.
  • the first graphic processor 140 does not perform conversion on the first graphic signal 621 based on the determination result as described above. That is, since the first graphic signal 621 is configured to have an HDR format that can be supported by the external device 200, the first graphic signal 621 does not need to be converted to a color space or a gamma value.
  • the first graphic signal 621 and the converted second graphic signal 622 are mixed by the compositor 145 to be output to the second graphic processor 150 as a graphic signal of a single layer according to the HDR format.
  • the second graphic processor 150 receives the mixed HDR graphic signal from the first graphic processor 140, and the mixed HDR graphic signal is set by the processor 180 to the bypass mode by the processing module 151, 152, or 153. ), That is, bypasses and is passed to the mixer 155.
  • the mixer 155 mixes or merges the HDR graphic signal transmitted as described above with the HDR video signal input from the video processor 130 and outputs the merged HDR video signal to the HDR TV which is the external device 200.
  • the image signal composed of the HDR video and the HDR graphic is transmitted to the external device 200 so that a high quality image can be displayed without distortion caused by the color of the image.
  • independent / parallel processing of the graphic signal 620 having a plurality of layers may be performed by the first graphic processor 140 operating on a software basis in the electronic device 100. do.
  • FIG. 9 is a diagram illustrating an example in which a video signal and a graphic signal are processed in the second embodiment of the present invention.
  • the electronic device 100 operating in the second embodiment is a playback device in which an SDR graphic signal is embedded, and the external device 200 displaying an image displays an SDR image.
  • Each TV is implemented as a possible TV, and the user may play the HDR content stored in the optical disc 171 in the electronic device 100.
  • the HDR content to be reproduced includes a video signal 710 in HDR format and a graphic signal (first graphic signal) 721 in HDR format.
  • the storage unit 170 of the electronic device 100 includes an SDR type graphic signal (second graphic signal) 722. That is, in the second embodiment, the graphic signal 721 is composed of a plurality of layers having different formats.
  • the processor 180 of the electronic device 100 bypasses the processing modules 151, 152, and 153 of the second graphic processor 150 with reference to the setting information of the storage unit 170. Set to.
  • the video signal 710 is connected to the video processor 130 with the first graphic signal 721.
  • the two graphic signals 722 are input to the first graphic processor 140.
  • the processor 180 determines, as SDR, a format of a video signal and a graphic signal that can be supported by the external device 200 implemented as an HDR TV using the identification data obtained from the external device 200.
  • the video processing module 131 (for example, the xvYCC processing block) of the video processing unit 130 performs color space conversion (2020 RGB to 709 RGB conversion) and gamma conversion on the video signal 710 based on the determination result as described above. ST.2084 to ST.1886 conversion), respectively.
  • gamma conversion may be performed by a plurality of steps of ST.2084 to leaner de-gamma conversion and linear to ST.1886 gamma conversion, as shown in FIG. 9 (b).
  • the converted video signal 610 is transmitted to the mixer 155 provided in the output module 154 of the second graphic processor 150.
  • the first graphic processor 140 converts the first graphic signal 721 to correspond to the SDR format based on the determination result as described above.
  • the first graphic processor 140 executes a program read from the storage unit 170 to perform color space conversion (2020 RGB to 709 RGB conversion) and gamma conversion (ST.2084 to). ST.1886 conversion) can be performed separately.
  • the first graphic processor 140 may further perform transparency processing using an alpha value with respect to the first graphic signal.
  • the first graphic processor 140 does not perform conversion on the second graphic signal 722 based on the determination result as described above. That is, since the second graphic signal 722 is configured to have an SDR format that can be supported by the external device 200, the second graphic signal 722 does not need to be converted to a color space or a gamma value.
  • the electronic device 1 selectively converts the graphic signal in accordance with the specification of the external device 200 as described above, so that image distortion is not generated in the external device 200.
  • the converted first graphic signal 721 and the second graphic signal 722 are mixed by the compositor 145 to be output to the second graphic processor 150 as a single layer graphic signal according to the SDR format.
  • the second graphic processor 150 receives the mixed SDR graphic signal from the first graphic processor 140, and the mixed SDR graphic signal is set in the bypass mode by the processor 180 to be the processing module 151, 152, or 153. ), That is, bypasses and is passed to the mixer 155.
  • the mixer 155 mixes, or merges, the SDR graphic signal transmitted as described above with the SDR video signal input from the video processor 130 and outputs the merged SDR graphic signal to the SDR TV which is the external device 200.
  • the image signal consisting of SDR video and SDR graphics is transmitted to the external device 200, so that the image can be displayed normally without distortion generated in the color of the image.
  • independent / parallel processing of the graphic signal 720 having a plurality of layers may be performed by the first graphic processor 140 operating on a software basis in the electronic device 100. do.
  • FIG. 10 is a diagram showing an example in which a video signal and a graphic signal are processed in the third embodiment of the present invention.
  • the electronic device 100 operating in the third embodiment is a playback device in which an HDR graphic signal is embedded, and the external device 200 displaying an image displays an SDR image.
  • Each TV is implemented as a possible TV, and the user may play the HDR content stored in the optical disc 171 in the electronic device 100.
  • the HDR content to be reproduced includes a video signal 810 in HDR format and a graphic signal (first graphics signal) 821 in HDR format.
  • the storage unit 170 of the electronic device 100 includes a graphic signal (second graphic signal) 822 in an HDR format. That is, in the third embodiment, the graphic signals 620 are composed of a plurality of layers having the same format.
  • the processor 180 of the electronic device 100 bypasses the processing modules 151, 152, and 153 of the second graphic processor 150 with reference to the setting information of the storage unit 170. Set to.
  • the video signal 810 is transmitted to the video processor 130 and the first graphic signal 821 and the first graphic signal 821.
  • the two graphic signals 822 are input to the first graphic processor 140.
  • the processor 180 determines, as SDR, a format of a video signal and a graphic signal that can be supported by the external device 200 implemented as an HDR TV using the identification data obtained from the external device 200.
  • the video processing module 131 (eg, the xvYCC processing block) of the video processing unit 130 performs color space conversion (2020 RGB to 709 RGB conversion) and gamma conversion on the video signal 810 based on the determination result as described above. ST.2084 to ST.1886 conversion), respectively.
  • gamma conversion may be performed by a plurality of steps of ST.2084 to leaner de-gamma conversion and linear to ST.1886 gamma conversion, as shown in FIG. 10 (b).
  • the converted video signal 810 is transmitted to the mixer 155 provided in the output module 154 of the second graphic processor 150.
  • the first graphic processor 140 converts the second graphic signal 622 to correspond to the HDR format based on the determination result as described above.
  • the first graphic processor 140 executes a program read from the storage unit 170 to perform color space conversion (2020 RGB to 709 RGB conversion) and gamma conversion (ST. 2084 to). ST.1886 conversion) can be performed separately.
  • the first graphic processor 140 converts the first graphic signal 821 to correspond to the SDR format based on the determination result as described above. In addition, the first graphic processor 140 converts the second graphic signal 822 to correspond to the SDR format based on the determination result as described above.
  • the first graphic processor 140 executes a program read from the storage unit 170 to execute color programs for the first and second graphic signals 821 and 822, respectively. Conversion (2020 RGB to 709 RGB conversion) and gamma conversion (ST.2084 to ST.1886 conversion) can be performed in parallel.
  • the first graphic processor 140 may further perform transparency processing using alpha values on the first and second graphic signals 821 and 822.
  • the converted first graphic signal 821 and the second graphic signal 822 are mixed by the compositor 145 to be output to the second graphic processor 150 as a graphic signal of a single layer according to the SDR format.
  • the second graphic processor 150 receives the mixed SDR graphic signal from the first graphic processor 140, and the mixed SDR graphic signal is set in the bypass mode by the processor 180 to be the processing module 151, 152, or 153. ), That is, bypasses and is passed to the mixer 155.
  • the mixer 155 mixes, or merges, the SDR graphic signal transmitted as described above with the SDR video signal input from the video processor 130 and outputs the merged SDR graphic signal to the SDR TV which is the external device 200.
  • the image signal consisting of SDR video and SDR graphics is transmitted to the external device 200, so that the image can be displayed normally without distortion generated in the color of the image.
  • the third embodiment as described above differs from the first and second embodiments in that both the first graphic signal and the second graphic signal are converted in the format (HDR-> SDR).
  • independent / parallel processing of the graphic signal 820 having a plurality of layers may be performed by the first graphic processor 140 operating on a software basis in the electronic device 100.
  • FIG. 11 is a diagram showing an example in which a video signal and a graphic signal are processed in the fourth embodiment of the present invention.
  • video content including a video signal and a graphic signal is received by the electronic device 100 in the form of real time streaming.
  • the electronic device 100 operating in the fourth embodiment is a playback device in which an SDR graphic signal is embedded, and the external device 200 displaying an image displays an HDR image.
  • an SDR graphic signal is embedded
  • the external device 200 displaying an image displays an HDR image.
  • Each can be implemented as a possible TV.
  • the streaming SDR content to be played includes an SDR format video signal 910 and an SDR format graphics signal (first graphics signal) 921.
  • the storage unit 170 of the electronic device 100 includes an SDR type graphic signal (second graphic signal) 922. That is, in the fourth embodiment, the graphic signals 620 are composed of a plurality of layers having the same format.
  • the processor 180 of the electronic device 100 refers to the setting information of the storage unit 170 and transfers the processing modules 151, 152, and 153 of the second graphic processor 150 to the output device. Set the conversion mode accordingly.
  • the HDR to SDR conversion mode is an example of the conversion mode thus set.
  • the processor 180 uses the identification data obtained from the external device 200 to determine the external device 200. Determines the formats of video and graphics signals that can be supported.
  • the external device 200 is an HDR TV
  • a supportable format is determined as SDR.
  • the processor 180 sets a mode of the processing modules 151, 152, and 153 of the second graphic processor 150 to an SDR to DDR conversion mode.
  • the processing modules 151, 152, and 153 of the second graphic processing unit 150 are set to a mode for converting a graphic signal instead of a bypass module, this information is transmitted to the first graphic processing unit 140. 1
  • the graphic processor 140 does not perform an operation related to the conversion of the graphic signal.
  • the video signal 910 is sent to the video processor 130, and the first graphic signal 921 and the first graphic signal 921 are received.
  • the two graphic signals 922 are input to the first graphic processor 140.
  • the video processing module 131 (eg, the xvYCC processing block) of the video processing unit 130 performs color space conversion and gamma conversion on the SDR video signal 710 based on the determination result as described above. (ST.1886 to ST.2084 conversion) can be performed respectively.
  • gamma conversion may be implemented to sequentially perform ST.1886 to leaner de-gamma conversion and linear to ST.2084 gamma conversion, as shown in FIG. 11 (b).
  • the converted HDR video signal 610 is transmitted to the mixer 155 provided in the output module 154 of the second graphic processor 150.
  • the first graphic processor 140 may apply to the first graphic signal 921 and the second graphic signal 922 based on the mode settings of the processing modules 151, 152, and 153 of the second graphic processor 150 as described above. No conversion is done for However, as described with reference to FIG. 5, the first graphic processing unit 140 is implemented to have various graphic processing functions such as animation processing. As shown in FIG. 11B, a second graphic displayed as a UI is shown. An animation process may be performed on the graphic signal 922.
  • the first graphic signal 621 and the second graphic signal 622 are mixed by the compositor 145 and output to the second graphic processor 150.
  • the second graphic processor 150 receives the mixed SDR graphic signal from the first graphic processor 140, and the mixed SDR graphic signal is HDR by the processing modules 151, 152, and 153 set to the SDR to DDR conversion mode. It is converted into a graphic signal and transmitted to the mixer 155.
  • the mixer 155 mixes or merges the HDR graphic signal transmitted as described above with the HDR video signal input from the video processor 130 and outputs the merged HDR video signal to the HDR TV which is the external device 200.
  • the image signal composed of the HDR video and the HDR graphic is transmitted to the external device 200 so that a high quality image can be displayed without distortion caused by the color of the image.
  • the first graphic processing unit 140 operating on a software basis may be configured as a UI. Performs animation processing for the graphic signal and converts the graphic signal 920 by the second graphic processor 150 having a hardware configuration along a single processing path, thereby making use of all available resources. Can be processed.
  • the electronic device 100 receives the video signal and the first and second graphic signals in the SDR format, and the external device 200 displaying the image is an HDR TV.
  • the format of the content provided by streaming in the present invention, the format of the built-in UI, or the type of TV is not limited thereto.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

La présente invention concerne un dispositif électronique, un procédé de commande associé et un support d'enregistrement. Le dispositif électronique comprend : une unité de connexion ; une unité de stockage ; une unité de traitement vidéo pour traiter un signal vidéo ; une première et une seconde unité de traitement graphique pour traiter des signaux graphiques ; et un processeur pour déterminer des formats pouvant être pris en charge d'un signal vidéo et d'un signal graphique sur la base de données d'identification d'un dispositif d'affichage connecté par l'intermédiaire de l'unité de connexion, pour commander la première unité de traitement graphique pour convertir un signal parmi un premier signal graphique associé au signal vidéo et un second signal graphique stocké dans l'unité de stockage de telle sorte qu'un signal parmi le premier signal graphique et le second signal graphique correspond au format déterminé du signal graphique, et pour combiner et délivrer le premier signal graphique et le second signal graphique, pour permettre à la seconde unité de traitement graphique de recevoir le signal vidéo délivré par l'unité de traitement vidéo et le signal graphique délivré par la première unité de traitement graphique et pour commander un signal de sortie sur la base du signal vidéo reçu et du signal graphique devant être transmis à un dispositif externe par l'intermédiaire de l'unité de connexion.
PCT/KR2019/005120 2018-05-18 2019-04-29 Dispositif électronique, procédé de commande associé et support d'enregistrement Ceased WO2019221423A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020180057289A KR20190132072A (ko) 2018-05-18 2018-05-18 전자장치, 그 제어방법 및 기록매체
KR10-2018-0057289 2018-05-18

Publications (1)

Publication Number Publication Date
WO2019221423A1 true WO2019221423A1 (fr) 2019-11-21

Family

ID=68540415

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/005120 Ceased WO2019221423A1 (fr) 2018-05-18 2019-04-29 Dispositif électronique, procédé de commande associé et support d'enregistrement

Country Status (2)

Country Link
KR (1) KR20190132072A (fr)
WO (1) WO2019221423A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110223216A (zh) * 2019-06-11 2019-09-10 西安博图希电子科技有限公司 一种基于并行plb的数据处理方法、装置及计算机存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102806665B1 (ko) * 2020-06-26 2025-05-13 삼성전자주식회사 전자 장치 및 그 제어 방법
KR20220056404A (ko) * 2020-10-28 2022-05-06 삼성전자주식회사 디스플레이장치 및 그 제어방법

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120034574A (ko) * 2010-10-01 2012-04-12 삼성전자주식회사 디스플레이 장치 및 신호 처리 장치와, 그 방법들
US8564622B1 (en) * 2012-04-05 2013-10-22 Lockheed Martin Corporation Image generation device for generating multiple image streams
JP2014085861A (ja) * 2012-10-24 2014-05-12 Canon Inc 表示システム、端末装置、表示装置、表示システムの制御方法、端末装置の制御方法、及び、表示装置の制御方法
KR20160122027A (ko) * 2015-04-13 2016-10-21 삼성전자주식회사 영상 컨텐츠를 재생하는 재생 장치 및 그 동작방법
KR101698284B1 (ko) * 2012-09-13 2017-01-19 낫소스 파이낸스 에스에이 복수의 주변장치를 식별하고 주변장치 중 하나의 주변장치의 콘텐츠를 선택하여 디스플레이할 수 있는 텔레비전 세트

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120034574A (ko) * 2010-10-01 2012-04-12 삼성전자주식회사 디스플레이 장치 및 신호 처리 장치와, 그 방법들
US8564622B1 (en) * 2012-04-05 2013-10-22 Lockheed Martin Corporation Image generation device for generating multiple image streams
KR101698284B1 (ko) * 2012-09-13 2017-01-19 낫소스 파이낸스 에스에이 복수의 주변장치를 식별하고 주변장치 중 하나의 주변장치의 콘텐츠를 선택하여 디스플레이할 수 있는 텔레비전 세트
JP2014085861A (ja) * 2012-10-24 2014-05-12 Canon Inc 表示システム、端末装置、表示装置、表示システムの制御方法、端末装置の制御方法、及び、表示装置の制御方法
KR20160122027A (ko) * 2015-04-13 2016-10-21 삼성전자주식회사 영상 컨텐츠를 재생하는 재생 장치 및 그 동작방법

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110223216A (zh) * 2019-06-11 2019-09-10 西安博图希电子科技有限公司 一种基于并行plb的数据处理方法、装置及计算机存储介质
CN110223216B (zh) * 2019-06-11 2023-01-17 西安芯瞳半导体技术有限公司 一种基于并行plb的数据处理方法、装置及计算机存储介质

Also Published As

Publication number Publication date
KR20190132072A (ko) 2019-11-27

Similar Documents

Publication Publication Date Title
WO2018016720A1 (fr) Dispositif d'affichage d'image et procédé d'affichage d'image
WO2019194457A1 (fr) Appareil électronique, procédé de commande de celui-ci, et support d'enregistrement associé
WO2019098778A1 (fr) Appareil d'affichage, procédé permettant de commander cet appareil d'affichage, et appareil de fourniture d'images
WO2016080700A1 (fr) Appareil d'affichage et procédé d'affichage
WO2019035657A1 (fr) Appareil d'affichage d'images
WO2014092469A1 (fr) Appareil de lecture de contenu, procédé de fourniture d'une interface utilisateur (ui) d'un appareil de lecture de contenu, serveur de réseau et procédé de commande par un serveur de réseau
WO2015076608A1 (fr) Procédé de traitement vidéo et appareil de traitement vidéo
WO2018030829A1 (fr) Appareil d'affichage d'image et son procédé de fonctionnement
WO2016167468A1 (fr) Dispositif de lecture pour la lecture de contenu vidéo et son procédé de fonctionnement
WO2020055121A1 (fr) Appareil d'affichage, procédé pour le commander et support d'enregistrement associé
WO2022030892A1 (fr) Dispositif d'affichage et procédé de commande associé
WO2020171657A1 (fr) Dispositif d'affichage et procédé d'affichage d'image associé
WO2016190691A1 (fr) Appareil d'affichage et son procédé de commande
WO2020050609A1 (fr) Appareil d'affichage et procédé de commande associé
WO2019221423A1 (fr) Dispositif électronique, procédé de commande associé et support d'enregistrement
WO2019098672A1 (fr) Appareil de fourniture de contenu, et procédé de commande associé
WO2019112218A1 (fr) Dispositif d'affichage et procédé de commande correspondant
WO2022025343A1 (fr) Dispositif d'affichage à diodes électroluminescentes organiques et procédé de fonctionnement associé
WO2020055120A1 (fr) Appareil d'affichage, procédé de commande dudit appareil et support d'enregistrement associé
WO2022025525A1 (fr) Dispositif électronique, serveur et procédé de commande associé
WO2020149605A1 (fr) Appareil électronique et son procédé de commande
EP3797346A1 (fr) Appareil d'affichage et procédé de commande associé
WO2020067701A1 (fr) Dispositif d'affichage, procédé de commande associé et support d'enregistrement
WO2024058369A1 (fr) Appareil de projection et son procédé de fonctionnement
WO2018186626A1 (fr) Système d'affichage multiple configurant un dispositif d'affichage et son procédé de commande

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19802766

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19802766

Country of ref document: EP

Kind code of ref document: A1