TWI584641B - Device and method for providing image and non-transitory computer-readable recording medium - Google Patents
Device and method for providing image and non-transitory computer-readable recording medium Download PDFInfo
- Publication number
- TWI584641B TWI584641B TW102125571A TW102125571A TWI584641B TW I584641 B TWI584641 B TW I584641B TW 102125571 A TW102125571 A TW 102125571A TW 102125571 A TW102125571 A TW 102125571A TW I584641 B TWI584641 B TW I584641B
- Authority
- TW
- Taiwan
- Prior art keywords
- video image
- image
- resolution
- video
- region
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/39—Control of the bit-mapped memory
- G09G5/391—Resolution modifying circuits, e.g. variable screen formats
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Computer Hardware Design (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
- Television Systems (AREA)
- Studio Devices (AREA)
- Closed-Circuit Television Systems (AREA)
Description
本申請案主張在韓國專利局2012年7月17日申請之韓國專利申請案第10-2012-0077919號以及2013年7月10日申請之韓國專利申請案第10-2013-0081194之優先權,所述申請案之全部揭示內容特此以引用之方式併入。 The priority of the Korean Patent Application No. 10-2012-0077919, filed on Jan. 17, 2012, and the Korean Patent Application No. 10-2013-0081194, filed on Jul. 10, 2013, The entire disclosure of the application is hereby incorporated by reference.
例示性實施例有關於提供影像至另一裝置的系統與方法,此影像包含對應於利用裝置擷取的影像的部分所對應的物件。 The illustrative embodiments are directed to systems and methods for providing images to another device that includes objects corresponding to portions of images captured by the device.
目前,在具有多媒體功能的裝置之間傳送以及接收影像的技術已經積極的被使用。特別來說,如已提供的移動通信基礎設施,以及典型被使用的裝置例如智慧型手機、移動型手機和個人數位助理,以這些裝置提供除了語音通話功能外的多樣服務。 Currently, technologies for transmitting and receiving images between devices having multimedia functions have been actively used. In particular, as provided in the mobile communication infrastructure, as well as typically used devices such as smart phones, mobile handsets, and personal digital assistants, these devices provide a variety of services in addition to voice calling capabilities.
此外,使用這些裝置執行的視訊通話,允許在兩個不同地點的使 用者進行面對面視訊通話,即使他們彼此距離遙遠,且因此視訊通話正在快速的增加。 In addition, video calls performed using these devices are allowed in two different locations. Users make face-to-face video calls even if they are far away from each other, and therefore video calls are increasing rapidly.
一般而言,在傳輸端的裝置取得視訊通話的使用者的視訊影像,根據預定的視訊編碼格式編碼所取得的影像,且傳輸編碼過的視訊影像當作編碼過的視訊資料,至對立端的裝置。 Generally, the device at the transmitting end obtains the video image of the user of the video call, encodes the acquired image according to a predetermined video encoding format, and transmits the encoded video image as the encoded video data to the opposite device.
此外,在接收端的裝置經由移動通信網路接收編碼過的視訊資料,且解碼以及顯示在被嵌入在接收端的裝置上的顯示器,例如,液晶顯示器。因此,在接收端的使用者可即時的觀看在傳輸端裝置擷取的影像進行電話通話。 Further, the device at the receiving end receives the encoded video material via the mobile communication network, and decodes and displays the display on the device embedded in the receiving end, for example, a liquid crystal display. Therefore, the user at the receiving end can immediately view the image captured by the transmitting device to make a telephone call.
然而,包含在裝置內的顯示裝置有多樣的解析度,且如被傳輸介於裝置之間的資料的串流解析度根據通信方法而不一樣時,需要有效率地利用傳輸端裝置提供被擷取的視訊影像的部分至接收端的裝置的技術。此外,當進行視訊通話,需要有效率的選擇和展開被在傳輸端上裝置所擷取的視訊影像的部分的技術,且提供這部分至使用者。 However, the display device included in the device has various resolutions, and if the stream resolution of the data transmitted between the devices is different according to the communication method, it is necessary to efficiently use the transmission device to provide the bedding. The technique of taking the portion of the video image to the device at the receiving end. In addition, when a video call is made, a technique of efficiently selecting and expanding a portion of the video image captured by the device on the transmitting side is required, and this portion is provided to the user.
例示性實施例關於提供影像系統與方法,藉此,裝置可追蹤被包含在被擷取影像的物件,以及傳輸包含追蹤物件的影像的部分至另一裝置。 The illustrative embodiments are directed to providing an imaging system and method whereby a device can track an object contained in a captured image and transmit a portion of the image containing the tracking object to another device.
根據示例性實施例的觀點,影像提供方法被提供,包含:將自原始解析度的原始視訊影像轉換的第一解析度的第一視訊影像傳輸至外部裝置;自外部裝置接收關於第一解析度的第一視訊影像的感興趣區的區域資訊,第一解析度的第一視訊影像被顯示於外部裝置的螢幕;基於區域資訊,決定對應於原始解析度的原始視訊影像的感興趣區的區域,其中決定區域小於所述原始解析度的原始視訊影像;將原始解析度的原始視訊影像的部 份轉換成第一解析度的第二視訊影像,此部分對應於決定區域;以及傳送第二視訊影像至外部裝置。 According to an aspect of the exemplary embodiment, an image providing method is provided, including: transmitting a first video image of a first resolution converted from an original video image of an original resolution to an external device; and receiving, regarding the first resolution, from the external device The area information of the region of interest of the first video image, the first video image of the first resolution is displayed on the screen of the external device; and the region of the region of interest corresponding to the original video image of the original resolution is determined based on the region information , wherein the original video image whose area is smaller than the original resolution is determined; the original video image portion of the original resolution is determined Converting the second video image into a first resolution, the portion corresponding to the decision area; and transmitting the second video image to the external device.
感興趣區可包含顯示於第一視訊影像中的物件,並且透過外部裝置產生區域資訊。 The region of interest may include an object displayed in the first video image and generate regional information through an external device.
當觸控外部裝置的螢幕,感興趣區被選擇以便包含對應於螢幕的觸控點的物件。 When the screen of the external device is touched, the region of interest is selected to include an object corresponding to the touch point of the screen.
當觸控外部裝置的螢幕,則包含螢幕的觸控點周圍的先前設定範圍的感興趣區可被選擇。 When the screen of the external device is touched, the region of interest including the previously set range around the touch point of the screen can be selected.
在接收區域資訊時,當外部裝置的螢幕被觸控,可自外部裝置接收螢幕的觸控點的座標資訊。 When the area information is received, when the screen of the external device is touched, the coordinate information of the touch point of the screen can be received from the external device.
當外部裝置的螢幕被觸控,用以選擇所述感興趣區的使用者介面可被顯示於外部裝置的螢幕上。 When the screen of the external device is touched, the user interface for selecting the region of interest can be displayed on the screen of the external device.
第一視訊影像以及第二視訊影像可為外部裝置作為視訊通話的視訊影像,且在傳輸第一視訊影像至外部裝置時,第一視訊影像基於被擷取的視訊影像,被傳輸至所述外部裝置,且被擷取的視訊影像的解析度可大於視訊通話的串流解析度。 The first video image and the second video image may be external video devices as video images of the video call, and when the first video image is transmitted to the external device, the first video image is transmitted to the external image based on the captured video image. The resolution of the captured video image may be greater than the streaming resolution of the video call.
感興趣區的範圍可根據外部裝置用以溝通的通信方法的類型決定。 The range of the region of interest may be determined according to the type of communication method the external device uses to communicate.
第一解析度可根據外部裝置用以溝通的通信方法的類型決定。 The first resolution may be determined according to the type of communication method that the external device uses to communicate.
影像提供方法可更包括根據外部裝置用以溝通的通信方法的修改來修改第一解析度。 The image providing method may further include modifying the first resolution according to a modification of the communication method used by the external device to communicate.
影像提供方法更包括據外部裝置用以溝通的通信方法的修改來 修改被決定區域。 The image providing method further includes modification of a communication method according to an external device for communication. Modify the determined area.
在傳輸第一視訊影像至外部裝置時,第一視訊影像與第二視訊影像可基於被擷取的視訊影像被傳輸至外部裝置,其中此方法更包括當被包含於感興趣區的物件自被擷取的視訊影像消失,則修改決定區域。 When transmitting the first video image to the external device, the first video image and the second video image may be transmitted to the external device based on the captured video image, wherein the method further includes: when the object included in the region of interest is If the captured video image disappears, the decision area is modified.
影像提供方法可更包括,當自被擷取的視訊影像消失的物件再出現在被擷取的視訊影像,只有包含再出現的物件的部份的第二視訊影像被提供至外部裝置。 The image providing method may further include: when the object disappearing from the captured video image reappears in the captured video image, only the second video image including the portion of the reappearing object is provided to the external device.
通知第二視訊影像被傳輸的通知訊息可被插入於第二視訊影像。 A notification message notifying that the second video image is transmitted can be inserted into the second video image.
通知訊息被插入對應於第二視訊影像的先前設定圖框的封包的標頭。 The notification message is inserted into the header of the packet corresponding to the previously set frame of the second video image.
封包可為即時傳送協定封包,且即時傳送協定封包的即時傳送協定標識欄的值可為1。 The packet may be an instant delivery protocol packet, and the value of the instant delivery protocol identification column of the instant delivery protocol packet may be one.
封包可為即時傳送協定封包,且通知訊息可被插入於即時傳送協定封包的標頭擴增欄位。 The packet may be an instant delivery protocol packet, and the notification message may be inserted into the header extension field of the instant delivery protocol packet.
通知訊息可包含區域資訊,區域資訊指出對應於第二視訊影像的第一視訊影像的部份。 The notification message may include area information indicating the portion of the first video image corresponding to the second video image.
感興趣區可為基於使用者輸入於顯示所述第一視訊影像的外部裝置的螢幕上的特定區。 The region of interest may be a specific region based on a user input on a screen of an external device displaying the first video image.
根據示例性實施例的觀點,提供影像接收方法,利用裝置,包含:自外部裝置接收第一視訊影像;提供區域資訊至外部裝置,區域資訊關於接收的第一視訊影像所包含的物件;以及自外部裝置接收第二視訊影像,第二視訊影像包含只有第一視訊影像的部份,其中此部份包含物件,其中 第二視訊影像的解析度為大於第一視訊影像的此部份的解析度,並且包含物件的第一視訊影像的部份由外部裝置基於所提供的區域資訊來決定。 According to an aspect of an exemplary embodiment, an image receiving method is provided, comprising: receiving a first video image from an external device; providing area information to an external device, the area information about the object included in the received first video image; and The external device receives the second video image, and the second video image includes only a portion of the first video image, wherein the portion includes the object, wherein The resolution of the second video image is greater than the resolution of the portion of the first video image, and the portion of the first video image containing the object is determined by the external device based on the provided region information.
影像接收方法可更包括:基於使用者輸入選擇感興趣區,感興趣的區有關於被包含在所接收的第一視訊影像的物件;以及產生關於所選擇的感興趣區的區域資訊。 The image receiving method may further include: selecting a region of interest based on user input, the region of interest having an object related to the received first video image; and generating region information about the selected region of interest.
在選擇感興趣區時,當顯示第一視訊影像的裝置的螢幕被觸控,感興趣區可被選擇以便包含被包含在被接收的第一視訊影像的物件,其中物件包含螢幕的觸控點。 When the region of interest is selected, when the screen of the device displaying the first video image is touched, the region of interest may be selected to include the object included in the received first video image, wherein the object includes the touch point of the screen .
在選擇感興趣區時,當顯示的第一視訊影像的裝置的螢幕被觸控,螢幕的被觸控點周圍的先前設定範圍的區域可被選擇。 When the region of interest is selected, when the screen of the displayed device of the first video image is touched, the area of the previously set range around the touched point of the screen can be selected.
在提供區域資訊時,當顯示第一視訊影像的裝置的螢幕被觸控,螢幕的觸控點的座標資訊可被提供至外部裝置。 When the area information is provided, when the screen of the device displaying the first video image is touched, the coordinate information of the touch point of the screen can be provided to the external device.
影像接收方法可更包括,當顯示第一視訊影像的裝置的螢幕被觸控,顯示使用者介面用以選擇感興趣區。 The image receiving method may further include: when the screen of the device displaying the first video image is touched, displaying a user interface for selecting the region of interest.
第一視訊影像以及第二視訊影像可以為外部裝置作為視訊通話的視訊影像,且第一視訊影像以及第二視訊影像可基於以外部裝置擷取的視訊影像透過外部裝置被提供,且被擷取的視訊影像的解析度可大於視訊通話的串流解析度。 The first video image and the second video image may be external video devices as video images of the video call, and the first video image and the second video image may be provided through the external device based on the video image captured by the external device and captured. The resolution of the video image can be greater than the stream resolution of the video call.
感興趣區的範圍可以根據外部裝置用以溝通的通信方法的類型的裝置決定。 The range of the region of interest may be determined by the type of device used by the external device to communicate.
第一視訊影像以及第二視訊影像其中至少之一的解析度,可以根據外部裝置用以溝通的通信方法的類型的外部裝置決定。 The resolution of at least one of the first video image and the second video image may be determined according to an external device of a type of communication method used by the external device to communicate.
第一視訊影像以及第二視訊影像其中至少之一的解析度,可以根據外部裝置用以溝通的通信方法的類型的外部裝置修改。 The resolution of at least one of the first video image and the second video image may be modified according to an external device of a type of communication method used by the external device to communicate.
此部份可根據與外部裝置溝通的通信方法的修改利用外部裝置修改。 This part can be modified by an external device according to the modification of the communication method communicated with the external device.
第一視訊影像以及第二視訊影像可基於利用外部裝置擷取的視訊影像以外部裝置提供,以及當被呈現在擷取的影像的物件自所述擷取視訊影像消失,第一視訊影像的部份可被修改,其中影像接收方法更包含:自外部裝置接收第二視訊影像,第二視訊影像只包含修改過的部份。 The first video image and the second video image may be provided by an external device based on the video image captured by the external device, and when the object presented in the captured image disappears from the captured video image, the first video image portion The image receiving method may further include: receiving the second video image from the external device, and the second video image only includes the modified portion.
影像接收方法可更包括當自擷取的視訊影像消失的物件再出現於擷取的視訊影像,自外部裝置接收的第二視訊影像,第二視訊影像只包含部份包含再出現的物件。 The image receiving method may further include: when the image captured by the captured video image disappears from the captured video image, the second video image received from the external device, and the second video image only includes a part containing the reappearing object.
根據另一個示例性實施例的觀點,裝置被提供,裝置包含:記憶體設置以儲存至少一程式;處理器設置以利用執行至少一程式來提供被擷取的視訊影像至外部裝置,其中所述至少一個程式包含傳輸第一視訊影像至外部裝置的命令;自外部裝置接收對應於物件的區域資訊,物件被包含於第一視訊影像;且基於區域資訊提供第二視訊影像,第二視訊影像只包含第一視訊影像包含物件的部份,以及其中第二視訊影像的解析度為大於第一視訊影像的部份的解析度。 According to another exemplary embodiment, a device is provided, the device comprising: a memory setting to store at least one program; the processor being configured to provide the captured video image to an external device by executing at least one program, wherein At least one program includes a command for transmitting the first video image to the external device; receiving, from the external device, area information corresponding to the object, the object is included in the first video image; and the second video image is provided based on the area information, and the second video image is only The portion of the first video image including the object, and the resolution of the second video image is greater than the resolution of the portion of the first video image.
區域資訊可為關於外部裝置選擇的感興趣區的資訊並透過外部裝置產生。 The area information may be information about the area of interest selected by the external device and generated by an external device.
當顯示第一視訊影像的外部裝置的螢幕被觸控,感興趣區,其包含螢幕的觸控點的物件,可被選擇。 When the screen of the external device displaying the first video image is touched, the region of interest, which contains the touch point of the screen, can be selected.
當顯示第一視訊影像的外部裝置的螢幕被觸控,則螢幕的觸控點周圍的先前設定範圍的感興趣區可被選擇。 When the screen of the external device displaying the first video image is touched, the previously set range of the region of interest around the touch point of the screen can be selected.
在接收區域資訊時,當顯示第一視訊影像的外部裝置的螢幕被觸控,外部裝置的觸控點的座標資訊可自外部裝置被接收。 When the area information is received, when the screen of the external device displaying the first video image is touched, the coordinate information of the touch point of the external device can be received from the external device.
當顯示第一視訊影像的外部裝置的螢幕被觸控,則用以選擇感興趣區的使用者介面,可被顯示於外部裝置的螢幕。 When the screen of the external device displaying the first video image is touched, the user interface for selecting the region of interest can be displayed on the screen of the external device.
第一視訊影像以及第二視訊影像可為外部裝置作為視訊通話的視訊影像,且在傳輸第一視訊影像至外部裝置時,視訊影像可基於被擷取的視訊影像被傳輸至外部裝置,且被擷取的視訊影像的解析度可為大於視訊通話的串流解析度。 The first video image and the second video image may be external video devices as video images of the video call, and when the first video image is transmitted to the external device, the video image may be transmitted to the external device based on the captured video image, and The resolution of the captured video image may be greater than the stream resolution of the video call.
感興趣區的範圍可根據用來與外部裝置溝通的通信方法的類型被決定。 The range of the region of interest may be determined according to the type of communication method used to communicate with the external device.
第一視訊影像以及第二視訊影像其中至少之一的解析度可根據用來與外部裝置溝通的通信方法的類型決定,。 The resolution of at least one of the first video image and the second video image may be determined according to the type of communication method used to communicate with the external device.
裝置可更包含根據用來與外部裝置溝通的通信方法的修改而執行第一視訊影像以及第二視訊影像其中至少之一的解析度的修改的命令。 The apparatus can further include a command to perform a modification of the resolution of at least one of the first video image and the second video image in accordance with a modification of the communication method used to communicate with the external device.
裝置可更包含命令,用來執行:根據用來與外部裝置溝通的通信方法的修改來修改此部分;且提供修改過的部份的第二視訊影像至外部裝置。 The device may further include a command to: modify the portion according to a modification of the communication method used to communicate with the external device; and provide the modified portion of the second video image to the external device.
在傳輸第一視訊影像至外部裝置時,第一視訊影像與第二視訊影像可基於被擷取的視訊影像被傳輸至外部裝置,,其中裝置更包括命令以執行:當物件自被擷取的視訊影像消失,修改此部分,且提供修改過的部 分的第二視訊影像至外部裝置。 When transmitting the first video image to the external device, the first video image and the second video image may be transmitted to the external device based on the captured video image, wherein the device further includes a command to perform: when the object is captured The video image disappears, this section is modified, and the modified part is provided. Dividing the second video image to an external device.
裝置可更包含命令以執行:當自被擷取的視訊影像消失的物件再出現在被擷取的視訊影像,只有包含再出現的部份的物件的第二視訊影像提供至外部裝置。 The device may further include a command to perform: when the object disappearing from the captured video image reappears in the captured video image, only the second video image containing the recurring portion of the object is provided to the external device.
根據另一個示例性實施例的觀點,提供裝置,此裝置包含:記憶體設置以儲存至少一程式;處理器設置以透過執行至少一程式來提供被擷取的視訊影像至外部裝置,其中至少一個程式包含命令以接收來自外部裝置的第一視訊影像,提供有關於被包含於被接收第一視訊影像的物件的區域資訊至所述外部裝置;以及自外部裝置接收第二視訊影像,第二視訊影像只包含第一視訊影像部份,其中第一視訊影像的部份包含物件,其中第二視訊影像的解析度為大於第一視訊影像的部份的解析度,以及基於被提供的區域資訊決定其中包含物件的第一視訊影像的部份。 According to another aspect of the present invention, a device is provided, the device comprising: a memory setting to store at least one program; and a processor configured to provide the captured video image to an external device by executing at least one program, at least one of The program includes a command to receive a first video image from an external device, provide area information about the object included in the received first video image to the external device; and receive a second video image from the external device, the second video The image includes only the first video image portion, wherein the first video image portion includes the object, wherein the resolution of the second video image is greater than the resolution of the portion of the first video image, and is determined based on the provided region information. It contains the portion of the first video image of the object.
根據另一個示例性實施例的觀點,提供影像提供方法,此方法包含:傳輸具有複數個第一圖框的第一視訊影像圖框至外部裝置;自外部裝置接收區域資訊,區域資訊與被包含在第一視訊影像的物件有關;基於區域資訊選擇自複數個第一圖框之中包含物件的第一圖框圖框;以及傳輸第二視訊影像至外部裝置,第二視訊影像包含複數個只包含被選擇的第一圖框的部份的第二圖框。 According to another aspect of the present invention, an image providing method is provided, the method comprising: transmitting a first video image frame having a plurality of first frames to an external device; receiving regional information from the external device, and the regional information is included Corresponding to the object of the first video image; selecting, according to the regional information, the first frame block containing the object in the plurality of first frames; and transmitting the second video image to the external device, the second video image includes a plurality of only A second frame containing the portion of the selected first frame.
根據另一個示例性實施例的觀點,影像提供方法被提供,此方法包含:傳輸具有複數個第一圖框的第一視訊影像至外部裝置;自外部裝置接收區域資訊,區域資訊與被包含在第一視訊影像的物件有關;基於區域資訊自複數個第一圖框之中選擇包含物件的部分;以及傳輸第二視訊影像 至外部裝置,第二視訊影像包含複數個只包含被選擇部份的第二圖框。 According to another exemplary embodiment, an image providing method is provided, the method comprising: transmitting a first video image having a plurality of first frames to an external device; receiving regional information from the external device, and the regional information is included in The object of the first video image is related; the part including the object is selected from the plurality of first frames based on the area information; and the second video image is transmitted To the external device, the second video image includes a plurality of second frames containing only the selected portion.
根據另一個示例性實施例的觀點,提供影像提供方法,此方法包含:傳輸第一解析度的第一影像至外部裝置,第一解析度對應於應用程式的執行螢幕;自外部裝置接收關於顯示在外部裝置的螢幕上的第一影像的感興趣區的區域資訊;基於區域資訊決定對應於感興趣區的第一影像的部份,其中此部份小於第一影像;基於被決定的部份轉換第一影像至第二影像;且以第一解析度傳輸第二影像至外部裝置。 According to another aspect of the present invention, a method for providing an image is provided, the method comprising: transmitting a first image of a first resolution to an external device, the first resolution corresponding to an execution screen of the application; and receiving the display from the external device The area information of the region of interest of the first image on the screen of the external device; determining the portion of the first image corresponding to the region of interest based on the region information, wherein the portion is smaller than the first image; based on the determined portion Converting the first image to the second image; and transmitting the second image to the external device at the first resolution.
根據另一個示例性實施例的觀點,提供影像提供方法,此方法包含:傳輸第一視訊影像至外部裝置;自外部裝置接收關於第一視訊影像區域的區域資訊;基於區域資訊產生第二視訊影像;以及傳輸第二視訊影像至外部裝置。 According to another aspect of the present invention, an image providing method is provided, the method comprising: transmitting a first video image to an external device; receiving regional information about the first video image region from the external device; generating the second video image based on the region information And transmitting the second video image to an external device.
第二視訊影像的解析度可為,大於第一視訊影像的區域的解析度。 The resolution of the second video image may be greater than the resolution of the region of the first video image.
第二視訊影像可包含被顯示於第一視訊影像的區域的物件。 The second video image may include an object that is displayed in an area of the first video image.
第二視訊影像可包含第一視訊影像的區域周圍的先前設定範圍的視訊。 The second video image may include video of a previously set range around the area of the first video image.
根據另一個示例性實施例的觀點,利用裝置的影像接收方法被提供,此方法包含:自外部裝置接收第一視訊影像;提供關於第一視訊影像區域的區域資訊至外部裝置;以及自外部裝置接收第二視訊影像,第二視訊影像只包含對應於區域資訊的第一視訊影像的部份。 According to another exemplary embodiment, an image receiving method using a device is provided, the method comprising: receiving a first video image from an external device; providing area information about the first video image area to the external device; and from the external device Receiving a second video image, the second video image only includes a portion of the first video image corresponding to the area information.
第二視訊影像的解析度可為大於第一視訊影像的區域的解析度。 The resolution of the second video image may be greater than the resolution of the region of the first video image.
第一視訊影像的部份可為第一視訊影像的區域周圍的先前設定 範圍的區域。 The portion of the first video image may be a previous setting around the area of the first video image The area of the range.
區域資訊可包含第一視訊影像的區域的座標資訊。 The area information may include coordinate information of the area of the first video image.
此方法可更包括顯示使用者介面,用以選擇第一視訊影像的區域。 The method can further include displaying a user interface for selecting an area of the first video image.
以參考附圖式詳細描述例示性實施例,以上、其他特徵以及優點將更顯而易見。 The above, other features, and advantages will be more apparent from the detailed description of exemplary embodiments.
22‧‧‧包含在第一視訊影像的物件 22‧‧‧ Objects contained in the first video image
80‧‧‧觸控點 80‧‧‧ Touch points
82‧‧‧臉 82‧‧‧ face
84‧‧‧區域 84‧‧‧ area
10‧‧‧導引線 10‧‧‧Guideline
12‧‧‧功能選擇單 12‧‧‧Features
14‧‧‧預定區域 14‧‧‧Predetermined area
16‧‧‧第一視訊影像的部分 16‧‧‧Parts of the first video image
90‧‧‧即時傳送協定標識欄 90‧‧‧ Instant Transfer Agreement Logo
40‧‧‧嘴巴部分 40‧‧‧ mouth part
42‧‧‧第一視訊影像 42‧‧‧First video image
44‧‧‧展開的影像 44‧‧‧Expanded images
100‧‧‧第一裝置 100‧‧‧ first device
200‧‧‧第二裝置 200‧‧‧second device
S300‧‧‧動作 S300‧‧‧ action
S310‧‧‧動作 S310‧‧‧ action
S320‧‧‧動作 S320‧‧‧ action
S330‧‧‧動作 S330‧‧‧ action
S340‧‧‧動作 S340‧‧‧ action
S350‧‧‧動作 S350‧‧‧ action
S360‧‧‧動作 S360‧‧‧ action
S370‧‧‧動作 S370‧‧‧ action
S322‧‧‧動作 S322‧‧‧ action
S324‧‧‧動作 S324‧‧‧ action
S326‧‧‧動作 S326‧‧‧ action
S500‧‧‧動作 S500‧‧‧ action
S510‧‧‧動作 S510‧‧‧ action
S520‧‧‧動作 S520‧‧‧ action
S600‧‧‧動作 S600‧‧‧ action
S610‧‧‧動作 S610‧‧‧ action
S620‧‧‧動作 S620‧‧‧ action
S700‧‧‧動作 S700‧‧‧ action
S710‧‧‧動作 S710‧‧‧ action
S720‧‧‧動作 S720‧‧‧ action
S730‧‧‧動作 S730‧‧‧ action
S740‧‧‧動作 S740‧‧‧ action
S750‧‧‧動作 S750‧‧‧ action
S760‧‧‧動作 S760‧‧‧ action
S770‧‧‧動作 S770‧‧‧ action
S780‧‧‧動作 S780‧‧‧ action
110‧‧‧影像取得元件 110‧‧‧Image acquisition component
120‧‧‧影像提供元件 120‧‧‧Image providing components
130‧‧‧物件辨識元件 130‧‧‧object identification component
140‧‧‧物件追蹤元件 140‧‧‧Object tracking component
150‧‧‧網路檢查元件 150‧‧‧Network inspection component
160‧‧‧資料庫 160‧‧‧Database
170‧‧‧收發元件 170‧‧‧Transceiver components
180‧‧‧控制元件 180‧‧‧Control elements
190‧‧‧圖框緩衝器 190‧‧‧ Frame buffer
210‧‧‧影像接收元件 210‧‧‧Image receiving components
220‧‧‧使用者輸入元件 220‧‧‧User input components
230‧‧‧網路檢查元件 230‧‧‧Network inspection component
240‧‧‧區域資料產生元件 240‧‧‧Regional data generating components
250‧‧‧區域資料提供元件 250‧‧‧Regional data providing components
260‧‧‧顯示元件 260‧‧‧ display components
270‧‧‧資料庫 270‧‧‧Database
280‧‧‧收發元件 280‧‧‧Transceiver components
290‧‧‧控制元件 290‧‧‧Control elements
1001‧‧‧移動通信元件 1001‧‧‧Mobile communication components
1002‧‧‧次通信元件 1002‧‧‧ communication components
1003‧‧‧廣播接收元件 1003‧‧‧Broadcast receiving components
1004‧‧‧相機元件 1004‧‧‧ camera components
1005‧‧‧感測元件 1005‧‧‧Sensor components
1006‧‧‧全球定位系統接收元件 1006‧‧‧Global Positioning System Receiver
1010‧‧‧輸入/輸出元件 1010‧‧‧Input/output components
1011‧‧‧按鈕 1011‧‧‧ button
1012‧‧‧麥克風 1012‧‧‧Microphone
1013‧‧‧揚聲器 1013‧‧‧ Speaker
1014‧‧‧振動馬達 1014‧‧‧Vibration motor
1015‧‧‧連接器 1015‧‧‧Connector
1016‧‧‧鍵盤 1016‧‧‧ keyboard
1017‧‧‧觸控視窗控制器 1017‧‧‧Touch Window Controller
1018‧‧‧觸控視窗 1018‧‧‧ touch window
1019‧‧‧電源供應元件 1019‧‧‧Power supply components
1020‧‧‧圖框緩衝器 1020‧‧‧ Frame buffer
1050‧‧‧控制元件(處理器) 1050‧‧‧Control elements (processors)
1060‧‧‧記憶體 1060‧‧‧ memory
1061‧‧‧移動通信裝置模組 1061‧‧‧Mobile communication device module
1062‧‧‧無線通信系統模組 1062‧‧‧Wireless communication system module
1063‧‧‧藍芽模組 1063‧‧‧Blue Bud Module
1064‧‧‧數位互動多媒體廣播模組 1064‧‧‧Digital Interactive Multimedia Broadcasting Module
1065‧‧‧相機模組 1065‧‧‧ camera module
1066‧‧‧感測模組 1066‧‧‧Sense Module
1067‧‧‧全球定位系統模組 1067‧‧‧Global Positioning System Module
1068‧‧‧視訊影像重播模組 1068‧‧‧Video Image Replay Module
1069‧‧‧音頻重播模組 1069‧‧‧Audio Replay Module
1070‧‧‧電源模組 1070‧‧‧Power Module
1071‧‧‧觸控視窗模組 1071‧‧‧Touch Window Module
1072‧‧‧使用者介面模组 1072‧‧‧User interface module
1073‧‧‧應用程式模組 1073‧‧‧Application Module
12‧‧‧功能選單 12‧‧‧ function menu
92‧‧‧標頭展開(任選) 92‧‧‧ Header unfolding (optional)
S2100‧‧‧動作 S2100‧‧‧ action
S2200‧‧‧動作 S2200‧‧‧ action
S2300‧‧‧動作 S2300‧‧‧ action
S2400‧‧‧動作 S2400‧‧‧ action
S2205‧‧‧動作 S2205‧‧‧ action
S2210‧‧‧動作 S2210‧‧‧ action
S2220‧‧‧動作 S2220‧‧‧ action
S2230‧‧‧動作 S2230‧‧‧ action
S2240‧‧‧動作 S2240‧‧‧ action
S2250‧‧‧動作 S2250‧‧‧ action
S2260‧‧‧動作 S2260‧‧‧ action
S2270‧‧‧動作 S2270‧‧‧ action
S2280‧‧‧動作 S2280‧‧‧ action
S2290‧‧‧動作 S2290‧‧‧ action
S2305‧‧‧動作 S2305‧‧‧ action
S2310‧‧‧動作 S2310‧‧‧ action
S2320‧‧‧動作 S2320‧‧‧ action
S2330‧‧‧動作 S2330‧‧‧ action
S2340‧‧‧動作 S2340‧‧‧ action
圖1為根據例示性實施例的影像提供系統的示意圖。 FIG. 1 is a schematic diagram of an image providing system, according to an exemplary embodiment.
圖2A以及圖2B根據例示性實施例繪示包含物件的影像被顯示於第二裝置,此物件對應於利用第一裝置擷取的影像的部分。 2A and 2B illustrate that an image containing an object is displayed on a second device corresponding to a portion of the image captured by the first device, in accordance with an illustrative embodiment.
圖3為根據例示性實施例的流程,其說明提供視訊影像至第二裝置的方法,視訊影像包含的物件對應於利用第一裝置擷取的視訊影像的部份。 3 is a flow diagram illustrating a method of providing a video image to a second device, the video image containing an object corresponding to a portion of the video image captured by the first device, in accordance with an illustrative embodiment.
圖4是根據例示性實施例的流程,其說明利用第二裝置產生關於感興趣區的區域資訊的方法。 4 is a flow illustrating a method of generating region information about a region of interest using a second device, in accordance with an illustrative embodiment.
圖5是根據例示性實施例的流程,其說明當第一裝置和第二裝置之間的通信方法被修改時,利用第一裝置修改選擇的感興趣區,且針對於被修改區提供視訊影像至第二裝置的方法。 FIG. 5 is a flowchart illustrating modifying a selected region of interest with a first device and providing a video image for a modified region when a communication method between the first device and the second device is modified, according to an exemplary embodiment The method to the second device.
圖6為根據示例性實施例的流程,其說明當第一裝置以及第二裝置之間的通信方法被修改時,利用第一裝置提供具有被修改影像品質的視訊影像至第二裝置的方法。 FIG. 6 is a flowchart illustrating a method of providing a video image having a modified image quality to a second device using a first device when a communication method between the first device and the second device is modified, according to an exemplary embodiment.
圖7為根據另一個示例性實施例的流程,其說明提供包含物件的視訊影像至第二裝置的方法,物件對應於被第一裝置擷取的視訊影像的部份。 7 is a flow diagram illustrating a method of providing a video image comprising an object to a second device corresponding to a portion of the video image captured by the first device, in accordance with another exemplary embodiment.
圖8A和圖8B為根據示例性實施例說明的範例,其繪示利用第二裝置決定第一視訊影像的部份作為感興趣區,使得決定區域包含使用者觸控的觸控點的物件。 8A and FIG. 8B are diagrams illustrating an example of determining, by using a second device, a portion of the first video image as a region of interest, such that the determination region includes a touch point touched by the user, according to an exemplary embodiment.
圖9A以及圖9B為根據示例性實施例說明的範例,其繪示利用第二裝置,自使用者觸控點決定先前設定範圍的部份作為感興趣區。 FIG. 9A and FIG. 9B are diagrams illustrating an example of determining a portion of a previously set range from a user touch point as a region of interest using a second device, according to an exemplary embodiment.
圖10A以及圖10B為根據示例性實施例說明的範例,其繪示利用第二裝置決定第一視訊影像的部份作為感興趣區,經由用以決定第一視訊影像的部份的使用者介面。 FIG. 10A and FIG. 10B are diagrams illustrating an example of determining a portion of a first video image as a region of interest by using a second device, via a user interface for determining a portion of the first video image, in accordance with an exemplary embodiment. .
圖11A以及圖11B為根據示例性實施例說明的範例,其繪示當第一裝置以及第二裝置之間的通信方法被修改,用第二裝置接收來自第一裝置100的修改過的解析度的視訊影像。 11A and 11B are diagrams illustrating an example in which a communication method between a first device and a second device is modified, and a modified resolution from the first device 100 is received by the second device, according to an exemplary embodiment. Video image.
圖12A和12B根據例示性實施例說明的範例,其繪示當第一裝置以及第二裝置之間的通信方法被修改時,用第二裝置接收來自第一裝置100的被修改影像品質的視訊影像。 12A and 12B illustrate an example of receiving a modified image quality video from the first device 100 with a second device when the communication method between the first device and the second device is modified, in accordance with an exemplary embodiment. image.
圖13A和13B根據例示性實施例說明的範例,其繪示當第一裝置以及第二裝置的通信方法被修改時,用第二裝置接收來自第一裝置100的修改過的部分的視訊影像。 13A and 13B illustrate an example of receiving a video image from a modified portion of the first device 100 with a second device when the communication method of the first device and the second device is modified, in accordance with an illustrative embodiment.
圖14為根據示例性實施例說明第一裝置的方塊圖。 FIG. 14 is a block diagram illustrating a first device in accordance with an exemplary embodiment.
圖15為根據示例性實施例說明第二裝置的方塊圖。 Figure 15 is a block diagram illustrating a second device in accordance with an exemplary embodiment.
圖16為根據另一個示例性實施例說明裝置的方塊圖。 Figure 16 is a block diagram illustrating an apparatus in accordance with another exemplary embodiment.
圖17A至圖17C根據示例性實施例說明的範例,其繪示展開第一視訊影像的部份被顯示在第二裝置的螢幕上。 17A-17C illustrate an example of an embodiment of the first video image being displayed on a screen of a second device, in accordance with an exemplary embodiment.
圖18A至圖18C為根據示例性實施例說明的範例,其繪示展開視訊影像的部份,視訊影像以逐步式方式被顯示在第二裝置的螢幕。 18A through 18C illustrate an example of expanding a portion of a video image, the video image being displayed on the screen of the second device in a stepwise manner, in accordance with an exemplary embodiment.
圖19A至19C根據示例性實施例說明的範例,其繪示在第二裝置上顯示包含第一視訊影像的被展開部份的預視影像,且在第二裝置顯示自第一裝置提供的第二視訊影像。 19A through 19C illustrate an example of displaying a preview image including an expanded portion of a first video image on a second device, and displaying a second image from the first device, in accordance with an exemplary embodiment. Two video images.
圖20為根據示例性實施例說明的範例,其繪示即時傳送協定封包標頭。 20 is an illustration of an instant delivery protocol packet header, in accordance with an illustrative embodiment.
圖21為根據示例性實施例的流程,其利用第一裝置產生第四視訊影像的方法。 21 is a flow diagram of a method of generating a fourth video image using a first device, in accordance with an exemplary embodiment.
圖22為根據示例性實施例的流程,其說明第二裝置正與第一裝置進行視訊通話時,以第二裝置接收第二視訊影像的方法,第二視訊影像是第一視訊影像的被展開部分。 FIG. 22 is a flowchart illustrating a method of receiving a second video image by a second device while the second device is performing a video call with the first device, where the second video image is an unfolded image of the first video image, according to an exemplary embodiment. section.
圖23為根據示例性實施例的流程,其說明第二裝置與第一裝置進行視訊通話時,以第二裝置展開及顯示第一視訊影像的部分的方法。 FIG. 23 is a flowchart illustrating a method of deploying and displaying a portion of a first video image with a second device when the second device performs a video call with the first device, according to an exemplary embodiment.
圖24A至圖24C為根據示例性實施例,說明第一視訊影像的被展開部份與第一視訊影像一起被顯示在第二裝置的螢幕上。 24A through 24C illustrate that the expanded portion of the first video image is displayed on the screen of the second device along with the first video image, in accordance with an exemplary embodiment.
用來說明例示性實施例的附圖用以參照,為了得到對於例示性實 施例充分的了解,以下的例示性實施例將參照附圖來詳細描述,像是在圖內的參照號碼表示類似元件,在目前的規格下,當成分元件「連接」或「被連接」到另一個成分元件時,這個成分元件接觸或被連接到另一個成分元件,不僅直接的而且是電子式的,透過至少一個其他成分元件被插入其間。 並且,當一部分可「包含」某些的成分元件時,若無特別指明的話,這部份不可被解釋成將另外的成分元件排除在外,但可被解釋為包含更多其他的成份元件。 The drawings used to illustrate the exemplary embodiments are referred to for the purpose of illustration. The following exemplary embodiments will be described in detail with reference to the accompanying drawings, in which like reference numerals refer to like elements, in the present specification, when the component is "connected" or "connected" to In the case of another component element, this component element is contacted or connected to another component element, not only directly but also electronically, through which at least one other component element is inserted. Also, when a part of the component elements can be "included", the part is not to be construed as excluding the other component elements unless otherwise specified, but can be interpreted as including more other component elements.
當在前面的提列的元件陳述例如"至少其中一個"的描述時,修改全部提列的元件且不是修改提列元件中的特定元件。 When the elements of the preceding list state, for example, the description of "at least one of", the elements that are all listed are modified and the particular elements in the elements are not modified.
圖1為根據例示性實施例的影像提供系統的示意圖。 FIG. 1 is a schematic diagram of an image providing system, according to an exemplary embodiment.
參考圖1,第一裝置100和第二裝置200可互相進行視訊通話,且第一裝置100可提供用第一裝置100擷取的視訊影像至第二裝置200。並且,第二裝置200可提供利用第二裝置200擷取的視訊影像給第一裝置100。 Referring to FIG. 1, the first device 100 and the second device 200 can perform video calls with each other, and the first device 100 can provide video images captured by the first device 100 to the second device 200. Moreover, the second device 200 can provide the video image captured by the second device 200 to the first device 100.
以下,根據目前的例示性實施例,第一裝置100在影像提供系統內提供視訊影像給第二裝置200的實施例,將會用方便的描述來敘述。並且,利用第一裝置100擷取的視訊影像被描述為以第一裝置100提供內容給第二裝置200,但內容並不侷限於此,且第一裝置100可提供至第二裝置200的內容範例包含了視訊影像、照相影像、擷取影像以及應用程式的執行影像。 Hereinafter, according to the present exemplary embodiment, an embodiment in which the first device 100 provides a video image to the second device 200 in the image providing system will be described in a convenient description. Moreover, the video image captured by the first device 100 is described as providing the content to the second device 200 by the first device 100, but the content is not limited thereto, and the content of the first device 100 can be provided to the second device 200. Examples include video images, camera images, captured images, and application execution images.
第一裝置100可基於使用第一裝置100所擷取的視訊影像提供第一視訊影像至第二裝置200,且接收自第二裝置200的區域資訊,區域資訊關於包含在第一視訊影像的物件。並且,第一裝置100可基於接收的區域 資訊追蹤被包含在第一視訊影像的預定物件,且提供第二視訊影像至第二裝置200,第二視訊影像只包含第一視訊影像包含追蹤物件的部分。 The first device 100 can provide the first video image to the second device 200 based on the video image captured by the first device 100, and receive the regional information from the second device 200, and the regional information about the object included in the first video image. . And, the first device 100 can be based on the received area The information tracking is included in the predetermined object of the first video image, and the second video image is provided to the second device 200. The second video image only includes the portion of the first video image that includes the tracking object.
當利用第一裝置100擷取的視訊影像的解析度為大於,視訊影像傳輸於第一裝置100和第二裝置200之間的串流解析度(streaming resolution),則第一裝置100可提供針對被擷取視訊影像的部分的第二視訊影像至第二裝置200。 When the resolution of the video image captured by the first device 100 is greater than the streaming resolution between the first device 100 and the second device 200, the first device 100 may provide The second video image of the portion of the video image is captured to the second device 200.
第一裝置100和第二裝置200為有能力傳輸視訊影像、影像或相似物給另一裝置的裝置,且第一裝置100以及第二裝置200的範例包含智慧型手機、行動型手機、個人數位助理、膝上型電腦、媒體播放器、全球定位系統、其他行動運算裝置以及其他非行動運算裝置。然而,第一裝置100和第二裝置200並不侷限於此。 The first device 100 and the second device 200 are devices capable of transmitting video images, images or the like to another device, and examples of the first device 100 and the second device 200 include a smart phone, a mobile phone, and a personal digital device. Assistants, laptops, media players, global positioning systems, other mobile computing devices, and other non-mobile computing devices. However, the first device 100 and the second device 200 are not limited thereto.
至少三個裝置可彼此同時進行視訊通話,舉例來說,第一裝置100、第二裝置200以及第三裝置(未展示),可一起進行視訊通話。在這情況下,第一裝置100可提供第一視訊影像至第二裝置200以及第三裝置(未展示)。並且,當第二裝置200選擇第一視訊影像的部分,第一裝置100可提供有關於被選擇部分的視訊影像給第二裝置200以及第三裝置(未展示)。若第二裝置200和第三裝置(未展示)各自地選擇第一視訊影像的部分,第一裝置100可提供針對以第二裝置200選擇的部分的視訊影像至第二裝置200,以及提供另外針對以第三裝置(未展示)選擇的部分的視訊影像給第三裝置(未展示)。 At least three devices can simultaneously perform video calls with each other. For example, the first device 100, the second device 200, and the third device (not shown) can perform a video call together. In this case, the first device 100 can provide the first video image to the second device 200 and the third device (not shown). Moreover, when the second device 200 selects a portion of the first video image, the first device 100 can provide a video image about the selected portion to the second device 200 and a third device (not shown). If the second device 200 and the third device (not shown) respectively select a portion of the first video image, the first device 100 may provide a video image for the portion selected by the second device 200 to the second device 200, and provide another A third device (not shown) is provided for the portion of the video image selected by the third device (not shown).
第一裝置100可提供第三視訊影像至第二裝置200,第三視訊影像對應於第一裝置100所執行的應用程式的執行螢幕。在這情況下,第二 裝置200可選擇接收的第三視訊影像的部分,以及接收自第一裝置100針對選擇部份的第四視訊影像。 The first device 100 can provide a third video image to the second device 200, where the third video image corresponds to an execution screen of the application executed by the first device 100. In this case, the second The device 200 can select a portion of the received third video image and a fourth video image received from the first device 100 for the selected portion.
圖2A以及圖2B根據例示性實施例說明繪示包含物件的影像被顯示於第二裝置,此物件對應於利用第一裝置擷取的影像的部分。詳細來說,圖2A根據例示性實施例說明第一視訊影像,以及圖2B根據例示性實施例說明第二視訊影像。 2A and 2B illustrate, in accordance with an illustrative embodiment, an image showing an object being displayed on a second device corresponding to a portion of the image captured using the first device. In detail, FIG. 2A illustrates a first video image in accordance with an illustrative embodiment, and FIG. 2B illustrates a second video image in accordance with an illustrative embodiment.
第一裝置100可基於目前被擷取的視訊影像,提供第一視訊影像至第二裝置200,且可檢查包含在第一視訊影像的物件22。並且,第一裝置100可提供第二視訊影像給第二裝置200,第二視訊影像只包含第一視訊影像中被檢查物件22的部份。 The first device 100 can provide the first video image to the second device 200 based on the currently captured video image, and can inspect the object 22 included in the first video image. Moreover, the first device 100 can provide the second video image to the second device 200, and the second video image only includes the portion of the first video image that is inspected.
第一裝置100可檢查被擷取的視訊影像的預定部份20包含的物件22,但並不侷限於此。第一裝置100也可檢查提供至第二裝置200的第一視訊影像中的物件22。 The first device 100 can check the object 22 included in the predetermined portion 20 of the captured video image, but is not limited thereto. The first device 100 can also check the object 22 in the first video image provided to the second device 200.
圖3為根據例示性實施例的流程圖,其說明提供視訊影像至第二裝置200的方法,視訊影像包含對應於利用第一裝置100擷取的視訊影像的部份的物件。 3 is a flow diagram illustrating a method of providing a video image to a second device 200 that includes an object corresponding to a portion of a video image captured using the first device 100, in accordance with an illustrative embodiment.
在動作S300中,第一裝置100提供第一視訊影像至第二裝置200。第一裝置100可基於被擷取的視訊影像,提供第一視訊影像至第二裝置。第一裝置100可提供被擷取的視訊影像,作為沒有任何額外處理的第一視訊影像至第二裝置200。並且,第一裝置100可處理被擷取的視訊影像,且提供被處理的視訊影像作為第一視訊影像至第二裝置200。在這情況下,第一裝置100可修改被擷取的視訊影像的解析度或格式。舉例來說,當被 擷取的視訊影像的解析度為大於串流解析度,則允許傳輸於第一裝置100和第二裝置200之間的資料串流不中斷,第一裝置100修改被擷取視訊影像的解析度,使其相同於串流解析度,且可提供具有被修改解析度的第一視訊影像至第二裝置200。並且,第一視訊影像可具有複數個第一圖框(frames)。 In action S300, the first device 100 provides the first video image to the second device 200. The first device 100 can provide the first video image to the second device based on the captured video image. The first device 100 can provide the captured video image as the first video image without any additional processing to the second device 200. Moreover, the first device 100 can process the captured video image and provide the processed video image as the first video image to the second device 200. In this case, the first device 100 can modify the resolution or format of the captured video image. For example, when If the resolution of the captured video image is greater than the stream resolution, the data stream transmitted between the first device 100 and the second device 200 is allowed to be uninterrupted, and the first device 100 modifies the resolution of the captured video image. , making it the same as the stream resolution, and providing the first video image with the modified resolution to the second device 200. Moreover, the first video image can have a plurality of first frames.
第一裝置100可在第一解析度下傳輸具有原始解析度的第一視訊影像至第二裝置200。第一裝置100可修改第一視訊影像的原始解析度為第一解析度,且第一裝置100可傳輸具有第一解析度的第一視訊影像至第二裝置200。在這情況下,第一裝置100可先得到關於包含在第二裝置200的顯示器的解析度資訊且將之儲存,且基於包含在第二裝置200的顯示器的解析度決定第一解析度。 The first device 100 can transmit the first video image having the original resolution to the second device 200 at the first resolution. The first device 100 can modify the original resolution of the first video image to a first resolution, and the first device 100 can transmit the first video image with the first resolution to the second device 200. In this case, the first device 100 may first obtain and store the resolution information about the display included in the second device 200, and determine the first resolution based on the resolution of the display included in the second device 200.
第一裝置100可提供對應於在第一裝置100執行的應用程式的執行螢幕的第三視訊影像至第二裝置200。第一裝置100可以第三解析度提供第三視訊影像至第二裝置200。 The first device 100 can provide a third video image corresponding to the execution screen of the application executed by the first device 100 to the second device 200. The first device 100 can provide the third video image to the second device 200 at a third resolution.
在動作S310中,第二裝置200顯示接收的第一視訊影像。第二裝置200可在第二裝置200的螢幕上顯示接收的第一視訊影像。第二裝置200可在第二裝置200的螢幕上顯示第一解析度的第一視訊影像。 In Act S310, the second device 200 displays the received first video image. The second device 200 can display the received first video image on the screen of the second device 200. The second device 200 can display the first video image of the first resolution on the screen of the second device 200.
同時,當第二裝置200已接收第三視訊影像,第三視訊影像對應於在第一裝置100執行的應用程式的執行視窗,第二裝置200可顯示接收的第三視訊影像。第二裝置200可顯示第三解析度的第三視訊影像。 Meanwhile, when the second device 200 has received the third video image, the third video image corresponds to the execution window of the application executed by the first device 100, and the second device 200 can display the received third video image. The second device 200 can display a third video image of the third resolution.
在動作S320中,第二裝置200產生關於在第一視訊影像包含的物件的區域資訊。第二裝置200可基於使用者輸入,選擇第一視訊影像的 部分作為感興趣區,且可產生關於選擇的感興趣區的區域資訊。並且,第二裝置200可選擇在第一視訊影像包含的預定物件,且產生關於被選擇物件的區域資訊。 In Act S320, the second device 200 generates area information about the object contained in the first video image. The second device 200 can select the first video image based on the user input. Part of it acts as a region of interest and can generate regional information about the selected region of interest. And, the second device 200 can select a predetermined object included in the first video image, and generate area information about the selected object.
第二裝置200可接收使用者針對於第一視訊影像的觸控輸入,且基於觸控輸入的位置選擇感興趣區。詳細來說,當使用者接觸在第一視訊影像的預定點,則第二裝置200辨識包含被觸控位置的物件,且選擇包含被辨識的物件的區域。舉例來說,當臉部在第一視訊影像的觸控位置被觸控,第二裝置200可辨識臉部,其為包含觸控位置中的物件。並且,第二裝置200可選擇包含被辨識的臉的區域作為感興趣區。 The second device 200 can receive a touch input of the user for the first video image, and select a region of interest based on the location of the touch input. In detail, when the user touches a predetermined point of the first video image, the second device 200 recognizes the object including the touched position, and selects an area including the recognized object. For example, when the face is touched at the touch position of the first video image, the second device 200 can recognize the face, which is the object included in the touch position. And, the second device 200 can select an area including the recognized face as the region of interest.
當使用者觸控在第一視訊影像上預定點,第二裝置200可自被觸控點選擇先前設定的範圍的區域作為感興趣區。舉例來說,第二裝置200可選擇被觸控點的周圍的預定的矩型區域作為感興趣區。 When the user touches a predetermined point on the first video image, the second device 200 may select an area of the previously set range as the region of interest from the touch point. For example, the second device 200 can select a predetermined rectangular region around the touch point as the region of interest.
第二裝置200可在螢幕上顯示使用者介面,讓使用者選擇第一視訊影像的部分作為感興趣區。舉例來說,第二裝置200可在第一視訊影像的部分上顯示矩型,且提供使用者介面以便使用者可透過觸控和拖曳長矩形的圖框來修改矩形的尺寸。 The second device 200 can display a user interface on the screen, and let the user select a portion of the first video image as the region of interest. For example, the second device 200 can display a rectangular shape on a portion of the first video image and provide a user interface so that the user can modify the size of the rectangle by touching and dragging the long rectangular frame.
儘管第二裝置200基於使用者輸入選擇第一視訊影像的部分作為感興趣區,例示性實施例並不侷限於此。第二裝置200可在沒有任何額外的使用者輸入下辨別包含在第一視訊影像內的臉部,且選擇包含臉部的預定區域作為感興趣區。 Although the second device 200 selects a portion of the first video image as the region of interest based on user input, the illustrative embodiments are not limited thereto. The second device 200 can identify the face contained within the first video image without any additional user input, and select a predetermined area containing the face as the region of interest.
在第一視訊影像中被選擇的感興趣區的尺寸,可基於在第一裝置100和第二裝置200之間傳輸的資料的串流解析度決定。在第一視訊影像中 的感興趣表面區的上限,可基於傳輸於第一裝置100和第二裝置200之間的資料的串流解析度決定。 The size of the region of interest selected in the first video image may be determined based on the stream resolution of the data transmitted between the first device 100 and the second device 200. In the first video image The upper limit of the surface area of interest may be determined based on the stream resolution of the data transmitted between the first device 100 and the second device 200.
第二裝置200可產生被選擇的感興趣區的座標資訊。第二裝置200可自全部的第一視訊影像的座標之中產生座標值,此座標值指出被選擇感興趣區的位置。並且,第二裝置200可自全部的第一視訊影像產生座標值,此座標值指出觸控輸入點的位置。 The second device 200 can generate coordinate information of the selected region of interest. The second device 200 can generate a coordinate value from among the coordinates of all of the first video images, the coordinate value indicating the location of the selected region of interest. Moreover, the second device 200 can generate a coordinate value from all of the first video images, the coordinate value indicating the position of the touch input point.
第二裝置200可產生關於在第一視訊影像所包含的複數個第一圖框的每一者的感興趣區的區域資訊。 The second device 200 can generate region information about a region of interest of each of the plurality of first frames included in the first video image.
當對應於第一裝置100所執行的應用程式的執行螢幕的第三視訊影像被提供至第二裝置200,第二裝置200可選擇第三視訊影像的部分,且產生關於選擇部分的區域資訊。 When the third video image corresponding to the execution screen of the application executed by the first device 100 is provided to the second device 200, the second device 200 may select a portion of the third video image and generate regional information about the selected portion.
在動作S330中,第二裝置200提供產生的區域資訊至第一裝置100,產生的區域資訊關於感興趣區。第二裝置200可提供被選擇的感興趣區的座標值至第一裝置100。並且,第二裝置200可提供使用者觸控輸入點的座標值至第一裝置100。 In action S330, the second device 200 provides the generated region information to the first device 100, and the generated region information is related to the region of interest. The second device 200 can provide a coordinate value of the selected region of interest to the first device 100. Moreover, the second device 200 can provide the coordinate value of the touch input point of the user to the first device 100.
在動作S340中,第一裝置100辨識有關於區域資訊的物件。在動作S340中,第一裝置100可基於接收的區域資訊辨識在第一視訊影像的物件。舉例來說,當包含在對應於接收的區域資訊的第一視訊影像中的物件是臉部,第一裝置100可自第一視訊影像辨識臉部。並且,有關於接收的區域資訊的物件可自包含在第一視訊影像中的複數個第一圖框的每一者被辨識。 In Act S340, the first device 100 recognizes an object related to the area information. In action S340, the first device 100 may identify the object in the first video image based on the received area information. For example, when the object included in the first video image corresponding to the received area information is a face, the first device 100 can recognize the face from the first video image. And, an object having information about the received area can be identified from each of the plurality of first frames included in the first video image.
第一裝置100可基於接收的區域資訊,從被擷取的視訊影像辨識 物件。接收的區域資訊為關於第一視訊影像的部分的區域資訊,且因此,第一裝置100可檢查自被擷取視訊影像的部分,此部分對應於第一視訊影像對應於接收到的區域資訊的部分。並且,第一裝置100可自被擷取的視訊影像的部分辨識包含對應於的物件。 The first device 100 can identify the captured video image based on the received area information. object. The received area information is area information about a portion of the first video image, and therefore, the first device 100 can check a portion of the captured video image corresponding to the first video image corresponding to the received area information. section. Moreover, the first device 100 can identify the corresponding object from the captured portion of the captured video image.
第一裝置100可利用自第一視訊影像被辨識的物件,辨識包含在被擷取視訊影像中的物件。第一裝置100可自被擷取的視訊影像,辨識相似於自第一視訊影像被辨識物件的影像的物件。無論物件相似與否,都可用許多的方式決定。舉例來說,無論物件相似與否,第一裝置100可以比較尺寸、顏色以及物件的形式至少其中之一來決定。或是,第一裝置100可對多樣的物件的部分彼此比較來決定物件是否相似。 The first device 100 can identify the object included in the captured video image by using the object recognized from the first video image. The first device 100 can identify an object similar to the image from the first video image recognized object from the captured video image. Whether the objects are similar or not, they can be decided in many ways. For example, regardless of whether the object is similar or not, the first device 100 can determine at least one of size, color, and form of the object. Alternatively, the first device 100 can compare portions of the various items to each other to determine whether the objects are similar.
若第一裝置100接收自第二裝置200的第三視訊影像的部份的區域資訊,其第三視訊影像的部份對應於執行在第一裝置100上的應用程式的執行螢幕,第一裝置100可基於接收的區域資訊,辨識自第三視訊影像的物件。 If the first device 100 receives the area information of the portion of the third video image of the second device 200, the portion of the third video image corresponds to the execution screen of the application executed on the first device 100, the first device 100 may identify an object from the third video image based on the received area information.
在動作S350中,第一裝置100追蹤被辨識的物件。第一裝置100可追蹤自第一視訊影像中被辨識的物件。並且,第一裝置100可追蹤自利用第一裝置擷取的視訊影像中被辨識的物件。以第一裝置100擷取的視訊影像包含目前正利用第一裝置100擷取的視訊影像。被辨識的物件可在此視訊影像內移動或旋轉,且第一裝置100可基於物件的形式或顏色追蹤在此視訊影像內的物件。追蹤被辨識的物件的意思為,當物件移動的情況下,檢查視訊影像內移動物件的位置,且檢查物件被包含的區域,但追蹤並不侷限於此。 In Act S350, the first device 100 tracks the identified object. The first device 100 can track the identified objects from the first video image. Moreover, the first device 100 can track the identified object from the video image captured by the first device. The video image captured by the first device 100 includes the video image currently being captured by the first device 100. The identified object can move or rotate within the video image, and the first device 100 can track the object within the video image based on the form or color of the object. Tracking the identified object means that, when the object moves, the position of the moving object within the video image is checked, and the area in which the object is included is checked, but the tracking is not limited thereto.
在動作S350中,第一裝置100可自第一視訊影像的複數個第一圖框中選擇包含辨識物件的圖框。並且,第一裝置100可辨識自第一視訊影像的複數個第一圖框中包含辨識物件的部分。 In Act S350, the first device 100 may select a frame containing the identified object from a plurality of first frames of the first video image. Moreover, the first device 100 can identify a portion of the first frame containing the identification object from the first video image.
當第一裝置100接收自第二裝置200的區域資訊,此區域資訊對應於執行在第一裝置100上的應用程式的執行螢幕的第三視訊影像的部分,第一裝置100可追蹤在第三視訊影像的物件。 When the first device 100 receives the area information from the second device 200, the area information corresponds to a portion of the third video image of the execution screen of the application executing on the first device 100, and the first device 100 can track the third device. The object of the video image.
在動作S360中,第一裝置100提供第二視訊影像至第二裝置200,第二視訊影像只包含被辨識物件的部份。第一裝置100可自擷取的影像裁剪包含被辨識物件的部份,且提供裁剪部分作為第二視訊影像至第二裝置200。 In the action S360, the first device 100 provides the second video image to the second device 200, and the second video image only includes the portion of the identified object. The first device 100 can crop the portion containing the recognized object from the captured image, and provide the cropped portion as the second video image to the second device 200.
詳細來說,第一裝置100可基於接收的區域資訊決定區域,此區域對應於在具有原始解析度的第一視訊影像的螢幕中的感興趣區。並且,第一裝置100可轉換第一視訊影像至第二視訊影像,使得第二視訊影像只包含決定的區域。並且,第一裝置100可提供在第一解析度下的第二視訊影像至第二裝置200。第一解析度的第一視訊影像可自原始解析度的第一視訊影像轉換而來。舉例來說,當第一視訊影像的原始解析度是1000×1000,且第二視訊影像的第一解析度是100×100,第一裝置100可轉換對應於被決定的區域的第一視訊影像的部份,至具有100×100解析度的第二視訊影像,且在100×100解析度下傳輸第二視訊影像至第二裝置200。 In detail, the first device 100 may determine an area based on the received area information, the area corresponding to the region of interest in the screen of the first video image having the original resolution. Moreover, the first device 100 can convert the first video image to the second video image such that the second video image only includes the determined region. Moreover, the first device 100 can provide the second video image at the first resolution to the second device 200. The first video image of the first resolution can be converted from the first video image of the original resolution. For example, when the original resolution of the first video image is 1000×1000, and the first resolution of the second video image is 100×100, the first device 100 may convert the first video image corresponding to the determined region. The portion is to a second video image having a resolution of 100×100, and the second video image is transmitted to the second device 200 at a resolution of 100×100.
第一裝置100可自第一視訊影像的複數個第一圖框中,區別出包含辨識物件的部份,且提供包含複數個第二圖框的第二視訊影像至外部裝置,第二圖框只包含複數個第一圖框的部份。 The first device 100 can distinguish the portion including the identification object from the plurality of first frames of the first video image, and provide the second video image including the plurality of second frames to the external device, and the second frame Contains only the parts of a plurality of first frames.
當第一裝置100自第一視訊影像的複數個第一圖框中選擇出包含被辨識的物件的圖框,第一裝置100可提供具有複數個只包含被選擇圖框的部分的第二圖框的第二視訊影像至外部裝置。在這情況下,這部分可為感興趣區。並且,第一裝置100可根據每個被選擇的圖框裁剪出對應於感興趣區的部分,因此產生每個被選擇圖框的第二圖框。 When the first device 100 selects a frame containing the recognized object from the plurality of first frames of the first video image, the first device 100 may provide a second image having a plurality of portions including only the selected frame. The second video image of the frame is to the external device. In this case, this part can be a region of interest. And, the first device 100 may crop a portion corresponding to the region of interest according to each selected frame, thus generating a second frame of each selected frame.
此外,第一裝置100可根據第一裝置100和第二裝置200之間的通信方法決定對應於第二視訊影像的區域尺寸。 In addition, the first device 100 may determine an area size corresponding to the second video image according to a communication method between the first device 100 and the second device 200.
第二視訊影像可包含複數個第二圖框,每個第二圖框只包含有被動作S350中選擇的圖框的部分,但並不侷限於此。並且,第二視訊影像可包含複數個只包含在動作S350中可區別的部份的第二圖框,但並不侷限於此。 The second video image may include a plurality of second frames, each of which includes only a portion of the frame selected by the action S350, but is not limited thereto. Moreover, the second video image may include a plurality of second frames including only the distinguishable portions in the action S350, but is not limited thereto.
第一裝置100可根據第一裝置100和第二裝置200之間的通信方法決定第二視訊影像的影像品質或解析度。舉例來說,當包含辨識物件的圖框的部分的解析度小於第一裝置100和第二裝置200之間所傳輸的資料的串流解析度,第一裝置100可增加包含辨識物件的部份的解析度或影像品質。此外,舉例來說,當包含辨識物件的圖框的部分的解析度小於第一裝置100和第二裝置200之間所傳輸的資料的串流解析度,第一裝置100可增加包含辨識物件的圖框的部份的解析度或影像品質。 The first device 100 can determine the image quality or resolution of the second video image according to the communication method between the first device 100 and the second device 200. For example, when the resolution of the portion of the frame including the identification object is smaller than the stream resolution of the data transmitted between the first device 100 and the second device 200, the first device 100 may increase the portion including the identification object. Resolution or image quality. In addition, for example, when the resolution of the portion of the frame including the identification object is smaller than the stream resolution of the data transmitted between the first device 100 and the second device 200, the first device 100 may increase the inclusion of the identification object. The resolution or image quality of the part of the frame.
介於第一裝置100和第二裝置200的通信方法的範例包含,沒有限制,第三代(3G)通信、第四(4G)代通信以及無線(Wi-Fi)通信。 Examples of the communication method between the first device 100 and the second device 200 include, without limitation, third generation (3G) communication, fourth (4G) generation communication, and wireless (Wi-Fi) communication.
當介於第一裝置100和第二裝置200之間的通信方法被修改時,第一裝置100可修改對應於第二視訊影像的感興趣區的大小或第二視訊影 像的影像品質。當第一裝置100和第二裝置200至少其中之一執行交遞,第一裝置100和第二裝置之間的通信方法可被修改。 When the communication method between the first device 100 and the second device 200 is modified, the first device 100 may modify the size of the region of interest corresponding to the second video image or the second video shadow Image quality like image. When at least one of the first device 100 and the second device 200 performs handover, the communication method between the first device 100 and the second device can be modified.
此外,當辨識物件從擷取視訊影像消失,亦即,當辨識物件不被擷取時,第一裝置100可修改對應於第二視訊影像的區域。舉例來說,當辨識物件從擷取視訊影像消失時,第一裝置100可提供全部的擷取視訊影像至第二裝置200。並且,在這情況下,第一裝置100可基於額外的使用者輸入,提供全部的擷取視訊影像至第二裝置200。 In addition, when the identification object disappears from capturing the video image, that is, when the identification object is not captured, the first device 100 may modify the area corresponding to the second video image. For example, when the identification object disappears from capturing the video image, the first device 100 can provide all the captured video images to the second device 200. Moreover, in this case, the first device 100 can provide all captured video images to the second device 200 based on additional user input.
此外,當消失的物件再出現在擷取影像中,亦即,當消失的物件再次被擷取,包含自擷取影像的全部區域之中出現的物件的部份的視訊影像可被提供至第二裝置200。 In addition, when the disappearing object appears again in the captured image, that is, when the disappeared object is captured again, the video image containing the portion of the object appearing in all areas of the captured image can be provided to the first Two devices 200.
當第一裝置100接收區域資訊,區域資訊關於對應於執行在第一裝置100的應用程式的執行螢幕的第三視訊影像的部分,第一裝置100可提供第四視訊影像至第二裝置200,第四視訊影像只包含被辨識物件的部份。在這情況下,第一裝置100可以第三解析度提供第四視訊影像至第二裝置200。 When the first device 100 receives the area information, the area information is related to the portion of the third video image corresponding to the execution screen of the application of the first device 100, the first device 100 may provide the fourth video image to the second device 200, The fourth video image contains only the portion of the identified object. In this case, the first device 100 can provide the fourth video image to the second device 200 at a third resolution.
當第一裝置100接收區域資訊,區域資訊關於對應於執行在第一裝置100的應用程式的執行螢幕的第三視訊影像的部份,第一裝置100不能辨識或追蹤此包含在第三視訊影像的物件。在這情況下,第一裝置100可基於接收到的區域資訊,裁剪第三視訊影像的部分,且轉換裁剪的部份為第四視訊影像,且提供第四視訊影像至第二裝置200。 When the first device 100 receives the area information and the area information is related to the portion of the third video image corresponding to the execution screen of the application executed by the first device 100, the first device 100 cannot recognize or track the third video image. Object. In this case, the first device 100 may crop the portion of the third video image based on the received area information, and convert the cropped portion into a fourth video image, and provide the fourth video image to the second device 200.
在動作S370中,第二裝置200顯示接收的第二視訊影像。第二裝置200的使用者可檢查詳細的視訊影像,視訊影像針對包含在選擇區域 的物件。並且,第二裝置200可顯示接收的第二視訊影像的靜止螢幕。 In Act S370, the second device 200 displays the received second video image. The user of the second device 200 can check the detailed video image, and the video image is included in the selected area. Object. Moreover, the second device 200 can display a still screen of the received second video image.
同時,第二裝置200可一起顯示第一視訊影像和第二視訊影像在第二裝置的螢幕上。在這情況下,第二裝置200可接收不只第二視訊影像,還可接收在動作S360中的第一視訊影像。並且,第二裝置200可透過重疊第二視訊影像在第一視訊影像上來顯示第一和第二視訊影像。第二裝置200可將第二視訊影像重疊在第一視訊影像不顯示第一裝置100的使用者的部分。此外,第二裝置200可調整第一視訊影像被顯示部分的尺寸,和第二視訊影像被顯示部分的尺寸。然而,例示性實施例並不侷限於此,且第二裝置200可顯示第一和第二視訊影像在第二裝置的螢幕上而不重疊第一和第二視訊影像。 At the same time, the second device 200 can display the first video image and the second video image together on the screen of the second device. In this case, the second device 200 can receive not only the second video image but also the first video image in action S360. Moreover, the second device 200 can display the first and second video images on the first video image by overlapping the second video images. The second device 200 may superimpose the second video image on a portion of the first video image that does not display the user of the first device 100. In addition, the second device 200 can adjust the size of the displayed portion of the first video image and the size of the displayed portion of the second video image. However, the exemplary embodiment is not limited thereto, and the second device 200 can display the first and second video images on the screen of the second device without overlapping the first and second video images.
儘管第二裝置200接收自第一裝置100的第二視訊影像,且顯示第一和第二視訊影像如上所述,或者,第二裝置200可選擇第一視訊影像的部分,萃取自第一視訊影像選擇的部分的展開影像,且一起顯示萃取展開的影像和第一視訊影像在第二裝置200的螢幕。 Although the second device 200 receives the second video image from the first device 100 and displays the first and second video images as described above, or the second device 200 can select a portion of the first video image, extracted from the first video. An image of the selected portion of the image is displayed, and the extracted image and the first video image are displayed together on the screen of the second device 200.
圖4是根據例示性實施例的流程圖說明利用第二裝置200產生關於感興趣區的區域資訊的方法。 4 is a flowchart illustrating a method of generating region information about a region of interest using the second device 200, in accordance with an illustrative embodiment.
在動作S322中,第二裝置200接收用於選擇第一視訊影像的部分的使用者輸入。第二裝置200可接收用於選擇第一視訊影像的部份的使用者的觸控輸入。舉例來說,第二裝置200可接收用於觸控第一視訊影像的預定點的使用者輸入,或使用者用於觸控且拖曳第一視訊影像的預定點的輸入。 In Act S322, the second device 200 receives a user input for selecting a portion of the first video image. The second device 200 can receive a touch input of a user for selecting a portion of the first video image. For example, the second device 200 can receive a user input for touching a predetermined point of the first video image, or an input of a predetermined point used by the user to touch and drag the first video image.
並且,第二裝置200可經由顯示在螢幕上的預定使用者介面接收 使用者的觸控輸入。舉例來說,第二裝置200可顯示在第一視訊影像的部分上的矩形,且提供使用者介面,以便使用者可觸控和拖曳矩形的圖框來修改矩形的尺寸。並且,第二裝置200可經由提供的使用者介面接收使用者的觸控輸入。 And, the second device 200 can receive via a predetermined user interface displayed on the screen. User's touch input. For example, the second device 200 can display a rectangle on a portion of the first video image and provide a user interface so that the user can touch and drag the rectangular frame to modify the size of the rectangle. Moreover, the second device 200 can receive the user's touch input via the provided user interface.
在動作S324中,第二裝置200檢查與第一裝置100有關的通信方法。第二裝置200可檢查與第一裝置100有關的通信方法的類型和頻寬。 並且,第二裝置200可檢查第一裝置100和第二裝置200之間的資料傳輸的串流解析度。第一裝置100和第二裝置200之間的通信方法的範例包含,並無限制,3G通信、4G通信以及無線通信。 In Act S324, the second device 200 checks the communication method related to the first device 100. The second device 200 can check the type and bandwidth of the communication method associated with the first device 100. And, the second device 200 can check the stream resolution of the data transmission between the first device 100 and the second device 200. Examples of the communication method between the first device 100 and the second device 200 include, without limitation, 3G communication, 4G communication, and wireless communication.
在動作S326中,第二裝置200基於接收的使用者輸入和檢查的通信方法,選擇第一視訊影像的部分作為感興趣區。第二裝置200可基於在第一視訊影像的觸控輸入點位置,選擇第一視訊影像的部分。詳細來說,當使用者觸控在第一視訊影像的觸控點,第二裝置200辨識包含觸控點的物件,且選擇包含辨識物件的第一視訊影像內的部份。舉例來說,當臉部的顯示影像在第一視訊影像中被觸控,第二裝置200可辨識臉部,此臉部即為包含被觸控點的物件。並且,第二裝置200可選擇包含辨識的臉部的部份作為感興趣區。 In Act S326, the second device 200 selects a portion of the first video image as the region of interest based on the received user input and the communication method of the check. The second device 200 can select a portion of the first video image based on the position of the touch input point of the first video image. In detail, when the user touches the touch point of the first video image, the second device 200 recognizes the object including the touch point, and selects a portion of the first video image including the identification object. For example, when the display image of the face is touched in the first video image, the second device 200 can recognize the face, which is the object containing the touched point. And, the second device 200 can select a portion including the recognized face as the region of interest.
此外,當使用者觸控在第一視訊影像上的預定點,第二裝置200可自觸控點選擇先前設定範圍的區域,作為感興趣區。舉例來說,第二裝置200可選擇有關於觸控點的預定尺寸的矩形區域作為感興趣區。 In addition, when the user touches a predetermined point on the first video image, the second device 200 can select an area of the previously set range from the touch point as the region of interest. For example, the second device 200 may select a rectangular region having a predetermined size with respect to the touch point as the region of interest.
第二裝置200可經由使用者界面根據使用者的觸控輸入,修改選擇的感興趣區。 The second device 200 can modify the selected region of interest according to the user's touch input via the user interface.
在第一視訊影像中選擇的感興趣區尺寸,可根據在第一裝置100和第二裝置200之間的通信方法被決定。舉例來說,在第一視訊影像中選擇的感興趣區尺寸可基於通信方法的類型和頻寬至少其中之一被決定。並且,在另一個範例,在第一視訊影像中選擇的感興趣區尺寸可基於在第一裝置100和第二裝置200之間的資料傳輸的串流解析度的程度被決定。在第一視訊影像中選擇感興趣區大小的上限,可根據在第一裝置100和第二裝置200之間的通信方法被決定。 The size of the region of interest selected in the first video image can be determined according to the communication method between the first device 100 and the second device 200. For example, the size of the region of interest selected in the first video image may be determined based on at least one of the type and bandwidth of the communication method. Moreover, in another example, the size of the region of interest selected in the first video image may be determined based on the degree of stream resolution of the data transmission between the first device 100 and the second device 200. The upper limit of the size of the region of interest in the first video image can be determined according to the communication method between the first device 100 and the second device 200.
根據參照於上面圖4的描述,儘管第二裝置200基於使用者輸入選擇第一視訊影像的部分,例示性實施例並不侷限於此。第二裝置200可在沒有額外的使用者輸入下,辨認在第一視訊影像中的臉部,且選擇包含臉部的預定區域當作感興趣區。並且,在這情況下,被選擇感興趣區的大小,可根據在第一裝置100和第二裝置200之間的通信方法被決定。 According to the description with reference to FIG. 4 above, although the second device 200 selects a portion of the first video image based on user input, the illustrative embodiments are not limited thereto. The second device 200 can recognize the face in the first video image without additional user input, and select a predetermined area including the face as the region of interest. Also, in this case, the size of the selected region of interest may be determined according to the communication method between the first device 100 and the second device 200.
圖5是根據例示性實施例的流程圖,其說明當在第一裝置100和第二裝置200之間的通信方法被修改時,修改利用第一裝置100選擇的感興趣區,且針對於被修改區提供視訊影像至第二裝置200的方法。 FIG. 5 is a flowchart illustrating modification of a region of interest selected by the first device 100 when a communication method between the first device 100 and the second device 200 is modified, and is directed to being used, according to an exemplary embodiment The modification area provides a method of providing a video image to the second device 200.
在動作S500中,第一裝置100判定在第一裝置100和第二裝置200之間的通信方法被修改與否。詳細來說,第一裝置100可檢查通信方法的類型或頻寬被修改與否。並且,第二裝置200可檢查在第一裝置100和第二裝置200間的資料傳輸的串流解析度被修改與否。 In action S500, the first device 100 determines whether the communication method between the first device 100 and the second device 200 is modified or not. In detail, the first device 100 can check whether the type or bandwidth of the communication method is modified or not. And, the second device 200 can check whether the stream resolution of the data transmission between the first device 100 and the second device 200 is modified or not.
在第一裝置100和第二裝置200之間的通信方法的範例包含,沒有限制,3G通信、4G通信以及無線通信。此外,當第一裝置100和第二裝置200至少其中之一執行移交時,在第一裝置100和第二裝置200之間 的通信方法可被修改。 Examples of the communication method between the first device 100 and the second device 200 include, without limitation, 3G communication, 4G communication, and wireless communication. Further, when at least one of the first device 100 and the second device 200 performs handover, between the first device 100 and the second device 200 The communication method can be modified.
基於動作S500判定的結果,當通信方法被修改時,在動作S510中,第一裝置100修改對應於被傳輸到第二裝置的第二視訊影像的區域。 當在第一裝置100和第二裝置200之間的通信方法被修改時,第一裝置100可對應於第二視訊影像修改第一視訊影像的部份的尺寸。 Based on the result of the decision of action S500, when the communication method is modified, in action S510, the first device 100 modifies the region corresponding to the second video image transmitted to the second device. When the communication method between the first device 100 and the second device 200 is modified, the first device 100 may modify the size of the portion of the first video image corresponding to the second video image.
舉例來說,在第一裝置100和第二裝置200之間的通信方法自3G通信修改至無線通信,要自第一裝置100被傳輸第一視訊影像的部分可被選擇,此部分是大於對應於第二視訊影像的第一視訊影像的部份。當在第一裝置100和第二裝置200之間的通信方法為3G通信,且第一裝置100已經傳輸第一視訊影像的臉部部分,接著,第一裝置100和第二裝置200之間的通信方法修改至無線通信,第一裝置100可選擇第一視訊影像的部份,使得除了臉之外的第一視訊影像的背景部份更被包含。另外,舉例來說,當在第一裝置100和第二裝置200之間的通信方法自4G通信被修改為無線通信,可選擇小於對應於第二視訊影像的部份的區域。 For example, the communication method between the first device 100 and the second device 200 is modified from 3G communication to wireless communication, and the portion of the first video image to be transmitted from the first device 100 can be selected, and the portion is greater than the corresponding The portion of the first video image of the second video image. When the communication method between the first device 100 and the second device 200 is 3G communication, and the first device 100 has transmitted the face portion of the first video image, then, between the first device 100 and the second device 200 The communication method is modified to wireless communication, and the first device 100 can select a portion of the first video image such that the background portion of the first video image other than the face is more included. Further, for example, when the communication method between the first device 100 and the second device 200 is modified from wireless communication to 4G communication, an area smaller than a portion corresponding to the second video image may be selected.
並且,舉例來說,當在第一裝置100和第二裝置200之間的資料傳輸的串流解析度被修改,對應於第二視訊影像的部份的尺寸可被修改。 Also, for example, when the stream resolution of the data transmission between the first device 100 and the second device 200 is modified, the size of the portion corresponding to the second video image can be modified.
對應於通信方法的類型以及頻寬至少其中之一的區域的尺寸,可先被設定以及儲存在第一裝置100中。並且,被傳輸在第一裝置100和第二裝置200之間的資料的串流解析度的區域的尺寸可先被設定以及儲存在第一裝置100。 The size of the area corresponding to at least one of the type of the communication method and the bandwidth may be set and stored in the first device 100 first. Also, the size of the region of the stream resolution of the material transmitted between the first device 100 and the second device 200 may be first set and stored in the first device 100.
在動作S520中,第一裝置100提供修改過的區域的視訊影像至第二裝置200。舉例來說,當在第一裝置100以及第二裝置200之間的通信 方法自3G通信被修改為無線通信,第一裝置100可提供針對第一視訊影像的部份的視訊影像至第二裝置200,此第一視訊影像的部份大於第一視訊影像對應於第二視訊影像的部份。並且,舉例來說,當被傳輸在第一裝置100以及第二裝置200之間的資料的串流解析度被減少,第一裝置100可提供針對視訊影像的部份,較小於第一視訊影像對應於第二視訊影像的部份至第二裝置200。 In Act S520, the first device 100 provides the video image of the modified region to the second device 200. For example, when communication between the first device 100 and the second device 200 The method is modified from the 3G communication to the wireless communication, and the first device 100 can provide the video image of the portion of the first video image to the second device 200. The portion of the first video image is larger than the first video image corresponding to the second device. Part of the video image. Moreover, for example, when the stream resolution of the data transmitted between the first device 100 and the second device 200 is reduced, the first device 100 can provide a portion for the video image, which is smaller than the first video. The image corresponds to a portion of the second video image to the second device 200.
圖6為根據示例性實施例的流程圖,說明當第一裝置100以及第二裝置200之間的通信方法被修改,利用第一裝置100提供具有被修改影像品質的視訊影像至第二裝置200的方法。 6 is a flowchart illustrating that when a communication method between the first device 100 and the second device 200 is modified, the first device 100 is used to provide a video image having a modified image quality to the second device 200, according to an exemplary embodiment. Methods.
在動作S600中,第一裝置100判定有關於第二裝置200通信方法是否被修改。詳細來說,第一裝置100可檢查有關於第二裝置200通信方法的類型或頻寬是否被修改。並且,第二裝置200可檢查被傳輸在第一裝置100以及第二裝置200的資料的串流解析度是否被修改。 In Act S600, the first device 100 determines whether the communication method of the second device 200 is modified. In detail, the first device 100 may check whether the type or bandwidth of the communication method with respect to the second device 200 is modified. And, the second device 200 can check whether the stream resolution of the data transmitted between the first device 100 and the second device 200 is modified.
基於動作S600的結果,當在動作S610中判定通信方法被修改,第一裝置100修改傳輸至第二裝置200的第二視訊影像的影像品質。如第一裝置100與第二裝置200之間的通信方法被修改,第一裝置100可修改第二視訊影像的影像品質為高影像品質或低影像品質。 Based on the result of the action S600, when it is determined in the action S610 that the communication method is modified, the first device 100 modifies the image quality of the second video image transmitted to the second device 200. If the communication method between the first device 100 and the second device 200 is modified, the first device 100 can modify the image quality of the second video image to be high image quality or low image quality.
舉例來說,當第一裝置100與第二裝置200之間的通信方法自第三代通信被修為無線通信,則第二視訊影像的影像品質可被修改為較第三代通信更高的影像品質。另外,舉例來說,當第一裝置100和第二裝置200之間的通信方法自第四代通信被修為第三代通信,則第二視訊影像的影像品質可被修改為較第四代通信低的影像品質。 For example, when the communication method between the first device 100 and the second device 200 is repaired to wireless communication from the third generation communication, the image quality of the second video image can be modified to be higher than the third generation communication. Image quality. In addition, for example, when the communication method between the first device 100 and the second device 200 is modified from the fourth generation communication to the third generation communication, the image quality of the second video image can be modified to be the fourth generation. Low image quality for communication.
另一個例子,當第一裝置100和第二裝置200之間的資料傳輸的串流解析度被修改,第二視訊影像的影像品質可被修改。 As another example, when the stream resolution of the data transmission between the first device 100 and the second device 200 is modified, the image quality of the second video image can be modified.
對應於通信方法的類型以及頻寬至少其中之一的影像品質可先被設定以及儲存在第一裝置100。並且,對應於第一裝置100以及第二裝置200之間的資料傳輸的串流解析度的影像品質,可先被設定以及儲存在第一裝置100。 The image quality corresponding to at least one of the type of communication method and the bandwidth may be first set and stored in the first device 100. Further, the image quality corresponding to the stream resolution of the data transmission between the first device 100 and the second device 200 may be first set and stored in the first device 100.
在動作S620中,第一裝置100提供修改過影像品質的視訊影像至第二裝置200。第一裝置100可提供具有相當於修改過的影像品質的視訊影像至第二裝置200。 In Act S620, the first device 100 provides the video image with the modified image quality to the second device 200. The first device 100 can provide a video image having a modified image quality to the second device 200.
圖7為根據另一個示例性實施例的流程圖,說明包含對應於被擷取視訊影像的部份的物件的視訊影像,利用第一裝置100提供至第二裝置200的方法。參考圖7,第一裝置100可接收自第二裝置200的第一視訊影像的預定點的座標資訊,以及利用接收的座標資訊選擇第一視訊影像的部份作為感興趣區。 FIG. 7 is a flow diagram illustrating a method of providing a video image of an object corresponding to a portion of the captured video image to the second device 200 using the first device 100, in accordance with another exemplary embodiment. Referring to FIG. 7, the first device 100 can receive coordinate information of a predetermined point of the first video image of the second device 200, and select a portion of the first video image as the region of interest by using the received coordinate information.
在動作S700中,第一裝置100提供第一視訊影像至第二裝置200。第一裝置100可基於被擷取的視訊影像,提供第一視訊影像至第二裝置200。第一裝置100可提供擷取的視訊影像作為沒有處理的第一視訊影像至第二裝置200。並且,第一裝置100可處理被擷取的視訊影像,且提供被處理的視訊影像作為第一視訊影像至第二裝置200。在這情況下,第一裝置100可修改被擷取的視訊影像的解析度,或轉換被擷取的視訊影像轉為預定格式。舉例來說,若被擷取的視訊影像的解析度大於第一裝置100和第二裝置200之間的資料的串流解析度,第一裝置100可修改被擷取視訊影像 的解析度至與資料的解析度相同,以及可以修改後解析度提供被擷取的視訊影像作為第一視訊影像至第二裝置200。 In Act S700, the first device 100 provides the first video image to the second device 200. The first device 100 can provide the first video image to the second device 200 based on the captured video image. The first device 100 can provide the captured video image as the unprocessed first video image to the second device 200. Moreover, the first device 100 can process the captured video image and provide the processed video image as the first video image to the second device 200. In this case, the first device 100 may modify the resolution of the captured video image or convert the captured video image into a predetermined format. For example, if the resolution of the captured video image is greater than the stream resolution of the data between the first device 100 and the second device 200, the first device 100 may modify the captured video image. The resolution is the same as the resolution of the data, and the modified video image can be provided as the first video image to the second device 200.
在動作S700中,第一裝置100可以第一解析度傳輸具有原始解析度的第一視訊影像至外部裝置。第一裝置100可轉換具有原始解析度的第一視訊影像至第一解析度的第一視訊影像,且傳輸具有第一解析度的第一視訊影像至第二裝置200。在這情況下,第一裝置100可先取得關於被包含在第二裝置200的顯示器的解析度的資訊以及將其儲存,且基於包含在第二裝置200的顯示器的解析度判定第一解析度。 In Act S700, the first device 100 may transmit the first video image having the original resolution to the external device at the first resolution. The first device 100 can convert the first video image with the original resolution to the first video image of the first resolution, and transmit the first video image with the first resolution to the second device 200. In this case, the first device 100 may first acquire information about the resolution of the display included in the second device 200 and store it, and determine the first resolution based on the resolution of the display included in the second device 200. .
在動作S710中,第二裝置200顯示接收的第一視訊影像。第二裝置200可在第二裝置200的螢幕顯示被接收的第一視訊影像。舉例來說,第二裝置200可在螢幕中顯示第一解析度的第一視訊影像。 In Act S710, the second device 200 displays the received first video image. The second device 200 can display the received first video image on the screen of the second device 200. For example, the second device 200 can display the first video image of the first resolution on the screen.
在動作S720中,使用者的觸控輸入針對在螢幕上顯示的第一視訊影像,第二裝置200接收使用者的觸控輸入。第二裝置200可接收使用者的觸控輸入來選擇在螢幕上顯示的第一視訊影像的預定點。並且,第二裝置200可產生被觸控點的座標資訊。 In Act S720, the user's touch input is for the first video image displayed on the screen, and the second device 200 receives the user's touch input. The second device 200 can receive a touch input of the user to select a predetermined point of the first video image displayed on the screen. Moreover, the second device 200 can generate coordinate information of the touched point.
在動作S730,第二裝置200提供觸控點的座標資訊至第一裝置100。 In Act S730, the second device 200 provides coordinate information of the touch point to the first device 100.
在動作S740中,第一裝置100基於接收的座標資訊,將被提供至第二裝置200的第一視訊影像的部份判定作為感興趣區。第一裝置100可基於被觸控點的座標來選擇部份。詳細來說,第一裝置100可辨識包含觸控點的物件,且選擇包含被辨識物件的區域。舉例來說,當在第一視訊影像的臉部部分被觸控,第一裝置100可辨識臉部為包含被觸控點的物件。 並且,第一裝置100可選擇包含被辨識的臉部的部分作為感興趣區。 In Act S740, the first device 100 determines the portion of the first video image provided to the second device 200 as the region of interest based on the received coordinate information. The first device 100 can select a portion based on the coordinates of the touched point. In detail, the first device 100 can recognize an object including a touch point and select an area including the identified object. For example, when the face portion of the first video image is touched, the first device 100 can recognize the face as an object including the touched point. And, the first device 100 can select a portion including the recognized face as the region of interest.
並且,第一裝置100可選擇觸控點周圍的先設定範圍的區域作為感興趣區。舉例來說,第一裝置100可選擇具有觸控點周圍的預定尺寸的矩形區域作為感興趣區。 Moreover, the first device 100 can select an area of a first set range around the touch point as the region of interest. For example, the first device 100 may select a rectangular area having a predetermined size around the touch point as the region of interest.
在動作S750中,第一裝置100辨識包含在判定部分的物件。舉例來說,當第一裝置100自觸控點選擇先設定範圍的區域作為感興趣區,第一裝置100可自第一視訊影像辨識包含被選擇部份的物件。 In Act S750, the first device 100 recognizes the object included in the determination portion. For example, when the first device 100 selects a region of the first set range as the region of interest from the touch point, the first device 100 can identify the object including the selected portion from the first video image.
第一裝置100可基於被決定的感興趣區,自擷取的視訊影像辨識物件。被決定的感興趣區為第一視訊影像的部份,並且第一裝置100因此可自目前被擷取的視訊影像檢查相符於第一視訊影像的感興趣區的區域。 並且,第一裝置100可自目前被擷取的視訊影像辨識被包含在相符區域的物件。 The first device 100 can identify the object from the captured video image based on the determined region of interest. The determined region of interest is part of the first video image, and the first device 100 can therefore check the region of the region of interest of the first video image from the currently captured video image. Moreover, the first device 100 can identify the object included in the matching area from the currently captured video image.
第一裝置100可利用自第一視訊影像被辨識的物件辨識被包含在被擷取的視訊影像的物件。第一裝置100可利用自第一視訊影像辨識的物件來辨識包含在被擷取的視訊影像中的物件。第一裝置100可基於相符/辨識門檻來辨識相似於自第一視訊影像被辨識的物件的影像。 The first device 100 can identify the object included in the captured video image by using the object recognized from the first video image. The first device 100 can identify an object included in the captured video image by using an object recognized from the first video image. The first device 100 can identify an image similar to the object recognized from the first video image based on the coincidence/identification threshold.
在動作S760中,第一裝置100追蹤被辨識的物件。第一裝置100可追蹤自第一視訊影像辨識的物件。並且,第一裝置100可追蹤自被擷取的視訊影像中被辨識的物件。 In action S760, the first device 100 tracks the identified object. The first device 100 can track the object identified from the first video image. Moreover, the first device 100 can track the identified object from the captured video image.
在動作S770中,第一裝置100提供包含被追蹤的物件的第二視訊影像至第二裝置200。第一裝置100可自擷取的視訊影像,剪裁出包含有被辨識的物件的部份,且提供所剪裁的部份作為第二視訊影像至第二裝置 200。 In Act S770, the first device 100 provides a second video image containing the tracked object to the second device 200. The first device 100 can automatically extract the portion containing the recognized object from the captured video image, and provide the clipped portion as the second video image to the second device. 200.
詳細來說,第一裝置100可基於接收的區域資訊,判定具有原始解析度的第一視訊影像的螢幕的部份,此部分對應於感興趣區。並且,第一裝置100可轉換第一視訊影像至第二視訊影像,使得只有判定部份被包含在第二視訊影像。並且,第一裝置100可以第一解析度提供第二視訊影像至第二裝置200。第一解析度的第一視訊影像可轉換自原始解析度的第一視訊影像。舉例來說,當第一視訊影像的原始解析度為1000×1000,且第二視訊影像的第一解析度為100×100,第一裝置100可轉換第一視訊影像的判定部份至第二視訊影像,且以100×100解析度傳輸第二視訊影像至第二裝置200。 In detail, the first device 100 may determine, according to the received area information, a portion of the screen of the first video image having the original resolution, the portion corresponding to the region of interest. Moreover, the first device 100 can convert the first video image to the second video image such that only the determination portion is included in the second video image. Moreover, the first device 100 can provide the second video image to the second device 200 at the first resolution. The first video image of the first resolution can be converted from the first video image of the original resolution. For example, when the original resolution of the first video image is 1000×1000, and the first resolution of the second video image is 100×100, the first device 100 can convert the determination part of the first video image to the second. The video image is transmitted, and the second video image is transmitted to the second device 200 at a resolution of 100×100.
第一裝置100可根據第一裝置100和第二裝置200之間的通信方法來決定對應於第二視訊影像的部份的尺寸。並且,第一裝置100可根據第一裝置100和第二裝置200之間通信方法來決定第二視訊影像的影像品質。第一裝置100和第二裝置200之間的通信方法的範例包含,沒有限制,第三代通信、第四代通信以及無線通信。 The first device 100 can determine the size of the portion corresponding to the second video image according to the communication method between the first device 100 and the second device 200. Moreover, the first device 100 can determine the image quality of the second video image according to the communication method between the first device 100 and the second device 200. Examples of the communication method between the first device 100 and the second device 200 include, without limitation, third generation communication, fourth generation communication, and wireless communication.
當第一裝置100和第二裝置200的通信方法被修改,第一裝置100可修改對應於第二視訊影像的區域的尺寸,或對應於第二視訊影像的區域的影像品質。當第一裝置100和第二裝置200至少其中之一執行交遞(hand over),第一裝置100和第二裝置200的通信方法可被修改。 When the communication method of the first device 100 and the second device 200 is modified, the first device 100 may modify the size of the area corresponding to the second video image or the image quality of the area corresponding to the second video image. When at least one of the first device 100 and the second device 200 performs hand over, the communication method of the first device 100 and the second device 200 may be modified.
在動作S780中,第二裝置200顯示接收的視訊影像。第二裝置200的使用者可檢查包含在被選擇區域的物件的細微視訊影像。 In Act S780, the second device 200 displays the received video image. The user of the second device 200 can check the subtle video image of the object contained in the selected area.
同時,第二裝置200可在第二裝置200的螢幕上一起顯示第一視 訊影像以及第二視訊影像。在這情況下,在動作S770中,第二裝置200可接收不僅第二視訊影像,也接收第一視訊影像。並且,第二裝置200可以利用交疊第二視訊影像在第一視訊影像上以顯示第一以及第二視訊影像。 第二裝置200可將第二視訊影像交疊在第一視訊影像中沒有顯示第一裝置100的使用者的部份。另外,第二裝置200可調整顯示第一視訊影像的部份的尺寸,以及顯示第二視訊影像的部份的尺寸。然而,例示性實施例並不侷限於此,第二裝置200可在第二裝置200的螢幕上顯示第一以及第二視訊影像而不交疊第一以及第二視訊影像。 Meanwhile, the second device 200 can display the first view together on the screen of the second device 200. Video and second video. In this case, in operation S770, the second device 200 can receive not only the second video image but also the first video image. Moreover, the second device 200 can use the overlapping second video images on the first video image to display the first and second video images. The second device 200 can overlap the second video image in a portion of the first video image that does not display the user of the first device 100. In addition, the second device 200 can adjust the size of the portion of the first video image and the size of the portion of the second video image. However, the exemplary embodiment is not limited thereto, and the second device 200 may display the first and second video images on the screen of the second device 200 without overlapping the first and second video images.
圖8A和圖8B為根據示例性實施例的範例,說明利用第二裝置決定第一視訊影像的部份作為感興趣區,此決定區域包含使用者觸控的觸控點的物件。 8A and 8B illustrate an example of determining, by using a second device, a portion of a first video image as a region of interest, the decision region including an object of a touch point touched by a user, according to an exemplary embodiment.
參考圖8A以及圖8B,當使用者觸控顯示在第二裝置200的螢幕上的在第一視訊影像中的預定點80,第二裝置200可判定出包含臉部82的區域84作為第一視訊影像的部份,臉部82包含觸控點80。 Referring to FIG. 8A and FIG. 8B, when the user touches a predetermined point 80 in the first video image displayed on the screen of the second device 200, the second device 200 can determine the area 84 including the face 82 as the first The portion 82 of the video image includes a touch point 80.
詳細來說,當使用者觸控被顯示在螢幕上的第一視訊影像中的預定點80,第二裝置200可辨識包含被觸控點的臉部82。並且,第二裝置200可選擇包含臉部82的區域84。在這情況下,區域84的尺寸可基於第一裝置100和第二裝置200之間的通信方法決定。 In detail, when the user touches a predetermined point 80 in the first video image displayed on the screen, the second device 200 can recognize the face 82 including the touched point. Also, the second device 200 can select an area 84 that includes the face 82. In this case, the size of the area 84 can be determined based on the communication method between the first device 100 and the second device 200.
舉例來說,當使用者觸控在第二裝置200的螢幕上顯示的預定的功能選擇單,預定框(predetermined box)被顯示在第二裝置200的視窗上,且使用者可移動顯示的框或調整框的尺寸來選擇感興趣區。在這情況下,使得這些框被移動或框的尺寸被調整的使用者介面也可被顯示於第二裝置 200的螢幕上。 For example, when the user touches a predetermined function menu displayed on the screen of the second device 200, a predetermined box is displayed on the window of the second device 200, and the user can move the displayed frame. Or adjust the size of the box to select the area of interest. In this case, the user interface that causes the frames to be moved or the size of the frame to be adjusted can also be displayed on the second device. 200 on the screen.
圖9A以及圖9B為根據示例性實施例的範例,其說明利用第二裝置200自使用者觸控點判定先前設定範圍中的部分作為感興趣區。 9A and 9B are diagrams illustrating an example of determining a portion of a previously set range as a region of interest from a user touch point using the second device 200, in accordance with an exemplary embodiment.
參考圖9A以及圖9B,當使用者觸控了顯示在第二裝置200的螢幕上的第一視訊影像中的預定點80,在觸控點80周圍的具有預定尺寸的矩形區域92可決定為第一視訊影像的部份。在這情況下,區域92的尺寸可基於第一裝置100以及第二裝置200之間的通信方法決定。 Referring to FIG. 9A and FIG. 9B, when the user touches a predetermined point 80 in the first video image displayed on the screen of the second device 200, the rectangular area 92 having a predetermined size around the touch point 80 can be determined as Part of the first video image. In this case, the size of the area 92 can be determined based on the communication method between the first device 100 and the second device 200.
或者,第二裝置200可基於使用者非捏縮輸入(unpinching input)決定感興趣區。當使用者,舉例來說,使用他的或她的拇指以及食指以非捏縮輸入展開第二視訊影像的預定部份,且使正在觸控的拇指以及食指停止預定的時間區段或更長,第二裝置200可判定以非捏縮輸入展開的部份作為感興趣區。並且,第二裝置200可提交第二視訊影像的需求給第一裝置100,此需求對應於被決定的感興趣區。 Alternatively, the second device 200 may determine the region of interest based on the user's unpinching input. When the user, for example, uses his or her thumb and forefinger to unfold a predetermined portion of the second video image with a non-pinch input, and stops the touched thumb and forefinger for a predetermined period of time or longer The second device 200 can determine the portion unfolded with the non-pinch input as the region of interest. Moreover, the second device 200 can submit the demand for the second video image to the first device 100, and the demand corresponds to the determined region of interest.
圖10A以及圖10B為根據示例性實施例的範例,說明利用第二裝置200決定第一視訊影像的部份作為感興趣區,經由用以決定第一視訊影像的部份的使用者介面。 10A and 10B illustrate an example of using a second device 200 to determine a portion of a first video image as a region of interest via a user interface for determining a portion of the first video image, in accordance with an exemplary embodiment.
參考圖10A以及圖10B,第二裝置200可顯示導引線(guide line)10以選擇在螢幕上的第一視訊影像的部份。並且,第二裝置200可基於使用者觸控以及托曳導引線的部份修改導引線10的尺寸。並且,第二裝置200可決定包含在修改過的導引線10的部份作為第一視訊影像的感興趣區。在這情況下,被包含在導引線10的部份的尺寸的上限可基於第一裝置100和第二裝置200之間的通信方法決定。 Referring to Figures 10A and 10B, the second device 200 can display a guide line 10 to select a portion of the first video image on the screen. Moreover, the second device 200 can modify the size of the guide wire 10 based on the touch of the user and the portion of the guide wire. Moreover, the second device 200 can determine the portion of the modified guide line 10 to be the region of interest of the first video image. In this case, the upper limit of the size of the portion included in the guide wire 10 can be determined based on the communication method between the first device 100 and the second device 200.
圖11A以及圖11B為根據示例性實施例的範例,說明當第一裝置100以及第二裝置200之間的通信方法被修改,利用第二裝置200接收自第一裝置100的修改過的解析度的視訊影像。圖11A說明在通信方法修改前修改在第二裝置200顯示的視訊影像,以及圖11B說明在通信方法被修改後修改在第二裝置200顯示的視訊影像。 11A and 11B are diagrams illustrating an example in which the communication method between the first device 100 and the second device 200 is modified, and the modified resolution from the first device 100 is received by the second device 200, according to an exemplary embodiment. Video image. 11A illustrates the modification of the video image displayed on the second device 200 before the communication method is modified, and FIG. 11B illustrates the modification of the video image displayed on the second device 200 after the communication method is modified.
當第一裝置100以及第二裝置200之間使用的通信方法被修改時,所述第一裝置100以及第二裝置200的資料傳輸的串流解析度可能會減少。在這情況下,第二裝置200可接收來自第一裝置100的較低的解析度的視訊影像,此視訊影像相較於在通信方法修改前接收的來自第一裝置100的視訊影像而言具有較低的解析度。並且,第二裝置200可顯示在通信方法被修改後所接收的視訊影像,此視訊影像相較於在通信方法被修改前所接收的視訊影像而言具有較小尺寸的。 When the communication method used between the first device 100 and the second device 200 is modified, the stream resolution of the data transmission of the first device 100 and the second device 200 may be reduced. In this case, the second device 200 can receive a lower resolution video image from the first device 100, the video image having a video image from the first device 100 received prior to the modification of the communication method. Lower resolution. Moreover, the second device 200 can display the video image received after the communication method is modified, and the video image has a smaller size than the video image received before the communication method is modified.
圖12A和12B為根據例示性實施例的範例,說明當第一裝置100以及第二裝置200之間的通信方法被修改時,用第二裝置200接收自第一裝置100的修改過影像品質的視訊影像。圖12A說明在通信方法被修改前,第二裝置200顯示的視訊影像,且圖12B說明在通信方法被修改後,在第二裝置200顯示的視訊影像。 12A and 12B are diagrams illustrating an example of a modified image quality received from the first device 100 by the second device 200 when the communication method between the first device 100 and the second device 200 is modified, according to an exemplary embodiment. Video image. FIG. 12A illustrates a video image displayed by the second device 200 before the communication method is modified, and FIG. 12B illustrates a video image displayed at the second device 200 after the communication method is modified.
當第一裝置100以及第二裝置200之間的通信方法被修改時,第一裝置100以及第二裝置200之間的資料傳輸的串流解析度可能會減少,在這情況下,第二裝置200可接收來自第一裝置100的較低的影像品質視訊影像,此視訊影像相較於在通信方法修改前接收自第一裝置100的視訊影像而言具有較低的影像品質。並且,第二裝置200可顯示在通信方法被 修改後接收的視訊影像,此視訊影像相較於在通信方法被修改前所接收的視訊影像而言具有相同尺寸。 When the communication method between the first device 100 and the second device 200 is modified, the stream resolution of the data transmission between the first device 100 and the second device 200 may be reduced, in which case the second device The 200 can receive a lower image quality video image from the first device 100, the video image having a lower image quality than the video image received from the first device 100 prior to modification of the communication method. And, the second device 200 can be displayed in the communication method The modified video image is received, and the video image has the same size as the video image received before the communication method is modified.
圖13A和13B為根據例示性實施例的範例,說明當第一裝置100以及第二裝置200的通信方法被修改時,用第二裝置200接收自第一裝置100的修改過的部分的視訊影像。圖13A說明在通信方法被修改前第二裝置200顯示的視訊影像,且圖13B說明在通信方法被修改後第二裝置200顯示的視訊影像。 13A and 13B are diagrams illustrating an example of receiving a video image from a modified portion of the first device 100 with the second device 200 when the communication method of the first device 100 and the second device 200 is modified, according to an exemplary embodiment. . FIG. 13A illustrates a video image displayed by the second device 200 before the communication method is modified, and FIG. 13B illustrates the video image displayed by the second device 200 after the communication method is modified.
當第一裝置100以及第二裝置200之間的通信方法被修改時,第一裝置100以及第二裝置200之間的資料傳輸的串流解析度可能會增加。 在這情況下,第二裝置200接收自第一裝置100的視訊影像,此視訊影像相較於在通信方法修改前接收自第一裝置100的視訊影像而言具有較寬的區域。 When the communication method between the first device 100 and the second device 200 is modified, the stream resolution of the data transmission between the first device 100 and the second device 200 may increase. In this case, the second device 200 receives the video image from the first device 100, which has a wider area than the video image received from the first device 100 before the communication method is modified.
圖14為根據示例性實施例的方塊圖,其說明第一裝置100。 FIG. 14 is a block diagram illustrating a first device 100, in accordance with an exemplary embodiment.
如同圖14的說明,第一裝置100包含影像取得元件110(例如:影像提取器…等等)、影像提供元件120(例如:影像提供器…等等)、物件辨識元件130(例如:物件辨識器…等等)、物件追蹤元件140(例如:物件追蹤器…等等)、網路檢查元件150(例如:網路檢查器…等等)、圖框緩衝器(frame buffer)190、資料庫(database,DB)160、收發元件170(例如:收發器…等等)以及控制元件180(例如:控制器、處理器…等等)。 As illustrated in FIG. 14, the first device 100 includes an image acquisition component 110 (eg, an image extractor, etc.), an image providing component 120 (eg, an image provider, etc.), and an object recognition component 130 (eg, object recognition). Device...etc.), object tracking component 140 (eg, object tracker...etc.), network check component 150 (eg, network checker...etc.), frame buffer 190, database (database, DB) 160, transceiver component 170 (eg, transceivers, etc.) and control component 180 (eg, controller, processor, etc.).
影像取得元件110取得要被提供於第二裝置200的影像。影像取得元件110可取得利用第一裝置100包含的照相設備或影像感測器所擷取的視訊影像,但並不侷限於此。影像取得元件110可取得例如圖片或被擷 取影像的內容。 The image acquisition component 110 acquires an image to be provided to the second device 200. The image capturing component 110 can obtain the video image captured by the camera device or the image sensor included in the first device 100, but is not limited thereto. The image acquisition component 110 can obtain, for example, a picture or a bedding Take the content of the image.
當對應於執行在第一裝置100中的應用程式的執行螢幕的第三視訊影像被提供至第二裝置200,則影像取得元件110可從圖框緩衝器190取得對應的應用程式的執行螢幕的第三視訊影像。然而,例示性實施例並不侷限於此,影像取得元件110可從圖框緩衝器190萃取對應於應用程式的執行螢幕的影像,這部份後面會再描述,並透過處理的被萃取的影像來產生第三視訊影像。 When the third video image corresponding to the execution screen of the application executed in the first device 100 is provided to the second device 200, the image obtaining component 110 can obtain the execution screen of the corresponding application from the frame buffer 190. The third video image. However, the exemplary embodiment is not limited thereto, and the image capturing component 110 may extract an image corresponding to the execution screen of the application from the frame buffer 190, which will be described later and processed through the extracted image. To generate a third video image.
影像提供元件120提供取得的影像至第二裝置200。影像提供元件120可處理取得的影像,以及將其提供至第二裝置200,但並不侷限於此。 影像提供元件120可提供取得的影像至第二裝置200而無需任何額外的處理。 The image providing component 120 provides the acquired image to the second device 200. The image providing component 120 can process the acquired image and provide it to the second device 200, but is not limited thereto. Image providing component 120 can provide the captured image to second device 200 without any additional processing.
影像提供元件120可基於第一裝置100擷取的視訊影像提供第一視訊影像以及第二視訊影像至第二裝置200。影像提供元件120也可提供未經處理的擷取視訊影像至第二裝置200以作為第一視訊影像。同樣的,影像提供元件120可處理擷取的視訊影像,以及提供處理後的視訊影像至第二裝置200以作為第一視訊影像。在這情況下,影像提供元件120可修改擷取的視訊影像的解析度或是影像品質或轉換擷取的視訊影像的格式。 The image providing component 120 can provide the first video image and the second video image to the second device 200 based on the video images captured by the first device 100. The image providing component 120 can also provide an unprocessed captured video image to the second device 200 as the first video image. Similarly, the image providing component 120 can process the captured video image and provide the processed video image to the second device 200 as the first video image. In this case, the image providing component 120 can modify the resolution or image quality of the captured video image or convert the format of the captured video image.
影像提供元件120可以在第一解析度下傳送具有原始解析度的第一視訊影像至第二裝置200。具有第一解析度的第一視訊影像可轉換自具有原始解析度的第一視訊影像。在這情況下,第一裝置100可優先取得及儲存關於第二裝置200的顯示器解析度的資訊,並且基於第二裝置200的顯示器解析度決定第一解析度。 The image providing component 120 can transmit the first video image having the original resolution to the second device 200 at the first resolution. The first video image having the first resolution can be converted from the first video image having the original resolution. In this case, the first device 100 can preferentially acquire and store information about the display resolution of the second device 200, and determine the first resolution based on the display resolution of the second device 200.
影像提供元件120可提供包含了利用物件追蹤元件140追蹤的物件的第二視訊影像至第二裝置200,這部份後面會再描述。第二視訊影像可包括只包含追蹤物件的部分。並且,當第一裝置100與第二裝置200之間的通信方法被修改,則影像提供元件120可修改第二視訊影像的解析度或影像品質,且提供修改後的視訊影像至第二裝置200。並且,當第一裝置100與第二裝置200之間的通信方法被修改,則影像提供元件120可修改對應於第二視訊影像的部分的尺寸,且提供修改後的部份的視訊影像至第二裝置200。 The image providing component 120 can provide a second video image containing the object tracked by the object tracking component 140 to the second device 200, as will be described later. The second video image may include only portions that track the object. Moreover, when the communication method between the first device 100 and the second device 200 is modified, the image providing component 120 can modify the resolution or image quality of the second video image, and provide the modified video image to the second device 200. . Moreover, when the communication method between the first device 100 and the second device 200 is modified, the image providing component 120 can modify the size of the portion corresponding to the second video image, and provide the modified portion of the video image to the first Two devices 200.
同時,影像提供元件120可提供第三視訊影像至第二裝置200,第三視訊影像對應於在第一裝置100執行的應用程式的執行螢幕。並且,當第二裝置200選擇自第一裝置100接收的第三視訊影像的部份,且請求被選擇部份的視訊影像,第一裝置100可提供對應於被選擇的部份的第四視訊影像至第二裝置200。在這情況下,第四視訊影像可為剪裁自第三視訊影像被選擇部份後取得的影像。 At the same time, the image providing component 120 can provide a third video image to the second device 200, and the third video image corresponds to an execution screen of the application executed by the first device 100. Moreover, when the second device 200 selects a portion of the third video image received from the first device 100 and requests the selected portion of the video image, the first device 100 can provide the fourth video corresponding to the selected portion. The image is to the second device 200. In this case, the fourth video image may be an image obtained by cropping the selected portion of the third video image.
物件辨識元件130自取得影像辨識物件。物件辨識元件130可接收來自第二裝置200的第一視訊影像的部份的區域資訊,且自擷取視訊影像或第一視訊影像辨識物件。 The object recognition component 130 acquires an image recognition object. The object recognition component 130 can receive the region information of the portion of the first video image from the second device 200, and automatically capture the video image or the first video image recognition object.
物件追蹤元件140自取得影像追蹤物件。物件追蹤元件140可追蹤從來自第一視訊影像或擷取後視訊影像的辨識物件。 The object tracking component 140 retrieves the image tracking object. The object tracking component 140 can track the identified object from the first video image or the captured video image.
網路檢查元件150,檢查第一裝置100與第二裝置200之間的通信方法。網路檢查元件150可檢查第一裝置100與第二裝置200之間的通信方法的類型或頻寬。並且,網路檢查元件150可檢查介於第一裝置100 與第二裝置200之間的資料傳送的串流解析度。 The network check component 150 checks the communication method between the first device 100 and the second device 200. The network check component 150 can check the type or bandwidth of the communication method between the first device 100 and the second device 200. And, the network check component 150 can check the first device 100. Stream resolution of data transfer with the second device 200.
圖框緩衝器190儲存對應於執行在第一裝置100上的應用程式的執行螢幕的影像。 The frame buffer 190 stores an image corresponding to the execution screen of the application executed on the first device 100.
資料庫160儲存多種類型的資訊,此資訊為當第一裝置100提供視訊影像的預定部份的影像至第二裝置200時所需要的資訊。 The database 160 stores a plurality of types of information, which is information required when the first device 100 provides a predetermined portion of the video image to the second device 200.
收發元件170將多種類型的資訊傳送至或接收自第二裝置200,此資訊為第一裝置100提供第一視訊的預定部份的影像至第二裝置200時所需要的資訊。 The transceiver component 170 transmits or receives a plurality of types of information from the second device 200, the information required to provide the first device 100 with a predetermined portion of the image of the first video to the second device 200.
控制元件180控制影像取得元件110、影像提供元件120、物件辨識元件130、物件追蹤元件140、網路檢查元件150、圖框緩衝器190、資料庫160以及收發元件170,使得第一裝置100可提供視訊影像的預定區域的影像至第二裝置200。 The control component 180 controls the image acquisition component 110, the image providing component 120, the object recognition component 130, the object tracking component 140, the network inspection component 150, the frame buffer 190, the data library 160, and the transceiver component 170, so that the first device 100 can An image of a predetermined area of the video image is provided to the second device 200.
圖15為根據示例性實施例方塊圖,其說明第二裝置200。 FIG. 15 is a block diagram illustrating a second device 200, in accordance with an exemplary embodiment.
如圖15說明,第二裝置200包含影像接收元件210(例如:影像接收器…等等)、使用者輸入元件220(例如:使用者輸入器…等等)、網路檢查元件230(例如:網路檢查器…等等)、區域資訊產生元件240(例如:區域資訊產生器…等等)、區域資訊提供元件250(例如:區域資訊產生器…等等)、顯示元件260(例如:顯示器…等等)、資料庫270、收發元件280以及控制元件290。 As illustrated in FIG. 15, the second device 200 includes an image receiving component 210 (eg, an image receiver, etc.), a user input component 220 (eg, a user input device, etc.), and a network inspection component 230 (eg, Network checker...etc.), area information generating component 240 (eg, area information generator, etc.), area information providing component 250 (eg, area information generator, etc.), display element 260 (eg, display) ...etc.), database 270, transceiver component 280, and control component 290.
影像接收元件210接收自第一裝置100的影像。影像接收元件210可接收自第一裝置100的第一視訊影像以及第二視訊影像。並且,當通信方法被修改,則影像接收元件210可接收修改後的解析度或修改後的影像 品質的視訊影像,但並不限定於此例示性實施例。 Image receiving component 210 receives an image from first device 100. The image receiving component 210 can receive the first video image and the second video image from the first device 100. And, when the communication method is modified, the image receiving component 210 can receive the modified resolution or the modified image. A quality video image, but is not limited to this illustrative embodiment.
當對應於在第一裝置100執行的應用程式的執行螢幕上的第三視訊影像被提供,則影像接收元件210可自第一裝置100接收第三視訊影像。 The image receiving component 210 can receive the third video image from the first device 100 when the third video image corresponding to the execution screen of the application executed on the first device 100 is provided.
使用者輸入元件220接收使用者對第一視訊影像的部份進行選擇的輸入。舉例來說,使用者輸入元件220可接收使用者對第一視訊影像的預定點進行觸控的輸入,或使用者對第一視訊影像的預定點進行觸控及拖曳的輸入。並且,使用者輸入元件220可接收使用者經由在第二裝置200的螢幕上顯示的預定使用者介面觸控的輸入。同時,當對應於在第一裝置100執行的應用程式的執行螢幕上的第三視訊影像被提供,則使用者輸入元件200接收使用者對第三視訊影像的部分進行選擇的輸入。 The user input component 220 receives an input by the user to select a portion of the first video image. For example, the user input component 220 can receive an input of a touch of a predetermined point of the first video image by the user, or an input of a touch and drag of the predetermined point of the first video image by the user. Moreover, the user input component 220 can receive input from a user via a predetermined user interface display displayed on the screen of the second device 200. Meanwhile, when a third video image corresponding to the execution screen of the application executed on the first device 100 is provided, the user input component 200 receives an input by the user to select a portion of the third video image.
網路檢查元件230檢查第一裝置100與第二裝置200之間的通信方法。網路檢查元件230可檢查第一裝置100與第二裝置200之間的通信方法的類型或頻寬。並且,網路檢查元件230可檢查第一裝置100與第二裝置200之間的資料傳送的串流解析度。 The network check component 230 checks the communication method between the first device 100 and the second device 200. The network check component 230 can check the type or bandwidth of the communication method between the first device 100 and the second device 200. And, the network check component 230 can check the stream resolution of the data transfer between the first device 100 and the second device 200.
區域資訊產生元件240基於使用者輸入以及檢查過的通信方法來選擇第一視訊影像的部份。區域資訊產生元件240可產生的有關於包含在第一視訊影像中的物件的區域資訊。區域資訊產生元件240可基於第一視訊影像中觸控輸入點的部份來選擇第一視訊影像的部分。詳細來說,當使用者觸控在第一視訊影像中的預定點,則區域資訊產生元件240可辨識包含觸控點的物件,以及選擇包含辨識物件的區域。 The area information generating component 240 selects a portion of the first video image based on the user input and the checked communication method. The area information generating component 240 can generate area information about the objects included in the first video image. The area information generating component 240 can select a portion of the first video image based on a portion of the touch input point in the first video image. In detail, when the user touches a predetermined point in the first video image, the area information generating component 240 can recognize the object including the touch point and select an area including the identified object.
並且,當使用者觸控在第一視訊影像中的預定點,則區域資訊產生元件240可選擇觸控點周圍的先前定範圍的區域以作為第一視訊影像的 部份。並且,區域資訊產生元件240可根據使用者觸控輸入經由使用者介面修改選擇的部份。並且,第一視訊影像選擇的部份的尺寸可基於第一裝置100及第二裝置200之間的通信方法決定。 Moreover, when the user touches a predetermined point in the first video image, the area information generating component 240 can select a previously ranged area around the touch point as the first video image. Part. Moreover, the area information generating component 240 can modify the selected portion via the user interface according to the user's touch input. Moreover, the size of the portion selected by the first video image may be determined based on a communication method between the first device 100 and the second device 200.
區域資訊提供元件250提供產生的區域資訊至第一裝置100。 The area information providing component 250 provides the generated area information to the first device 100.
區域資訊提供元件250可提供選擇的部份的座標值至第一裝置100。並且,區域資訊提供元件250可提供使用者觸控輸入點所輸入的座標值至第一裝置100。 The area information providing component 250 can provide a coordinate value of the selected portion to the first device 100. Moreover, the area information providing component 250 can provide the coordinate value input by the user touch input point to the first device 100.
顯示元件260在螢幕上顯示自第一裝置100接收的影像。顯示元件260可在螢幕上顯示從第一裝置100接收的視訊影像。 Display element 260 displays the image received from first device 100 on a screen. Display component 260 can display the video image received from first device 100 on a screen.
資料庫270儲存各種類型的資料,因此第二裝置200可接收自第一裝置100接收的第一視訊影像的部份的視訊影像。 The database 270 stores various types of data, so the second device 200 can receive a video image of a portion of the first video image received from the first device 100.
收發元件280將多樣類型的資料傳送至或接收自第一裝置100,因此第二裝置200可接收自第一裝置100接收的第一視訊影像的部份的視訊影像。 The transceiver component 280 transmits or receives various types of data to and from the first device 100. Therefore, the second device 200 can receive a video image of a portion of the first video image received from the first device 100.
控制元件290控制影像接收元件210、使用者輸入元件220、網路檢查元件230、區域資訊產生元件240、區域資訊提供元件250、顯示元件260、資料庫270、收發元件280以及控制元件290,因此第二裝置200可接收自第一裝置100接收的第一視訊影像的部份的視訊影像。 The control element 290 controls the image receiving element 210, the user input element 220, the network check component 230, the area information generating component 240, the area information providing component 250, the display component 260, the data library 270, the transceiver component 280, and the control component 290. The second device 200 can receive a video image of a portion of the first video image received from the first device 100.
圖16為根據另一個示例性實施例方塊圖,其說明裝置。根據示例性實施例,圖16中說明的裝置可以為第一裝置100或第二裝置200。 Figure 16 is a block diagram illustrating an apparatus in accordance with another exemplary embodiment. According to an exemplary embodiment, the device illustrated in FIG. 16 may be the first device 100 or the second device 200.
移動通信元件(mobile communication unit)1001(例如:移動通信器…等等),經由例如3G或4G的行動網路執行有關於基地台或資料通信的 呼叫設定。次通信元件1002執行用以短程通信的功能,短程通信例如藍芽或近場通信(near field communication,NFC)。廣播元件1003(例如:廣播接收器…等等)接收數位互動多媒體廣播(DMB)訊號。 A mobile communication unit 1001 (eg, a mobile communicator...etc.) performs a base station or data communication via a mobile network such as 3G or 4G. Call settings. The secondary communication component 1002 performs functions for short-range communication, such as Bluetooth or near field communication (NFC). The broadcast component 1003 (eg, a broadcast receiver, etc.) receives a digital interactive multimedia broadcast (DMB) signal.
相機元件1004包含透鏡以及光學元件以便擷取圖片或視訊影像。 Camera component 1004 includes a lens and an optical component for capturing a picture or video image.
感測元件1005可包含,例如,感測裝置的動作的重力感測器、感測光照度的亮度感測器、感測個體接近的接近感測器以及感測個體運動的運動感測器。 Sensing element 1005 can include, for example, a gravity sensor that senses the motion of the device, a brightness sensor that senses the illuminance, a proximity sensor that senses the proximity of the individual, and a motion sensor that senses the motion of the individual.
全球定位系統(global positioning system,GPS)接收元件1006接收自人造衛星的GPS訊號。利用GPS訊號可提供使用者多樣的服務。 A global positioning system (GPS) receiving component 1006 receives GPS signals from an artificial satellite. The use of GPS signals provides users with a variety of services.
輸入/輸出元件1010提供有關於外部裝置或個體的介面,且可包含例如:按鈕1011、麥克風1012、揚聲器1013、振動馬達1014、連接器1015或鍵盤1016。 The input/output element 1010 is provided with an interface with respect to an external device or an individual, and may include, for example, a button 1011, a microphone 1012, a speaker 1013, a vibration motor 1014, a connector 1015, or a keyboard 1016.
觸控視窗1018接收使用者的觸控輸入。在此,觸控輸入可以拖曳手勢或輕擊手勢的輸入。觸控視窗控制器1017通過觸控螢幕1018傳送輸入的觸控輸入至控制元件1050。電源供應元件1019連接至電池或外部電源以提供需要的電源給裝置。 The touch window 1018 receives the user's touch input. Here, the touch input can drag the input of a gesture or a tap gesture. The touch window controller 1017 transmits the input touch input to the control element 1050 through the touch screen 1018. Power supply component 1019 is coupled to a battery or external power source to provide the required power to the device.
控制元件1050利用執行儲存在記憶體1060的程式來顯示以及修改被顯示在裝置上的內容的部份。控制元件1050可寫入以及/或讀取自圖框緩衝器1020的資料。 Control component 1050 utilizes a program stored in memory 1060 to display and modify portions of the content displayed on the device. Control element 1050 can write and/or read data from frame buffer 1020.
被儲存在記憶體1060的程式可根據功能分類成複數個模組,例如:移動通信模組(mobile communication module)1061、無線通信系統模組(Wi-Fi module)1062、藍芽模組(Bluetooth module)1063、數位互動多媒體廣 播模組(DMB module)1064、相機模組(camera module)1065、感測模組(sensor module)1066、全球定位系統模組(GPS module)1067、視訊影像重播模組(video image replay module)1068、音頻重播模組(audio replay module)1069、電源模組(power module)1070、觸控螢幕模組(touch screen module)1071、使用者介面模組(user interface module,UI module)1072或應用程式模組(application module)1073。本領域的通常知識者可自模組的名稱直覺的歸納出各別模組的功能。 The programs stored in the memory 1060 can be classified into a plurality of modules according to functions, for example, a mobile communication module 1061, a wireless communication system module (Wi-Fi module) 1062, and a Bluetooth module (Bluetooth). Module) 1063, digital interactive multimedia DMB module 1064, camera module 1065, sensor module 1066, GPS module 1067, video image replay module 1068, audio replay module 1069, power module 1070, touch screen module 1071, user interface module (UI module) 1072 or application Application module 1073. Those of ordinary skill in the art can intuitively summarize the functions of the individual modules from the name of the module.
以下,應用程式模組1073將會仔細的描述。 Below, the application module 1073 will be described in detail.
首先,當圖16說明的裝置是第一裝置100,則應用程式模組1073可基於擷取的視訊影像利用包含在第二裝置100的模組來提供第一視訊影像至第二裝置200,並且接收關於第一視訊影像的部份的區域資訊。並且,應用程式模組1073可利用包含在第二裝置100的模組來辨識以及追蹤對應於部份的物件,並且提供包含被追蹤的物件的第二視訊影像至第二裝置200。並且,應用程式模組1073可利用包含模組的第一裝置100檢查有關於第二裝置200的通信方法,並且,當通信方法被修改,應用程式模組1073可提供相較於第二視訊影像而言是修改過的解析度或影像品質的視訊影像至第二裝置200。 First, when the device illustrated in FIG. 16 is the first device 100, the application module 1073 can provide the first video image to the second device 200 by using the module included in the second device 100 based on the captured video image, and Receiving regional information about a portion of the first video image. Moreover, the application module 1073 can utilize the module included in the second device 100 to identify and track the object corresponding to the portion, and provide the second video image including the tracked object to the second device 200. Moreover, the application module 1073 can check the communication method related to the second device 200 by using the first device 100 including the module, and when the communication method is modified, the application module 1073 can provide the second video image. It is a modified resolution or image quality video image to the second device 200.
並且,當圖16的裝置為第二裝置200,應用程式模組1073可利用包含在第二裝置200的模組接收第一視訊影像,且選擇第一視訊影像的部份。在這情況下,可基於第一裝置100和第二裝置200之間的通信方法來決定選擇部份的尺寸。並且,應用程式模組1073可利用包含在第二裝置200的模組來產生關於選擇部份的區域資訊,以及將其提供至第一裝置 100。並且,應用程式模組1073可利用包含在第二裝置200的模組顯示自第二裝置200接收的第二視訊影像。 Moreover, when the device of FIG. 16 is the second device 200, the application module 1073 can receive the first video image by using the module included in the second device 200, and select a portion of the first video image. In this case, the size of the selected portion can be determined based on the communication method between the first device 100 and the second device 200. Moreover, the application module 1073 can utilize the module included in the second device 200 to generate regional information about the selected portion and provide the same to the first device. 100. Moreover, the application module 1073 can display the second video image received from the second device 200 by using the module included in the second device 200.
圖17A至圖17C根據示例性實施例的範例,說明展開第一視訊影像的部份,第一視訊影像被顯示在第二裝置200的螢幕。 17A-17C illustrate a portion of a first video image that is displayed on a screen of the second device 200, according to an example of an exemplary embodiment.
如圖17A至圖17C的說明,第二裝置200可基於使用者觸控輸入以及托曳輸入來展開第一視訊影像的部份。在這情況下,第二裝置200可基於第一視訊影像的原始解析度來決定第一視訊影像展開的程度。詳細來說,如圖17A說明,當使用者觸控以及進行拖曳動作以橫越第一視訊影像的視窗的多重部分,第一視訊影像的部分可被展開,如圖17B說明。並且,第二裝置200可考慮第一視訊影像的原始解析度以及第二裝置200的螢幕尺寸決定展開第一視訊影像的程度。因此,如圖17C,即使當使用者持續觸控及拖曳,第一視訊影像不可被展開至超過圖17B所表示的展開程度。 As illustrated in FIGS. 17A-17C, the second device 200 can expand a portion of the first video image based on the user's touch input and the drag input. In this case, the second device 200 can determine the degree of expansion of the first video image based on the original resolution of the first video image. In detail, as illustrated in FIG. 17A, when the user touches and performs a dragging operation to traverse multiple portions of the window of the first video image, portions of the first video image can be expanded, as illustrated in FIG. 17B. Moreover, the second device 200 can determine the extent to which the first video image is developed in consideration of the original resolution of the first video image and the screen size of the second device 200. Therefore, as shown in FIG. 17C, even when the user continues to touch and drag, the first video image cannot be expanded beyond the degree of expansion shown in FIG. 17B.
並且,為了決定第一視訊影像展開的程度,第二裝置200可先接收以及儲存自第一裝置100的關於第一視訊影像的原始解析度的資料,但不侷限於此例示性實施例。 Moreover, in order to determine the extent of the first video image expansion, the second device 200 may first receive and store data about the original resolution of the first video image from the first device 100, but is not limited to the exemplary embodiment.
圖18A至圖18C為根據示例性實施例說明範例,展開視訊影像的部份,視訊影像以逐步方式被顯示在第二裝置200的視窗。 18A-18C are diagrams illustrating an example of expanding a portion of a video image, the video image being displayed in a window of the second device 200 in a stepwise manner, according to an exemplary embodiment.
如圖18A說明,可選擇視訊影像的一部分,且選擇的部份可作第一次展開,接著,視訊影像的展開部分的部份可第二次被選擇以及展開。 As illustrated in Figure 18A, a portion of the video image can be selected and the selected portion can be expanded for the first time, and then the portion of the expanded portion of the video image can be selected and expanded a second time.
圖19A至19C根據示例性實施例的範例,說明在第二裝置200顯示包含第一視訊影像被展開的部份的預視影像,且在第二裝置200顯示 自第一裝置100提供的第二視訊影像。在此,第一裝置100以及第二裝置200可彼此視訊通話。 19A to 19C illustrate, in an example of an exemplary embodiment, a preview image including a portion in which the first video image is expanded is displayed on the second device 200, and is displayed on the second device 200. The second video image provided from the first device 100. Here, the first device 100 and the second device 200 can talk to each other for video.
如圖19A說明,使用者可選擇第二裝置200的螢幕上顯示的第一視訊影像的部分16作為感興趣區。第二裝置200可接收自第一裝置100的具有第一解析度的第一視訊影像,且在第二裝置200的螢幕上顯示接收的第一視訊影像。 As illustrated in FIG. 19A, the user can select portion 16 of the first video image displayed on the screen of the second device 200 as the region of interest. The second device 200 can receive the first video image of the first device 100 having the first resolution, and display the received first video image on the screen of the second device 200.
接著,如圖19B說明,預視影像展示被選擇的感興趣區的展開,此預視影像可被顯示在第二裝置200上,以及功能選擇單12可顯示於第一裝置100上,功能選擇單12用以決定是否展開並且提供第一視訊影像的一部份。並且,在第二裝置200被展開的第一視訊影像的那個部份可在第一裝置100的預定區域14上顯示。 Next, as illustrated in FIG. 19B, the preview image shows the expansion of the selected region of interest, the preview image can be displayed on the second device 200, and the function menu 12 can be displayed on the first device 100, the function selection The single 12 is used to determine whether to deploy and provide a portion of the first video image. Moreover, that portion of the first video image that is deployed by the second device 200 can be displayed on the predetermined area 14 of the first device 100.
當使用者選擇功能選擇單12上的「允許」,第一裝置100可提供被選擇的感興趣區的第二視訊影像至第二裝置200,如圖19C說明,且第二裝置200可顯示接收的第二視訊影像。在這情況下,第一裝置100可提供具有第一解析度的被選擇感興趣區的第二視訊影像至第二裝置200。 When the user selects "Allow" on the function menu 12, the first device 100 can provide the second video image of the selected region of interest to the second device 200, as illustrated in FIG. 19C, and the second device 200 can display and receive. The second video image. In this case, the first device 100 can provide the second video image of the selected region of interest having the first resolution to the second device 200.
同時,當提供第二視訊影像至第二裝置200,第一裝置100可插入通知資訊至第二視訊影像以通知第二裝置200,告知第二視訊影像是被選擇感興趣區的展開影像。詳細來說,當第一裝置100停止傳送第一視訊影像但傳送第二視訊影像,第一裝置100可流入第一視訊影像以及第二視訊影像至第二裝置200,並且插入通知資訊至第二視訊影像。舉例來說,當第一裝置100為了傳送第二視訊影像而停止傳送第一視訊影像,則第一裝置100可在流入階段插入預定的參數值至預定封包,以通知第二裝置200第二 視訊影像已被提供。並且,通知資訊可被插入至即時傳送協定(real-time transfer protocol,RTP)封包標頭,如在圖20說明。圖20為根據示例性實施例的範例,說明即時傳送協定封包標頭(packet header)。 Meanwhile, when the second video image is provided to the second device 200, the first device 100 can insert the notification information to the second video image to notify the second device 200 that the second video image is the expanded image of the selected region of interest. In detail, when the first device 100 stops transmitting the first video image but transmits the second video image, the first device 100 can flow the first video image and the second video image to the second device 200, and insert the notification information into the second device. Video image. For example, when the first device 100 stops transmitting the first video image in order to transmit the second video image, the first device 100 may insert a predetermined parameter value into the predetermined packet in the inflow phase to notify the second device 200 of the second device. Video images have been provided. And, the notification information can be inserted into a real-time transfer protocol (RTP) packet header, as illustrated in FIG. 20 is an illustration of an instant delivery protocol packet header, in accordance with an exemplary embodiment.
自第一裝置100提供至第二裝置200的第二視訊影像的各自圖框可包含複數個即時傳送協定封包。並且,第一裝置100可對應於第二視訊影像的各自圖框插入通知訊息至複數個即時傳送協定封包的預定封包中。 舉例來說,第一裝置100可插入通知訊息至即時傳送協定封包,其中對應於第二視訊影像的各自圖框的複數個即時傳送協定封包的標頭所包含的即時傳送協定標識欄(RTP marker field)90的位元率(bit rate)為1。 The respective frames of the second video image provided from the first device 100 to the second device 200 may include a plurality of instant transfer protocol packets. Moreover, the first device 100 can insert a notification message into a predetermined packet of the plurality of instant transfer protocol packets corresponding to the respective frames of the second video image. For example, the first device 100 can insert a notification message into the instant delivery protocol packet, wherein the instant delivery protocol identifier column (RTP marker) included in the header of the plurality of instant delivery protocol packets corresponding to the respective frames of the second video image. Field) 90 has a bit rate of 1.
並且,第一裝置100可插入通知訊息至第二視訊影像的複數個圖框之中的預定圖框。舉例來說,第一裝置100可插入通知訊息至預定數字的圖框,此數字自第二視訊影像的第一圖框開始計算。然而,並不侷限於此例示性實施例。 Moreover, the first device 100 can insert a notification message into a predetermined frame among the plurality of frames of the second video image. For example, the first device 100 can insert a notification message to a frame of a predetermined number, the number being calculated from the first frame of the second video image. However, it is not limited to this exemplary embodiment.
並且,第一裝置100可插入通知訊息至即時傳送協定封包標頭的標頭擴增欄位92。通知訊息可具有預定位元率。並且,通知訊息可包含預定區域資訊。區域資訊可為指出第一視訊影像的那個部份是利用第一裝置100剪裁出來以產生第二視訊影像的資訊。舉例來說,區域資訊可為指出原始視訊影像的整個螢幕之中一部份的位置的數值,此部分對應於顯示第二視訊影像的螢幕,。並且,區域資訊可具有預定座標值。 And, the first device 100 can insert a notification message to the header augmentation field 92 of the instant delivery protocol packet header. The notification message can have a predetermined bit rate. And, the notification message may include predetermined area information. The area information may be information indicating that the portion of the first video image is clipped by the first device 100 to generate a second video image. For example, the area information may be a value indicating a position of a portion of the entire screen of the original video image, the portion corresponding to the screen displaying the second video image. And, the area information can have a predetermined coordinate value.
圖21為根據示例性實施例的流程,說明利用第一裝置100產生第四視訊影像的方法。第一裝置100可提供對應於第一裝置100執行的應用程式的執行螢幕的第三視訊影像至第二裝置200,並且接收關於自第二裝 置200的第三視訊影像的部份的區域資訊,用以產生第四視訊影像,並且提供所產生的第四視訊影像至第二裝置200。 21 is a flow illustrating a method of generating a fourth video image using the first device 100, in accordance with an exemplary embodiment. The first device 100 can provide a third video image corresponding to the execution screen of the application executed by the first device 100 to the second device 200, and receive information about the second device. The area information of the portion of the third video image of 200 is used to generate a fourth video image, and the generated fourth video image is provided to the second device 200.
在動作S2100中,第一裝置100自第一裝置100中的圖框緩衝器取得第三視訊影像。圖框緩衝器可儲存對應於在第一裝置100執行的應用程式的執行螢幕上的第三視訊影像。 In Act S2100, the first device 100 acquires a third video image from the frame buffer in the first device 100. The frame buffer may store a third video image corresponding to an execution screen of the application executed on the first device 100.
在動作S2200中,第一裝置100可基於自第二裝置200接收的區域資訊來修剪部份的第三視訊影像。並且,第一裝置100可在動作S2300中編碼第三視訊影像的修剪部份的部份,以及在動作S2400中將其封包。 In action S2200, the first device 100 may trim a portion of the third video image based on the region information received from the second device 200. Moreover, the first device 100 may encode a portion of the trimmed portion of the third video image in action S2300 and packetize it in action S2400.
圖22為根據示例性實施例的流程,說明利用第二裝置200與第一裝置100進行視訊通話來接收第二視訊影像的方法,第二視訊影像是第一視訊影像被展開部分。 FIG. 22 is a flowchart illustrating a method of receiving a second video image by using a second device 200 to perform a video call with the first device 100 according to an exemplary embodiment. The second video image is a first video image being expanded.
在動作S2205中,第一裝置100和第二裝置200連接用以視訊通話。 In action S2205, the first device 100 and the second device 200 are connected for a video call.
在動作S2210中,第一裝置100提供第一視訊影像至第二裝置200。第一裝置100可擷取第一裝置100的使用者,且產生第一視訊影像用以視訊通話。並且,第一裝置100可傳送產生的第一視訊影像至第二裝置200。 In Act S2210, the first device 100 provides the first video image to the second device 200. The first device 100 can capture the user of the first device 100 and generate a first video image for a video call. Moreover, the first device 100 can transmit the generated first video image to the second device 200.
在動作S2220中,第二裝置200顯示自第一裝置100接收的第一視訊影像於第二裝置200的螢幕上。 In action S2220, the second device 200 displays the first video image received from the first device 100 on the screen of the second device 200.
在動作S2230中,第二裝置200選擇部份的第一視訊影像用以展開。舉例來說,第二裝置200可自第一視訊影像選擇第一裝置100的使用者的嘴巴部份,或第一裝置100的使用者持有的書的書套(book cover)。在 這情況下,第二裝置200可基於使用者的觸控輸入來選擇部份,但並不侷限於此例示性實施例。要被展開的部份可於視訊通話期間先設定,並且第二裝置200可自第一裝置100的使用者的影像選擇先前設定部份。 In Act S2230, the second device 200 selects a portion of the first video image for expansion. For example, the second device 200 can select a mouth portion of the user of the first device 100 from the first video image, or a book cover of the book held by the user of the first device 100. in In this case, the second device 200 can select a portion based on the user's touch input, but is not limited to the exemplary embodiment. The portion to be expanded can be set first during the video call, and the second device 200 can select the previously set portion from the image of the user of the first device 100.
舉例來說,第二裝置200可追蹤自第一裝置100的使用者的臉影像其中的使用者的嘴巴部份,用以選擇使用者的嘴巴部份作為部分。詳細來說,第二裝置200可自第一裝置100的使用者的影像偵測臉辨別資訊,且可基於偵測的臉部辨別資訊追蹤以及選擇第一裝置100的使用者的臉部的嘴巴部份。偵測臉部辨別資訊的方法的範例例如包含特徵基礎方法、外觀基礎方法以及混合方法。在特徵基礎方法中,臉部或臉部特徵構件(例如:眼、鼻、嘴或下巴)的幾何資訊可基於這些構件的尺寸以及外型、構件之間的相互關係或基於這些臉部組成的資訊用以辨別臉部。特徵基礎方法可包含,例如:純幾何方法(pure geometry method)、動態鏈接架構基礎方法(dynamic link architecture based method)以及隱馬可夫模型基礎方法(hidden Markov model-based method)。並且,根據外觀基礎方法,臉部可利用自多組學習影像所學習的模型來辨別。外觀基礎方法的範例包含使用以分析主要構件產生的特徵臉部的方法、使用線性的區辨性分析的方法、使用類神經網路的方法以及使用支持向量機的方法。另外,混合方法同時使用特徵基礎方法以及外觀基礎方法兩者。混合方法的範例包含線性特徵分析基礎方法、外觀標準化基礎方法以及構件基礎方法。然而,根據目前的示例性實施例,並不侷限以上述三種偵測臉部辨別資訊的方法,且其他各種方法可被使用於偵測臉部辨別資訊。 For example, the second device 200 can track the mouth portion of the user in the face image of the user of the first device 100 to select the user's mouth portion as a part. In detail, the second device 200 can detect the face recognition information from the image of the user of the first device 100, and can track the information based on the detected face recognition information and select the mouth of the user's face of the first device 100. Part. Examples of the method of detecting facial recognition information include, for example, a feature-based method, a appearance-based method, and a hybrid method. In the feature-based approach, the geometric information of a facial or facial feature (eg, eye, nose, mouth, or chin) may be based on the size and shape of the components, the interrelationships between the components, or based on the composition of the faces. Information is used to identify faces. The feature base method may include, for example, a pure geometry method, a dynamic link architecture based method, and a hidden Markov model-based method. Moreover, according to the appearance basic method, the face can be distinguished by a model learned from a plurality of sets of learning images. Examples of the appearance-based method include a method of analyzing a feature face generated by a main component, a method of using a linear discriminant analysis, a method using a neural network-like, and a method using a support vector machine. In addition, the hybrid method uses both the feature based method and the appearance based method. Examples of hybrid methods include a basic method of linear feature analysis, a basic method of appearance standardization, and a component-based method. However, according to the current exemplary embodiment, the above three methods of detecting face recognition information are not limited, and other various methods can be used to detect face recognition information.
在動作S2240中,第二裝置200傳送選擇部份的座標資訊至第一 裝置100。 In action S2240, the second device 200 transmits the coordinate information of the selected portion to the first Device 100.
在動作S2250中,第一裝置100顯示以第二裝置200選擇的第一視訊影像的部份。第一裝置100例如可以虛線顯示第二裝置200所選擇部份的第一視訊影像。並且,在第一裝置100的螢幕上,第一裝置100可只顯示第二裝置200所選擇的第一視訊影像的部份。 In Act S2250, the first device 100 displays a portion of the first video image selected by the second device 200. The first device 100 can display, for example, a first video image of a selected portion of the second device 200 in a dashed line. Moreover, on the screen of the first device 100, the first device 100 can display only a portion of the first video image selected by the second device 200.
在動作S2260中,第一裝置100決定將有關於選擇的部份的第二視訊影像提供至第二裝置200。第一裝置100可基於經由使用者介面輸入的使用者輸入來顯示使用者介面以及決定將有關於被選擇部份的第二視訊影像提供至第二裝置200。 In Act S2260, the first device 100 determines to provide the second video image with respect to the selected portion to the second device 200. The first device 100 can display the user interface based on user input input through the user interface and decide to provide the second video image with respect to the selected portion to the second device 200.
在操作2270中,第一裝置100擷取的部份對應於選擇部份。舉例來說,第一裝置100可擷取第一裝置100的使用者的嘴巴部份或第一裝置100使用者持有的書的書套。 In operation 2270, the portion captured by the first device 100 corresponds to the selected portion. For example, the first device 100 can capture the book cover of the user of the first device 100 or the book holder of the book held by the user of the first device 100.
在動作S2280中,第一裝置100提供第二視訊影像至第二裝置200。第一裝置100可以透過擷取對應於選取的部份的部份來產生第二視訊影像,以及提供產生的第二視訊影像至第二裝置200。 In Act S2280, the first device 100 provides the second video image to the second device 200. The first device 100 can generate a second video image by capturing a portion corresponding to the selected portion, and provide the generated second video image to the second device 200.
在動作S2290中,第二裝置200顯示第二視訊影像。 In Act S2290, the second device 200 displays the second video image.
同時,第二裝置200可在第二裝置200的螢幕上顯示第一視訊影像以及第二視訊影像兩者。在這情況下,在動作S2280中,第二裝置200可接收不僅第二視訊影像,而且也接收第一視訊影像。另外,第二裝置200可以透過第一視訊影像上交疊第二視訊影像來顯示第一和第二視訊影像。 第二裝置200將第二視訊影像交疊在第一視訊影像中第一裝置100的使用者沒有被顯示的部份。另外,第二裝置200可調節被顯示的第一視訊影像 的部份的尺寸,以及被顯示的第二視訊影像的部份的尺寸。然而,不侷限於此例示性實施例,且第二裝置200可在第二裝置200的螢幕上顯示沒有交疊的第一及第二視訊影像。 At the same time, the second device 200 can display both the first video image and the second video image on the screen of the second device 200. In this case, in Act S2280, the second device 200 can receive not only the second video image but also the first video image. In addition, the second device 200 can display the first and second video images by overlapping the second video images on the first video image. The second device 200 overlaps the second video image in a portion of the first video image in which the user of the first device 100 is not displayed. In addition, the second device 200 can adjust the displayed first video image. The size of the portion and the size of the portion of the second video image being displayed. However, it is not limited to this exemplary embodiment, and the second device 200 can display the first and second video images that are not overlapped on the screen of the second device 200.
圖23為根據示例性實施例的流程,說明以第二裝置200與第一裝置100進行視訊通話時,第一視訊影像的部分的展開及顯示方法。 FIG. 23 is a flowchart illustrating a method of expanding and displaying a portion of a first video image when a second device 200 performs a video call with the first device 100, according to an exemplary embodiment.
在動作S2305中,第一裝置100和第二裝置200連接用以視訊通話。 In action S2305, the first device 100 and the second device 200 are connected for a video call.
在動作S2310中,第一裝置100提供第一視訊影像至第二裝置200。第一裝置100可擷取第一裝置100的使用者,以及可產生第一視訊影像用以視訊通話。並且,第一裝置100可傳送產生的第一視訊影像至第二裝置200。 In Act S2310, the first device 100 provides the first video image to the second device 200. The first device 100 can capture the user of the first device 100 and can generate the first video image for the video call. Moreover, the first device 100 can transmit the generated first video image to the second device 200.
在動作S2320中,第二裝置200的螢幕上顯示自第一裝置100接收的第一視訊影像。 In Act S2320, the first video image received from the first device 100 is displayed on the screen of the second device 200.
在動作S2330中,第二裝置200選擇第一視訊影要被展開的部份。第二裝置200可自第一視訊影像選擇第一裝置100的使用者的部份嘴巴或第一裝置100的使用者持有的書的書套。 In Act S2330, the second device 200 selects a portion of the first video image to be expanded. The second device 200 can select a portion of the mouth of the user of the first device 100 or a book cover of the book held by the user of the first device 100 from the first video image.
在這情況下,第二裝置200可基於使用者的觸控輸入選擇部份,但不侷限在此例示性實施例。要被展開的部份可在影像通話期間先被設定,且第二裝置200可自第一裝置100的使用者的影像選擇先前設定部份。 舉例來說,第二裝置200可以利用追蹤第一裝置100的使用者的臉部影像中使用者的嘴巴部分來選擇使用者的嘴巴作為部份。 In this case, the second device 200 can select a portion based on the user's touch input, but is not limited to this exemplary embodiment. The portion to be expanded can be set first during the video call, and the second device 200 can select the previously set portion from the image of the user of the first device 100. For example, the second device 200 can select a user's mouth as a part by tracking the mouth portion of the user in the facial image of the user of the first device 100.
在動作S2340中,在第二裝置200的螢幕上,只顯示被在動作 S2330中被選取的第一視訊影像的部份。第二裝置200可利用影像處理來展開第一視訊影像被選擇部份,且在第二裝置200的螢幕上可顯示被展開的部份。舉例來說,當第一視訊影像的解析度是200×200,且被選擇部份的解析度是50×50,則第一裝置100可展開被選擇部份的解析度至200×200。 In action S2340, on the screen of the second device 200, only the action being displayed is displayed. The portion of the first video image selected in S2330. The second device 200 can use the image processing to expand the selected portion of the first video image, and the expanded portion can be displayed on the screen of the second device 200. For example, when the resolution of the first video image is 200×200, and the resolution of the selected portion is 50×50, the first device 100 may expand the resolution of the selected portion to 200×200.
同時,第二裝置200可將展開的影像交疊在第一視訊影像上。第二裝置200可將被展開的影像交疊在第一視訊影像的部份,此部分為在沒有顯示第一裝置100的使用者的部份。另外,第二裝置200可調整顯示第一視訊影像的部份的尺寸,以及顯示第二視訊影像的部份的尺寸。然而,不侷限於此例示性實施例,且第二裝置200可在第二裝置200的螢幕上顯示沒有交疊的第一及第二視訊影像。 At the same time, the second device 200 can overlap the unfolded image on the first video image. The second device 200 can overlap the unfolded image on a portion of the first video image, which is a portion of the user who does not display the first device 100. In addition, the second device 200 can adjust the size of the portion of the first video image and the size of the portion of the second video image. However, it is not limited to this exemplary embodiment, and the second device 200 can display the first and second video images that are not overlapped on the screen of the second device 200.
圖24A至圖24C為根據示例性實施例,說明第一視訊影像的被展開部份42與第一視訊影像一起被顯示在第二裝置200的視窗。 24A-24C illustrate a window in which the expanded portion 42 of the first video image is displayed with the first video image in the second device 200, in accordance with an exemplary embodiment.
參考圖24A,選擇第一裝置100的使用者的臉的嘴巴部分40顯示在第二裝置200的螢幕上。嘴巴部份40可被第二裝置200的使用者選擇。 然而,並不侷限於此例示性實施例,且根據先前的設定基準,第二裝置200可在第一視訊影像42追蹤與選擇嘴巴部份40。 Referring to FIG. 24A, the mouth portion 40 of the face of the user who selects the first device 100 is displayed on the screen of the second device 200. The mouth portion 40 can be selected by the user of the second device 200. However, it is not limited to this exemplary embodiment, and the second device 200 can track and select the mouth portion 40 in the first video image 42 according to the previous setting reference.
參考圖24B,選擇的嘴巴部分40的展開影像44可交疊在第一視訊影像42上。在這情況下,第二裝置200可決定第一視訊影像42中沒有顯示第一裝置100的使用者的部份,且將第二視訊影像交疊在沒有顯示使用者的部份。 Referring to Figure 24B, the expanded image 44 of the selected mouth portion 40 can overlap the first video image 42. In this case, the second device 200 may determine that the portion of the first video image 42 that does not display the user of the first device 100 and overlap the second video image with the portion where the user is not displayed.
另外,參考圖24C,選擇的嘴巴部分40的展開影像44可以沒有交疊於第一視訊影像42,但選擇的嘴巴部分40的展開影像44和第一視訊 影像42可在各自被顯示在分開的視窗中。 In addition, referring to FIG. 24C, the expanded image 44 of the selected mouth portion 40 may not overlap the first video image 42, but the expanded image 44 of the selected mouth portion 40 and the first video Images 42 can be displayed in separate windows.
示例性實施例也可以記錄媒體的形式被實現,記錄媒體包含電腦可執行的命令,諸如以電腦執行的程式模組。電腦可讀取的記錄媒體可為用電腦可執行的任意可用媒體,且可為任何變性、不變性、可分離的以及不可分離的媒體其中之一。並且,電腦可讀取的記錄媒體的範例可包含電腦儲存媒體以及通信媒體。電腦儲存媒體的範例包含變性、不變性、可分離的以及不可分離的媒體,以任意方法或技術來實現,以儲存關於電腦可讀取指令資訊、資料結構、程式模組或其他資料。通信媒體可包含電腦可讀取指令、資料結構、程式模組或其他調變資料信號的資料,例如:載波或其他傳輸機制,且可為任意資料傳輸媒體。 The exemplary embodiment can also be implemented in the form of a recording medium containing computer executable commands, such as a program module executed by a computer. The computer readable recording medium can be any available media executable by a computer and can be any of any denatured, invariant, detachable, and inseparable media. Moreover, examples of computer readable recording media may include computer storage media and communication media. Examples of computer storage media include denatured, invariant, detachable, and inseparable media implemented in any method or technique for storing information about computer readable instructions, data structures, programming modules, or other materials. The communication medium may include computer readable instructions, data structures, program modules or other data of modulated data signals, such as carrier waves or other transmission mechanisms, and may be any data transmission medium.
儘管已參考實施例特定地展示且描述了例示性實施例,但本領域的通常知識者將理解,在不脫離如由所附申請專利範圍界定的精神以及範疇的情況下,可對本發明進行形式以及細節上的各種改變。例示性實施例應只被考慮為描述性的理解並不用於限定的意圖。舉例來說,每個以單一類型描述的構件可被分散,且相似地,描述為分散的構件可以結合。 While the exemplary embodiments have been particularly shown and described with reference to the embodiments of the embodiments of the present invention And various changes in the details. The illustrative embodiments are to be considered in all respects as illustrative and not restrictive. For example, each component described in a single type can be dispersed, and similarly, components that are described as discrete can be combined.
例示性實施例的範圍已被基於附的專利範圍所定義,且所有不同範圍內的範圍將被理解已經被包含在本發明內容。 The scope of the exemplary embodiments has been defined by the scope of the appended claims, and the scope of
100‧‧‧第一裝置 100‧‧‧ first device
200‧‧‧第二裝置 200‧‧‧second device
Claims (20)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR20120077919 | 2012-07-17 | ||
| KR1020130081194A KR102091137B1 (en) | 2012-07-17 | 2013-07-10 | System and method for rpoviding image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW201410004A TW201410004A (en) | 2014-03-01 |
| TWI584641B true TWI584641B (en) | 2017-05-21 |
Family
ID=50143597
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW102125571A TWI584641B (en) | 2012-07-17 | 2013-07-17 | Device and method for providing image and non-transitory computer-readable recording medium |
Country Status (5)
| Country | Link |
|---|---|
| JP (1) | JP6271892B2 (en) |
| KR (1) | KR102091137B1 (en) |
| BR (1) | BR112015001112A2 (en) |
| RU (1) | RU2653305C2 (en) |
| TW (1) | TWI584641B (en) |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9858470B2 (en) | 2014-07-18 | 2018-01-02 | Htc Corporation | Method for performing a face tracking function and an electric device having the same |
| KR102121532B1 (en) * | 2014-08-26 | 2020-06-10 | 삼성전자주식회사 | Apparatus and method for providing preview image |
| US20160094849A1 (en) * | 2014-09-27 | 2016-03-31 | Intel Corporation | THERMAL THROTTLING OF WiDi VIDEO STREAM RESOLUTION |
| JP2017028587A (en) * | 2015-07-24 | 2017-02-02 | ソニー株式会社 | Information processing device and information processing method |
| JP6720353B2 (en) * | 2016-06-08 | 2020-07-08 | 華為技術有限公司Huawei Technologies Co.,Ltd. | Processing method and terminal |
| KR102623181B1 (en) * | 2016-10-05 | 2024-01-11 | 엘지전자 주식회사 | Wireless device and wireless system |
| WO2019045128A1 (en) * | 2017-08-29 | 2019-03-07 | 라인 가부시키가이샤 | Image quality enhancement of video call |
| KR20210049828A (en) * | 2018-08-31 | 2021-05-06 | 베스텔 일렉트로닉 사나이 베 티카레트 에이에스 | Electronic device and how it works |
| RU2696009C1 (en) * | 2018-10-22 | 2019-07-30 | Акционерное общество "Калужский научно-исследовательский институт телемеханических устройств" | Method of movable object positioning based on video images |
| KR102222871B1 (en) * | 2019-02-22 | 2021-03-04 | 삼성전자주식회사 | Display apparatus and Method of displaying image thereof |
| KR102067191B1 (en) * | 2019-06-28 | 2020-02-11 | 배경 | Apparatus for generating detailed image |
| CN115174824B (en) * | 2021-03-19 | 2025-06-03 | 阿里巴巴创新公司 | Video generation method and device, promotional video generation method and device |
| KR20220149803A (en) * | 2021-04-23 | 2022-11-08 | 삼성전자주식회사 | Electronic device and method for sharing information |
| KR102833619B1 (en) * | 2021-06-07 | 2025-07-14 | 삼성전자주식회사 | Display apparatus and control method thereof |
| EP4250282A4 (en) | 2021-06-07 | 2024-11-06 | Samsung Electronics Co., Ltd. | DISPLAY DEVICE AND CONTROL METHOD THEREFOR |
| KR102571349B1 (en) * | 2021-12-16 | 2023-08-29 | 주식회사 랩241 | System and method for magnifing selection area of video |
| JP2023154916A (en) * | 2022-04-08 | 2023-10-20 | キヤノン株式会社 | Information processing device, method and program |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060114987A1 (en) * | 1998-12-21 | 2006-06-01 | Roman Kendyl A | Handheld video transmission and display |
| US20070229680A1 (en) * | 2006-03-30 | 2007-10-04 | Jai Pulnix, Inc. | Resolution proportional digital zoom |
| US20110096228A1 (en) * | 2008-03-20 | 2011-04-28 | Institut Fuer Rundfunktechnik Gmbh | Method of adapting video images to small screen sizes |
| TW201142642A (en) * | 2010-05-19 | 2011-12-01 | Siemens Transportation Systems | Securization of a transmission video at a distance serving for the control of a vehicle at a distance |
| TW201225654A (en) * | 2010-12-13 | 2012-06-16 | Sonix Technology Co Ltd | Image accessing apparatus and image data transmission method thereof |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6178204B1 (en) * | 1998-03-30 | 2001-01-23 | Intel Corporation | Adaptive control of video encoder's bit allocation based on user-selected region-of-interest indication feedback from video decoder |
| JP2002369164A (en) * | 2001-06-06 | 2002-12-20 | Nikon Corp | Electronic imaging device and electronic imaging system |
| SE526226C2 (en) * | 2003-12-19 | 2005-08-02 | Ericsson Telefon Ab L M | Image Processing |
| US8019175B2 (en) | 2005-03-09 | 2011-09-13 | Qualcomm Incorporated | Region-of-interest processing for video telephony |
| JP3115546U (en) * | 2005-08-05 | 2005-11-10 | 東芝テリー株式会社 | Display device |
| TWI275308B (en) * | 2005-08-15 | 2007-03-01 | Compal Electronics Inc | Method and apparatus for adjusting output images |
| GB2447245B (en) * | 2007-03-05 | 2011-12-28 | Snell & Wilcox Ltd | Video transmission |
| JP2009239480A (en) * | 2008-03-26 | 2009-10-15 | Toshiba Corp | Video reception client, video distribution server, reception algorithm switching control method and program |
| KR101113061B1 (en) * | 2008-06-25 | 2012-04-12 | 엔조스탄카토 | Multifunction Apparatus for Telecommunications |
| JP2010027000A (en) * | 2008-07-24 | 2010-02-04 | Sony Corp | Image detection device and image detection method |
| JP5294967B2 (en) * | 2009-04-30 | 2013-09-18 | キヤノン株式会社 | Image processing apparatus and image processing method |
| JP5089658B2 (en) * | 2009-07-16 | 2012-12-05 | 株式会社Gnzo | Transmitting apparatus and transmitting method |
| US9185335B2 (en) * | 2009-12-28 | 2015-11-10 | Thomson Licensing | Method and device for reception of video contents and services broadcast with prior transmission of data |
-
2013
- 2013-07-10 KR KR1020130081194A patent/KR102091137B1/en active Active
- 2013-07-12 RU RU2015105185A patent/RU2653305C2/en not_active IP Right Cessation
- 2013-07-12 BR BR112015001112A patent/BR112015001112A2/en not_active IP Right Cessation
- 2013-07-17 TW TW102125571A patent/TWI584641B/en not_active IP Right Cessation
- 2013-07-17 JP JP2013148383A patent/JP6271892B2/en not_active Expired - Fee Related
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060114987A1 (en) * | 1998-12-21 | 2006-06-01 | Roman Kendyl A | Handheld video transmission and display |
| US20070229680A1 (en) * | 2006-03-30 | 2007-10-04 | Jai Pulnix, Inc. | Resolution proportional digital zoom |
| US20110096228A1 (en) * | 2008-03-20 | 2011-04-28 | Institut Fuer Rundfunktechnik Gmbh | Method of adapting video images to small screen sizes |
| TW201142642A (en) * | 2010-05-19 | 2011-12-01 | Siemens Transportation Systems | Securization of a transmission video at a distance serving for the control of a vehicle at a distance |
| TW201225654A (en) * | 2010-12-13 | 2012-06-16 | Sonix Technology Co Ltd | Image accessing apparatus and image data transmission method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| JP6271892B2 (en) | 2018-01-31 |
| JP2014023158A (en) | 2014-02-03 |
| RU2653305C2 (en) | 2018-05-07 |
| RU2015105185A (en) | 2016-09-10 |
| TW201410004A (en) | 2014-03-01 |
| KR20140011264A (en) | 2014-01-28 |
| BR112015001112A2 (en) | 2017-06-27 |
| KR102091137B1 (en) | 2020-03-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI584641B (en) | Device and method for providing image and non-transitory computer-readable recording medium | |
| EP2688295B1 (en) | System and method for providing image | |
| CN103916623B (en) | Display device and method for its video call | |
| US9742995B2 (en) | Receiver-controlled panoramic view video share | |
| KR20190008610A (en) | Mobile terminal and Control Method for the Same | |
| KR20190013308A (en) | Mobile terminal and method for controlling the same | |
| JP7441926B2 (en) | Computer program that performs video coding | |
| KR20180092621A (en) | Terminal and method for controlling the same | |
| KR20170029329A (en) | Mobile terminal and method for controlling the same | |
| CN108762501B (en) | AR display method, smart terminal, AR device and system | |
| US20130335587A1 (en) | Terminal device and image capturing method | |
| CN108632543B (en) | Image display method, image display device, storage medium and electronic equipment | |
| US20130300934A1 (en) | Display apparatus, server, and controlling method thereof | |
| KR20160127606A (en) | Mobile terminal and the control method thereof | |
| KR20180131908A (en) | Mobile terminal and method for controlling the same | |
| KR20170112493A (en) | Mobile terminal and method for controlling the same | |
| KR20180031239A (en) | Mobile terminal and method for controlling the same | |
| KR20160012009A (en) | Mobile terminal and method for controlling the same | |
| KR20180028701A (en) | Portable camera and method for controlling the same | |
| KR20180027191A (en) | Terminal and method for controlling the same | |
| KR20150025268A (en) | Electronic Device And Method Of Controlling The Same | |
| US20250097382A1 (en) | Non-transitory recording medium, image processing system, teleconference service system | |
| KR20170087247A (en) | Mobile terminal | |
| US20230388447A1 (en) | Subject-based smart segmentation of video feed on a transmitting device | |
| KR20180032025A (en) | Terminal and method for controlling the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| MM4A | Annulment or lapse of patent due to non-payment of fees |