[go: up one dir, main page]

TW201118745A - Barcode augmented reality system and method - Google Patents

Barcode augmented reality system and method Download PDF

Info

Publication number
TW201118745A
TW201118745A TW98138792A TW98138792A TW201118745A TW 201118745 A TW201118745 A TW 201118745A TW 98138792 A TW98138792 A TW 98138792A TW 98138792 A TW98138792 A TW 98138792A TW 201118745 A TW201118745 A TW 201118745A
Authority
TW
Taiwan
Prior art keywords
bar code
augmented reality
image
unit
real
Prior art date
Application number
TW98138792A
Other languages
Chinese (zh)
Other versions
TWI424355B (en
Inventor
Jun-Cai Ye
Yi-Qing Zhao
Original Assignee
Funcode Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Funcode Technology Co Ltd filed Critical Funcode Technology Co Ltd
Priority to TW98138792A priority Critical patent/TWI424355B/en
Publication of TW201118745A publication Critical patent/TW201118745A/en
Application granted granted Critical
Publication of TWI424355B publication Critical patent/TWI424355B/en

Links

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present invention discloses a barcode augmented reality system capable of interacting with a barcode by superposing a virtual object onto a real image. The real image can be captured by an image capturing unit. The content and space information of the virtual object can be obtained by decoding the barcode. The system can superposes the virtual object onto the real image according to the space information. The present invention also discloses a method to executing the system through internet.

Description

201118745 六、發明說明: 【發明所屬之技術領域】 充實境應用模式系統 本發明係關於一種條碼擴充實境系統,利用擴充實境條碼 標誌性質,可以完成-個精確、容錯、有延伸性與更適於各種擴 【先前技術】201118745 VI. Description of the invention: [Technical field of invention] The invention relates to a barcode augmented reality system, which can complete an accurate, fault-tolerant, extensible and more Suitable for various expansions [prior art]

近幾年來,相關於Mixed Reality(MR)或 Augumented Reality(AR)等擴充實境的研究有相當活躍的發展,所謂擴充實 境指的是-個合併虛擬物件與真實物件的紐,它的目的 一個與真實世界的物件同時並存的虛擬實境。 擴充實境系統中使用者與系統的互動通常為:使用者展示 (通常是手持或穿戴)標統透過對標諸的侧來辨別使用 者的動作,產生相應反映,並將虛擬物件與實體影像結合在一起 回饋給使用者。擴充實境系統通常包含多個模組,其中標誌偵 測模組疋使用者與系統的輸入媒介,其效能與正癌性影響整套系 、、先甚矩,疋擴充貝;I兄系統表重要的核心技術,因此使用的偵測技 術與標誌樣式設計,是決定擴充實境系統品質的重要因素。 目前已有數組用於開發擴充實境的工具已被發表,例如 ARtoolkit’ARtoolkit 的細節可參考 H.Kat0, M· Billinghurst, I. Poupyrev, L Imamoto, K. Tachibana,於 ISAR 2000,In recent years, research on augmented reality such as Mixed Reality (MR) or Augusted Reality (AR) has been quite active. The so-called augmented reality refers to a combination of virtual objects and real objects. Its purpose A virtual reality that coexists with real-world objects. The interaction between the user and the system in the augmented reality system is usually: the user displays (usually hand-held or worn) the system to identify the user's actions through the side of the target, to generate corresponding reflections, and to visualize the virtual object and the physical image. Combined with feedback to the user. The augmented reality system usually consists of a number of modules, including the logo detection module, the input medium of the user and the system, the effectiveness and positiveness of the system affecting the entire system, the first moment, and the expansion of the shell; The core technology, therefore, the use of detection technology and logo style design is an important factor in determining the quality of the real-world system. Tools for developing augmented reality have been published. For example, the details of ARtoolkit’ARtoolkit can be found in H.Kat0, M. Billinghurst, I. Poupyrev, L Imamoto, K. Tachibana, ISAR 2000.

Oct. 5 6,2000 研a寸會所發表的 virtual Object Manipulation on a Table-Top AR Environment” ’ AR toolkit 使用圖形比對 的方式來偵測標誌,在這種技術下,標誌必須事先定義並經過一 201118745 ,並__人线,之彳_才能據此 注意覆蓋_或=1遭^^2’例如_者手指不 二Γ標誌數目的增加,混淆誤判的機率也會大 ,某些應用上的限制。另外,每張標諸的樣式也僅能 址。、則、碼或圖案,無法在標翻儲存較大量的資料,例如網 之不==:rr統’即是針對現有系統上 【發明内容】 本發明係關:ίΡί種條石馬辨右旗/ 誤糾正、具延伸性、能精確判統’讓條碼標諸具錯 用模式的擴充實境純 _有延伸性,更適於任意應 ===::碼模組以及擴充實境空間定位心 得影像,經過前置影像處理後,擴充實 經 再由擴充實 別解碼並計算出條碼標認的内容以及 ☆ 由擴充實境虛擬物縣得模組取得對^虛旋Γ度’ 度並堆疊於所擷取的實境影像中,最後, 置,對應於條·位置及角 顯 示模組將結合的影像 201118745 顯示給使用者。Oct. 5 6,2000 Research on virtual object Manipulation on a Table-Top AR Environment" 'AR toolkit uses a graphical comparison method to detect signs. Under this technology, the mark must be defined in advance and passed through a 201118745, and __ human line, then _ _ can only pay attention to cover _ or =1 by ^ ^ 2 'such as _ the number of fingers is not the number of signs, the probability of confusion and misjudgment will be large, some applications In addition, each of the marked styles can only be located., then, code or pattern, can not store a larger amount of data in the standard flip, such as the network does not ==: rr system is to target the existing system [invention Contents] The invention is related to: Ρ Ρ 种 种 种 / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / / The ===:: code module and the extended real-world spatial positioning experience image. After the pre-image processing, the extended real-life and then the extended real-distance decoding and calculation of the bar code identification content and ☆ by the augmented reality virtual object The county has obtained the module's virtual Γ degree And stacked reality image captured, the last, is set corresponding to the position and the angle-bar display module displays the combined image to the user 201,118,745.

在本發明_,擴充實境條碼標諸有多重用途,使用者除了可 透過擴充貫境條碼標誌與擴充實境系統互動,讓系統將虛擬物件 堆疊於實境影像中,或對擴充實境系統下達命令,另一個用途是 透過擴充貝i兄條碼標認本身存有的數位資訊(例如網址URL)','讓 系統y以連結_應_址,進行虛擬物件的下載歧新,本發 明也提出擴充實_路服務的方法’可遠魏行擴充實境系統, 另外,此擴充實境網路服務模組也可·做為—個遠端的各式條 碼解碼系統,可财客戶朝時執行,解決條碼 出 新’客戶端系統更新不易的問題。 在本發明所提出的系統中,採用的條碼標諸、設計與條碼伊士 =測技=具有錯誤偵測與精確判讀的能力,在不穩定環境下使 成t碼標設計也相對容易,並且能應付條 個系統可以適用:較響:判讀的精確度,這些特性讓這 展示系統,或商用 合網路内容,將系統基礎;:===讓條賴'結 做切分,系統將可以適應更多客^;1伸的= 位内容/功能 性,容易支援等優點。 的订為’具有強大的延伸 【實施方式】 雖然將以數個較佳實施例 具有通常技藝者所瞭解的其= 中所提及之所有優點及# 二鉍例(^3並未提供此 有優點及彳寸相實_)亦落在本發明的 201118745 嘴中。因此’本發明之範嘴係僅參考隨附之申請專利範圍 所定義。 現將參照圖式,欽述根據本發明之條碼擴充實境系統 與方法之說明性實施例。 參考第1圖’本發明之第一實施例。 本實施例提供一種條碼擴充實境系統,包含:一條瑪 標誌100 ; —影像擷取單元102,可取得一實境影像.一條 碼標諸識別單元1G4,可判卿實境影像是否包含該條碼梯 誌及識別該條碼標誌;一内容解碼單元1〇6,可解碼該條瑪 標誌以得到該條碼標誌代表的内容;一空間定位單元, 可決定該條碼標誌在該實境影像的空間資訊;一擴充實境 虛擬物件轉單元11G,可取得制雜碼標狀表内容的 虛擬物件,一擴充實境虛擬物件儲存及管理單元112,玎 ^取,虛擬物件;一擴充實境產生單元120,可將該虛擬物 4堆唛在δ亥實境影像中的該條碼標諸空間位置上而產生一 乜充貝i兄衫像,及一顯示單元13〇,顯示該擴充實境影像。 、,實施例中的條碼標誌100可為各式二維條碼、一維條 ,或彩色條碼’範例格式如第2(a)至第2(i)圖所示。其中,第 ’在圖式中以灰階表示色彩。又,條碼標热 如σ匕3有—非機器可辨識之區域,此區域可放置各式圖樣, 100 、商品商標、公司商標或其他各種圖案。此條碼標誌 人古〜谷可包含網址資訊(URL)或對應到網址的代碼,亦可勺 3子、數字、二元碼及特殊符號等内容。 0 實&例中的影像操取單元1〇2可以是任何可指員取與 201118745 模組等 像或視訊Φ流的電子裝置,例如:網路攝影機(喊啦)、固 ^式攝影機、數位攝影機(DV)、手機解持行動裝置上的照相 條碼標誌識別單元104可對影像#|取單元1Q2所 到的實境影雜行影像的前置處理,例如:影像的二元 理、條碼標辦徵的掃描、條碼標諸位置判定(如巾^點及 頂,的判定)、條碼標誌'類別的判定、條碼標總的版本及大㈣ 判定、條碼標惩的校正及條碼標認格點的顏色判定等 實境影像是否有包含條碼麟,並取得條碼標麵影像資^ 在此實施例中,條端誌、識別單元1G4係在近端本機編于。 内容解碼單元1()6係為一個具錯誤糾 其係將條碼細別單元104所取得 以 =訊進行_,以取得條碼標域表的”,解碼 /、碼遮罩_除、依據條碼類型所定義的湖取得正確的訊^ 、將訊息串進行錯誤糾正、根據編碼原則將訊息串解二 予碼。在此實婦,内容解鱗元觸係在近端本機= 空間定位單元108係藉由條碼標諸識別單幻〇4所取 ^碼標誌㈣像資絲衫條碼標註、在實境影 =In the present invention, the augmented reality bar code has multiple uses, and the user can interact with the augmented reality system by expanding the cross-bar code flag to allow the system to stack virtual objects in the real-world image, or to augment the real-world system. Another purpose is to use the extended barcode to identify the digital information (such as the URL of the website), which allows the system y to link the _ _ address, and to download the virtual object. The method of expanding the real-road service is proposed to extend the real-world system. In addition, this extended-reality network service module can also be used as a remote bar code decoding system. Execution, solve the problem of bar code new 'client system update is not easy. In the system proposed by the present invention, the bar code labeling, design and bar code Essence=testing technology=the ability to have error detection and accurate interpretation, and it is relatively easy to design the t code in an unstable environment, and Can handle a system can be applied: louder: the accuracy of the interpretation, these characteristics allow this display system, or commercial network content, will be based on the system;: === let the line cut the knot, the system will be able to Adapt to more customers ^; 1 stretch = bit content / functionality, easy support and other advantages. ''has a strong extension' [Embodiment] Although all of the advantages mentioned in the = which are known to those skilled in the art will be described in several preferred embodiments and #二铋例(^3 does not provide this Advantages and advantages _) also fall in the mouth of the 201118745 of the present invention. Therefore, the scope of the present invention is defined by reference only to the scope of the accompanying claims. Illustrative embodiments of a bar code augmented reality system and method in accordance with the present invention will now be described with reference to the drawings. Reference is made to Fig. 1 'the first embodiment of the invention. The embodiment provides a barcode augmented reality system, comprising: a horse mark 100; an image capturing unit 102, which can obtain a real image. A code label identifying unit 1G4 can determine whether the real image includes the barcode. And a content decoding unit 1〇6, which can decode the bar mark to obtain the content represented by the bar code flag; and a spatial positioning unit, which can determine spatial information of the bar code mark in the real image; An augmented reality virtual object transfer unit 11G can obtain a virtual object of the content of the coded standard table, an augmented reality virtual object storage and management unit 112, a virtual object, and an augmented reality generating unit 120. The virtual object 4 may be stacked on the spatial position of the bar code in the δHurreal image to generate a 兄 贝 兄 兄 , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , The bar code mark 100 in the embodiment may be various types of two-dimensional bar codes, one-dimensional bars, or color bar codes' example formats as shown in the second (a) to (2)th drawings. Wherein, the color is represented by gray scale in the drawing. In addition, the bar code heat, such as σ匕3, has a non-machine identifiable area, which can be placed in various patterns, 100, trademarks, company trademarks or other various patterns. This barcode symbol can be used to include the URL information (URL) or the code corresponding to the URL, or to include 3 sub-numbers, numbers, binary codes and special symbols. The image manipulation unit 1〇2 in the real example can be any electronic device that can be used to capture images or video Φ streams of the 201118745 module, such as a network camera (screaming), a solid camera, The digital barcode camera identification unit 104 on the digital camera (DV) and the mobile phone unarming mobile device can perform pre-processing on the image of the real image line that the image 1Q2 is sent to, for example, the binary processing of the image and the barcode. Scanning of the mark, bar code mark position determination (such as towel ^ point and top, judgment), bar code mark 'category judgment, bar code mark total version and big (four) judgment, bar code punishment correction and bar code mark Whether the real image of the point is determined to include the barcode, and the barcode image is obtained. In this embodiment, the barcode and the identification unit 1G4 are locally programmed at the near end. The content decoding unit 1()6 is an error correction system that obtains the bar code field table by the bar code detail unit 104 to obtain the bar code field table, and decodes, codes masks, and divides according to the bar code type. The defined lake obtains the correct message, corrects the message string, and solves the message sequence according to the coding principle. In this case, the content solution scale is in the near-end local = spatial positioning unit 108 is based on the bar code Marked by the identification of the single illusion 〇 4 take the ^ code mark (four) like the silk shirt barcode mark, in the real shadow =

貝訊,如蝴立置與_角度,包括條碼標糾 J 娜角度、對y轴旋轉角度、對^ 旋轉从核其投雜料訊來決定ΐ 執行。a貝例中’空間定位單元⑽係在近端本機 擴充實境虛擬物件取得單元no可藉由内容解碼單元 201118745 106解碼得到條碼標誌代表的内容以 表内容的虛擬物件。可將條碼標諸代表内容域 如:ί條碼標訪為—維條碼時,此料可以im 條碼標誌是二維條碼時,也可以 疋戈碼,虽 外,擴充實境虛擬物件取得單元 虛擬物件儲存及管理單元 曰由存取擴充貫i兄 虛擬物件。纽實_卜條碼銳_内容的 係在近端本機執行。廣充〇兄虛擬物件取得單元⑽ 條碼m,可存取對應於 取得單元110的敌…ΓΓ件 疋接受擴充實境虛擬物件 擬物件。在此’ _應對應於條碼標諸代表内容的虛 m係在近端1^。,_境細議梅理單元 r單f =1^生單7112G ’係'將各個於擴充實境虛擬物件取 I 斤取仔的虛擬物件,根據空間定位單元108所取得針 應的旋轉歧及如位置,將虛錄件移輯計算㈣ ζ) ’亚且將虛擬物件分卿χ,y,Ζ軸做計算轉, ==:影像齡單元⑽所擷取的實境影:二 條馬^'工間位置上’而產生―擴充實境影像。在此實施 擴充貫境產生單元12〇係在近端本機執行。 擴充^=像元13〇,用以顯示擴充實境產生單元120所產生的 此實施例亦提供一種條碼擴充實境方法,包含:掏取 一貫境影像;識別該實境影像是否包含-條碼標諸並取得 201118745 該條碼標誌的空間資訊,及解碼該條碼標誌以得到對應該 條碼標誌的内容;取得對應該條碼標誌代表内容的一虛擬 物件;根據取得之該條碼標誌、的空間資訊 件於實境影像中而產生一擴充實境影像,及顯;該= 境影像。 ' 此實施例將條碼標誌識別單元1〇4、内容解碼單元 106、空間定位單元108、擴充實境虛擬物件取得單元11〇、 擴充實境虛擬物件儲存及管理單元112,及一擴充實境產生 馨單元120置於近端本機上,且虛擬物件已儲存在近端本機, 不需經由網路連結取得虛擬物件,因此可減少網路傳輸數 據量。 參考第3圖,本發明之第二實施例。 第二實施例提供一種條碼擴充實境系統,包含:一條 碼標誌^00; —擴充實境開關1〇1,設定於開啟狀態;一影 像榻取單兀102,可取得一實境影像;一條碼標誌識別單 φ 70 104 ’可判別該實境影像是否包含該條碼標誌及識別該條 碼標遠'’一内容解碼單元1〇6,可解碼該條碼標誌以得到 該條碼標誌代表的内容;一空間定位單元108,可決定該 條碼,遠、在4實境影像的空間資訊;一擴充實境虛擬物件 取得單元」10 ’經由網路連結到遠端的一擴充實境虛擬物 #儲存及fil單it 212,以取得對應該條碼標誌、代表内容 的-虛擬物件,並回傳該虛擬物件;一擴充實境產生單元 120 ’可將該虛擬物件堆疊在該實境影像中的該條碼標誌空 間位置上而產生一擴充實境影像,及-顯示單元130,顯 示該擴充實境影像。 201118745 _本實施例又可包含一擴充實境虛擬物件儲存及管 元m於近端本機,將透過網路連結回傳的虛擬物件 並建立索引,可讓擴充實境虛擬物件取得單元ho 子 並取得對應於此索引的虛擬物件。 子’ 第二實施例仍將條碼標誌識別單元1〇4、内 兀1〇6、空間定位單元1〇8、擴充實境虛擬物件果早 110,及-擴充實境產生單幻2〇置於近端本機上 =Beixun, such as the butterfly stand and the _ angle, including the bar code to correct the J angle, the y-axis rotation angle, and the ^ rotation from the core to determine the ΐ execution. In the case of a shell, the spatial positioning unit (10) is in the near-end local augmented reality virtual object obtaining unit no, and the content decoding unit 201118745 106 can decode the virtual object of the content represented by the barcode symbol. The bar code can be marked as representative of the content field, such as: ί bar code is marked as - dimension bar code, this material can be im bar code mark is a two-dimensional bar code, can also dig the code, although the augmented reality virtual object acquisition unit virtual object The storage and management unit 扩充 expands the virtual object by access. New Zealand _ _ barcode sharp _ content is implemented locally at the local end.广充〇兄 virtual object acquisition unit (10) barcode m, can access the enemy component corresponding to the acquisition unit 110 疋 accept the augmented reality virtual object. Here, the _ should correspond to the virtual code of the bar code representing the content at the near end 1^. , _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ For example, the position of the virtual record is calculated (4) ζ) 'Ya and the virtual object is divided into χ, y, Ζ axis to do the calculation, ==: image age unit (10) captured the real shadow: two horses ^' At the location of the workplace, the resulting image is augmented. The implementation of the extended context generation unit 12 is performed locally at the near end. The expansion method ^=pixel 13 is used to display the augmented reality generating unit 120. The embodiment also provides a bar code augmented reality method, including: capturing a consistent image; and identifying whether the real image includes a bar code Zhuhe obtains the spatial information of the bar code mark of 201118745, and decodes the bar code mark to obtain the content corresponding to the bar code mark; obtains a virtual object corresponding to the content of the bar code mark; according to the obtained space code mark, the spatial information piece is true An augmented reality image is generated in the image of the environment, and the image is displayed. This embodiment will be a barcode identification unit 1〇4, a content decoding unit 106, a spatial positioning unit 108, an augmented reality virtual object acquisition unit 11〇, an augmented reality virtual object storage and management unit 112, and an augmented reality generation. The immersion unit 120 is placed on the local end, and the virtual object is stored in the near-end local machine, and the virtual object is not required to be accessed through the network connection, thereby reducing the amount of data transmitted by the network. Referring to Figure 3, a second embodiment of the present invention. The second embodiment provides a bar code augmented reality system, comprising: a code flag ^00; - an augmented reality switch 1〇1, set in an open state; an image couching unit 102, can obtain a real image; The bar code flag identification unit φ 70 104 ′ can determine whether the real-world image includes the bar code flag and identify the bar code far--a content decoding unit 1〇6, and can decode the bar code flag to obtain the content represented by the bar code flag; The spatial locating unit 108 can determine the bar code, and the spatial information of the 4 real-world images; the augmented reality virtual object obtaining unit 10 ′ is connected to the remote a virtual reality virtual object via the network. Single it 212, to obtain a corresponding virtual object of the bar code mark, representative content, and return the virtual object; an augmented reality generating unit 120' can stack the virtual object in the bar code mark space in the real image An augmented reality image is generated in position, and the display unit 130 displays the augmented reality image. 201118745 _ This embodiment may further comprise an augmented reality virtual object storage and management unit m at the near end local machine, which will link and return the virtual object through the network and establish an index, so that the augmented reality virtual object acquisition unit ho And get the virtual object corresponding to this index. The second embodiment still places the bar code mark recognition unit 1〇4, the inner 兀1〇6, the spatial locating unit 1〇8, the augmented reality virtual object as early as 110, and the augmented reality produces a single illusion 2〇 Near-end local =

實境虛擬物件儲存及管理單元212則置於遠端 ^, 擬物件須經由網路連結下載或更新。 ’虛 參考第4圖,本發明之第三實施例。 第三實施例提供-條碼擴充實m包含: 標諸100; -擴充實境開關1(H,設定於開啟狀態; 擷取單元102,可取得一實境影像;一網路服務 如 如網路連結150,提供網路連結服務並可傳送該每产^例 一條碼標總識別單元204,可判別該fθ 兄, 碼標諸及識職條碼標^該條 該條碼標誌以得到該條碼標誌代表的内容;一空:解, 元208 ’可決定該條碼標諸在該實境影像的位^ 擴充實境虛擬物件取得單元21〇,以取得對應該^碼^ 代表内容的-纽物件;―擴充實境趣物稍== 單元212,可存取該虛擬物件;一擴充實境產生 吕 可將該虛擬替堆疊在該實境影像中的該條碼標20 ’ 置上而產生一擴充實境影像,並透過網路連社Η曰1^ 擴充實境影像,及-顯示單元⑽,顯示該擴㈣境 201118745 本貫施例則將條碼標諸識別單元204、内容解瑪單_ 206、空間定位單元2〇8、擴充實境虛擬物件取得單元= 擴充實境虛擬物件儲存及管理單元212,及一擴充實境產生 單兀220置於遠端。當近端本機設備有所限制時,本實施 例可以將主要功能與計算放在遠端網路。此外,本實施例 也有助於系統的更新,只要在遠端或伺服器端更新,可免 除針對所有客戶端--更新的困擾。 參考第5圖’本發明之第四實施例。 •第四實施例提供一條碼擴充實境系統,包含:一條碼 標誌100 ; —擴充實境開關101,設定於開啟狀態;一影像 揭取單元102,可取得一實境影# ; 一條碼標諸識別單元 104,可判別該實境影像是否包含該條碼標誌及識別該條碼 標誌;一網路服務單元,例如網路連結15〇,提供網路連 結服務並可傳送該條碼標誌的影像資訊;一内容解碼單元 206,可解碼該條碼標誌以得到該條碼標誌代表的内容;一 空間定位單元208,可決定該條碼標誌在該實境影像的空 •間資訊;一擴充實境虛擬物件取得單元11〇,經由網路連 結以取得對應該條碼標諸代表内容的一虛擬物件,該虛擬 物件可為3D物件、影片、影像或數位内容;一擴^境 虛擬物件儲存及管理單元112,可存取該虛擬物件;三擴 充貫境產生單元12〇,可將該虛擬物件堆疊在該實境影像 中的該條碼標遠' 空間位置上而產生一擴充實境影像,及一 顯示單元130,顯示該擴充實境影像,又,該擴充實境產 生單元另包含一比例參數,可調整該虛擬物件堆疊於該實 境影像的大小。 [S] 12 201118745 本實施例則將内容解碼單元施與空間定 置於遠端計^其餘與雜及虛___功糾包 碼標德識別單元1〇4、擴充實境虛擬物件取得單元n〇 、 充實境虛擬物件儲存及管理單元n2及一擴士, 機執行。此方式有助於分散 術)的請,並避免影像及虛擬物件等較大·的網 參考第6圖,本發明之第五實施例。 第五實施例提供-種條碼標諸解碼方法 關ΠΠ設定於關閉狀態,其方法為利用第三實^ = ^但不執彳單元删、擴充實境虛擬物件取得 =π 210、擴充實境虛擬物件儲存及管理單元212,及擴充 貫境產生單元220的功能。 一種條碼標誌解碼方法,包含:擷取一實境影像;經 由網路連結將該實境影像傳送至遠端的一條碼標誌識別單 =,識別該實境影像是否包含一條碼標誌並取得該條碼標 〜的影像資訊,解碼該條碼標誌以取得該條碼標誌内容; 將已解碼之該條碼標誌内容經由網路連結傳至一顯示單 元,及顯示已解碼之該條碼標誌内容。 參考第7圖’本發明之第六實施例。 第六實施例提供一種條碼標誌解碼方法,擴充實境開 關101設定於關閉狀態,其方法為利用第四實施例之架 ,,但不執行空間定位單元2〇8、擴充實境虛擬物件取得 單π 110、擴充實境虛擬物件儲存及管理單元112,及擴充 201118745 實境產生單元120的功能。 一種條竭標諸解碼方法,包含: 擷取一實境影像;識別該實境影像是否包含一條碼標誌並 取得該條碼標誌的影像資訊;經由網路連結將該條碼標誌 的影像資訊傳送至遠端的一内容解碼單元;解碼該條碼標 諸以取得該條碼標諸内容;將已解碼之該條碼標誌内容經 由網路連結傳至一顯示單元,及顯示已解碼之該條碼標誌 内容。 • 熟知此項技藝者應瞭解,上述之方法及設計具有額 外的應用且相關的應用並不限於上列所具體闡述者。 又,本發明可以其他的特定形式來加以實施卻不會脫離 本文中所述之基本特性。不論是以何種角度而言,上述 之實施例皆應被視為是說明性而非限制性。 【圖式簡單說明】 第1圖係顯示第一實施例的示意圖; _ 第2(a)至2(i)圖係顯示各式條碼標誌; 第3圖係顯示第二實施例的示意圖; 第4圖係顯示第三實施例的示意圖; 第5圖係顯示第四實施例的示意圖; 第6圖係顯示第五實施例的示意圖;以及 第7圖係顯示第六實施例的示意圖。 14 201118745 【主要元件付就說明】 100〜條碼標誌 〜影像擷取單元 104〜條碼標誌識別單元丨 108〜空間定位單元 112〜擴充實境虛擬物件儲存及虛擬物件取得單元 120〜擴充實境產生單元13〇 内容解碼單元 101〜擴充實境開關 管理單元 镅示單元The virtual object storage and management unit 212 is placed at the remote end ^, and the object must be downloaded or updated via a network link. 'Virtual reference to Fig. 4, a third embodiment of the present invention. The third embodiment provides that the bar code expansion real m includes: a label 100; an augmented reality switch 1 (H, set to an on state; the capture unit 102 can obtain a real image; a network service such as a network The link 150 provides a network connection service and can transmit a code identification total identification unit 204 for each production method, and can identify the fθ brother, the code label and the identification barcode label, and the barcode label is used to obtain the barcode symbol. The content; an empty: solution, element 208 'can determine that the bar code is marked in the real image, ^ augmented reality virtual object acquisition unit 21〇, to obtain the corresponding object of the ^ code ^ representative; The real thing is slightly == unit 212, the virtual object can be accessed; an augmented reality generates the virtual code for the virtual code stack 20' in the real image to create an augmented reality image. And expand the real-world image through the Internet, and display unit (10), display the expansion (four) environment 201118745. The local application will mark the barcode to the identification unit 204, the content solution _ 206, spatial positioning Unit 2〇8, augmented reality virtual object acquisition unit = expansion The virtual reality object storage and management unit 212 and an augmented reality generating unit 220 are placed at the remote end. When the local device is limited, the embodiment can put the main functions and calculations on the remote network. In addition, this embodiment also contributes to the update of the system, as long as it is updated at the remote end or the server side, the trouble for all client-updates can be dispensed with. Referring to Figure 5, the fourth embodiment of the present invention. The fourth embodiment provides a code augmented reality system, comprising: a code flag 100; - an augmented reality switch 101, set in an on state; an image removal unit 102, which can obtain a real shadow #; The unit 104 may determine whether the real-world image includes the barcode identifier and identify the barcode identifier; a network service unit, such as a network connection, provides a network connection service and can transmit image information of the barcode identifier; The decoding unit 206 can decode the barcode flag to obtain the content represented by the barcode identifier; a spatial positioning unit 208 can determine the space information of the barcode identifier in the real image; The virtual reality object obtaining unit 11 is connected to obtain a virtual object corresponding to the barcode content represented by the barcode, and the virtual object may be a 3D object, a movie, an image or a digital content; and an expanded virtual object storage and The management unit 112 can access the virtual object, and the third extended environment generating unit 12 can stack the virtual object in the far-spaced position of the barcode in the real-world image to generate an augmented reality image, and A display unit 130 displays the augmented reality image, and the augmented reality generating unit further includes a proportional parameter, which can adjust the size of the virtual object stacked on the real image. [S] 12 201118745 This embodiment will The content decoding unit applies the space to the far-end meter, the rest, the miscellaneous and the virtual ___, the power correction packet code identification unit 1〇4, the augmented reality virtual object acquisition unit n〇, the abundance virtual object storage and management unit N2 and a expansion, machine execution. This method contributes to the dispersal of the application, and avoids large images such as images and virtual objects. Referring to Fig. 6, a fifth embodiment of the present invention. The fifth embodiment provides that the decoding method of the barcode label is set to the off state, and the method is to use the third real ^ = ^ but not the unit to delete, the augmented virtual object to obtain = π 210, augmented reality virtual The object storage and management unit 212, and the function of the extended context generating unit 220. A bar code flag decoding method includes: capturing a real-world image; transmitting a real-time image to a remote code mark identification list via a network link, identifying whether the real-world image includes a code mark and obtaining the barcode The image information of the mark is decoded, the bar code mark is decoded to obtain the content of the bar code mark; the decoded content of the bar code mark is transmitted to a display unit via a network link, and the decoded bar code mark content is displayed. Reference is made to Fig. 7 'the sixth embodiment of the present invention. The sixth embodiment provides a bar code flag decoding method, in which the augmented reality switch 101 is set in a closed state by using the frame of the fourth embodiment, but the spatial positioning unit 2〇8 and the augmented reality virtual object obtaining form are not executed. π 110, the augmented reality virtual object storage and management unit 112, and the function of the 201118745 reality generation unit 120. A method for decoding a decoding method, comprising: capturing a real-world image; identifying whether the real-world image includes a code mark and obtaining image information of the bar code mark; transmitting the image information of the bar code mark to the far distance via a network link a content decoding unit of the terminal; decoding the barcode to obtain the barcode content; transmitting the decoded barcode identifier content to a display unit via a network link, and displaying the decoded barcode identifier content. • Those skilled in the art will appreciate that the methods and designs described above have additional applications and related applications are not limited to those specifically set forth above. Further, the invention may be embodied in other specific forms without departing from the basic characteristics described herein. The above embodiments are to be considered as illustrative and not restrictive. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a schematic view showing a first embodiment; _ 2(a) to 2(i) are diagrams showing various types of bar code marks; and Fig. 3 is a view showing a second embodiment; 4 is a schematic view showing a third embodiment; FIG. 5 is a schematic view showing a fourth embodiment; FIG. 6 is a schematic view showing a fifth embodiment; and FIG. 7 is a view showing a sixth embodiment. 14 201118745 [Description of main components] 100~Barcode markup~Image capturing unit 104~Barcode markage identifying unit丨108~Space locating unit 112~Augmented reality virtual object storage and virtual object obtaining unit 120~Augmented reality generating unit 13〇 content decoding unit 101~ augmented reality switch management unit display unit

15〇〜網路連結 212〜擴充實境虛擬物件健存及管理單元 2 〇4〜條碼標號、識別單元 208〜空間定位單元 220〜擴充實境產生單元 206〜内容解碼單元 210〜擴充實境虛擬物件取得單元15〇~network link 212~Augmented reality virtual object storage and management unit 2〇4~Bar code label, identification unit 208~space positioning unit 220~Augmented reality generating unit 206~Content decoding unit 210~Augmented reality virtual Object acquisition unit

[S][S]

Claims (1)

201118745 七、申請專利範圍 1. 一種條碼擴充實境系統,包含: 一條碼標諸; 一影像擷取單元,可取得一實境影像; 一條碼標誌識別單元,可判別該實境影像是否包含該 條碼標誌、及識別該條碼標諸, 一内容解碼單元,可解碼該條碼標誌以得到該條碼標 誌代表的内容; 一空間定位單元,可決定該條碼標誌在該實境影像的 空間資訊; 一擴充實境虛擬物件取得單元,可取得對應該條碼標 誌代表内容的一虛擬物件; 一擴充實境虛擬物件儲存及管理單元,可存取該虛擬 物件; 一擴充實境產生單元,可將該虛擬物件堆疊在該實境 影像中的該條碼標誌空間位置上而產生一擴充實境 影像;及 一顯示單元,顯示該擴充實境影像。 2. 如申請專利範圍第1項之條碼擴充實境系統,其中該 條碼標諸可為各式·一維條碼。 3. 如申請專利範圍第1項之條碼擴充實境系統,其中該 條碼標諸可為各式二維條碼。 4.如申請專利範圍第1項之條碼擴充實境系統,其中該 16 201118745 條碼標誌可為包含有定位符號、錯誤糾正碼及深淺方 格組成的資料圖案。 5. 如申請專利範圍第1項之條碼擴充實境系統,其中該 條碼標§志可為網址資訊(URL )或對應到網址的代碼。 6. 如申請專利範圍第1項之條碼擴充實境系統,其中該 條碼標誌可包含有一非機器可辨識之區域 κ 7. :申:!專利乾?第1項之條碼擴充實境系統,其中号 .作衫像資訊,係可為類別、相 式版本大小、中心點座標、頂點座標及顏色。 8. 如申請專利範圍第β之條碼 内容解碼單元,係為一個 · Λ兄系、、先,其中_ ,、錯誤糾正功能的解碼器。 9. :申請專利範圍第Μ之條碼 J 虛擬物件可為3D物件、旦,u '、只兄糸、、先’其中錢 〜片、影像或數位内容。 10. 如申請專利範圍第1項 擴充實境虛擬物件儲存及二碼擴。充貫境系統’其中該 單元置於同-電子裝置。&理單凡可與該影像掏φ 11. 如申請專利範圍第丨項 擴充實境虛擬物件儲存及,擴σ充實境系統,其中該 元置於不同電子裝置。g理單元與該影像擷取單 12. 如申請專利範圍第丨項 擴充實境產生單元另包A 1擴充實境系統’其中該 3 —比例參數,可調整該虛 201118745 物件堆疊於該實境影像的大小。 13. 如申請專利範圍第1項之條碼擴充實境系統,其中該 條碼標誌識別單元、該内容解碼單元、該空間定位單 元、該擴充實境虛擬物件取得單元、該擴充實境虛擬 物件儲存及管理單元或該擴充實境產生單元與該影 像擷取單元可於不同電子裝置運作。 14. 如申請專利範圍第1項之條碼擴充實境系統,另包含 一網路連結單元,用於連結網路以取得對應該條碼標 誌之該虛擬物件或連結網路取得網路服務。 15. 如申請專利範圍第1項之條碼擴充實境系統,另包含 一擴充實境開關,用於切換擴充實境系統或條碼標誌 解碼功能。 16. —種條碼擴充實境方法,包含: 擷取一實境影像; 識別該實境影像是否包含一條碼標誌並取得該條碼 標誌的空間資訊,及解碼該條碼標誌以得到對應該條 碼標誌的内容; 取得對應該條碼標誌代表内容的一虛擬物件; 根據取得之該條碼標諸的空間資訊,堆疊該虛擬物件 於實境影像中而產生一擴充實境影像;及 顯示該擴充實境影像。 17. —種條碼標誌解碼方法,包含: 擷取一實境影像; 18 201118745 經由網路連結將該實境影像傳送至遠端的一條碼標 誌識別單元; 識別該實境影像是否包含一條碼標誌並取得該條碼 標諸的影像資訊; 解碼該條碼標f志以取得該條碼標誌、内容, 將已解碼之該條碼標誌内容經由網路連結傳至一顯 示單元;及 顯示已解碼之該條碼標誌内容。 • 18. —種條碼標誌解碼方法,包含: 擷取一實境影像; 識別該實境影像是否包含一條碼標誌並取得該條碼 標誌·的影像貢訊, 經由網路連結將該條碼標誌的影像資訊傳送至遠端 的一内容解碼單元; 解碼該條碼標諸以取得該條碼標諸内容, 將已解碼之該條碼標誌内容經由網路連結傳至一顯 鲁 示單元;及 顯示已解碼之該條碼標誌内容。 19201118745 VII. Patent application scope 1. A bar code augmented reality system, comprising: a code mark; an image capture unit, which can obtain a real image; a code mark identification unit, can determine whether the real image includes the a bar code flag, and identifying the bar code label, a content decoding unit, which can decode the bar code flag to obtain content represented by the bar code flag; a spatial positioning unit that can determine spatial information of the bar code flag in the real image; The virtual object obtaining unit can obtain a virtual object corresponding to the content represented by the barcode symbol; an augmented reality virtual object storage and management unit can access the virtual object; and an augmented reality generating unit can be the virtual object Stacking the spatial position of the bar code in the real image to generate an augmented reality image; and displaying a display of the augmented reality image. 2. For example, the bar code augmented reality system of claim 1 of the patent scope, wherein the bar code may be a variety of one-dimensional bar codes. 3. For example, the bar code augmented reality system of claim 1 of the patent scope, wherein the bar code may be a variety of two-dimensional bar codes. 4. The bar code augmented reality system of claim 1 of the patent scope, wherein the 16 201118745 bar code mark may be a data pattern comprising a positioning symbol, an error correction code, and a darkness and a square. 5. For example, the bar code augmented reality system of claim 1 of the patent scope, wherein the bar code mark may be a website information (URL) or a code corresponding to the website address. 6. For example, the bar code augmented reality system of claim 1 of the patent scope, wherein the bar code mark may include a non-machine identifiable area κ 7. : Shen:! The bar code of the first item augments the reality system, the number of which is the type of information, which can be category, phase version size, center point coordinates, vertex coordinates and color. 8. If the bar code content decoding unit of the patent application scope is β, it is a decoder of the brother system, first, where _ , and error correction function. 9. : The barcode of the third application patent scope J virtual object can be 3D object, Dan, u ', only brother, first, then money ~ film, image or digital content. 10. If the scope of patent application is item 1, expand the virtual reality object storage and the second code expansion. The Chongjing system' in which the unit is placed in the same-electronic device. & singularity can be associated with the image 掏 φ 11. If the scope of the patent application is expanded, the virtual reality object storage and expansion system can be expanded, and the element is placed in different electronic devices. The unit of the image and the image capture unit 12. If the patent application scope item 扩充 augmented reality generation unit is further packaged with A 1 augmented reality system 'where the 3 - scale parameter, the virtual 201118745 object can be adjusted to be stacked in the real world The size of the image. 13. The bar code augmented reality system of claim 1, wherein the bar code flag recognition unit, the content decoding unit, the spatial location unit, the augmented reality virtual object acquisition unit, the augmented reality virtual object storage and The management unit or the augmented reality generating unit and the image capturing unit can operate on different electronic devices. 14. For example, the bar code augmented reality system of claim 1 includes a network link unit for connecting to the network to obtain the virtual object or the link network corresponding to the bar code to obtain the network service. 15. For example, the bar code augmented reality system of claim 1 of the patent scope includes an augmented reality switch for switching the augmented reality system or bar code flag decoding function. 16. A bar code augmented reality method, comprising: capturing a real-world image; identifying whether the real-world image includes a code mark and obtaining spatial information of the bar code mark, and decoding the bar code mark to obtain a corresponding bar code mark And obtaining a virtual object corresponding to the content of the bar code mark; stacking the virtual object in the real image to generate an augmented reality image according to the obtained spatial information of the bar code; and displaying the augmented reality image. 17. A method for decoding a bar code flag, comprising: capturing a real-world image; 18 201118745 transmitting the real-world image to a remote code mark identification unit via a network connection; identifying whether the real-world image includes a code mark And obtaining the image information marked by the barcode; decoding the barcode label to obtain the barcode identifier and content, and transmitting the decoded barcode identifier content to a display unit via a network link; and displaying the decoded barcode identifier content. • 18. A method for decoding a bar code flag, comprising: capturing a real-world image; identifying whether the real-world image includes a code mark and obtaining an image of the bar code mark, and connecting the image of the bar code via a network link Transmitting the information to a remote content decoding unit; decoding the barcode label to obtain the barcode content, transmitting the decoded barcode identifier content to a display unit via a network link; and displaying the decoded content Bar code flag content. 19
TW98138792A 2009-11-16 2009-11-16 Barcode augmented reality system and method TWI424355B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW98138792A TWI424355B (en) 2009-11-16 2009-11-16 Barcode augmented reality system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW98138792A TWI424355B (en) 2009-11-16 2009-11-16 Barcode augmented reality system and method

Publications (2)

Publication Number Publication Date
TW201118745A true TW201118745A (en) 2011-06-01
TWI424355B TWI424355B (en) 2014-01-21

Family

ID=44935831

Family Applications (1)

Application Number Title Priority Date Filing Date
TW98138792A TWI424355B (en) 2009-11-16 2009-11-16 Barcode augmented reality system and method

Country Status (1)

Country Link
TW (1) TWI424355B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI503785B (en) * 2013-12-02 2015-10-11 Chunghwa Telecom Co Ltd Augmented reality system, application method thereof and non-temporary computer readable medium containing augmented reality application program
TWI513495B (en) * 2013-01-28 2015-12-21
CN108256594A (en) * 2016-12-29 2018-07-06 杨东华 Object anti-counterfeiting system and method thereof
US12499336B2 (en) 2023-11-06 2025-12-16 Samsung Electronics Co., Ltd. AR view for barcode scanning

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19917660A1 (en) * 1999-04-19 2000-11-02 Deutsch Zentr Luft & Raumfahrt Method and input device for controlling the position of an object to be graphically represented in a virtual reality
US7587412B2 (en) * 2005-08-23 2009-09-08 Ricoh Company, Ltd. Mixed media reality brokerage network and methods of use
TWI287395B (en) * 2005-06-23 2007-09-21 Wiquest Comm Inc Wireless display
TWM323177U (en) * 2007-06-01 2007-12-01 Azurewave Technologies Inc Wireless image signal-transmission device
TW200901089A (en) * 2007-06-22 2009-01-01 Mo Fz Tang Co Ltd Virtual reality image superimposing system and method thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI513495B (en) * 2013-01-28 2015-12-21
TWI503785B (en) * 2013-12-02 2015-10-11 Chunghwa Telecom Co Ltd Augmented reality system, application method thereof and non-temporary computer readable medium containing augmented reality application program
CN108256594A (en) * 2016-12-29 2018-07-06 杨东华 Object anti-counterfeiting system and method thereof
US12499336B2 (en) 2023-11-06 2025-12-16 Samsung Electronics Co., Ltd. AR view for barcode scanning

Also Published As

Publication number Publication date
TWI424355B (en) 2014-01-21

Similar Documents

Publication Publication Date Title
US11494994B2 (en) Apparatus, method, and system for presentation of multimedia content including augmented reality content
US9164577B2 (en) Augmented reality system, method, and apparatus for displaying an item image in a contextual environment
US10121099B2 (en) Information processing method and system
US20140236768A1 (en) Physical references for providing supplemental real estate information
US20140016820A1 (en) Distributed object tracking for augmented reality application
CN110880139A (en) Commodity display method, commodity display device, terminal, server and storage medium
CN118363456A (en) Depth estimation using biological data
CN104951498A (en) Method for generating a content in augmented reality mode
CN110036356A (en) Image procossing in VR system
TW201118745A (en) Barcode augmented reality system and method
KR101197126B1 (en) Augmented reality system and method of a printed matter and video
JP5215328B2 (en) Label display device, label display method, and program thereof
TW200901089A (en) Virtual reality image superimposing system and method thereof
JP2012190085A (en) Marker recognition processor, recognition processing program and recognition processing method
US20210390306A1 (en) Ar system for enhanced book covers and related methods
CN119137619A (en) Dynamically render augmented reality content generator
JP2013214158A (en) Display image retrieval device, display control system, display control method, and program
CN113486205B (en) Plant science popularization information system based on augmented virtual reality technology
JP2016535356A (en) Product description inquiry method, apparatus, system and client
CN120166255A (en) Image processing method, image processing device, electronic device and medium
JP2024525132A (en) COMPUTER-IMPLEMENTED METHOD FOR POSITIONING AND ORIENTING ELECTRONIC DEVICES IN A SHARED VIRTUAL SPACE - Patent application