JP2007004438A - Optical tag function control method, optical tag, and optical tag system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To develop a variety of application systems by adding a new function to a conventional optical tag and an optical tag system.
An ID is given as identification information to an optical tag, infrared emission is instructed for each optical tag, and the light emitted from the optical tag is imaged by an infrared camera of a recognition unit and the light is emitted. In the optical tag system 1 that recognizes the tag 10 and records information about the optical tag 10 in the database and provides the information recorded in the database to the client, the optical tag 10 is assigned a plurality of IDs. 10 holds a function of executing different processes corresponding to each ID of the plurality of IDs. And the infrared command containing ID is transmitted with respect to the optical tag 10 from the recognition part 20, the optical tag 10 detects ID contained in the received infrared command, and performs the process corresponding to the said ID. .
[Selection] Figure 1

Description

  The present invention relates to an optical tag function control method, an optical tag, and an optical tag system, and in particular, by adding new functions to the conventional optical tag and optical tag system, various application systems can be developed. The present invention relates to an optical tag function control method, an optical tag, and an optical tag system.

  Conventional techniques for optical tag systems have been proposed (see, for example, Patent Document 1, Non-Patent Documents 1, 2, and 3).

  An example of this conventional optical tag system will be described. For example, as shown in the configuration example of the conventional optical tag system in FIG. 6, the optical tag system 1a is attached to an object or person (real world object) 201 that exists in the real world, or is itself an object. Identification information (ID) is assigned to each optical tag 10a to a certain optical tag 10a. The optical tag 10 a receives the modulated infrared pulse illumination emitted by the recognition unit 20 of the optical tag system by the infrared light receiving unit 12 and the demodulation circuit 13, and is sent to the optical tag 10 a by the processing of the control microcomputer 11. In response to a command (infrared command) via the information channel, the infrared light emitting unit 14 emits light by infrared rays.

  The recognizing unit 20 controls the infrared camera 23 with the control PC (control computer) 21 and the image processing control unit 22 to photograph the light emitted from the optical tag 10a. The real-time communication control unit 24 of the recognition unit 20 performs real-time control in synchronization with the frame signal of the infrared camera 23, and the infrared pulse illumination unit 25 instructs the optical tag 10a to send an infrared light emission (infrared ray). Send a flash command).

  For example, as shown in FIG. 7, a command is sent to the corresponding optical tag 10a in synchronization with the image frame time (Tm-1, Tm, Tm + 1) associated with the ID (m-1, m, m + 1) of the optical tag 10a. Then, the recognition unit 20 recognizes the image of the light emission presence / absence and light emission position of the optical tag corresponding to the image frame time.

  Also, the system captures the spot with the visible camera 26 and corresponds to the metadata of the optical tag 10a including the recognition ID, time and position in the real-world captured image / video distribution information and the ID of the optical tag 10a. A series of link information that can start the operation is attached.

  For example, as shown in FIG. 8, the object identification ID = m, m + 1,..., The time Tm, Tm + 1,..., The frame in-frame coordinates of the object (Xm, Ym), (Xm + 1, Ym + 1) ),..., That is, a frame image position data extraction file 135 of each object is generated.

  That is, the computer system 200 detects the position coordinates in the frame image of each identification ID (m, m + 1,...) Extracted from each time (Tm, Tm + 1,...) And the corresponding output frame (n, n + 1,...). Association is performed (steps S101 and S102), and then a frame image position data extraction file 135 of each object is generated based on the associated identification IDs (m, m + 1,...) And the frame image position coordinates. (Step S103). That is, the frame image position data extraction file 135 corresponds to each object ID (m, m + 1,...) And each time (Tm, Tm + 1,...) And screen coordinates (Xm, Ym), (Xm + 1, Ym + 1). Are registered in association with each other.

  Further, as shown in FIG. 9, the in-frame position data extraction file 135 of each object shown in FIG. 8 is combined with the information file in the computer system 200 in advance and configured and handled as an object database 141. As an example of the information file in the computer system 200, a data file 137 relating to an object name is illustrated. The data file 137 related to the object name is a file in which information related to the object is stored in advance as a separate file.

  In combination with the information in the computer system 200 shown in FIG. 9, the frame image position data extraction file 135 of each object and the data file 137 relating to the object name are combined with a common object ID based on a relational database concept. (Step S110). Prior to this combination, the position of the optical tag 10a attached with the identification ID = m at time Tm was only known to be the screen coordinates (Xm, Ym) which are the coordinates in the frame image, but is shown in FIG. As described above, by combining with the data file 137 relating to the object name, it is possible to construct the object database 141 that is obtained as information that is easier to understand for human beings such that the name A is at the coordinates (Xm, Ym) at time Tm. .

  10 is different from the data file 137 related to the object name of the object database 141 in which the object position data extraction file 135 and the data file 137 related to the object name described in FIG. An example is shown in which the information database 143 is configured by combining the keyword, which is an item, with the information file 138 using the common key (step S111).

  The information file 138 registers information such as hobbies, purchase history, color, price, URL-B and the like corresponding to the keyword, and the information database 143 is stored on the IP (Internet Protocol) network 151 in the URL-B. It shows that an existing website can be accessed and information can be obtained from this website.

  As shown in FIG. 10, by combining a plurality of files with a common key, a plurality of databases can be configured, and the added value of information to be provided can be increased. For example, it is possible to make the information with high added value that the purchase history of the name A at the coordinates (Xm, Ym) at time Tm is XX. Furthermore, as described above, if a URL (Uniform Resource Locator) indicating the location of a file on the IP network is added as additional information, information can be extracted from the site of the specified URL and added to the information as additional information. Is possible.

  Further, FIG. 11 shows a cyberspace (computer system 200 or a plurality of computer systems connected to a network and information stored in the computer system) in which the object frame image position data extraction file 135 is constructed by the computer system 200. FIG. 6 is a diagram showing that an object management database 145 of the real world and the cyber world is constructed in association with object management in a space constructed from the above.

  In more detail, the computer system 200 combines the frame image position data extraction file 135 of each object with the object list 139 in the cyber world and an identification ID that is a common item of both, as a key, and the real world and the cyber world. The object management database 145 is configured (step S113). The cyber object list 139 includes items such as an identification ID, position, time, attribute, sensing information, and α.

  In the cyber world, managing objects in the real world as virtual objects means managing their properties, and what constitutes those properties is usually fixed information that can be supplemented in advance. limited. For example, in the case of a book, the number of pages, publisher, etc. In the example shown in FIG. 11, the position information of the real world object is recognized in real time like the position data extraction file 135 in the frame image of each object, and it is provided to other files in association with the identification ID. In order to provide a mechanism that can do this, location information in the real world can be added in real time as an item in the cyber object list 139. In this way, it is possible to automatically change cyber object information that has been fixed in the past in accordance with changes in the real world. In other words, the cyber objects are managed in accordance with the real world, the cyber objects are densely realized in the real world, and the real world and the cyber world can be combined.

  The client of the optical tag system can also display an icon at the recognition position in the image / video screen based on the metadata and assign link information attached to an ID corresponding to the position.

As described above, objects in the real world (real world) of other places related to the place or system are connected in real time with the cyber world {virtual world on a computer system (single or multiple systems)}. It makes it possible to obtain complex effects that cannot be obtained in the world alone.
JP 2004-192623 A Fumiharu Morisawa, Shinichiro Muto, Jun Terada, Yasuhiro Sato, Yuichi Mon Bunharu Morisawa, Shinichiro Muto, Jun Terada, Yasuhiro Sato, Yuichi Mon Muto, et al. "Small devices that connect the real world and networks and their broadband applications-Stick-on communiqué" (NTT Technology Journal, December 2003 issue)

The conventional optical tag described above and the optical tag system using the same have the following problems.
The first problem is that when a function for interaction with the surrounding environment is added to the optical tag, the initial simple optical tag configuration becomes complicated and large.
The second problem is that a new uplink information channel is required to transmit information from the optical tag. Furthermore, when radio waves or the like are used for an information channel, a mechanism having a different radio wave system must be added in addition to the optical system of the optical tag.

The third problem is that even if the upstream information channel can be provided in the optical system, it becomes an unstable transmission route depending on the installation status of the optical tag in the place.
The fourth problem is that the state of recognition of the optical tag itself by the system is not transmitted to the object to which the conventional optical tag is attached.

The fifth problem is that although the recognition result of the optical tag is reflected in the system in real time, information that can be used as content including valuable context (context) developed on the spot is lost and cannot be reused. is there.
A sixth problem is that when a plurality of recognition mechanisms coexist on the spot, the operation cannot be performed because the correspondence between the ID and the frame conflicts.
The seventh problem is not only related to the optical tag system using the above method and medium (optical tag), but also to an event (for example, an event at a stage / theatre, a theme park, etc.). If there is no mechanism for a device that links a computer system for processing information and an optical tag system, that is, a space device, it lacks applicability.

  The present invention has been made to solve the above-mentioned problems, and an object of the present invention is to solve the above-mentioned problems by adding new functions to conventional optical tags and optical tag systems. The present invention provides an optical tag function control method, an optical tag, and an optical tag system that enable development of various application systems.

  In the optical tag function control method of the present invention, an ID is given to the optical tag as identification information, an infrared command including the ID is transmitted to the optical tag by infrared rays, and the infrared emission of the optical tag having the corresponding ID is transmitted. An optical tag function control method in an optical tag system for recognizing the optical tag, recording information on the optical tag in a database, and providing the information recorded in the database to a client. A step of assigning a plurality of IDs to the tag, a step of holding the function of executing different processing in correspondence with each ID of the plurality of IDs, and a step from the optical tag system to the optical tag. Transmitting an infrared command including an ID, and the optical tag detects an ID included in the infrared command received from the optical tag system and corresponds to the ID. Characterized in that it comprises a step of executing processing.

  The optical tag function control method according to the present invention includes a step of assigning one of the plurality of IDs as a main ID used to instruct the optical tag to emit light and determine the presence / absence of the optical tag. And a step of assigning a sub-ID different from the main ID to the optical tag in order to distinguish from the function of determining the presence / absence of the optical tag.

  In addition, the optical tag function control method of the present invention includes a step in which the optical tag makes an acceptance request to the optical tag system by infrared emission when a request button provided on the optical tag is pressed, and an optical tag system However, when receiving an acceptance request from the optical tag, a step of transmitting a plurality of light emission instructions together with a sub ID to the optical tag, and a sub ID transmitted from the optical tag system by the optical tag. And a step of resetting a reception request for the optical tag system when an infrared emission instruction by the included infrared command is received a predetermined number of times or more.

  The optical tag function control method of the present invention includes a step in which the optical tag makes an acceptance request to the optical tag service, and the optical tag emits light by visible light or sound by an instruction from the optical tag system. And when the optical tag system accepts an acceptance request from the optical tag, the optical tag system instructs the optical tag to emit sound by visible light or sound. Features.

  Further, the optical tag of the present invention assigns an ID as identification information to the optical tag, transmits an infrared command including the ID to the optical tag by infrared rays, and emits infrared light from the optical tag of the corresponding ID. An optical tag in an optical tag system that captures an image, recognizes the optical tag, records information about the optical tag in a database, and provides the information recorded in the database to a client, and holds a plurality of IDs Means, means for executing a different process specified for each ID, and means for executing a specified process according to the type of ID included in the infrared command received from the optical tag system. It is characterized by.

  The optical tag of the present invention receives one of the plurality of IDs as a main ID and means for holding the remaining IDs as sub IDs and an infrared command including the main ID from the optical tag system. In this case, when receiving an infrared command including a sub-ID from the optical tag system and means for emitting infrared light to make the optical tag system discriminate the presence / absence of the optical tag, the sub-ID And a means for executing a process associated with.

  The optical tag of the present invention includes a request button for making an acceptance request to the optical tag system by infrared light emission, and a plurality of optical tag systems from the optical tag system when the optical tag system accepts an acceptance request from the optical tag. Means for receiving an infrared emission instruction by an infrared command including a sub-ID transmitted twice, and resetting an acceptance request to the optical tag system when the infrared command is received a predetermined number of times or more. Features.

  Further, the optical tag of the present invention comprises means for receiving an infrared command for instructing sound generation by light emission or sound by visible light from the optical tag system, and light emission or sound by visible light from the optical tag system. When receiving an infrared command for generating sound, the optical tag system is provided with means for generating sound by light emission or sound by visible light.

  The optical tag system of the present invention is characterized by using the optical tag function control method described above.

  The optical tag system of the present invention also includes a database that stores currently captured images of optical tags to be recognized, meta information related to the recognized optical tags, and link information, and time is stored in the stored link information. And a means for providing a composite service in which the present and the past are integrated with each other by recombining with information in the cyber world based on the accumulated information extracted from the database.

  In addition, the optical tag system of the present invention is further characterized by further comprising means for designating an expected future scene set on the condition of the presence of a plurality of optical tag IDs, their positional relationship, and time relationship.

  The optical tag system of the present invention is characterized by comprising means for generating secondary information in which the primary information is combined using the information related to the optical tag recorded in the database as primary information.

  The optical tag system according to the present invention includes a plurality of optical tag recognizing means for recognizing an optical tag and a plurality of recognizing means in the same place by exchanging priority by a token between the plurality of recognizing means. And a means for actuating.

  The optical tag system of the present invention is installed in a place where an event is held, and is used in combination with a field control system that collects and processes information related to the event.

  In the optical tag function control method of the present invention, a plurality of IDs are assigned to the optical tag, different processing functions are associated with each ID, and the optical tag system performs different processing on the optical tag by specifying the ID. As a result, it is possible to reduce the number of dedicated circuits and the like necessary for adding an additional function to the optical tag, thereby simplifying the optical tag.

  In the optical tag function control method of the present invention, one of a plurality of IDs is used as a main ID that instructs the optical tag to emit light in order to determine the presence or absence of the optical tag, and the presence or absence of the optical tag. In order to distinguish from the function of determining the presence, a different sub-ID is assigned to the optical tag, so that the presence / absence of the optical tag is regarded as the transmission information from the optical tag, and the original presence / absence is determined. In order to make a distinction, an ID different from the original ID of the optical tag can be assigned to the transmission information, and an uplink additional information channel transmitted from the optical tag is not required.

  In the optical tag function control method of the present invention, the optical tag is provided with a request button for making an acceptance request for the optical tag system by infrared light emission, and when the optical tag system accepts the request, the sub tag is assigned to the optical tag. In response to a plurality of infrared emission instructions, the optical tag resets the acceptance request when receiving an infrared emission instruction from the optical tag system a predetermined number of times or more. Even when the optical tag recognition state is unstable, which depends on the situation, the optical tag recognition information can be used stably.

  Further, in the optical tag function control method, the optical tag makes a reception request to the optical tag system and emits light by visible light or generates sound by sound according to an instruction from the optical tag system. The optical tag can mediate active communication between the optical tag system and the object (human etc.) to which the optical tag is attached.

  Further, in the optical tag of the present invention, a plurality of IDs are assigned to the optical tag, different processing functions are associated with each ID, and the optical tag system performs different processing by designating the ID. Thus, it is possible to reduce the number of dedicated circuits and the like necessary for adding an additional function to the optical tag, and to simplify the optical tag.

  In addition, in the optical tag of the present invention, when an infrared emission instruction is received from an optical tag system by an infrared command including a main ID, red is used to make the optical tag system determine the presence or absence of the optical tag. When infrared light is emitted and an infrared command including a sub-ID is received from the optical tag system, the processing associated with the sub-ID is executed. In order to distinguish transmission information from the tag from the original presence or absence, an ID different from the original ID of the optical tag can be assigned to the transmission information, and an uplink additional information channel transmitted from the optical tag is not required.

  In the optical tag of the present invention, the optical tag is provided with a request button for making an acceptance request for the optical tag system by infrared light emission, and when the optical tag system accepts the request, a plurality of subordinate IDs are assigned to the optical tag. When the infrared tag receives the infrared emission instruction from the optical tag system a predetermined number of times or more, the reception request is reset. Even in the recognition state of an unstable optical tag that is influenced, it can be used stably for transmission of optical tag recognition information.

  Moreover, in the optical tag of the present invention, the optical tag makes a reception request to the optical tag system and emits light by visible light or generates sound by sound according to an instruction from the optical tag system. The optical tag can mediate active communication between the optical tag system and the object (human etc.) to which the optical tag is attached.

  Moreover, in the optical tag system of the present invention, since the optical tag function control method described above is used, this reduces the number of dedicated circuits required to add an additional function to the optical tag. Thus, the optical tag can be simplified. In addition, the optical tag makes it possible to mediate active communication between the optical tag system and the object (human being or the like) to which the optical tag is attached. Furthermore, it is not necessary to use an uplink additional information channel transmitted from the optical tag.

  In the optical tag system of the present invention, the current captured image of the optical tag to be recognized, the meta information related to the optical tag, and the link information are stored in a database, and the stored link information includes time information. Since it is designed to give changes that reflect the progress and recombine with the accumulated information extracted from the database and the information of the cyber world, it provides a composite service that integrates the present and the past. Application services that can be used in any combination can be developed.

  Moreover, in the optical tag system of the present invention, since the future assumed scenes set on the condition of the presence of a plurality of optical tag IDs, their positional relations, and time relations are designated, the past, present, You can develop application services that use any combination of the future.

  Further, in the optical tag system of the present invention, the secondary information that combines the primary information is generated using the recognition information related to the optical tag recorded in the database as the primary information. Can be expanded.

  In the optical tag system of the present invention, a plurality of optical tag recognizing means for recognizing the optical tag are provided, and a plurality of recognizing means exchange priority with tokens, so that a plurality of the same tag can be used. Since the recognition means is activated, this allows multiple recognition systems to exist in the same field. For example, as seen in a television studio, the degree of freedom of scenario development from multiple viewpoints is expanded. In addition, the blind spot of the camera can be reduced.

  Further, in the optical tag system of the present invention, it is installed in a place where an event is held, and is used in combination with a field control system that collects and processes information related to the event. , Games, arts, academics, management, studios, stores, stage / theatres, theme parks, amusement parks, museums, homes, offices, vehicles, classrooms, etc. The field control system and the optical tag system can be integrated, and as a newly created space device, the characteristics of the original field control system alone and the optical tag system alone are remarkably increased, It can also create new effects.

[Description of optical tag system configuration]
FIG. 1 is a diagram showing a configuration example of an optical tag system according to the present invention.
This configuration example is a configuration example in which a new function is added to the conventional optical tag system described with reference to FIGS. 6 to 11. In the optical tag 10, the request button 15, the visible light emitting unit 16, and the additional function unit 17. Has been added. In addition, the information service computer 100 in the service cluster 2 is used instead of the computer system 200 shown in FIG. 6, and is configured to execute a more extended function in addition to the function of the conventional computer system 200. .

  As shown in FIG. 1, the optical tag system 1 recognizes an optical tag 10 attached to an object (see FIG. 6) such as a person, an object, and the optical tag 10, and a communication network (global network or local network). And the service cluster 2 functioning as a server for providing information to clients.

  Hereinafter, the details of each part constituting the optical tag system 1 will be described. In addition, since this invention expands the function on the basis of the conventional optical tag system demonstrated in FIGS. 6-11, description may overlap with a prior art example.

[Description of optical tag configuration and operation]
In FIG. 1, an optical tag 10 receives infrared pulse illumination (pulse signal modulated by infrared rays) from a control microcomputer 11 (control microcomputer) 11 that performs overall control of the entire optical tag and a recognition unit 20. Light receiving unit 12, demodulating circuit 13 for demodulating modulated infrared pulse illumination signal, infrared light emitting unit 14 for emitting infrared light, request button 15 for issuing an acceptance request to recognition unit 20, by visible light It comprises a visible light emitting unit 16 that emits light, an additional function unit 17 for executing various additional functions of the optical tag, and a battery 18 that is an operation power source of the optical tag.

  A command transmitted from the recognition unit 20 to the optical tag 10 by infrared pulse illumination is referred to as an “infrared command”. The infrared command includes information on the ID of the optical tag. The optical tag 10 is configured to hold a plurality of IDs of a main ID and a sub ID as IDs (identification codes), and is configured to be able to execute different processes corresponding to each ID.

  The optical tag 10 receives infrared pulse illumination by infrared rays transmitted from the recognition unit 20, and receives an infrared command transmitted from the recognition unit 20 by the infrared light receiving unit 12. In this case, the signal intensity of the infrared pulse greatly fluctuates depending on the reception status of the infrared rays due to the surrounding environment, and many environmental infrared noises exist, so the recognition unit 20 modulates the transmission signal and transmits it to the optical tag 10. To do.

  In the optical tag 10, the command information is demodulated via the demodulation circuit 13 and input to the control microcomputer 11. Therefore, the infrared pulse illumination is not a simple illumination but has a function of broadcasting a transmission signal to the entire optical tag in the place.

  FIG. 2 shows an operation flow of the control microcomputer 11 in the optical tag 10. Note that the shaded blocks in FIG. 2 are newly added processing portions, and the other processing portions are portions provided in common in the conventional example shown in FIG.

Hereinafter, the operation flow of the optical tag 10 will be described with reference to FIG.
In the optical tag 10, the received infrared command is analyzed by the control microcomputer 11, and the ID included in the command is compared with the main ID and the sub ID of the optical tag 10 (step S101). Performs command operation. If they do not match, the command is ignored and the next command is awaited.

  If the command of the infrared command is an operation instruction of infrared light emission including the main ID (step S102), the infrared light emitting unit 14 emits light corresponding to the frame time (step S103). For example, as shown in FIG. 5, light emission is performed in synchronization with the image frame time (Tm−1, Tm, Tm + 1) of the infrared camera 23 associated with the ID (m−1, m, m + 1) of the optical tag 10. To do.

  Further, when the instruction of the infrared command is the setting of the main ID, the process is performed (steps S104 and S105). If the command command is a sub ID setting, the ID accompanying the command is set as the sub ID of the optical tag (step S106).

  If the command ID matches the sub-ID of the optical tag 10 and the command content is infrared emission, the frame time depends on the status of the “reception request” requested from the optical tag 10 to the recognition unit 20. The corresponding light emission is performed (steps S110, S111, S112). The “acceptance request” refers to a state of being accepted by the recognition unit 20 when the request button 15 that is a push button provided in the optical tag 10 is pressed. When the request button 15 is pressed, the chatter (contact chattering) such as contact vibration of the switch contact in the request button is absorbed, and the control microcomputer 11 takes in the signal as a stable request signal.

  The control microcomputer 11 counts the number of infrared emission commands for the sub-ID received during the acceptance request (step S113), resets the acceptance request when the predetermined number of times, for example, six, and resets the count. Alternatively, the request and the count are reset when a predetermined time has elapsed from the start of the request (steps S114 and S115).

  If the infrared command transmitted from the recognition unit 20 is a light emission instruction by visible light, the visible light emission unit 16 provided in the optical tag 10 emits light that can be seen in the surroundings, and further has a rhythm to enhance recognition. Intermittent light emission is performed (steps S121 and S122). For example, an operation such as blinking every 0.5 seconds is performed. Further, the light emission is stopped after a predetermined time, for example, after 10 seconds. Alternatively, when the request button 15 is pressed, the light emission is stopped.

  Furthermore, the optical tag 10 can be provided with an additional function. For example, an infrared command corresponding to the sound generation function is provided, and an act operation of the optical tag 10 such as sound generation is added in the same procedure as the visible light emission. This additional function is provided in the additional function unit 17.

[Description of recognition unit configuration and operation]
In FIG. 1, the recognition unit 20 is provided with an image processing control unit 22 controlled by a control PC (control computer) 21, and the operation of the infrared camera 23 is controlled by the image processing control unit 22. Further, a real-time communication control unit 24 is provided to perform real-time control in synchronization with the frame signal of the infrared camera 23, and an infrared light emission instruction is given to the optical tag 10 for each frame of the infrared camera 23 by the infrared pulse illumination unit 25. Send the command. For example, as shown in FIG. 5, an infrared emission instruction command is transmitted at times Tm−1, Tm, and Tm + 1 for each frame image (n−1, n, n + 1).

  FIG. 3 shows the operation flow of the control PC 21. Note that the shaded blocks in FIG. 3 are newly added processing portions, and the other processing portions are portions provided in common in the conventional example shown in FIG.

  Referring to FIG. 3, in control PC 21, ID stack 31 is provided in real-time communication control unit 24 in order to cause optical tag 10 to emit infrared light. In addition, a frame counter 32 that counts the vertical frame synchronization signal of the infrared camera 23 from the image processing control unit 22 is provided and used as the stack pointer 32 a of the ID stack 31.

  The stack pointer 32a sequentially pushes the ID information of the recognition target optical tag 10 necessary at that time to the ID stack 31 in order of the total number. After completing the push, the control PC 21 issues a command for capturing an image from the infrared camera 23 to the image processing control unit 22 by the number of frames obtained by adding the number of empty frames before and after the total number.

  When the infrared camera 23 starts capturing, frame signals corresponding to the number of times are output from the image processing control unit 22, the frame counter 32 sequentially counts up from 0, and the ID corresponding to the optical tag of the corresponding frame from the ID stack 31. Is taken out. An infrared emission command is added to this ID, a synchronization signal such as a start / stop signal is added, one infrared command format 33 is assembled, modulated in accordance with a predetermined method, and sequentially red. The external pulse illumination is broadcast from the infrared pulse illumination unit 25 on the spot.

  By the operation of the optical tag 10, captured images (frame images) 131, 132, and 133 as shown in FIG. 5 are obtained as captured images of the corresponding frames of the infrared camera 23 that emit infrared light from the optical tag 10. . As shown in FIG. 5, since the optical tag 10 having only the ID specified by the ID stack 31 has the emission qualification in the assigned frame image (n−1, n, n + 1), it is the only light spot in the screen. 131a, 132a, and 133a. Therefore, the pixel coordinates of this light spot are obtained, while the ID (m−1, m, m + 1) corresponding to the frame is also known. Therefore, the position and ID of the optical tag 10 within the field of view of the infrared camera 23 are recognized (step S201). For example, as shown in FIG. 8, a frame image in-position data extraction file 135 for each object (object to which the optical tag 10 is attached) is generated.

In this case, in order to improve recognition performance, the previous and next frame images are subtracted from the image of the corresponding frame. For example, as shown in FIG. 5, the difference image for the object with ID = m is
It is obtained by [light emitting frame image (n)]-[previous frame image (n-1)]. Alternatively, it is obtained by [light emission frame image (n)] − [next frame image (n + 1)].
In this case, when the pixel value becomes negative, it is replaced with 0. In the preceding and succeeding frames, it is guaranteed that the optical tag with the ID corresponding to the corresponding frame does not emit light, so that the light spot with the corresponding ID is not affected by the subtraction. However, if the signals 132a ′ and 133a ′ that disturb the recognition are present in the corresponding frame, the possibility that they exist before and after the frame increases, and can be attenuated by subtraction. Further, since the light spots 131a and 133a in the preceding and following frames do not exist in the corresponding frame, they become negative when subtracted and consequently become 0, so that recognition is not disturbed.

  In order to enable subtraction of the preceding and succeeding frames, empty frames without ID assignment are placed at the beginning and end. In detecting a light spot, recognition errors can be reduced by reflecting not only subtraction but also characteristics such as the shape of the light spot.

  In the ID stack 31, sub IDs can be set without distinction. However, the detection of the optical tag 10 is performed with the sub ID. When the detected and recognized ID is a sub ID (steps S201 and S202), the sub ID is used only when the optical tag 10 is detected a predetermined number of times within a predetermined time in the sub ID, for example, three times. The recognition is accepted (step S203). The optical tag 10 side responds with infrared light emission so that it is recognized, for example, six times in the above operation, so even if half of it is not detected, it is detected as a response, and as a result The acceptance request by changing the push button of the optical tag 10 having the sub ID is stably recognized (step S204). As a result, the upstream signal channel from the optical tag 10 can be set using the recognition function that is inherently provided in the optical tag 10.

  In addition, the control PC 21 of the recognition unit 20 can control the optical tag 10 such as changing an ID as well as an infrared emission command. For this purpose, an ID and a command for this control are assembled as commands in addition to the route by the ID stack 31 in the real-time communication control unit so that the infrared command format 34 can be sent out from the infrared pulse illumination unit 25. At this time, when the capture to the infrared camera 23 is instructed and the ID stack 31 makes a round, the real-time communication control unit 24 is once in an idle state, and accepts the ID and control command from the control PC 21 during that time. Therefore, real-time infrared pulse illumination competition does not occur.

  By the way, even if the optical tag 10 is worn by a person as an object, for example, it is impossible for humans to determine at a glance how far the optical tag system recognizes and handles. In the above description, the visible light emission command and the sound generation command with the additional function are not only the functions of generating light and sound, but also the recognition status of the object attached to the optical tag 10 by the system or nearby, and the optical tag 10. A new effect will be noticed. Alternatively, even if the request button 15 is pressed, it is possible to guide the action ahead by knowing whether or not the request button 15 has been accepted. As described above, the object can interact with the system.

  Further, the control PC 21 further includes a visible camera 26 and images in the same direction as the infrared camera 23. The field of view of the infrared camera 23 is set so as to include the field of view of the visible camera 26 and is relatively fixed to each other. Then, it can be understood by simple coordinate conversion which position of the visible camera 26 the recognized position corresponds to.

  Since the visible camera 26 is not used for the above recognition, it is not necessarily provided in the recognition unit 20 as shown in FIG. 1, and can be pulled out via a network.

  In addition, each information as a result of recognition by the information service computer 100 can be subjected to secondary processing, and changes can be detected from moment to moment, and further secondary recognition can be performed. Since the recognition result consists of a large amount of ID, coordinates, time, link information, etc., if the entire information is recorded in the secondary processing information database 107 (see FIG. 4) and can be searched, the use of the secondary recognition information can be streamlined. . In addition, the recognition result can be synthesized not only as it is, but also as a secondary recognition such as a change in coordinates, a change in link destination, a change in appearance ID, and a combination of each change condition.

  In addition, the information service computer 100 or the control PC 21 can be combined with other function servers and client groups via a local network or a global network.

[Description of functional configuration of optical tag system]
FIG. 4 shows a functional configuration example of the optical tag system. In FIG. 4, each functional unit can be arbitrarily integrated, separated, multiplexed, and distributed according to the required performance and service convenience as a general technique of IT technology. The boundary between the local network and the global network can be changed freely with firewalls and related security technologies.

  The time series of the recognized coordinates and ID from time to time is meta information accompanying the visible image (hereinafter, including still images, picture-story quasi-moving images, and moving images), and the recognizing units 20a and 20b are the generation points of the meta information. is there.

  As shown in FIG. 4, sometimes two or more recognition units 20a and 20b are coexisting in one field, and the fields of view of a plurality of infrared cameras are used in an overlapping manner. The plurality of recognizing units 20a and 20b are connected to each other through a network, and a unique token is circulated between them. The recognizing unit having the token activates the ID recognition process and the individual ID corresponding command process to emit infrared pulse illumination. Do it exclusively. During this time, other recognition units do not perform infrared pulse illumination, so recognition is not confused.

  The recognition units 20a and 20b face the imaging target field 110 as an imaging target. The imaging target field 110 corresponds to a field as a target of a general video camera such as zooming and panning, but the difference is that the object group 111 exists in the imaging target field 110 and the optical tag 10 is added to the object 112. It has been done. Even the optical tag 10 alone can be handled as an object.

  The service cluster 2 includes a plurality of recognition units 20a and 20b (there may be one) and an information compression computer 101, an image compression unit 101, a distribution unit 102, a storage unit 103, a service unit 104, and a management unit 105. The database group 106 is included.

  The image compression unit 101 compresses the image of the visible camera 26 in accordance with required image quality, size, and transmission speed. A visible camera can be moved from the recognition unit 20 to the image compression unit 101.

  The distribution unit 102 distributes the compressed image created by the image compression unit 101 and the meta information created by the recognition unit 20 to clients and other systems. The distribution unit 102 may be omitted, and the meta information may be distributed from the recognition unit 20 and the compressed image may be distributed from the image compression unit 101. However, the processing performance is affected accordingly.

  The storage unit 103 stores the meta information and the compressed image in association with each other in the database 108 so that the meta information can be extracted and distributed again. It is the same methodology as a general storage function to correspond to database search as much as possible when storing. Therefore, the meta information and the compressed image accumulated from the keyword search can be extracted. Since the keyword includes a recognition ID, coordinates, and the time when the keyword is detected, the past can be searched from various viewpoints, and the image at that time can be reproduced with meta information.

  The service unit 104 can perform a scenario operation according to the purpose of an activation operation for meta information. For example, the clients of the client group 121 can display a clickable icon near the corresponding coordinates simultaneously with the image on the monitor screen from the meta information and the compressed image. The link destination of this icon can be defined by the service unit 104 and distributed from the distribution unit 102 together with the meta information and the compressed image.

  For example, by incorporating the next operation development into the link destination HTML, it becomes possible to develop a composite service. That is, when the service unit 104 receives information indicating that the clickable icon has been clicked on the monitor screen, the service unit 104 accesses the link destination HTML of the icon and displays the link destination HTML. Since the icon is dynamically associated with the image information, the client 121 can be operated in the present form in real time without any editing operation. That is, the real image serves as a portal site screen. Since the link information given by the service unit 104 is attached to the meta information and the compressed image, it can be simultaneously accumulated by the accumulation unit 103 as it is. The screen displaying the clickable or icon, which is the function screen of the Web server provided in the service unit 104 or the like, is displayed by accepting an access instruction to the corresponding URL from the user using a Web page or the like. Also good.

  Therefore, the client can operate in real time for past video recordings obtained from the storage unit 103. In addition, by making it possible to search meta information and compressed image databases, it is possible to provide a service that traces past the presence of a plurality of tag IDs, their positions, and times as keywords, Alternatively, it can also be the content obtained as a site location at that time. By recording precious events such as precious performers and non-reproducible events along with ID information, it is possible to leave content that may disappear on the spot.

  In addition, when the accumulated link information is extracted, it is possible to process the link that reflects the elapsed time, not just as it is, so that the effect of using past contents can be further increased.

  Accordingly, it is possible to provide a new IT tool that can develop the content over the present and the past and does not require editing and editing of the image. Furthermore, by making a future reservation for the link destination, the power of the service is further increased. In addition to simply performing a conventional reservation service, it is possible to specify a future scenario that is set based on the presence of a plurality of optical tag IDs, their positional relationships, and time relationships. In this way, a continuous service of the optical tag 10 can be developed for the past, the present, and the future.

  The management unit 105 is responsible for managing the entire system. If the service is charged, a method well known in IT such as user authentication and billing can be developed.

  Each of the above units forms a service providing service cluster 2 as a whole. As usual in IT, these can function organically even if distributed in a network. It is also possible to further combine a plurality of service clusters 2a, manage them in an integrated manner, develop a franchise, and the like. Or, as a data center, it is possible to consolidate except those that should be put in place.

  In addition, since the link function is used, it can be integrated with the conventional IT without any conflict.

  Note that the in-frame image position data extraction file 135, the object database 141, the information database 143, and the object management database 145 in the database group 106 are the same as those in the prior art described with reference to FIGS.

  The embodiment of the present invention has been described above. As described above, the information service computer 100 and the recognition unit 20 in the service cluster 2 have a computer system therein.

  A series of processes related to the above-described process is stored in a computer-readable recording medium in the form of a program, and the above-described process is performed by the computer reading and executing this program.

  That is, each processing in the information service computer 100 and the recognition unit 20 in the service cluster 2 is performed by a central processing unit such as a CPU reading the above program into a main storage device such as a ROM or a RAM to process or calculate information. This is realized by executing the process.

  Here, the computer-readable recording medium means a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Alternatively, the computer program may be distributed to the computer via a communication line, and the computer that has received the distribution may execute the program.

  Although the embodiments of the present invention have been described above, the optical tag system of the present invention is not limited to the above-described illustrated examples, and various modifications can be made without departing from the scope of the present invention. Of course.

  Since the present invention has an effect of enabling development of various application systems by adding a new function to the conventional optical tag and the optical tag system, the present invention provides an optical tag function control method, an optical tag, and the like. It is useful for optical tag systems and the like.

It is a figure which shows the structural example of the optical tag system of this invention. It is operation | movement explanatory drawing of an optical tag. It is operation | movement explanatory drawing of a recognition part. It is a figure which shows the function structural example of an optical tag system. It is a figure which shows the example which acquires a frame image. It is a figure which shows the structural example of the conventional optical tag system. It is a figure which shows the light emission instruction | indication to an optical tag, and the timing of light emission. It is a figure which shows the example of the extraction position data extraction file in an image. It is a figure which shows the example of an object database. It is a figure which shows the example combined with an information file by using the keyword of the data file regarding an object name as a common key. It is a figure which shows the example of an object management database.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1, 1a Optical tag system 2, 2a Service cluster 10, 10a Each optical tag 11 Control microcomputer 12 Infrared light-receiving part 13 Demodulator circuit 14 Infrared light-emitting part 15 Request button 16 Visible light-emitting part 17 Additional function part 18 Battery 20, 20a, 20b recognition unit 21 control PC
DESCRIPTION OF SYMBOLS 22 Image processing control part 23 Infrared camera 24 Real-time communication control part 25 Infrared pulse illumination part 26 Visible camera 31 ID stack 32a Stack pointer 32 Frame counter 33, 34 Infrared command format 100 Information service computer 101 Image compression part 102 Distribution part DESCRIPTION OF SYMBOLS 103 Accumulation part 104 Service part 105 Management part 106 Database group 107 Secondary processing information database 108 Meta information and compressed image database 110 Imaging object field 111 Object group 112 Object 121 Client group 131, 132, 133 Frame image 131a, 132a, 133a Frame Light spots in image 132a ', 133a' Interference signal 135 In-frame position data extraction file 137 Data on object name File 138 information file 139 object list 141 the object database 143 information database 145 object management database 151 IP network 200 the computer system 201 Object

Claims (14)

An ID is given as identification information to the optical tag, an infrared command including the ID is transmitted to the optical tag by infrared rays, and infrared emission of the optical tag of the corresponding ID is imaged to recognize the optical tag. An optical tag function control method in an optical tag system for recording information on the optical tag in a database and providing the information recorded in the database to a client,
Providing a plurality of IDs to the optical tag;
The optical tag having a function of executing different processing corresponding to each ID of the plurality of IDs;
Transmitting an infrared command including an ID from the optical tag system to the optical tag;
And a step of detecting an ID included in an infrared command received from the optical tag system and executing a process corresponding to the ID. Assigning one of the plurality of IDs as a main ID used to instruct the optical tag to emit light and determine the presence or absence of the optical tag;
2. The optical tag function control method according to claim 1, further comprising: assigning a sub-ID different from the main ID to the optical tag in order to distinguish from the function of determining the presence / absence of the optical tag. . When the optical tag is triggered by pressing of a request button provided on the optical tag, an acceptance request for the optical tag system is performed by infrared emission; and
When the optical tag system receives an acceptance request from the optical tag, a step of transmitting a plurality of light emission instructions together with the sub ID to the optical tag;
Resetting an acceptance request to the optical tag system when the optical tag receives an infrared emission instruction by an infrared command including a sub-ID transmitted from the optical tag system a predetermined number of times or more. The optical tag function control method according to claim 2. The optical tag making an acceptance request to the optical tag service;
The optical tag emits light by visible light or generates sound by sound according to an instruction from the optical tag system;
When the optical tag system receives an acceptance request from the optical tag, the optical tag system includes a step of instructing the optical tag to emit light by visible light or sound. Item 4. The optical tag function control method according to any one of Items 1 to 3. An ID is given as identification information to the optical tag, an infrared command including the ID is transmitted to the optical tag by infrared rays, and infrared emission of the optical tag of the corresponding ID is imaged to recognize the optical tag. , An optical tag in an optical tag system for recording information on the optical tag in a database and providing the information recorded in the database to a client,
Means for holding a plurality of IDs;
Means for executing different processes designated for each ID;
An optical tag comprising: means for executing specified processing according to a type of ID included in an infrared command received from the optical tag system. Means for holding one of the plurality of IDs as a main ID and holding the remaining IDs as sub-IDs;
Means for emitting infrared light to cause the optical tag system to determine the presence or absence of the optical tag when an infrared command including a main ID is received from the optical tag system;
The optical tag according to claim 5, further comprising: a unit configured to execute processing associated with the sub ID when an infrared command including the sub ID is received from the optical tag system. A request button for making an acceptance request to the optical tag system by infrared light emission,
When the optical tag system receives an acceptance request from the optical tag, the optical tag system receives an infrared emission instruction by an infrared command including a sub ID transmitted a plurality of times from the optical tag system, and the infrared command is predetermined. The optical tag according to claim 5, further comprising: a unit that resets a reception request for the optical tag system when the number of times of reception is more than the number of times. Means for receiving from the optical tag system an infrared command for instructing sound generation by light emission or sound by visible light;
A means for emitting light or sound by visible light to the optical tag system when an infrared command for sounding by light or sound by visible light is received from the optical tag system. The optical tag according to any one of claims 5 to 7. An optical tag system using the optical tag function control method according to claim 1. A database for storing the current captured image of the optical tag to be recognized, meta information related to the recognized optical tag, and link information;
Means for giving a change reflecting the passage of time to the accumulated link information;
The optical tag system according to claim 9, further comprising means for recombining with information in the cyber world based on accumulated information extracted from the database and providing a composite service in which the present and the past are integrated together. 11. The optical tag system according to claim 10, further comprising means for designating a future assumed scene set on the condition that there are a plurality of optical tag IDs, their positional relationship, and time relationship. The optical tag system according to claim 10 or 11, further comprising: means for generating secondary information obtained by combining the primary information, using information on the optical tag recorded in the database as primary information. A plurality of optical tag recognition means for recognizing the optical tag;
The system according to any one of claims 9 to 12, further comprising: means for operating a plurality of recognition means in the same place by exchanging priority with a token between the plurality of recognition means. Optical tag system. The optical tag system according to any one of claims 9 to 13, wherein the optical tag system is installed in a place where an event is held and used in combination with a field control system that collects and processes information related to the event. .

Images