TWI543595B - Signal plug-in module, photo sensing module, and interactive device and system using the same - Google Patents

Description

Signal plug-in module, light sensing module and interactive device and system thereof

The present invention relates to an interactive operating system, and more particularly to a signal plug-in module, a light sensing module, and an interactive device and system using the same.

At present, there are more and more opportunities in large-scale stores, airports, department stores and other public places to see digital signage of various sizes. These digital billboards are mainly based on media playback and advertisements, such as Simply play pre-recorded audio and video animations, as a demonstration of the Guangxuan application, or play real-time instant messages such as weather, temperature, train schedules, and instant news. Since the relationship between the above application and the consumer is still a one-way push, the interaction effect and the resulting benefit are also limited.

The invention relates to a signal plug-in module, a light sensing module and an interactive device and system using the same for human-computer interaction.

According to an aspect of the present invention, a signal plug-in module is provided for a smart phone, the smart phone has a headset jack, and the signal plug-in module is disposed in the ear. On the wheat jack. The signal plug-in module includes a sound source-optical signal converter and a transmitter. The sound source-optical signal converter is configured to receive an audio source signal and convert the sound source signal into a light source signal. The transmitter is coupled to the sound source-optical signal converter for emitting a directional light source, and the directional light source includes a signal pattern for identifying the smart phone.

According to an aspect of the invention, a light sensing module is provided for A display device. The light sensing device includes an array receiver and a light source signal processing unit. The array receiver is configured to receive the directional light source emitted by the transmitter of the signal plug-in module. The light source signal processing unit is coupled to the array receiver for recognizing the position and signal pattern of the directional light source projected onto the array receiver to output a decoded data.

According to an aspect of the invention, an interactive device is provided for In an interactive system with a display device and at least one smart phone, each smart phone has a headset jack. The interactive device includes the above signal plug-in module and the above-mentioned light sensing module. The signal plug-in module is located on the headset jack. The signal plug-in module includes a sound source-optical signal converter and a transmitter. The sound source-optical signal converter is configured to receive an audio source signal and convert the sound source signal into a light source signal. The transmitter is coupled to the sound source-optical signal converter for emitting a directional light source, and the directional light source includes a signal pattern for identifying the smart phone. The light sensing module is disposed on the display device. The light sensing device includes an array receiver and a light source signal processing unit. The array receiver is configured to receive the directional light source emitted by the transmitter of the signal plug-in module. The light source signal processing unit is coupled to the array receiver for recognizing the position and signal pattern of the directional light source projected onto the array receiver to output a decoded data.

According to an aspect of the present invention, an interactive system is proposed, which is suitable for Connected to a control module via a wireless network. The interactive system includes at least one smart phone, a signal plug-in module, a display device, and a light sensing module. The smart phone has a headset jack, and the smart phone obtains a selected signal pattern identifier from the wireless module through the wireless network, and sends a sound source signal associated with the selected signal pattern identifier through the headset jack. The signal plug-in module is located on the headset jack. The signal plug-in module includes a sound source-optical signal converter and a transmitter. The sound source-optical signal converter is configured to receive an audio source signal and convert the sound source signal into a light source signal. The transmitter is coupled to the sound source-optical signal converter for emitting a directional light source, and the directional light source includes a signal pattern for identifying the smart phone. The light sensing module is disposed on the display device. The light sensing module includes an array receiver and a light source signal processing unit. The array receiver is configured to receive a directional light source emitted by the transmitter. The light source signal processing unit is coupled to the array receiver for recognizing the position and signal mode of the directional light source projected onto the array receiver to output a decoded data and converting the decoded data into a picture operation command to control the display device. The screen that is played.

In order to better understand the above and other aspects of the present invention, the preferred embodiments are described below, and in conjunction with the drawings, the detailed description is as follows:

100‧‧‧ interactive system

110‧‧‧Smart Phone

110a~110d‧‧‧Smart Phone

111‧‧‧ Processor

112‧‧‧ headset jack

113‧‧‧Application

114‧‧‧Source signal generator

116‧‧‧Command Signal Converter

120‧‧‧ Signal plug-in module

122‧‧‧Source-Optical Signal Converter

124‧‧‧transmitter

130‧‧‧Display device

140‧‧‧Light sensing module

142‧‧‧Array Receiver

144‧‧‧Light source signal processing unit

150‧‧‧Control Module

160‧‧‧Wireless network

L‧‧‧Directive light source

A1, A2‧‧‧ amplitude

C1, C2‧‧‧ signal center point

P1, P2‧‧‧ signal mode

T1, T2‧‧ cycle

1 is a block diagram of an interactive system in accordance with an embodiment of the present invention.

2 is a block diagram of an interactive system in accordance with an embodiment of the present invention.

FIG. 3 is a diagram showing a signal plug-in module and a smart hand according to an embodiment of the invention. machine.

FIG. 4A is a schematic diagram showing the signal mode of the interactive system receiving multiple smart phones.

Figure 4B shows a schematic diagram of different signal patterns on the time axis.

Figure 5 illustrates the various steps that the application performs for initialization.

Figure 6 shows the steps of the source signal processing unit for identifying and tracking the signal pattern after successful initialization.

In an example of the embodiment, an interactive system is proposed, which uses a smart phone as a vehicle and a control end for personal interaction with a remote display device. The interactive system includes at least one smart phone, a signal plug-in module, a display device, and a light sensing module. The interactive system of the embodiment sends a specific signal through a signal plug-in module connected to a headset jack of the mobile phone. The directional light source of the mode and the light sensing module provided by the display device receive the light source as an interaction device between the smart phone and the display device for remote control.

In an example of the embodiment, the interactive system is coupled to a control module through a wireless network, and the control module includes a plurality of sets of signal patterns for identifying and tracking the pointing position of the smart phone. The smart phone includes a processor and an application for controlling the signal plug-in module and initializing it to obtain a signal pattern identifier that has not been used yet.

The embodiments are described in detail below, and the embodiments are only intended to be illustrative and not intended to limit the scope of the invention.

First embodiment

Please refer to the figures 1 to 4B, wherein FIG. 1 illustrates the invention according to the present invention. FIG. 2 is a block diagram of an interactive system 100 according to an embodiment of the present invention, and FIG. 3 is a schematic diagram of a signal plug-in module 120 and a smart phone according to an embodiment of the invention. 110, FIG. 4A is a schematic diagram showing the signal mode of the interactive system 100 receiving the plurality of smart phones 110a-110d, and FIG. 4B is a schematic diagram showing different signal patterns P1 and P2 on the time axis.

In Figures 1 and 2, the interactive system 100 includes a smart phone 110. A signal plug-in module 120, a display device 130, and a light sensing module 140 are coupled to a control module 150 via a wireless network 160. In general, the smart phone 110 is a mobile phone with network connection, video transmission and playback functions, and can be connected to the control module 150 via a WiFi, Wimax, 3G or 4G wireless network 160.

In Figure 1, the user uses the smart phone 110 as a personal and explicit The number of the smart phones 110 may be one or more. When a smart phone 110 is added to the interactive system 100, the interactive system 100 first has an initialization action to cause the display device 130 to pair with the smart phone 110 to obtain a connection, and through the wireless network 160 and the control module 150. Linking to obtain a signal pattern identification code for identifying the smart phone 110. After the smart phone 110 is successfully initialized, the light sensing module 140 identifies and tracks the signal pattern generated by the signal plug-in module 120 to determine the attribute of the signal mode.

In an embodiment, when there are multiple smart phones 110a~110d at the same time In use, since the different smart phones 110a~110d have different signal patterns, the light sensing module 140 can identify and track different signal patterns, and respectively output a screen operation command to the display device 130 to control The screen played by the device 130 is displayed. In FIG. 1, the user plays according to the display device 130. The screen controls the smartphone 110 to generate an operation action.

After the smart phone 110 generates an action, through the smart phone The internal application of the 110 converts the control signal of the mobile phone into a command signal by the command signal converter 116, and the sound source signal generator 114 converts the command signal into an audio signal, and then sends the sound source signal through the headset jack 112.

Please refer to Figures 1, 2 and 3, the smart phone 110 has a headset The hole 112 and the signal plug-in module 120 are disposed on the headset jack 112 to emit a directional light source. The signal plug-in module 120 includes a sound source-to-optical converter 122 and a transmitter 124. The audio source-to-optical converter 122 is configured to receive an audio source signal and convert the audio source signal into a light source signal. The transmitter 124 is configured to emit a directional light source, and the directional light source includes a signal pattern for identifying the smart phone 110 for the light sensing module 140 to recognize the position pointed by the smart phone 110, as shown in FIG. 4A.

In FIG. 4A, the light sensing module 140 is disposed on the display device 130. Above, for receiving the directional light source L. In FIG. 1 , the light sensing module 140 includes an array receiver 142 and a light source signal processing unit 144 . The array receiver 142, such as a CCD or CMOS light sensor, receives the directional light source emitted by the emitter 124. The light source signal processing unit 144 is configured to recognize the position and signal pattern of the directional light source projected onto the array receiver 142 to output a decoded data.

The transmitter 124 is, for example, an infrared emitter, and the array receiver 142 is, for example, an infrared receiver. In an embodiment, the infrared emitter 124 on the smart phone 110 faces the display device 130 and emits an infrared signal, and the infrared receiver can observe the directional light source emitted by each infrared emitter to detect the directional light source. Center point position and its signal mode.

Please refer to Figure 4B. The signal mode P1 and P2 are flashed by the light source signal. It consists of the frequency and amplitude. Therefore, when the blinking frequency (reciprocal of the period) of the light source signal changes or the amplitude changes, different signal patterns will be generated for the signal mode comparison. For example, two signal patterns P1 and P2 of different coordinate points are found in the frame, wherein the blinking frequency of one signal mode P1 is higher (the reciprocal of the period T1) but the amplitude A1 is smaller, and the blinking frequency of the other signal mode P2. Lower (reciprocal of period T2) but amplitude A2 is larger. Therefore, different signal patterns P1, P2 and the positions of the light source signal center points C1, C2 can be distinguished from the frame.

In an embodiment, the smart phone 110 includes a program memory (not And a processor 111 for storing an application 113 for executing the application 113 to control the signal plug-in module 120 to generate a directional light source. Please refer to FIG. 5, which illustrates various steps 101-105 of the smartphone 110 performing initialization. In step 101, the application searches for and pairs the display device 130 over the wireless network 160. In step 102, the application notifies the control module 150 via the wireless network 160 to begin initialization. In step 103, the application receives via the wireless network 160 a signal pattern identification code selected by the control module 150 that has not been used. In step 104, the application sends an initial test command over the wireless network 160 and continues to send a selected signal mode sound file through the headset jack 112 as an audio source signal. In step 105, the application receives an initialization success message via the wireless network 160. If the initialization success message is not received, then return to step 104.

Please refer to FIG. 6 , which shows the light source signal processing after the initialization is successful. Unit 144 steps the identification and tracking of the signal pattern. In step 201, the light source signal processing unit 144 receives a plurality of images from the arrayed receiver 142. For example, the array receiver 142 generates 30 frames per second, which can be temporarily stored in the memory for reading by the light source signal processing unit 144. In step 202, the light source signal processing unit 144 calculates the difference of the frames to find the position pointed by the directional light source. If there are multiple directional light sources, each directional light source has a different signal pattern for identification. In step 203, the light source signal processing unit 144 compares the average values of the pixels in the vicinity of the pointing position center point (for example, C1, C2) in the frames to learn the attribute of the signal mode. That is, the flicker frequency and amplitude of each light source signal are calculated for comparison. In step 204, if the attribute of the signal mode matches the selected signal pattern identification code, the comparison is successful. If no, go back to step 201 and search again.

After the comparison is successful, the smart phone 110 and the display device 130 The interaction can be made for the user to manipulate. For example, a display device 130 and a light sensing module 140 that interact with the smart phone 110 are installed in a window of the store, and a signal plug-in module 120 is installed on the smart phone 110 of the user. The store can display interactive games (eg, shooting, shooting, etc.) on the display device 130, and the user downloads the application 113 through the wireless network 160 to interact with the currently playing screen, and the interactive system 100 calculates the user's based on the interactive result. Scores, rankings, etc., and can receive substantial rewards or exchange for redemption or discount coupons to enter the store.

Signal plug-in module and light sensing disclosed in the above embodiments of the present invention Modules and their interactive devices and systems allow one or more users to use their smart phones as consoles and interact with the display screens, while the system can also know where the smart phones are pointing. Information such as orientation for related calculations of instant interaction. This embodiment is applied to a digital electronic board, combined with a smart phone and The application of wireless network makes digital electronic signboard no longer only a one-way message transmission and display use mode, but has multi-functional applications such as advertisement push, information provision, entertainment and interaction, so it can achieve more Interactive effects and the purpose of multi-marketing.

In conclusion, the present invention has been disclosed in the above preferred embodiments, and is not intended to limit the present invention. A person skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention. Therefore, the scope of the invention is defined by the scope of the appended claims.

100: Interactive system

110‧‧‧Smart Phone

112‧‧‧ headset jack

114‧‧‧Source signal generator

116‧‧‧Command Signal Converter

120‧‧‧ Signal plug-in module

122‧‧‧Source-Optical Signal Converter

124‧‧‧transmitter

130‧‧‧Display device

140‧‧‧Light sensing module

142‧‧‧Array Receiver

144‧‧‧Light source signal processing unit

150‧‧‧Control Module

160‧‧‧Wireless network

Claims (16)

A signal plug-in module for a smart phone, the smart phone has a headset jack, the signal plug-in module is disposed on the headset jack, and the signal plug-in module comprises: a sound source-to-light signal converter, Receiving a sound source signal and converting the sound source signal into a light source signal; and a transmitter coupled to the sound source-light signal converter for emitting a directional light source, the directional light source comprising a smart phone In the signal mode, the smart phone is connected to a control module through a wireless network, and the control module includes a plurality of signal patterns for identifying and tracking the pointing position of the smart phone, and the smart phone receives the wireless network through the wireless network. The control module selects a signal pattern identification code that has not been used, and transmits the sound source signal associated with the signal pattern identification code through the headset jack. The method of claim 1, wherein the smart phone includes a program memory and a processor, the program memory for storing an application, the processor for executing the application, and Control the signal plug-in module. The signal plug-in module of claim 1, wherein the transmitter is an infrared emitter. The signal plug-in module of claim 1, wherein the signal mode is composed of a blinking frequency and an amplitude of the light source signal. A light sensing module for a display device, the light sensing device comprising: an array receiver for receiving the method as recited in claim 1 The directional light source emitted by the transmitter of the signal plug-in module, and the smart phone is connected to a control module through a wireless network, the control module includes a plurality of signals for identifying and tracking the pointing position of the smart phone a mode, the smart phone receives a signal pattern identifier selected by the control module and is not used by the control module, and sends the sound source signal associated with the signal pattern identifier through the headset jack; and The light source signal processing unit is coupled to the array receiver for identifying a position of the directional light source projected to the array receiver and the signal mode to output a decoded data. The optical sensing module of claim 5, wherein the array receiver is an infrared receiver. An interactive device for an interactive system having a display device and at least one smart phone, each of the smart phones having a headset jack, the interaction device comprising: a signal plug-in module disposed on the headset jack, the The signal plug-in module includes: a sound source-optical signal converter for receiving an audio source signal and converting the sound source signal into a light source signal; and a transmitter coupled to the sound source-optical signal converter for emitting a a directional light source, the directional light source includes a signal pattern for identifying the smart phone, wherein the smart phone is connected to a control module through a wireless network, the control module includes a plurality of groups for identifying and tracking the pointing position of the smart phone The signal mode, the smart phone receives a signal pattern identifier selected by the control module and is not used by the wireless network, and sends and transmits through the headset jack The signal pattern identifier is associated with the sound source signal; and a light sensing module is disposed on the display device, the light sensing device includes: an array receiver for receiving the signal emitted by the transmitter And a light source signal processing unit coupled to the array receiver for identifying a position of the directional light source projected to the array receiver and the signal mode to output a decoded data. The interactive device of claim 7, wherein the smart phone includes a program memory and a processor, the program memory for storing an application, the processor for executing the application, and controlling the Signal plug-in module. The interactive device of claim 7, wherein the transmitter is an infrared emitter and the array receiver is an infrared receiver. The interactive device of claim 7, wherein the signal mode is composed of a blinking frequency and an amplitude of the light source signal. An interactive system is adapted to be coupled to a control module through a wireless network, the control module includes a plurality of sets of signal patterns for identifying and tracking a pointing position of the smart phone, the interactive system comprising: at least one smart phone having one a headset jack, the smart phone obtains a selected signal pattern identifier from the control module through the wireless network, and sends a sound source signal associated with the selected signal pattern identifier through the headset jack; The module is disposed on the headset jack, and the signal plug-in module includes: an audio source-to-optical signal converter for receiving the sound source signal, and the The sound source signal is converted into a light source signal; and a transmitter coupled to the sound source-optical signal converter for emitting a directional light source, the directional light source comprising a signal pattern for identifying the smart phone; a display device; The light sensing module is disposed on the display device, the light sensing module includes: an array receiver for receiving the directional light source emitted by the transmitter; and a light source signal processing unit coupled The array receiver is configured to identify a position of the directional light source projected to the array receiver and the signal mode to output a decoded data, and convert the decoded data into a picture operation command to control the display device. The screen that is played. The interactive system of claim 11, wherein the transmitter is an infrared emitter and the array receiver is an infrared receiver. The interactive system of claim 11, wherein the signal mode is composed of a blinking frequency and an amplitude of the light source signal. The interactive system of claim 11, wherein the smart phone includes a program memory and a processor, the program memory for storing an application for executing the application for initialization, And control the signal plug-in module. For example, in the interactive system described in claim 14, wherein the smart phone is initialized, the application includes: Searching and pairing the display device through the wireless network; notifying the control module to initiate initialization through the wireless network; receiving, by the wireless network, a signal pattern identifier selected by the control module that has not been used; The wireless network sends an initial test command and continuously sends a selected signal mode sound file through the headset jack as the sound source signal; and receives an initialization success message through the wireless network. For example, in the interactive system described in claim 15, wherein the smart phone receives the initialization mode, the light source signal processing unit identifies and tracks the signal pattern generated by the transmitter, and performs the following comparison, including : receiving a plurality of frames from the array receiver; calculating differences of the frames to find a position pointed by the directional light source; and averaging the pixels near the center point of the aligned pointing position in the message The characteristics of the box.