JP2010231355A - Information display device - Google Patents

Abstract

Provided is an information display device that is suitable for placement in a public place and that can display various types of advertisement information in accordance with viewer operations. Furthermore, the operation in the display device is facilitated.
An information display device includes: a display unit that displays advertisement information or notification information; a photographing unit that photographs the front of the display unit; and an operation of a viewer of the display unit based on a photographing result obtained from the photographing unit. And a specifying means for specifying the information selected by the viewer among the plurality of pieces of information displayed on the display unit in accordance with the action detected by the action detecting means.
[Selection] Figure 2

Description

  The present invention relates to an information display device that is arranged in a public place and displays advertisement information and notification information.

2. Description of the Related Art In recent years, development of large-sized information display devices that are installed in public places such as bus stops and stations and display advertisement information and notification information has been promoted. For example, Non-Patent Document 1 discloses an information display device that displays general advertisement information and notification information for unspecified majority persons.
ITpro EXPO 2008: Gender and age group estimation option of face recognition software for reference [Search on March 26, 2009], Internet <http://itpro.nikkeibp.co.jp/article/NEWS/20080131/292725/ >

  In an information display device that displays advertisement information and notification information, as a method for further improving the advertising effect, it is desired that various types of advertisement information can be displayed according to the operation of the viewer.

  However, when the information display device is arranged in a public place, if the operation unit operated by the viewer is an operation button, there is a possibility that it will be destroyed by a Service-to-Self. Further, when the operation unit is a touch panel, there is a problem that the display surface is easily soiled.

  SUMMARY OF THE INVENTION An object of the present invention is to provide an information display device that is suitable for placement in public places and that can display various types of advertisement information in accordance with viewer operations.

  The information display device according to the present invention includes a display unit that displays advertisement information or notification information, an imaging unit that images the front of the display unit, and the operation of the viewer of the display unit based on the imaging result obtained from the imaging unit. An action detecting means for detecting the information and a specifying means for specifying the information selected by the viewer among the plurality of information displayed on the display unit according to the action detected by the action detecting means. To do.

  ADVANTAGE OF THE INVENTION According to this invention, it is suitable for arrangement | positioning in a public place and can provide the information display apparatus which can display various advertisement information according to a viewer's operation.

  Hereinafter, embodiments of the present invention will be specifically described with reference to the drawings.

(Configuration of information display device 100)
As shown in FIG. 1, the information display device 100 is a CCD for photographing the front of the information display surface (10) on the upper part of the display body (1) having an information display surface (10) composed of, for example, a liquid crystal panel. An imaging device (2) composed of a camera or the like is provided. On the back of the display main body (1), a control device (3) for controlling the operation of the entire information display device 100 is provided.

  The information display device 100 has an electronic money settlement function, and an electronic money reader / writer (4) is connected to the control device (3).

  FIG. 2 shows a configuration of the control device (3), and the control device (3) includes a control unit (30) configured by a CPU or the like. The control unit (30) is connected to the bus (31). The display body (1) is connected to the bus (31) via the display I / F unit (32), and the audio I / F unit ( The speaker (5) is connected via 33). In addition, the imaging device (2) is connected to the bus (31) via the imaging device I / F unit (34), and the electronic money reader / writer (4) is connected via the electronic payment processing unit (35). It is connected.

  The control device (3) includes an advertisement information / program storage device (36) in which advertisement information, display schedule data, and various control programs are stored, a viewer information table (to be described later), and viewing that represents viewer operations. A viewer information storage device (37) in which a person action flag is stored, and a display memory (38) in which advertisement information and the like are temporarily stored. These advertisement information / program storage device (36), viewer information storage device (37), and display memory (38) are connected to the bus (31). The bus (31) is connected to a network such as the Internet or a LAN via a network I / F unit (39). For example, new advertisement information is downloaded from the network and a display information / program storage device (36 ).

Further, the control device (3) includes a wireless communication I / F unit (40) for performing wireless communication with a mobile communication terminal device such as a mobile phone or a PDA (Personal Digital Assistant). The F section (40) is connected to the bus (31).
The control unit (30) performs various processes to be described later such as management of advertisement information, management of display schedule, management of operation log, and analysis processing of image signals obtained from the imaging device (2).

(Type of advertising information)
The advertisement information includes general advertisement information for unspecified majority persons and advertisement information stored in association with gender information and age information.

  In general, general advertisement information for unspecified majority is sequentially read out from the advertisement information / program storage device (36) according to the display schedule data and displayed on the information display surface (10). At this time, when the advertisement information includes audio data, audio is output from the speaker (5).

  On the other hand, when there is a viewer who watches the advertisement information displayed on the information display surface (10) in front of the information display surface (10), the advertisement information / program storage device (36) Advertisement information corresponding to gender and age is read and displayed on the information display screen. 3 and 4 show examples of advertisement information of a car company. For example, when a viewer is a young woman, the advertisement information shown in FIG. 3 for a small car is displayed, and the viewer is an elderly man. In some cases, the advertisement information shown in FIG. 4 for the medium-sized vehicle is displayed.

  In addition, the advertisement information may include information such as a period, a time, and a frequency to be displayed on the information display surface (10). Based on these pieces of information, the control unit (30) may determine which of the advertisement information stored in the advertisement information / program storage device (36) is to be displayed.

(Interactive advertising information)
The advertisement information includes interactive advertisement information. FIG. 5 shows an example of interactive advertisement information by an automobile company.

  When such interactive advertisement information is displayed on the information display surface (10), the viewer existing in front of the information display surface moves the hand (arm) to input information (hereinafter referred to as gesture input). Can be done. For example, when interactive advertisement information including a plurality of content buttons as shown in FIG. 5 is displayed on the information display surface (10), if the viewer moves his / her hand in one of the up / down / left / right directions, The movement of the viewer's hand is detected based on the image signal obtained from the device (2), and one content button is selected according to the detection result. Then, when the viewer quickly moves his / her hand up and down to confirm the selection state in a state where the desired content button is selected, the viewer's hand is based on the image signal obtained from the photographing device (2). As a result, the advertisement information corresponding to the selected content button is read from the advertisement information / program storage device (36) and displayed on the information display surface (10).

  Referring to FIG. 5 again, the advertisement information includes three content buttons “SUV”, “sedan”, and “sports car”. Here, when the display function of the viewer (gesture input person) who performs gesture input is set to ON, as shown in the figure, the image of the gesture input person photographed by the photographing device (2) is displayed on the information display surface. Displayed in (10). The gesture input method is displayed on the information display surface (10).

  FIG. 5 shows a state in which the content button “sports car” is selected, and the content button is highlighted so that it can be distinguished from other content buttons. In this state, when the viewer raises his hand above the shoulder, the content button “sedan” is selected and the content button is highlighted. When the viewer raises his hand above the shoulder again, the content button “ “SUV” is selected and the content button is highlighted. In this state, when the viewer lowers his hand below the shoulder, the content button “sedan” is selected and the content button is highlighted. When the viewer lowers his hand below the shoulder again, the content button “ “Sports car” is selected and the content button is highlighted. In this way, each time the hand is raised above the shoulder, the content button displayed above the currently selected content button is selected, and every time the hand is lowered below the shoulder, The content button displayed immediately below the content button selected in is selected. For example, when the viewer quickly moves his / her hand up and down with the content button “sports car” highlighted as shown in the figure, the advertisement information shown in FIG. 6 for various sports cars is displayed on the information display surface. Will be displayed.

  Note that the information regarding the gesture input method stored in the advertisement information / program storage device (36) may be distributed from the advertising business operator via the network together with the advertisement information, or may be an information display device in advance. It may be prepared on the 100 side.

  As an example, what is prepared in advance on the information display device 100 side is, for example, a simple and orthodox method of selecting (three choices) according to the direction of the hand (upper, middle, lower) as described above. is there. On the other hand, when the advertising business operator instructs a special input method, for example, when the choices A, B, and C are selected with the gestures of goo, choki, and par, when the selection is made with the dances A, B, and C, the gesture input Information on the method is distributed from the advertising business owner via the network together with the advertising information.

  In addition, when the information regarding the gesture input method is distributed from the advertising business owner via the network together with the advertisement information, a corresponding gesture analysis program is also necessary. Therefore, the gesture analysis program may be distributed from the advertising business owner via the network together with the advertising information.

  Alternatively, various gesture analysis processing programs are stored in the information display device 100 in advance, and information for designating a program for performing the gesture analysis processing is distributed from the advertising business owner via the network together with the advertising information. It may be.

(Electronic payment)
The information display device 100 can transmit various types of information including pay information such as an electronic ticket to the viewer's mobile communication terminal device, and the interactive advertisement information including the information transmission request button displays the information. In the state displayed on the screen, the viewer selects the information transmission request button by moving his / her hand up / down / left / right as described above, and quickly moves his / her hand up / down in that state, When the mobile communication terminal device is brought close to the information transmission unit of the information display device, information is transmitted from the information display device to the mobile communication terminal device. Thereafter, when a mobile communication terminal device or card having an IC chip in which monetary value data is recorded is brought close to the electronic money reader / writer (4), electronic settlement processing is executed.

(Specific processing executed in information display apparatus 100)
FIG. 7 shows an overall processing procedure executed in the information display apparatus 100. First, in step S1, display data processing for reading out advertisement information to be displayed on the information display surface from the advertisement information stored in the advertisement information / program storage device (36) and storing it in the display memory is performed. In the subsequent step S2, display processing for reading display data from the display memory and outputting it to the display main body is performed. In step S3, an image signal obtained from the photographing apparatus is analyzed. Then, the process returns to step S1. In this way, display data processing, display processing, and image analysis processing are repeatedly executed.

  First, the image analysis process executed in step S3 will be described, and then the display data process executed in step S1 and the display process executed in step S2 will be described.

(Step S3: Image analysis processing)
FIG. 8 shows the image analysis process executed in step S3. The viewer information storage device (37) is provided with a storage area for viewer information tables for the past N times including the present, as shown in FIG. 9 (a).

  In the image analysis processing, first, in step S11 of FIG. 8, it is determined whether or not the image analysis function is set to ON based on the image analysis function ON / OFF information included in the system setting information. If so, a value of “0” is written in the current viewer information table storage area among the N viewer information table storage areas provided in the viewer information storage device (37) in step S26. At the same time, the viewer operation flag is set to “00h”, and the process ends.

  If the image analysis function is set to ON, the process proceeds to step S12, and an image signal is acquired from the photographing apparatus. Subsequently, in step S13, processing for detecting the face of a person facing the front is performed based on the image signal acquired from the photographing apparatus. Here, as the face detection processing method, various known methods such as a pattern matching method can be employed.

  Next, in step S14, based on the detection result in step S13, it is determined whether or not there is a viewer who is looking at the information display surface in front of the information display surface. Here, when the face of the person facing the front is not detected in step S13, it is determined as NO and the process proceeds to step S26, and the value “0” is stored in the current viewer information table storage area. And the viewer operation flag is set to “00h”, and the process ends.

  If the face of the person facing the front is detected in step S13, the determination in step S14 is YES and the process proceeds to step S15, where one or more viewers are viewing the information display surface. For each, a viewer information table shown in FIG. 9B is created and stored in the current viewer information table storage area. As shown in the figure, the viewer information table is provided with a viewer identification number, position information indicating the position of the face, face size information, sex information, age information, clothing color information and height information writing area. In the figure, “1” represents a viewer identification number. In step S15 of FIG. 8, the position of the face and the size of the face are detected for each viewer based on the image signal acquired from the imaging device in step S12. Write information to the viewer information table.

  Subsequently, in step S16, the age of one viewer is estimated based on the image signal acquired from the photographing apparatus in step S12, and the age information is written in the viewer information table for the viewer. In S17, the gender of the viewer is estimated based on the image signal, and gender information is written in the viewer information table for the viewer. Next, in step S18, the color of the viewer's clothes is detected based on the image signal, and the color information of the clothes is written in the viewer information table for the viewer, and in step S19, the image signal is added to the image signal. Based on this, the height of the viewer is estimated, and the height information is written in the viewer information table for the viewer. As the age estimation processing method, sex estimation processing method, clothing color detection processing method and height estimation processing method, various known methods can be employed.

  Thereafter, in step S20, whether or not the viewer analysis process including the age estimation process, the sex estimation process, the clothing color detection process, and the height estimation process has been completed for all viewers who are viewing the information display surface. If NO is determined, the process returns to step S16 to repeat the viewer analysis process.

  Thereafter, when the viewer analysis process is completed for all viewers and it is determined as YES in step S20, the process proceeds to step S21 and is based on the gesture analysis function ON / OFF information included in the system setting information. To determine whether the gesture analysis function is set to ON. If YES is determined in step S22, whether or not the advertisement information is interactive advertisement information is determined based on the additional information of the advertisement information currently displayed on the information display screen. If yes, in step S23, the information is displayed in front of the information display surface for a predetermined time or more based on the viewer information table stored in the viewer information storage device (37). It is determined whether or not there is a viewer (gazing person) watching the display surface.

  Here, if there are viewers whose viewer information tables for the past N times including the present are stored in the viewer information storage device (37), it is determined as YES and the process proceeds to step S25, and the gesture described later. An analysis process is performed and the process ends.

  On the other hand, if it is determined NO in step S21, step S22, or step S23, the viewer operation flag is set to “00h” in step S24, and the process ends.

  According to the above processing, when there is a viewer who is viewing the information display surface in front of the information display surface, the viewer information table shown in FIG. 9B is created for the one or more viewers. It is written in the viewer information storage device (37).

  In addition, the gesture analysis process described later may be performed only when there is a viewer who is watching the information display surface for a certain time or more among the viewers existing in front of the information display surface. good. That is, there is a high possibility that a person who makes a gesture input (a person who selects desired information) is gazing at the information display surface for a long time in front of the information display surface. Therefore, if the gesture analysis process is performed only when there is a viewer who is gazing at the information display surface for a certain time or longer, the useless gesture analysis process is not performed.

  When the image analysis function is set to OFF and when there is no viewer in front of the information display surface, a value of “0” is written in the viewer information storage device (37) and the viewing is performed. The person action flag is set to “00h”. Also, when the gesture analysis function is set to off, when the advertisement information displayed on the information display surface is not interactive advertisement information, and when there is no viewer watching the information display surface Therefore, the viewer operation flag is set to “00h”.

(Step S25: gesture analysis process)
In the gesture analysis process in step S25, as shown in FIG. 10, first, in step S31, image signals for a plurality of frames are acquired from the photographing apparatus with a certain time interval, and in step S32, One gesture input person is specified based on the extracted image signal of the image region centered on the gesture input person from the acquired image signal of each frame, and then the difference between the extracted image signals between the plurality of frames is calculated. calculate. In the gesture input person specifying process, when there is one gaze person, the gaze person is specified as the gesture input person, and when there are a plurality of gaze persons, for example, in the width direction of the information display surface A gaze person present at the center position or a gaze person present at a position closest to the information display surface is specified as a gesture input person. For example, when the image shown in FIG. 11 is taken by the photographing apparatus, the gaze person (6) existing at the center position is specified as the gesture input person, and then the gaze person (6) is centered as shown in FIG. The image signal of the image area is extracted.

  After the difference between the image signals extracted between a plurality of frames is calculated as described above, the gesture input person's action is analyzed based on the difference. At this time, since the image analysis range is narrowed by extracting the image signal of the image region centered on the gesture input person, the operation analysis process can be easily performed in a short time. Since the operation analysis process is publicly known, detailed description is omitted.

  In step S33 of FIG. 10, it is determined whether or not the gesture input person's action is to raise his hand (arm) above his / her shoulder. If the answer is yes, the viewer action flag is set in step S34. Set to “01h” to end the process. If NO is determined in step S33, the process proceeds to step S35 to determine whether or not the gesture input person's action is to lower the hand below the shoulder. In S36, the viewer operation flag is set to “02h”, and the process is terminated. When it is determined NO in step S35, the process proceeds to step S37, where it is determined whether or not the gesture input person moves the hand to the right. If YES, the process proceeds to step S38. Then, the viewer operation flag is set to “03h”, and the process is terminated. When it is determined NO in step S37, the process proceeds to step S39, where it is determined whether the gesture input person moves the hand to the left. If YES, the process proceeds to step S40. Then, the viewer operation flag is set to “04h”, and the process ends. If it is determined NO in step S39, the process proceeds to step S41 to determine whether the gesture input person moves the hand up or down. If YES, the process proceeds to step S42. Then, the viewer operation flag is set to “05h”, and the process ends. If it is determined NO in step S41, the viewer operation flag is set to “00h”, and the process ends.

  According to the above processing, the viewer operation flag is “01h” when the gesture input person raises the hand above the shoulder, “02h” when the hand is lowered from the shoulder, and when the hand is moved to the right. “03h” is set to “04h” when the hand is moved to the left, and “05h” is set when the hand is quickly moved up and down. Note that if the gesture input person does not perform any action, and if the gesture input person performs an action that is not one of the actions defined as the gesture input action, the viewer action flag is set to “00h”. Will be set.

  In the above description, when it is determined to be no in step S41, the viewer operation flag is set to “00h” and the process is ended. Instead, in step S94 of FIG. May be performed. In other words, the determination of “no” in S41 is considered to be caused by the gesture input person performing an operation other than that defined as the gesture input operation. Therefore, by displaying the correct gesture input method together with the advertisement information, it is possible to prevent erroneous input by the gesture input person. And after performing the process which synthesize | combines the said input method data, you may repeat the gesture analysis process (S25) of FIG. 10 again.

(Step S1: Display data processing)
FIG. 13 shows the display data processing executed in step S1 of FIG. 7. First, in step S51, the viewer operation flag stored in the viewer information storage device (37) is “00h”. Determine whether or not. If the determination is yes, the process proceeds to step S52, and the display schedule data stored in the advertisement information / program storage device (36) is referred to.

  Next, in step S53, it is determined whether or not the advertisement information displayed on the information display surface needs to be changed based on the reference result of the display schedule data. If the answer is NO, the process ends. .

  On the other hand, if it is determined that the predetermined time has elapsed from the display start time of the advertisement information displayed on the information display surface at that time and the advertisement information needs to be changed, the process proceeds to step S54. Then, the advertisement information to be displayed next is read from the advertisement information / program storage device (36), and the video data included in the advertisement information is written in the display memory. At this time, when a value of “0” is written in the latest viewer information table storage area of the viewer information storage device (37), that is, when the viewer information table is not stored, the display schedule data The advertisement information according to the above is read from the advertisement information / program storage device (36). On the other hand, when the viewer information table is stored, sex information and age information are read from the viewer information table, and advertisement information corresponding to the read sex information and age information is stored in the advertisement information / program. Read from device (36). When a plurality of viewer information tables are stored in the latest viewer information table storage area, for example, the viewer exists in the center position in the width direction of the information display surface, or exists in the position closest to the information display surface The sex information and the age information are read from the viewer information table for the viewer who performs. Note that the period in which the advertisement information is read from the advertisement information / program storage device (36) and written to the display memory, that is, the predetermined time differs depending on the advertisement information.

  In step S55, the display start address is updated to the video data write start address. In step S56, the display mode change function is turned on based on the display mode change function on / off information included in the system setting information. If the answer is no, the process ends. If the answer is yes, a display mode change process described later is executed in step S57, and the process ends. To do.

  If it is determined in step S51 that the viewer operation flag stored in the viewer information storage device (37) is not “00h”, the process proceeds to step S58, where the viewer operation flag is set to “00h”. It is determined whether or not 05h ″. Here, if the viewer operation flag has any value from “01h” to “04h”, that is, if the gesture input person moves his / her hand in any of the up / down / left / right directions, it is determined to be no. The process proceeds to S65, where one button is selected from a plurality of buttons currently displayed on the information display surface according to the value of the viewer operation flag, and the position of the highlight display is set to the position of the button. The process is terminated.

  On the other hand, if the gesture input person quickly moves his / her hand up or down while one button is selected among the plurality of buttons displayed on the information display surface, the answer is “Yes” in step S58. The process proceeds to step S59, and the advertisement information corresponding to the button selected at that time is read from the advertisement information / program storage device (36), and the video data included in the advertisement information is written in the display memory. In step S60, it is determined whether or not the selected button is an information transmission request button. If NO in step S60, the display start address is set to start writing of the video data in step S64. Update to the address and end the process.

  If the selected button is an information transmission request button, the pay information requested for transmission is read from the advertisement information / program storage device (36) in step S61, and then in step S62. The pay information is transmitted to the mobile terminal device. Subsequently, in step S63, the electronic payment processing unit is caused to execute the payment process, and then the process proceeds to step S64, where the display start address is updated to the video data write start address, and the process ends.

  According to the above processing, when there is no viewer in front of the information display surface, the advertising information is read from the advertising information / program storage device (36) according to the display schedule data and written to the display memory. Is present, the advertisement information corresponding to the gender and age of the viewer is read from the advertisement information / program storage device (36) and written to the display memory. Thereafter, when the display mode changing function is set to ON, a display mode changing process described later is executed.

  In addition, when a gesture input person quickly moves his / her hand up and down while one button is selected from among a plurality of buttons displayed on the information display surface, advertisement information corresponding to the button is displayed. It is read from the advertisement information / program storage device (36) and written to the display memory. If the button is an information transmission request button, the pay information requested to be transmitted is transmitted to the mobile terminal device, and then the electronic payment process is executed.

  Furthermore, when the gesture input person moves his / her hand in any direction, up / down / left / right, one button is selected according to the movement of the hand, and the button is highlighted.

(Step S57: Display mode changing process)
FIG. 14 shows the display mode change process in step S57. First, in step S71, it is determined whether or not the color change function is set to ON based on the color change function ON / OFF information included in the system setting information. If it is determined that the answer is no, the process proceeds to step S76. On the other hand, if it is determined as YES in step S71, the process proceeds to step S72, and whether or not the additional information of the advertisement information written in the display memory at that time includes a plurality of color information about the advertisement product. If NO is determined, the process proceeds to step S76.

  If it is determined as YES in step S72, the process proceeds to step S73, and the clothes color is selected from the viewer information table stored in the latest viewer information table storage area of the viewer information storage device (37). Read information. Here, when a plurality of viewer information tables are stored in the latest viewer information table storage area, for example, the viewer that is present at the center position in the width direction of the information display surface, or closest to the information display surface Clothes color information is read out from the viewer information table for the viewers present at the position. Next, in step S74, color information that is the same as or similar to the color information read in step S73 is selected from among a plurality of color information about the advertising product included in the additional information of the advertising information, In step S75, the color of the advertising product is changed on the display memory based on the selected color information, and then the process proceeds to step S76. In step S73, clothes color information is read from a plurality of viewer information tables. In step S74, average color information is obtained from the read color information, and color information that is the same as or similar to the obtained color information is obtained. It is also possible to select. In step S75, instead of changing the color of the advertising product on the display memory, it is possible to rewrite the advertising information written in the display memory to the advertising information having the selected color of the advertising product.

  In step S76, it is determined whether or not the display position change function is set to ON based on the display position change function ON / OFF information included in the system setting information. If NO, the process proceeds to step S80. .

  On the other hand, if it is determined as YES in step S76, the process proceeds to step S77, where the position information is obtained from the viewer information table stored in the latest viewer information table storage area of the viewer information storage device (37). And height information is read. Here, when a plurality of viewer information tables are stored in the latest viewer information table storage area, for example, the viewer that is present at the center position in the width direction of the information display surface, or closest to the information display surface The position information and the height information are read from the viewer information table for the viewer existing at the position. Next, in step S78, the display position of the advertisement information on the information display surface is determined from the read position information and height information, and in step S79, the display position of the advertisement information is changed to the determined display position on the display memory. Here, when the height of the viewer is high, the display position is set to a high position, and when the height is low, the display position is set to a low position. In addition, when the viewer's position is a position on the right side of the center of the information display surface, the display position is set to a position on the right side of the center of the information display surface. When the position is also the left position, the display position is set to the left position from the center of the information display surface.

  In step S80, it is determined whether or not the display size change function is set to ON based on the display size change function ON / OFF information included in the system setting information. If NO, the process ends.

  On the other hand, if it is determined as YES in step S80, the process proceeds to step S81, and the face size is determined from the viewer information table stored in the latest viewer information table storage area of the viewer information storage device (37). Read information. Here, when a plurality of viewer information tables are stored in the latest viewer information table storage area, for example, the viewer that is present at the center position in the width direction of the information display surface, or closest to the information display surface The face size information is read from the viewer information table for the viewer existing at the position. Next, in step S82, after estimating the distance from the information display surface from the read face size information, the display size of the advertisement information on the information display surface is determined based on the result, and in step S83, the advertisement is displayed on the display memory. Change the display size of the information to the determined display size. Here, when the size of the viewer's face is large, the viewer is present at a position close to the information display surface. Therefore, the display size is set small, and when the size of the viewer's face is small, the viewer Is present at a position far from the information display surface, the display size is set large.

  Thereafter, in step S84, it is determined whether or not the volume changing function is set to ON based on the volume changing function ON / OFF information included in the system setting information. If NO, the process ends. If YES is determined, the process proceeds to step S85, the volume output from the speaker is changed to a volume corresponding to the display size determined as described above, and the process ends. Here, when the display size is large, the viewer is at a position far from the information display surface, so the volume is set to a large value, and when the display size is small, the viewer is positioned near the information display surface. Therefore, the volume is set to a small value.

  According to the above processing, when the color change function is set to ON and the additional information of the advertisement information includes a plurality of pieces of color information about the advertisement product, the color of the advertisement product is displayed on the display memory. The color is changed according to the color of the clothes of the viewer existing in front of the display surface.

  When the display position change function is set to ON, the display position of the advertisement information on the display memory depends on the position in the width direction and the height of the information display surface of the viewer existing in front of the information display surface. Will be changed.

  Further, when the display size changing function is set to ON, the display size of the advertisement information is changed on the display memory according to the distance from the information display surface of the viewer existing in front of the information display surface. It will be.

  Furthermore, when the volume changing function is set to ON, the volume of the sound output from the speaker is changed according to the distance from the information display surface of the viewer existing in front of the information display surface. become.

(Step S2: Display processing)
FIG. 15 shows the display process executed in step S2 of FIG. 9. First, in step S91, the gesture input person image display is performed based on the gesture input person image display function on / off information included in the system setting information. It is determined whether or not the function is set to ON. If YES is determined, the process proceeds to step S92, and the image region centered on the gesture input person is determined from the image signal for one frame obtained from the photographing apparatus. After extracting the image signal and synthesizing the extracted image signal with display data written after the display start address set at that time to create new display data, the process proceeds to step S93 while When it is determined NO in S91, the process bypasses step S92 and proceeds to step S93.

  In step S93, it is determined whether or not the gesture input method display function is set to ON based on the gesture input method display function ON / OFF information included in the system setting information. If YES, the process proceeds to step S94. The input method data is read from the advertisement information / program storage device (36), and the read input method data is combined with the display data written after the display start address set at that time to create a new one. After creating the display data, the process proceeds to step S95. On the other hand, if NO is determined in step S93, the process bypasses step S94 and proceeds to step S95.

  In step S95, the display data written after the display start address set at that time is read from the display memory. Finally, in step S96, the read display data is output to the display body, and the process is terminated. .

  According to the above process, when the gesture input person image display function is set to ON, the image data representing the gesture input person is combined with the display data on the display memory to create new display data. become. Thereby, the person who is gazing at the information display surface (10) can perform an operation for selecting desired information while confirming his / her operation by the image displayed on the information display surface (10). .

  If the gesture input method display function is set to ON, the input method data is combined with the display data on the display memory to create new display data. Thereafter, the display data written in the display memory is output to the display body. As a result, the advertisement information is displayed on the information display surface. At this time, if the gesture input person image display function is set to ON, an image of the gesture input person is displayed, and if the gesture input method display function is set to ON, the gesture input method is displayed. Will be. If the advertisement information written in the display memory is not interactive advertisement information, the gesture input person image display function and the gesture input method display function are automatically set to OFF, and as a result, only the advertisement information is displayed. It will be displayed on the information display surface.

  Even in the case of interactive advertisement information, the gesture input person image display function and the gesture input method display function may be set to off. If the gesture input person image and the gesture input method are displayed side by side on the same display screen as the advertisement image, the advertisement image is inevitably reduced and displayed. Therefore, based on the intention of the advertising business owner and the like, such a setting may be performed in order to avoid a reduced display of the advertisement image even for interactive advertisement information. In the case where such a gesture input method is set not to be displayed, when the viewer makes an incorrect gesture input (for example, when reaching the step S43 in the process of FIG. 10), the gesture input is performed. The method may be displayed side by side with the advertisement image or combined.

(Function)
In the information display device 100, when the advertisement information displayed on the information display surface is interactive advertisement information, a viewer existing in front of the information display surface is displayed with a plurality of content buttons included in the advertisement information. The desired advertisement information can be displayed on the information display surface by selecting one desired content button from the menu. Even if the advertisement information displayed on the information display surface is not interactive advertisement information, if there is a viewer in front of the information display surface, it depends on the gender and age of the viewer. Advertisement information is displayed on the information display screen. Furthermore, the color of the advertising product is changed to the same color as or similar to the color of the viewer's clothes. In this way, by displaying the advertisement information corresponding to the viewer on the information display surface, a high advertisement effect can be obtained.

  Also, if a contact-type information input device such as a pointing device, a touch panel, or a switch is provided, an unspecified number of persons will touch the information input device or the information display device body. There may be a problem of damage, a problem of smearing the information display surface, a problem of peeling off the coating of the information display device body, and the like. Since one content button can be selected, the above problem does not occur.

  Furthermore, according to the information display device 100, information can be input without contact, so that it can be arranged, for example, in a show window.

  Furthermore, since the display position and display size of the advertisement information and the volume of the output sound from the speaker are changed according to the height and position of the viewer, the advertisement information can be viewed easily.

  In addition, each part structure of this invention is not restricted to the said embodiment, A various deformation | transformation is possible within the technical scope as described in a claim.

(Modification 1)
In the above-described embodiment, gesture analysis processing is performed based on the image signal obtained from the photographing apparatus (2) shown in FIG. 1, and the image of the gesture input person is represented based on the image signal obtained from the photographing apparatus (2). Is displayed on the information display surface, and another imaging device is provided separately from the imaging device (2), and a gesture analysis process is performed based on an image signal obtained from the other imaging device, It is also possible to adopt a configuration in which an image of a gesture input person is displayed on the information display surface based on an image signal obtained from the other photographing apparatus.

(Modification 2)
In the above embodiment, in step S23 of FIG. 8, it is determined whether or not there is a viewer who is gazing at the information display surface for a predetermined time or more in front of the information display surface. It is determined whether or not there is a viewer who is gazing at the information display surface for a predetermined time or more at a predetermined position in front of the information display surface. In the gesture analysis process shown in FIG. It is also possible to analyze. In such a configuration, there are viewers whose viewer information tables for the past N times including the present are stored in the viewer information storage device (37), and viewing with respect to one or a plurality of viewers is present. Based on the position information and face size information written in the person information table, the gesture analysis process is executed when it is determined that there is a viewer existing at a predetermined position among the one or more viewers. The In such a configuration, the viewer who is the subject of motion analysis is photographed at a predetermined size, which facilitates motion analysis processing.

  Further, in step S23 of FIG. 8, it is determined whether or not the viewer existing in front of the information display surface has performed a predetermined operation, and if it is determined that the predetermined operation has been performed, a gesture analysis process is executed. And a configuration for determining whether or not a viewer has performed a predetermined operation at a predetermined position in front of the information display surface, and performing a gesture analysis process when determining that a predetermined operation has been performed at a predetermined position It is also possible to adopt.

(Modification 3)
In the above embodiment, the image signal of the image area centered on the gesture input person is extracted from the image signal of each frame so that the motion analysis process can be easily performed. However, a photographing apparatus having a zoom function is provided. In this configuration, it is possible to photograph a gesture input person with a predetermined size by adjusting the zoom rate. In a configuration in which an imaging device capable of changing the shooting direction to the pan direction and / or the tilt direction is provided, the gesture input person is shot by changing the shooting direction to the pan direction and / or the tilt direction. It is also possible to take a picture with a fixed composition by being positioned at a predetermined position within the range.

(Modification 4)
When the viewer makes an incorrect gesture input (for example, when reaching the step S43 in the process of FIG. 10), the gesture input method may be output by voice. In addition, when the viewer performs erroneous gesture input many times, the viewer may select information by voice input instead of the gesture input.

(Modification 5)
It is considered embarrassing to perform gesture input, and there are also users who hesitate to use the information display device 100. In preparation for such a case, gesture input and voice input may be selected at any time according to the intention of the user.

(Modification 6)
In addition, in the case of nighttime, there is a possibility that the gesture input cannot be correctly recognized from the image taken by the photographing apparatus. Therefore, at night, information may be selected by voice input. Alternatively, at night, voice input may be standard input instead of gesture input.

(Modification 7)
In the above description, the gesture input is an example of the operation of moving the hand and arm up, down, left, and right, but other operations such as opening and closing the hand and moving the face up, down, left, and right are also possible.

(Modification 8)
It is possible to communicate with the mobile communication terminal device, and the selection means detects the operation in a state where an information transmission request button to be selected when requesting transmission of information is displayed on the information display surface. It is possible to select the information transmission request button according to the operation detected by the means, and further, information transmission for transmitting information to the mobile communication terminal device when the information transmission request button is selected by the selection means Means may be provided.

  When the user of the mobile communication terminal device performs a predetermined operation to select the information transmission request button while the information transmission request button is displayed on the information display surface, the user is based on the image signal obtained from the imaging device. As a result, information is transmitted to the user's portable communication terminal device.

(Modification 9)
In the above embodiment, an information display device that displays advertisement information has been described. However, the present invention can be implemented in various information display devices that display various information such as notification information.

(Modification 10)
In FIG. 1, the information display device 100 is depicted with the display body (1) and the control device (3) as separate bodies, but the control device (3) is provided in the display body (1), For example, it may be provided on the same substrate as the electronic circuit that performs general display control of the display.

(Modification 11)
The present invention can also be implemented in the outdoor type information display apparatus shown in FIG. As shown in the figure, the outdoor type information display device is configured by housing a display main body (1) and a control device (3) (not shown) inside a case (8) having a waterproof structure. The cooling device (9) and the fans (91) and (92) are arranged inside 8). In the information display device, the air cooled by the cooling device (9) flows around the display body (1) and is discharged to the outside as indicated by the arrows, thereby increasing the temperature in the housing (8). It is suppressed.

  As described above, if a contact-type information input device such as a pointing device, a touch panel, or a switch is provided, the information input device may be damaged, the information display surface may become dirty, or the information display device body may be peeled off. Problems may occur, but outdoor type information display devices are often placed in a situation where an unspecified number of persons can be contacted at night. Is likely to occur. In addition, in an outdoor type information display device, when the information display surface becomes dirty, sunlight is diffusely reflected on the information display surface, making it difficult to see the information displayed on the information display surface. Should be avoided. Therefore, the present invention is particularly effective when applied to an outdoor type information display device.

  In FIG. 16, in the display main body (1), only the modulation element such as a liquid crystal panel is accommodated in the casing (8), and various electronic circuits and electric circuits are arranged outside the casing (8). Various configurations may be adopted.

1 is a perspective view illustrating an appearance of an information display device 100. FIG. It is a block diagram showing the structure of the control apparatus of the said information display apparatus. It is a figure showing the example of the advertising information displayed on an information display surface, when a viewer is a young woman. It is a figure showing the example of the advertising information displayed on an information display surface, when a viewer is an elderly man. It is a figure showing the example of the interactive advertisement information displayed on an information display surface. It is a figure showing the example of the advertisement information displayed on an information display surface, when content button "sports car" is selected. It is a flowchart showing the display process performed in the said information display apparatus. It is a flowchart showing an image analysis process. It is a figure showing the storage area of a viewer information storage device, and a viewer information table. It is a flowchart showing a gesture analysis process. It is a figure showing the example of the image image | photographed with the imaging device. It is a figure showing the example of the area | region which extracts an image signal in a gesture analysis process. It is a flowchart showing a display data process. It is a flowchart showing a display mode change process. It is a flowchart showing a display process. It is sectional drawing showing the information display apparatus of another Example.

(1) Display body
(2) Imaging device
(3) Control device
(30) Control unit
(36) Advertising information / program storage device
(37) Viewer information storage device
(38) Display memory
(40) Wireless communication I / F section
(4) Electronic money reader / writer
(5) Speaker

Claims (6)

A display unit for displaying advertisement information or broadcast information;
A photographing unit for photographing the front of the display unit;
An operation detecting means for detecting the operation of the viewer of the display unit based on the imaging result obtained from the imaging unit;
According to the action detected by the action detecting means, the specifying means for specifying the information selected by the viewer among the plurality of information displayed on the display unit;
An information display device comprising:



The information display device according to claim 1, wherein the display unit displays an operation method for the viewer to select information together with advertisement information or notification information.
A receiving unit that receives the advertisement information or the broadcast information, and a storage unit that stores the operation method;
The display section
When the received information does not specify a specific operation method, the operation method stored in the storage unit is displayed,
The information display device according to claim 2, wherein when the received information designates a specific operation method, the specific operation method is displayed instead of the operation method stored in the storage unit.
The information display device according to claim 1, wherein the display unit displays an image of the viewer photographed by the photographing unit together with advertisement information or notification information.
The information display device according to claim 1, wherein the display unit displays an operation method when the motion detection unit cannot detect the viewer's motion.
The information display device according to claim 1, further comprising a voice output unit that outputs the operation method by voice.