JP2010015076A - Display system, display control device, and display control method - Google Patents

Abstract

A display system, a display control apparatus, and a display control method for displaying an image or the like by effectively using a display area configured by arranging a plurality of display apparatuses are provided.
In a display unit configured by arranging a plurality of display devices, a display object that detects the position of a person in the vicinity of the display unit and is displayed by the display device corresponding to a part of the display unit. The display position is determined based on the detected position of the person, the display object is displayed at the determined display position, and when a new position of the person is detected, a new position is determined based on the position of the new person. The display position is determined, and the display object is displayed at the new display position.
[Selection] Figure 1

Description

  The present invention relates to a display system that performs display using a plurality of display devices, a display control device that controls a display state in the display system, and a display control method.

Conventionally, a method of arranging a plurality of display devices to form one large screen is known (see, for example, Patent Document 1). In Patent Document 1, when a multi-display device that functions as a large screen is configured by arranging a plurality of image display units side by side, display data is input to each image display unit. It is disclosed. Such display of a plurality of display devices arranged as a whole on one screen is generally referred to as tiling display. Such a multi-display device is installed on, for example, a wall surface for the purpose of displaying an advertisement.
JP 2001-275137 A

By the way, when an advertisement or the like is displayed using a multi-display device, an image displayed on a normal display device is often enlarged and displayed, and there is no specific display method suited to the multi-display device. Therefore, it has been desired to develop a display method that takes advantage of the characteristics of the multi-display device.
SUMMARY An advantage of some aspects of the invention is that it provides a display system, a display control device, and a display control method that display an image or the like by effectively using a display area configured by arranging a plurality of display devices.

In order to solve the above-described problems, the present invention includes a display unit configured by arranging a plurality of display devices, and display data storage means for storing in advance a display object displayed by the display device corresponding to a part of the display unit. The display position of the display object stored in the display data storage means based on the person position detection means for detecting the position of the person in the vicinity of the display unit and the person position detected by the person position detection means Position determining means for determining, and display control means for reading out the display object stored in the display data storage means and displaying it at the display position determined by the position determining means, wherein the display control means comprises: The position of the person is newly detected by the person position detecting means, and the position determining means determines a new position based on the position of the new person. If Do display position has been determined, to update the display by changing the display position of the display object, to provide a display system characterized.
According to this configuration, since the position of a person in the vicinity of a display unit configured by arranging a plurality of display devices is detected, the display position of the display object is determined based on this position, and display is performed. An advertisement video, various images, etc. can be displayed as a display object in accordance with the position of a person near. For example, for a person near the display unit, a display object can be displayed in the immediate vicinity of the person. In addition, when a person's position is newly detected, the display position of the display object is changed based on the new position and the display is updated, so when a person moves or when the position of another person is detected. The display object can be displayed in accordance with the position of the new person. Therefore, for example, the display position of the display object can be changed so as to follow the moving person.
As described above, according to the present invention, a display area composed of a plurality of display devices is effectively used to make a person near the display unit feel a force or intimacy that cannot be achieved with a normal display screen. A display method can be provided. Thereby, taking advantage of the characteristics of a display unit configured by arranging a plurality of display devices, which is easy to enlarge, it is possible to perform a display rich in interest and impact, for example, when applied to advertising display, Excellent advertising effect can be expected.

In the above configuration, the position determining means selects a number of the display devices suitable for the display size of the display object from the plurality of display devices constituting the display unit, and determines the display position as the display position of the display object. It may be a thing.
In this case, since the number of display devices suitable for the display size of the display object is determined as the display position, processing such as display size conversion and image composition is not required when displaying the display object. As a result, the processing load related to the display can be reduced, so that the display process and the process of updating the display can be executed at high speed, for example, the display position can be changed at high speed.

In the above configuration, the human position detecting means recognizes a human image included in a captured image of the camera that captures a display object displayed on the display unit within a visible range and a human image. Image recognition means for detecting a position and determining a person attribute from the recognized person image, and the display data storage means stores a plurality of display objects respectively associated with the person attribute. The display control means may read out the display object corresponding to the attribute determined by the image recognition means from the display data storage means and display the display object.
In this case, the position of the person is detected by recognizing the person image from the photographed image of the camera, and further, the attribute of the person is determined from the person image and the display object corresponding to this attribute is displayed. It can be detected easily and quickly, and a display object that matches the attribute of the person can be displayed to create a stronger sense of intimacy and interest. Furthermore, for example, when the present configuration is applied to advertisement display, the degree of attention to the advertisement can be increased by using a display object that matches the attribute of the person, and an excellent advertisement effect can be expected.

Further, in the above configuration, a plurality of audio output devices that output audio toward a range where the display object displayed on the display unit can be visually recognized, audio data storage means that stores audio output data in advance, and Audio output for selecting the audio output device to be used based on the display position determined by the position determining means, and outputting audio from the selected audio output device based on the data stored in the audio data storage means And a control means.
In this case, since the sound is output from the sound output device selected based on the display position of the display object, the display and the sound can be output in accordance with the position of the person near the display unit. Thereby, it becomes possible to give a higher level of power, intimacy, and interest, and for example, when this configuration is applied to advertisement display, an excellent advertising effect can be expected.

Furthermore, in the above configuration, the microphone further includes a microphone that detects a voice in the vicinity of the display unit, and a voice identification unit that identifies a content of the voice detected by the microphone, and the voice data storage unit includes the voice identification unit. A plurality of data for voice output corresponding to the contents of the voice identifiable by the means, and the voice output control means based on the data corresponding to the contents of the voice detected by the microphone Sound may be output from the output device.
In this case, the display object is displayed at the display position determined based on the position of the person in the vicinity of the display unit, the content of the sound emitted by the person is identified, and the sound corresponding to the content of the sound is output. Therefore, bidirectional sound output such as outputting sound according to the request of the person becomes possible. Thereby, it becomes possible to give a higher intimacy and interest. For example, when this configuration is applied to advertisement display, an excellent advertisement effect can be expected.

In order to solve the above-described problem, the present invention is a display that is connected to a display unit configured by arranging a plurality of display devices and stores a display object that is displayed by the display device corresponding to a part of the display unit in advance. Data storage means, human position detection means for detecting the position of a person in the vicinity of the display unit, and a display object stored in the display data storage means based on the position of the person detected by the human position detection means Position display means for determining the display position of the display, and display control means for reading out the display object stored in the display data storage means and displaying it at the display position determined by the position determination means, the display control The means detects the position of the person newly by the person position detecting means, and determines the position based on the position of the new person. If a new display position has been determined by means updating the display to change the display position of the display object to provide a display control apparatus according to claim.
According to this configuration, the position of a person in the vicinity of a display unit configured by arranging a plurality of display devices is detected, the display object is displayed at a position determined based on this position, and the position of the person is newly detected. If so, the display object is changed based on the detected position and the display is updated, so display objects such as advertisement images and various images can be displayed according to the position of the person near the display unit, When a person moves or when the position of another person is detected, the display object can be displayed in accordance with the new position. Accordingly, it is possible to provide a new display method that makes it possible for a person in the vicinity of the display unit to feel the force, intimacy, and the like that cannot be achieved with a normal display screen by effectively using a display area including a plurality of display devices. Thereby, taking advantage of the characteristics of a display unit configured by arranging a plurality of display devices, which is easy to enlarge, it is possible to perform a display rich in interest and impact, for example, when applied to advertising display, Excellent advertising effect can be expected.

In order to solve the above problem, the present invention detects a position of a person in the vicinity of a display unit configured by arranging a plurality of display devices, and displays the display unit corresponding to a part of the display unit. The display position of the object is determined based on the detected position of the person, and the display object is displayed at the determined display position. When a new position of the person is detected, the display position of the object is determined based on the position of the new person. Provided is a display control method characterized by determining a new display position and displaying the display object at the new display position.
According to this method, the position of a person in the vicinity of a display unit configured by arranging a plurality of display devices is detected, a display object is displayed at a position determined based on the position, and a position of the person is newly detected. If this happens, the display position of the display object is changed based on the detected position, so display objects such as advertisement images and various images can be displayed according to the position of the person near the display unit. Alternatively, when the position of another person is detected, the display object can be displayed in accordance with the new position. Accordingly, it is possible to provide a new display method that makes it possible for a person in the vicinity of the display unit to feel the force, intimacy, and the like that cannot be achieved with a normal display screen by effectively using a display area including a plurality of display devices. Thereby, taking advantage of the characteristics of a display unit configured by arranging a plurality of display devices, which is easy to enlarge, it is possible to perform a display rich in interest and impact, for example, when applied to advertising display, Excellent advertising effect can be expected.

  According to the present invention, it is possible to effectively use a display area including a plurality of display devices by displaying a display object based on the position of a person in the vicinity of a display unit configured by arranging a plurality of display devices. Thus, it is possible to provide a display that is rich in intimacy, interest and impact.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing a schematic configuration of a display system 1 according to an embodiment to which the present invention is applied.
The display system 1 shown in FIG. 1 includes a display unit 2 configured by arranging a large number of display devices 20 each having a display panel vertically and horizontally. Each display device 20 is individually connected to the display control device 5 via the signal line 11, and the display system 1 is a system that displays an image on the display unit 2 under the control of the display control device 5. Further, the display device 20 has a function of outputting sound, and the sound can be output from each display device 20 under the control of the display control device 5.

A plurality of cameras 30 and microphones 40 are attached to the display unit 2, and the display control device 5 displays on the display device 20 based on the images captured by the cameras 30 and the sounds detected by the microphones 40. The image to be output and the sound output by the display device 20 are controlled.
The camera 30 is configured by, for example, a digital video camera, and starts shooting under the control of the display control device 5, and outputs captured moving image data to the display control device 5 while shooting or at predetermined time intervals. It is also possible to configure the camera 30 with a digital still camera. In this case, the camera 30 captures images according to the control of the display control device 5 and outputs captured still image data to the display control device 5.

A range (area) captured by the camera 30 is an area in which an image displayed on the display unit 2 can be viewed in front of the display unit 2. That is, the camera 30 takes a picture of a person in a place where the display unit 2 can be seen.
The display control device 5 has a function of recognizing and extracting a person image (an image of a human figure) from a photographed image photographed by the camera 30. With this function, the display control device 5 can also recognize a person image in a photographed image of the camera 30 and determine attributes such as the age and sex of the person based on the person image. It is also possible to determine whether or not the display unit 2 is viewed by identifying the face direction of the person.
In addition, when the display unit 2 includes a large number of display devices 20 and has a wide display area, the display unit 2 can be viewed from a considerable distance, but the focal length of the camera 30 in such a case is as follows. For example, it is set so that a person near the display unit 2 can be photographed clearly. This is because it is more effective to target a person close to the display unit 2 when the voice output function by the display device 20 and the display on the display device 20 are linked.
The display system 1 uses all the cameras 30 to capture an area extending in front of the display unit 2 and obliquely in front of the display unit 2 in a range in which an image displayed on the display unit 2 can be satisfactorily viewed. To do. The number of cameras 30 required here is appropriately determined depending on the angle of view of each camera 30, for example, a wide-angle lens with a focal length of 35 to 24 mm, an ultra-wide-angle lens with a focal length of 21 mm or less (both focal lengths are all converted to 35 mm film), Alternatively, the number of cameras 30 can be reduced by using a fisheye lens.

  The microphone 40 is a microphone that collects sound from the front of the display unit 2 and converts it into an analog electric signal. The analog electric signal is input to the display control device 5.

2 shows the configuration of the display device 20, FIG. 2A is a front view, and FIG. 2B is a longitudinal sectional view.
As shown in FIGS. 2A and 2B, the display device 20 is configured by housing each part in a rectangular parallelepiped frame 21 having a predetermined depth, and a transparent front panel 22 is fitted in the frame 21. In the back of the front panel 22, a display panel 23 for displaying an image, a backlight 24 for illuminating the display panel 23, and a control board 25 are accommodated.
The display panel 23 is, for example, a transmissive liquid crystal display panel that includes a color filter, a polarizing plate, and the like and is driven by a drive circuit 213 (FIG. 3) described later to display images (including still images and moving images). . The backlight 24 is a lighting device that irradiates light from the back surface of the display panel 23 so that an image displayed on the display panel 23 can be visually recognized. And a diffusion plate for irradiating light evenly.

The control board 25 is a board on which a control unit 200 (FIG. 3) that controls the operation of the display device 20 is mounted.
A plurality of vibrators 26 are attached to the back surface of the front panel 22. The vibrator 26 is an element that vibrates the front panel 22 by generating vibration according to an audio signal. By vibrating the front panel 22 with the vibrator 26, the front panel 22 functions in the same manner as a diaphragm of a speaker and outputs sound. That is, the front panel 22 and the vibrator 26 cooperate to function as an audio output device.

FIG. 3 is a functional block diagram showing the configuration of each part of the display system 1.
The display device 20 includes a control unit 200 mounted on the control board 25 (FIG. 2B). The control unit 200 is executed by the CPU 201 and the CPU 201 that execute various programs to realize various functions of the display device 20. ROM 202 that stores the program and data related to the program, RAM 203 that temporarily stores the program and data, etc., non-volatile memory 204 that stores ID unique to the display device 20, setting information related to the operation of the display device 20, and the like, The interface (I / F) unit 205 is connected to the display control device 5 through the signal line 11, and these units are connected to each other through a bus 206.
The ID stored in the non-volatile memory 204 is information unique to each display device 20 constituting the display unit 2, and may include information indicating the position of each display device 20 in the display unit 2.

In addition, the control unit 200 is connected to the bus 206 and draws an image to be displayed on the display panel 23 according to the control of the CPU 201, a drawing memory 212 that holds an image drawn on the image processing unit 211, A drive circuit 213 for displaying an image drawn by the image processing unit 211 on the display panel 23, and the drive circuit 213 is connected to the display panel 23.
The control unit 200 further includes an audio processing unit 221 that is connected to the bus 206 and generates an audio signal under the control of the CPU 201 and outputs the audio signal to the vibrator 26. The vibrator 26 generates vibration based on the audio signal input from the audio processing unit 221, and outputs audio based on the audio signal from the front panel 22.

  When image data is input from the display control device 5 connected via the signal line 11, the display device 20 performs drawing by the image processing unit 211 based on the image data, and displays an image on the display panel 23. . This image may be a moving image or a still image. Further, when audio data is input from the display control device 5, the display device 20 generates an audio signal by the audio processing unit 221 based on the input data, and vibrates the front panel 22 by the vibrator 26. Thus, sound is output from the front panel 22 as a speaker.

  On the other hand, the display control device 5 temporarily executes various programs to realize various functions of the display control device 5, a program executed by the CPU 51, a ROM 52 storing data related to the programs, programs and data, etc. The RAM 53, the input unit 54 for detecting an input operation in an input device such as a keyboard and a mouse, and outputting an operation signal corresponding to the input operation to the CPU 51, and the processing result by the CPU 51 are displayed on a display screen (not shown). The display unit 55 is connected to each other via a bus 50.

Further, the display control device 5 includes an interface unit 56, an image input unit 57, an audio input unit 58, and a communication interface unit 59 as interfaces connected to external devices. These interfaces are connected to the bus 50 and interconnected to the CPU 51.
A plurality of display devices 20 are connected to the interface unit 56, and the interface unit 56 transmits and receives various data to and from each display device 20 under the control of the CPU 51.
A plurality of cameras 30 attached to the display unit 2 are respectively connected to the image input unit 57, and data of captured images (hereinafter referred to as “captured image data”) captured by these cameras 30 is input and input. The captured image data is output to the CPU 51. The image input unit 57 controls the start / stop of the operation of the camera 30 according to the control of the CPU 51.
The audio input unit 58 is connected to each of the plurality of microphones 40 attached to the display unit 2, converts an analog electric signal input from the microphone 40 into digital data, and outputs the digital data to the CPU 51.
The communication interface unit 59 is connected to a network 12 such as the Internet via an external communication line, and receives various types of information from an external server device (not shown) via the network 12 under the control of the CPU 51.

The display control device 5 includes a storage unit 6 configured by a magnetic recording medium, a semiconductor memory element, or the like, and stores a program and data for controlling the display system 1 in the storage unit 6.
The storage unit 6 includes, as programs executed by the CPU 51, an initial setting program 61 for performing initial settings for controlling the display system 1, arrangement information 62 indicating the arrangement state of the display device 20 in the display unit 2, and the display unit 2 stores a display control program 63 for controlling image display and audio output.
The storage unit 6 also includes a display data storage area 64 (display data storage means) for storing image data displayed on the display device 20 and an audio data storage for storing data for outputting audio from the display device 20. It has area 65 (voice data storage means).
Further, the storage unit 6 stores an attribute correspondence table 66 for determining image data to be displayed on the display device 20 and an audio correspondence table 67 for determining audio data output from the display device 20.

The CPU 51 executes the initial setting program 61 to detect the operation state of each display device 20 constituting the display unit 2, the number of display devices 20, the number and operation states of the camera 30 and the microphone 40, and the like. Information for controlling the system 1 is acquired. Further, the CPU 51 initializes the operation states of the display device 20, the camera 30, and the microphone 40 by executing the initial setting program 61.
When the initial setting program 61 is executed, the CPU 51 acquires a unique ID for each display device 20 from all the display devices 20 constituting the display unit 2 and detects the arrangement state of the display device 20 in the display unit 2. Then, using the ID of each display device 20, the arrangement information 62 that specifies the position of each display device 20 is generated and stored.

As will be described later, the arrangement information 62 is used for the CPU 51 to identify each display device 20 and its position so as to control display and sound output on each display device 20.
The CPU 51 identifies each display device 20 constituting the display unit 2 based on the arrangement information 62, generates display data of an image to be displayed on each display device 20 based on the position of each display device 20, and generates The display data is sent to the display device 20 specified based on the ID included in the arrangement information 62 via the signal line 11. The same applies to audio. When audio is output by a specific display device 20, audio data to be output to the display device 20 is transmitted via the signal line 11 based on the ID included in the arrangement information 62. And send it out.

Thereafter, the CPU 51 executes the display control program 63 to perform display control processing.
In this display control process, the CPU 51 acquires captured image data input from the camera 30, recognizes a person image in the captured image, and determines an image and sound to be output to the recognized person. Further, the CPU 51 determines the display device 20 to be output from the display devices 20 constituting the display unit 2 in order to output an image and sound from a position close to the position of the recognized person. And CPU51 outputs the image and audio | voice corresponding to the person recognized in the picked-up image by the determined display apparatus 20. FIG. When the voice of the target person is detected by the microphone 40 during the output of the image and the sound, the CPU 51 specifies the content of the detected sound and outputs the sound corresponding to the specified content. Output instead of the voice inside.

FIG. 4 is a diagram schematically showing the configuration of the storage area of the storage unit 6, FIG. 4A shows the configuration of the display data storage area 64, and FIG. 4B shows the configuration of the audio data storage area 65.
In the display data storage area 64, a plurality of display objects are stored in association with their display sizes. These display objects are images (moving images or still images) that can be displayed by one or a plurality of display devices 20 constituting a part of the display unit 2, and are, for example, images of a substantially life-size person. The display control device 5 displays a display object using a part of the display devices 20 among the many display devices 20 constituting the display unit 2. In addition, it is possible to display a plurality of display objects at the same time on one display unit 2, and in this case, control may be performed so that the display objects do not overlap each other.
The display size associated with each display object is information indicating the number of display devices 20 necessary to display the display object. For example, the display size spans six display devices 20 of 3 vertical × 2 horizontal. The display size of the display object displayed is expressed as “3 × 2”.
In the audio data storage area 65, a plurality of audio objects are stored. Each sound object is sound data of sound output from the display device 20, and the length of the reproduction time may be different for each sound object, or may be the same. The display control device 5 can also simultaneously output sound based on one sound object from the plurality of display devices 20.

Here, the data format of the display object stored in the display data storage area 64, the data format of the audio object stored in the audio data storage area 65, and the like are arbitrary.
The sound object stored in the sound data storage area 65 may be sound data itself obtained by digitizing sound, or may be information for the CPU 51 to synthesize the sound data. That is, the voice output from the display device 20 by the CPU 51 is synthesized each time, and the synthesized voice data is output to the display device 20. The voice data storage area 65 has waveform data for synthesizing the voice data. Or a dictionary file or the like may be stored.

  Furthermore, the display object stored in the display data storage area 64 and the audio object stored in the audio data storage area 65 are not limited to data stored in advance in the display control device 5, for example, under the control of the CPU 51. It may be downloaded from an external server device (not shown) from the communication interface unit 59 via the network 12. In this case, the display object and the sound object can be updated, and a new display object and sound object can be acquired and output. Therefore, a more interesting display can be performed. Further, when an advertisement is output by the display system 1, there is an advantage that the display control device 5 can quickly acquire information for performing an advertisement related to the latest product or service. In addition, for example, when the latest information is always requested as a sound object such as when outputting a weather forecast sound as described later, the latest information is acquired via the network 12 under the control of the CPU 51. Then, it may be stored in the audio data storage area 65.

FIG. 5 is a diagram schematically showing the configuration of the table stored in the storage unit 6, FIG. 5A shows the configuration of the attribute correspondence table 66, and FIG. 5B shows the configuration of the audio correspondence table 67.
In the attribute correspondence table 66 shown in FIG. 5A, the appearance attributes of a person photographed by the camera 30, display objects displayed for the person, and sound objects output for the person are displayed. Correspondence is set.
The appearance attribute is an attribute that can be identified by the display control device 5 by analyzing the captured image captured by the camera 30. In the present embodiment, the attribute is determined by the generation (age) and gender determined based on the appearance. is there.
The display control device 5 recognizes the image of the person shown in the photographed image of the camera 30, the characteristics of the person's image, and the characteristics of the person image for each generation and sex (stored in the storage unit 6 in advance) ( The age and gender of the person is determined by collating with (not shown). Based on the attribute correspondence table 66, a display object and a sound object to be output to the person are determined.

Also, in the audio correspondence table 67 shown in FIG. 5B, the correspondence between the audio content detected by the microphone 40 and the audio object is set. For example, the sound object I corresponds to the sound requesting “weather forecast”, and the sound object J corresponds to the sound requesting “details of the advertisement product”.
The display control device 5 analyzes the audio detected by the microphone 40 attached to the display unit 2, recognizes it in the captured image of the camera 30, and displays the image set in the attribute correspondence table 66. Extract sound from the direction. When the extracted audio content corresponds to any of the contents set in the audio correspondence table 67, the display control device 5 reads out the audio object set in the audio correspondence table 67 and has already described the above. Instead of the sound being output to the person, the sound is output from the display device 20.

FIG. 6 is a flowchart showing the operation of the display system 1, and particularly shows the operation of the display control device 5.
When the operation shown in FIG. 6 is executed, the CPU 51 of the display control device 5 functions as a position determination unit, a display control unit, an image recognition unit, a voice output control unit, and a voice identification unit.
The display control device 5 performs initial setting based on the initial setting program 61 with the start of the operation of the display system 1, and then performs shooting by the camera 30, voice detection by the microphone 40, and display control processing based on the display control program 63. Is started (step S11).
Subsequently, the display control device 5 performs a process of recognizing a person image in the photographed image input from the camera 30 and detects a person image in the photographed image (step S12). In the process of step S12, the display control device 5 individually analyzes the captured images input from each of the plurality of cameras 30 to detect a person image and specifies an overlapping portion of the captured images of each camera 30. Thus, processing is performed so as not to detect the same person image repeatedly.

The display control device 5 determines whether or not a person image is detected from the captured image (step S13). If no person image is detected (step S13; No), the process returns to step S12 to detect the person image. If so (step S13; Yes), it is determined whether or not the person image is an image of a person that has already been detected (step S14).
If the person image detected in step S12 has not been detected at that time (step S14; No), the display control device 5 determines the attribute of the person based on the detected person image (step S14). S15), the display object and the sound object corresponding to the attribute determined with reference to the attribute correspondence table 66 (FIG. 5A) are specified, and the determined display object is read from the display data storage area 64 (step S16), and the process proceeds to step S17. Transition.

On the other hand, when the person image detected in step S12 is an image detected when the process of step S12 was performed before (step S14; Yes), the display control device 5 directly proceeds to step S17. . In this case, since the display control device 5 has already read the display object corresponding to the attribute determined from the person image from the display data storage area 64, the display control device 5 continues to display this display object.
Further, at the time when the determination of step S14 is first performed after the start of the display control process, it does not correspond to the detected person image, so that the process proceeds to step S17 after performing the processes of step S15 and step S16.

In step S <b> 17, the display control device 5 determines the display position based on the display size of the display object in order to display the display object corresponding to the detected person image at a position close to the person image.
In step S17, the display control device 5 selects the number of display devices 20 that matches the display size of the display object. For example, when the display size of the display object is “3 × 2” (vertical 3 × horizontal 2), the closest to the position where the person image is detected in step S12, 6 × 3 × 2 Display device 20 is selected and determined as the display position. The number of display devices 20 selected here may be the same as the display size as long as it matches the display size of the display object, or the same number as the display size enlarged or reduced at a predetermined magnification. May be. In this case, the size is preferably enlarged or reduced so that the aspect ratio of the display object is maintained. For example, in the above example, the display object whose display size is “3 × 2” is 6 × 4 It is possible to select one display device 20.
Subsequently, the display control device 5 transmits an image for displaying the display object to the display device 20 determined as the display position, and displays the display object (step S18).

Next, the display control device 5 determines whether or not a voice of a person from the position of the person image detected in step S12 is detected by the microphone 40 (step S19). In this step S19, when the person of the person image inputs an instruction or the like by voice, this voice is detected.
If no corresponding sound is detected (step S19; No), the sound object specified in step S16 is read from the sound data storage area 65 (step S20), and the process proceeds to step S23. When the voice from the position of the person image or the vicinity thereof is detected (step S19; Yes), the display control device 5 identifies the contents of the voice (step S21), and the voice correspondence table 67 (FIG. 5B). An audio object corresponding to the audio content identified based on the audio content is identified, and the audio object is read from the audio data storage area 65 (step S22), and the process proceeds to step S23.
In step S23, the display control device 5 generates audio data for reproducing the audio object, and transmits the generated audio data to the display device 20 that displayed the display object in step S18. Audio is output from 20.
Thereafter, the display control device 5 determines whether or not the end of the display control process has been instructed (step S24). If the end has not been instructed, the process returns to step S12. The process ends according to the instruction.

According to the process shown in FIG. 6, when the figure of the person in front of the display unit 2 is photographed by the camera 30, an image of this person is detected (step S12), and based on the detected image, The attribute of the person is determined (step S15). The attribute determined here is an apparent attribute that can be determined from the image. Then, the display control device 5 reads the display object corresponding to the attribute of the person (step S16), and the display device 20 closest to the position of the person displays the display object (steps S17 to S18). .
While the processes in steps S12 to S24 in FIG. 6 are repeatedly executed, the person in front of the display unit 2 is photographed several times by the camera 30, and a person image is detected each time (step S12). It is determined that the image of the person has been selected (step S14; Yes), and no new attribute determination is performed. In this case, the display object previously read based on the attribute of the person is displayed on the display device 20 close to the position of the person photographed this time. Accordingly, when the person moves in front of the display unit 2, the display device 20 near the position of the person when photographed by the camera 30 is determined as the display position, and a display object is displayed on the display device 20. Is done.
That is, when the person moves in front of the display unit 2, the display position of the display object is changed according to the position of the person, so the display position of the display object is changed so as to follow the movement of the person. be able to. Thereby, it is possible to perform display such that the display object moves according to the person.

  As described above, according to the display system 1 according to the embodiment to which the present invention is applied, the position of a person in the vicinity of the display unit 2 configured by arranging a plurality of display devices 20 is detected, and based on the position of the person. Thus, the display position of the display object can be determined, and an advertisement video or various images can be displayed as the display object. In addition, when a person's position is newly detected, the display position of the display object is changed based on the new position and the display is updated, so when a person moves or when the position of another person is detected. The display object is displayed in accordance with the position of the new person. Therefore, for example, the display position of the display object can be changed so as to follow the moving person. Therefore, by effectively using the display area of the display unit 2 that it is easy to enlarge the screen, a person near the display unit 2 feels a force or intimacy that cannot be achieved with a normal display screen. A new display method that is rich in performance and impact can be provided. For example, if it is applied to advertisement display, an excellent advertisement effect can be expected.

Here, since the number of display devices 20 suitable for the display size of the display object is selected as the display position, processing such as display size conversion and image composition is not required when displaying the display object. As a result, the processing load related to the display can be reduced, so that the display process and the process of updating the display can be executed at high speed. For example, the display position can be changed at high speed.
Then, the position of the person is detected by recognizing the person image from the photographed image of the camera 30, and further, the age group and gender are determined as the person attribute from the person image, and the display object corresponding to this age group and gender is displayed. Since it is displayed, the position of the person can be detected easily and quickly, and furthermore, a display object associated with the attribute of the person is displayed, and sound is also generated based on the sound object associated with the attribute of the person. Is output. This creates a strong sense of intimacy and interest. Furthermore, for example, when this configuration is applied to advertisement display, advertisements for products and services that match the person's attributes, advertisements using display objects and audio objects for specific age groups and genders, etc. By doing so, the degree of attention to the advertisement can be increased, and an excellent advertising effect can be expected.
In the operation of FIG. 6, a sound object corresponding to the attribute of the person is read, and the sound of the sound object is output from the display device 20 specified as the display position of the display object. Accordingly, it is possible to output the display and sound in conjunction with each other, and when the person moves in front of the display unit 2, the sound output position can be changed so as to follow the movement of the person.

  Furthermore, based on the audio content detected by the microphone 40, the audio object corresponding to the audio content is selected and the audio object audio is output. For example, when the weather forecast is obtained by audio, If the weather forecast voice is output and the voice indicates that no advertisement is required, the voice output can be silenced. As described above, by outputting sound corresponding to the sound of the person in front of the display unit 2, it becomes possible to give a higher intimacy and interest, for example, when this configuration is applied to advertisement display Can expect excellent advertising effect.

FIG. 7 is a diagram illustrating a usage example of the display system 1.
The usage example of FIG. 7 is an example in which the display unit 2 configured by arranging the display devices 20 of 6 rows × 10 rows is arranged on a wall surface of a passage or a building room, for example. In this example, an image of a person is displayed as a display object on the display device 20 constituting a part of the display unit 2, and a display form in which this person talks to a person in front of the display unit 2 is realized. The display unit 2 is installed so that the lower end of the display unit 2 is below a predetermined height from the passage where a person walks and the floor of a living room. It is arranged to perform.
In the example of FIG. 7, when there is a person (symbol P) standing in front of the display unit 2, the display object Q is displayed on the display device 20 close to the person P. The display object Q in this example is a human-type image displayed on eight display devices 20 having 4 columns × 2 columns.

Here, when the person P moves in the direction indicated by the arrow M in the figure, the display position of the display object Q is also indicated by the arrow in accordance with the position of the person P detected during or after the movement of the person P. Move in the direction of M. For this reason, it is possible to display such that the display object Q of the person's figure moves close to the person P.
Then, the sound of the sound object corresponding to the display object Q is output from the display device 20 displaying the display object Q in the display unit 2, and when the display position of the display object Q moves, Sound is output from the display device 20 that is the display position. That is, the display unit 2 can realize the same action as moving the speaker following the movement of the person P by switching the display device 20 that outputs sound.

  The display by the display system 1 can be used, for example, for advertisement of products. For example, instead of a still image of a humanoid character as a display object Q, a moving image in which a product is explained by talking to a person P is used to explain the product from the display device 20 displaying the display object Q. It is conceivable to use an audio object consisting of audio. In this case, the advertisement is performed while the display position of the display object and the output position of the sound are moved according to the position of the person P. Therefore, unlike the conventional advertisement, the distance to the person who sees the advertisement is close and a sense of familiarity is achieved. It is possible to pay attention to the content of the advertisement, and to make an advertisement rich in interest.

In the display system 1, when a person image of a person in the vicinity of the display unit 2 is detected from a captured image of the camera 30, an attribute is determined from the person image, that is, the appearance, and a display object corresponding to the attribute Output an audio object. As a specific application example, for example, a display object consisting of an image of a young woman is displayed for a person determined to be a young man from a person image, and the voice of this woman is output as an audio object. An example of outputting an image and sound of an elderly man is given to a person determined to be a woman.
Furthermore, when the display system 1 is applied to an advertisement, as illustrated in FIG. 5A, an age group and a gender are determined as attributes from a person image, and an advertisement for a product or service corresponding to the age group and gender is displayed as a display object and If it is output as a sound object, the person who sees and listens to the advertisement matches the target sex and target age group of the advertised product or service, so that an excellent advertising effect can be expected. In addition, for those who see and listen to advertisements using the display system 1, there is no sense of discomfort or discomfort due to the display of irrelevant advertisements. Knowing the products and services related to their age and gender is an intellectual curiosity. Can be satisfied and enjoyed.

Further, in the operation of FIG. 6, the sound from the position where the person image is detected is acquired by the microphone 40, the content is analyzed by analyzing the sound, and if this sound gives some instruction, A sound object corresponding to the content is output. For example, according to the voice correspondence table 67 shown in FIG. 5B, when the person P in front of the display unit 2 utters a voice requesting a weather forecast, the voice object I is selected, and the person P details the advertising product. The voice object J is selected when the voice requesting the voice is issued, and the voice object K is selected when the voice of the person P calling for the advertisement of another product is issued.
Here, if the voice data storage area 65 stores the sound of the weather forecast as the sound object I (sound explaining the weather overview, the weather of the current day or the next day, the probability of precipitation, etc.), Audio can be output. Moreover, if the audio | voice object J memorize | stores the audio | voice explaining the detailed information regarding goods, the detail of goods can be demonstrated according to the request | requirement of the person P, and the more excellent advertising effect can be anticipated.

Further, when the sound object K is selected, the advertisement sound object K itself stored in the sound data storage area 65 may be output. However, in reality, a sound object called the sound object K is not prepared. The audio object K may be processed as a kind of command. In this case, when the sound object K is selected, the display control device 5 selects a sound object other than the sound object currently being output from the other sound objects A to H.
Further, in the example of FIG. 5B, when a voice expressing that no advertisement is required is detected as the voice of the person P, silent voice data is selected as the voice object to be output, and the voice output from the display device 20 is performed. Is stopped. In this case, there is an advantage that information on products and services can be provided only to those who are interested in the content of the advertisement without giving discomfort to those who dislike the advertisement.

As described above, the display system 1 outputs the display object and the sound object toward the person in the vicinity of the display unit 2, detects the sound of the person with the microphone 40, and based on the content of the sound. The audio object can be changed or the audio output can be stopped. As a result, the display system 1 can provide information interactively with a person in the vicinity of the display unit 2, so that it can function as a highly convenient information providing medium, as well as a product or service. If you advertise, you can expect an excellent advertising effect.
In addition, based on the content of the sound detected by the microphone 40, not only the sound object but also a display object may be newly selected and changed from the displayed display object. In this case, more information can be provided interactively in a more interesting manner.

Further, the operation of FIG. 6 is not limited to only one person, and a plurality of display objects can be displayed on the display unit 2 so as to correspond to each of the plurality of persons.
That is, when human images of a plurality of persons are detected from images taken by the camera 30 (step S12), the display control device 5 determines whether or not each person image has been detected independently (step S12). S14) The attribute is determined (step S15), the display object corresponding to the determined attribute is read (step S16), the display position is determined (step S17), and the display object is displayed (step S18). In this case, for a plurality of persons, display objects corresponding to the attributes of the persons are displayed at display positions corresponding to the positions of the persons.

  For example, in the usage example of FIG. 7, one display object Q is displayed for one person P. However, if there is another person, another display object is displayed on the display device 20 close to that person. Can be displayed. In a state where a plurality of display objects are displayed on the display unit 2, the positions of the respective display objects are independently changed so as to follow the movement of the target person. At this time, a plurality of display objects are displayed near each person's position, and sound is also output from the display device 20 near each person. Therefore, display objects and sounds directed to other persons are in the way. There is nothing. Thereby, information can be provided to a plurality of people in a form having a strong impact by utilizing a wide display area of the display unit 2 configured by arranging a plurality of display devices 20 side by side.

  Here, the CPU 51 reads out the display object stored in the display data storage area 64, selects the number of display devices 20 equal to the display size of the display object as the display position, and displays the display object on the selected display device 20. indicate. For this reason, since processing such as conversion of the display size of the display object read from the display data storage area 64 and image composition are not required, the processing load related to display can be reduced. Therefore, the display update process associated with the display of the display object and the change of the display position can be performed at high speed. For example, the display position can be changed quickly following the movement of a person. In addition, when a plurality of display objects are displayed corresponding to a plurality of people, the display can be smoothly performed without causing a delay in processing or a reduction in image quality. Even if the number of display devices 20 selected as the display position is the number when the display size of the display object is enlarged or reduced while maintaining the aspect ratio of the display object, for example, it is light as described above. Display and display updates can be performed under load.

In the above embodiment, the configuration in which the camera 30 and the microphone 40 are arranged at the upper end of the display unit 2 has been described as an example. However, the present invention is not limited to this, and a part or all of the display devices 20 are arranged. The camera 30 and the microphone 40 may be arranged in the frame 21. In this case, furthermore, in this configuration, the captured image data of the camera 30 included in the display device 20, the audio signal of the sound detected by the microphone 40, and the like may be input to the display control device 5 through the signal line 11. In this case, there are advantages that the number of cables connecting between the display unit 2 and the display control device 5 can be reduced, and that each camera 30 and microphone 40 can be identified based on the arrangement information 62. .
Furthermore, in the above-described embodiment, the configuration in which sound is output by vibrating the front panel 22 included in the display device 20 by the vibrator 26 has been described. However, the present invention is not limited to this, and the vibrator 26 includes Instead, a normal speaker that outputs sound may be provided in the frame 21. In addition, a plurality of loudspeakers with high directivity may be provided on the upper portion of the display unit 2 and a drive mechanism for changing the direction of the loudspeakers may be provided to output sound toward a position where a person is present. 5 selects a speaker that outputs sound and performs processing for controlling the direction of the speaker.
Of course, the camera 30, the microphone 40, and the speaker described above are not limited to the display unit 2, and can be installed at a location away from the display unit 2 in the space where the display unit 2 is installed.
Furthermore, as the display panel 23 included in the display unit 2, a display panel using an organic EL element, a plasma display panel, or the like can be used. When a self-luminous display panel is used as described above, a back panel is used. A configuration in which the light 24 is eliminated may be employed, and other specific detailed configurations of the display system 1 may be arbitrarily changed.

It is a figure which shows schematic structure of the display system which concerns on embodiment. It is a figure which shows the structure of a display apparatus. It is a functional block diagram which shows the structure of each part of a display system. It is a figure which shows typically the structure of the storage area which the memory | storage part of a display control apparatus has. It is a figure which shows typically the structure of the table memorize | stored in the memory | storage part. It is a flowchart which shows operation | movement of a display system. It is a figure which shows the usage example of a display system.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Display system, 2 ... Display unit, 5 ... Display control apparatus, 6 ... Memory | storage part, 20 ... Display apparatus, 22 ... Front panel (audio | voice output device), 23 ... Display panel, 25 ... Control board, 26 ... Vibrator (Voice output device), 30 ... camera, 40 ... microphone, 51 ... CPU (position determining means, display control means, image recognition means, voice output control means, voice identification means), 57 ... image input unit, 58 ... voice input 64: Display data storage area (display data storage means), 65 ... Audio data storage area (audio data storage means), 200 ... Control section, 201 ... CPU, 211 ... Image processing section, 212 ... Drawing memory, 213 ... Drive circuit, 221... Audio processing unit.

Claims (7)

A display unit configured by arranging a plurality of display devices;
Display data storage means for storing in advance a display object displayed by the display device corresponding to a part of the display unit;
Human position detecting means for detecting the position of a person in the vicinity of the display unit;
Position determining means for determining the display position of the display object stored in the display data storage means based on the position of the person detected by the person position detecting means;
Display control means for reading the display object stored in the display data storage means and displaying the display object at the display position determined by the position determination means,
When the position of the person is newly detected by the person position detecting means and a new display position is determined by the position determining means based on the position of the new person, the display control means Changing the display position to update the display,
A display system characterized by The position determining means selects a number of the display devices suitable for the display size of the display object from the plurality of display devices constituting the display unit, and determines the display position as the display object;
The display system according to claim 1. The human position detection means, a camera for photographing a display object displayed on the display unit in a visible range;
Image recognition means for detecting a person's position by recognizing a person image included in a photographed image of the camera and determining a person's attribute from the recognized person image;
The display data storage means stores a plurality of display objects each associated with an attribute of a person,
The display control means reads out the display object corresponding to the attribute determined by the image recognition means from the display data storage means and displays the display object;
The display system according to claim 1, wherein: A plurality of sound output devices that output sound toward a visible range of a display object displayed on the display unit;
Audio data storage means for storing audio output data in advance;
A sound for selecting the sound output device to be used based on the display position determined by the position determining means and outputting sound based on the data stored in the sound data storage means from the selected sound output device. Output control means;
The display system according to claim 1, further comprising: A microphone for detecting voice in the vicinity of the display unit; and voice identification means for identifying the content of the voice detected by the microphone,
The voice data storage means stores a plurality of data for voice output corresponding to the contents of voice identifiable by the voice identification means,
The audio output control means, based on data corresponding to the content of audio detected by the microphone, to output audio from the audio output device;
The display system according to claim 4. It is connected to a display unit configured by arranging a plurality of display devices,
Display data storage means for storing in advance a display object displayed by the display device corresponding to a part of the display unit;
Human position detecting means for detecting the position of a person in the vicinity of the display unit;
Position determining means for determining the display position of the display object stored in the display data storage means based on the position of the person detected by the person position detecting means;
Display control means for reading the display object stored in the display data storage means and displaying the display object at the display position determined by the position determination means,
When the position of the person is newly detected by the person position detecting means and a new display position is determined by the position determining means based on the position of the new person, the display control means Changing the display position to update the display,
A display control device. Detecting the position of a person in the vicinity of a display unit configured by arranging a plurality of display devices,
Determining a display position of a display object displayed by the display device corresponding to a part of the display unit based on the position of the detected person;
While displaying the display object at the determined display position,
When a new person position is detected, a new display position is determined based on the new person position, and the display object is displayed at the new display position.
A display control method characterized by the above.

Images