JP2019068384A - Video voice management device for screening video and voice and screening system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable exclusive viewing of audio of a video desired by each viewer so that other viewers cannot hear it while simultaneously displaying a plurality of video contents in the same room. To obtain a video and audio system that can immediately switch to the changed audio. A video / audio management apparatus 100 includes a video information output unit 110 for outputting the video information to a plurality of video display devices 20a to 20c for simultaneously displaying a plurality of different videos, and the video information. And a voice information output unit 120 that outputs the voice information synchronized with each other so as to be switchably received by the plurality of wireless headphones 50a to 50k lent to the user. [Selection diagram] FIG.

Description

  The present disclosure relates to an AV (Audio-Visual) system, and more particularly to a video and audio management apparatus and a screening system for screening video and audio.

  In recent years, with the progress of digitization of video data, it is general to use a movie with a resolution as high as that of digitized HDTV received from a server for distributing video without using a film, and to perform movie screening on a relatively large screen It has become a target. In addition, the cinema complex, which has recently been generalized as a movie screening facility, is a complex movie theater having a plurality of screens in one building, and often has not only a movie theater but also other facilities such as a restaurant. Simultaneous screening of different works on multiple screens and multiple simultaneous screenings of popular movies are also possible.

  However, even with the cinema complex, screening times and works are predetermined, and it is not possible for an individual to always watch favorite works whenever they like it, and it becomes annoyance to surrounding customers when children cry in the hall . On the other hand, Patent Document 1 discloses a theater system for private use as a means for watching a movie without hesitation to the surroundings with only an individual or a companion. In the theater system described in Patent Document 1, the theater function is realized in a karaoke facility or at home by receiving the distribution of the video content accumulated in the content server.

  Also, according to Patent Document 2, when distributing a video to such a theater system, the type of movie to be distributed and the number of screening places to be a distribution destination according to the situation of reservation or request from a customer The technology for setting up and delivering is disclosed. In the video delivery system described in Patent Document 2, the center equipment side collects and automatically performs projection delivery device setting, schedule screening, screening status confirmation, etc., which are conventionally performed individually in a plurality of screening halls. ing. That is, in the center facility, the above-described work is collectively performed by the center facility according to the result of collecting customer reservations and requests from a plurality of screening places.

JP, 2005-142636, A JP 2002-304490 A

  The theater system for private use disclosed in Patent Document 1 receives the distribution of video content as a means to enjoy movies without hesitation to the surroundings with only individuals and friends, and realizes theater functions in karaoke facilities and homes. doing.

  However, also in the theater system disclosed in Patent Document 1, a plurality of video contents are simultaneously screened in separate theater rooms, as in the case of a conventional cinema complex. Therefore, the following problems peculiar to simultaneous screening of a plurality of video contents in the same theater room can not be solved.

  That is, even if a plurality of viewers try to view different video content according to their preferences, the audio for each video is mixed with each other in the same room and can not be heard clearly. Therefore, without making the audio of video content being viewed by a plurality of viewers in the same room mixed with each other, each viewer exclusively listens to each other so that the audio of the video desired to be viewed can not be heard by another person A device that can do that is necessary.

  Moreover, according to Patent Document 2, in the center facility, in accordance with the result of collecting customer reservations and requests from a plurality of screening places, equipment setting and screening frame allocation tasks individually performed in each movie theater are collectively performed. And run on center equipment. On the other hand, the viewer may want to switch from the video content currently being viewed to another video content for viewing among a plurality of video contents being simultaneously screened in the same theater room.

  Therefore, not only the viewers can mutually exclusively listen to the audio of the video content being viewed, but the following measures are required. That is, when the video content to be viewed by each viewer is switched, according to the technology described in Patent Document 2, the audio of the video is changed to the voice after the change in real time in synchronization with changing the video content to be viewed halfway. You can not realize the function you can switch to and listen to.

  As described above, in Patent Documents 1 and 2, when a plurality of video contents are simultaneously screened in the same room, each viewer exclusively listens to each other so that the audio of the video desired to be viewed can not be heard by another person. It does not disclose about the mechanism that makes it possible. Further, Patent Documents 1 and 2 disclose a technology for realizing a function that can switch audio in real time to audio after change and listen in real time when video content to be viewed by each viewer is switched. Absent.

  Therefore, in view of such circumstances, when a plurality of video contents are simultaneously screened in the same room, it is possible to exclusively view so that the audio of the video each viewer wants to view can not be heard by others. It is an object of the present invention to provide a video and audio management apparatus and a screening system. Another object of the present disclosure is to provide a video and audio management apparatus and a screening system that can switch the audio of video to the audio after change in real time and listen to the audio in accordance with the change of video content to be viewed. .

  In order to achieve the above object, a video and audio management device according to a first aspect of the present disclosure outputs video information to a plurality of video display devices for respectively screening a plurality of different videos simultaneously. The apparatus is characterized by comprising: an output unit; and an audio information output unit that outputs audio information synchronized with the video information so that the audio information can be switchably received by the plurality of wireless headphones lent to the user.

  In order to achieve the above object, a screening system according to a second aspect of the present disclosure includes: a plurality of video display devices for displaying and screening a plurality of different videos simultaneously on a plurality of screens; The video information output unit for outputting the video information to the video display device, and the audio information synchronized with the video information are wirelessly transmitted so that they can be switchably received by the plurality of wireless headphones loaned to the user An authentication charge for authenticating the user and charging the user to a voice information output unit, an internal space provided with a plurality of the screens along the inner wall surface, and a user who receives a loan of wireless headphones And a processing unit.

  According to the present disclosure, when a plurality of video contents are simultaneously screened in the same room, each viewer listens to the audio of the video through the wireless headphones. Therefore, according to the present disclosure, each viewer can exclusively view and listen to the sound of the video desired to be viewed so as not to be heard by another person. Further, according to the present disclosure, each viewer can switch the audio of the video to the changed audio using the wireless headphone. Therefore, according to the present disclosure, it is possible to switch the audio of the video to the audio after the change in real time and to listen in conjunction with the change of the video content to be viewed.

It is a figure which shows the external appearance seen from the bird's-eye view of the screening system which concerns on 1st Embodiment. It is a figure which shows the structural example of the audio-video management apparatus in the show system which concerns on 1st Embodiment. It is a figure which shows the synchronization and information exchange via the synchronous control part between the function parts which comprise an audio-video management apparatus. It is a figure which shows the processing flow at the time of transmitting an image | video and an audio | voice to each viewer under control of a synchronous control part. It is a figure which shows the processing flow at the time of collecting for analysis the information regarding the audience in image viewing and listening. It is a block diagram which illustrates the apparatus structure of the screening system which concerns on 2nd Embodiment. It is a figure which shows the structural example of the audio-video management apparatus concerning 2nd Embodiment. FIG. 10 is a diagram showing synchronization and information exchange via synchronization control units between functional units constituting the video and audio management device according to the second embodiment.

  Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that the embodiments described below do not unduly limit the content of the present disclosure described in the claims. In addition, not all of the components shown in the embodiment are necessarily essential components of the present disclosure.

First Embodiment
As shown in FIG. 1, the appearance viewed from the bird's-eye view of the screening system 1 according to the present embodiment includes an internal space in which a plurality of screens 2 a to 2 c are provided along the inner wall surface 3. 1 (a) is a bird's-eye view of the screening system 1 including the inner wall surface 3, and FIG. 1 (b) is a bird's-eye view with the wall omitted to make the inside of the screening system 1 shown in FIG. is there. In the following description, while the user of the screening system 1 is viewing the image of any of the screens 2a to 2c, or when necessary for the convenience of the explanation, the user according to the context It is called "Video Viewer" or "Audio Listener".

  In the screening system 1, long chairs 4a to 4c having a shape curved in an arch shape along the longitudinal direction are installed in front of the plurality of screens 2a to 2c. The long chairs 4a to 4c are sofas or the like on which a user (viewer) who is respectively looking at any of the screens 2a to 2c can sit to view an image displayed on the screens 2a to 2c.

  Further, in the screening system 1, a lending counter 5 is provided in the central part of the floor surface of the inner space surrounded by the inner wall 3. Various items such as wireless headphones, which will be described later, are lent to the user at the lending counter 5 and goods are sold. In addition, entry and exit management devices 6a and 6b are installed at the entrance where the user enters and leaves this internal space. It is also possible to obtain member information including personal information of the viewer by touching the entry / exit management device 6a or 6b with the IC chip built-in type membership card when the user enters. In addition, by counting the number of visitors using the entrance and exit management devices 6a and 6b, it is possible to perform entrance restriction at the entrance while the inside is crowded.

  In one embodiment, the user performs member registration by registering his / her personal information in the screening system 1 in advance, and the entry / exit management devices 6a and 6b authenticate the user when the user enters. And charging may be performed. At this time, the pre-registered user's personal information includes payment information such as the user's credit card number. In such a case, if the user performs member registration based on his / her personal information, a member card may be issued to the user.

  Furthermore, as shown in FIG. 2, the video and audio management device 100 is connected to the plurality of video display devices 20 a to 20 c respectively having the plurality of screens 2 a to 2 c. As described later, the video and audio management apparatus 100 (FIG. 2) displays a plurality of different video contents mv (1) to mv (3) simultaneously on the plurality of screens 2a to 2c, respectively, and displays them. The plurality of video display devices 20a to 20c are connected. Further, the lending counter 5 is provided with an authentication charge processing unit 32 (FIG. 2) for authenticating the user and charging the user for the user who receives the wireless headphone.

  In one embodiment, the authentication and charging processing unit 32 may include an information terminal installed in the lending counter 5 in order to perform authentication and charging of the entered user. In another embodiment, the authentication charge processing unit 32 reads personal information stored in the IC chip in the membership card when each user causes the entry / exit management device 6a or 6b to touch the membership card upon entry. The user may be charged for the entrance fee. Further, the lending counter 5 lends wireless headphones 50 (a) to 50 (K) to the user who has performed billing or authentication in association with the user information generated as a result of the billing or authentication. A lending management unit 33 (FIG. 2) is provided to manage the In the lending counter 5, not only the wireless headphones 50 (a) to 50 (K) but also motion sensors 70 (a) to 70 (M) described later may be lent to the user.

  In one embodiment, the authentication and charging processing unit 32 may perform inquiry processing to a credit sales company based on the credit card number input as payment information at the time of member registration by each user, and may charge the same. This charge may be in the form of charging a single admission fee each time the user enters, and is a form in which the equivalent of the valid free pass fee is charged over a period of one month to several months. May be

  The lending management unit 33 is a lending counter to perform data management for lending out the wireless headphones 50 (a) to 50 (K) and the motion sensors 70 (a) to 70 (M) in association with the above-described user information. An information terminal installed at 5 may be provided. An information terminal installed at the lending counter 5 may be provided. As shown in FIG. 2, the authentication and charging processing unit 32 and the lending management unit 33 are connected to the video and audio management apparatus 100, and the video and audio management apparatus 100 uses the video and audio required as the video and audio are provided. It is used for person management.

<Configuration of Video and Audio Management Device>
Hereinafter, a video and audio management apparatus 100 that executes provision of video and audio in the screening system 1 and a central function of user management associated therewith will be described with reference to FIG. As shown in FIG. 2, the video and audio management apparatus 100 according to the present embodiment includes a video information output unit 110, an audio information output unit 120, an analysis unit 130, a screening schedule management unit 140, and a synchronization control unit 150. , Bus and communication interface 160. As shown in FIG. 2, the video information output unit 110 and the audio information output unit 120 are connected to the content database 41 and the audio information database 42, respectively. Further, the analysis unit 130 and the screening schedule management unit 140 are connected to the user information database 43 and the schedule database 44, respectively.

  The content database 41 is distributed to the video display devices 20a to 20c via the video information output unit 110, and a large number of video contents to be displayed on the screens 2a to 2c are stored. The content database 41 is configured to be able to read out desired video content by searching using a video genre, a movie title or the like as a key. Also, in each of the video contents in the contents database 41, in addition to the information indicating the genre of the video, metadata μ (FIG. 2) including scene identification information for each video scene and identification information of performers is embedded. ing.

  The audio information database 42 separates and accumulates, as audio information, a large number of video contents stored in the content database 41, audio parts of promotion video, BGM, sound effects, and the like. The user information database 43 stores user information for each user. In the user information for each user, in addition to personal information of each user and personal recorded data, wireless headphones 50 (a) to 50 (K for each of users U (1) to U (K) Information on collecting and recording the usage status of) is included. In the schedule database 44, screening schedules of video contents to be screened on the screens 2a to 2c of the video display devices 20a to 20c are accumulated.

  The bus and communication interface 160 is configured as an internal bus connected to the audio information output unit 120, the analysis unit 130, and the screening schedule management unit 140. The voice information output unit 120, the analysis unit 130, and the screening schedule management unit 140 can transmit and receive signals and data via the bus and the communication interface 160.

  Further, the bus and communication interface 160 is an external communication interface connected to the organization frame sales information receiving unit 31 provided outside the video and audio management apparatus 100, the authentication and charging processing unit 32, and the lending management unit 33 via a communication line or the like. Further configured as The organization frame sales information receiving unit 31, the authentication and charging processing unit 32, and the lending management unit 33 can communicate signals and data with the video and audio management apparatus 100 via the bus and the communication interface 160. The details of the knitting frame sales information receiving unit 31 will be described later with reference to FIG.

  The bus and communication interface 160 also includes wireless headphones 50 (a) to 50 (K), user terminals 60 (a) to 60 (N), and a motion sensor 70 (a), which are provided outside the video and audio management apparatus 100. And 70 (M) are further configured as a wireless communication interface connected by wireless. The wireless headphones 50 (a) to 50 (K), the user terminals 60 (a) to 60 (N) and the motion sensors 70 (a) to 70 (M) are connected to a video and audio management device via a bus and communication interface 160. It is possible to wirelessly communicate information and data with one another.

  When a plurality of video contents mv (1) to mv (3) are simultaneously screened in the internal space of screening system 1, viewers U (1) to U (K) are respectively wireless headphones 50 (a) to 50 (a) to 50 Listen to the audio of the video by (K). Therefore, in the present embodiment, the viewers who are viewing different images in the same room can exclusively view each other so that the audio of the image they want to view can not be heard by others.

  In addition, the wireless headphones 50 (a) to 50 (K) have an operation unit (not shown) that can be operated by the viewers U (1) to U (K). When the viewers U (1) to U (K) operate the operation unit, a received voice switching operation is performed to switch which voice information is received from a plurality of pieces of audio information synchronized with different video information. It is possible. Furthermore, the viewers U (1) to U (K) can operate the operation unit to perform the volume adjustment operation and the power on / off switching operation for receiving an audio signal.

  Further, in the present embodiment, each of the viewers U (1) to U (K) operates the operation switches (not shown) of the wireless headphones 50 (a) to 50 (K), respectively, The audio of the video can be switched to the changed audio. Therefore, when each of the viewers U (1) to U (K) changes which of the video contents mv (1) to mv (3) to view, the audio of the video is changed to the audio after the change in real time. You can switch and listen.

  More specifically, in each of the wireless headphones 50 (i) (1 ≦ i ≦ K), it is possible to perform an operation of selecting an active audio channel for audio reception from a plurality of audio channels. . The plurality of audio channels are used to respectively transmit a plurality of audio information synchronized with the plurality of video contents mv (i) (1 ≦ j ≦ J). Then, in each of the wireless headphones 50 (i) (1 ≦ i ≦ K), the audio information corresponding to the video content mv (x) only when the audio channel corresponding to the video content mv (x) is selected. Is received.

  Furthermore, in the wireless headphone 50 (i), when the audio channel being selected is switched from the audio channel corresponding to the video content mv (x) to the audio channel corresponding to the video content mv (y), the video content mv (y) The audio information corresponding to is received. At that time, a recording regarding which audio channel has been switched to the audio channel in the wireless headphone 50 (i) is wirelessly transmitted to the video and audio management device 100. How the recording of the audio channel switching operation by the user U (i) on the wireless headphone 50 (i) is used in the video and audio management apparatus 100 will be described later.

  The video information output unit 110 outputs video information to a plurality of video display devices 20a to 20c for respectively screening a plurality of different videos simultaneously. The video information output from the video information output unit 110 is connected to the video information output unit 110, and is supplied from the content database 41 in which content data of a large number of video content and promotion video are stored.

  The audio information output unit 120 outputs audio information synchronized with the video information so that it can be switchably received by each of the plurality of wireless headphones 50 (a) to 50 (K) lent to the user. The audio information output from the audio information output unit 120 is supplied from the audio information database 42 connected to the audio information output unit 120. The audio information database 42 separates and accumulates, as audio information, a large number of video contents stored in the content database 41, audio parts of promotion video, BGM, sound effects, and the like.

  Further, the audio information output unit 120 is configured to output a plurality of audio information including at least a main audio and a sub audio to a plurality of wireless headphones 50 (a) to 50 (K) with respect to one video information. There is. At that time, the audio information output unit 120 performs audio output so that the wireless headphones 50 (a) to 50 (K) can switchably receive a plurality of audio information.

  As a result, each of the users U (1) to U (K) can select whether to listen to the main voice that is the Japanese voice of the video content or to hear the secondary voice that is the foreign language voice. Become. For example, each of the users U (1) to U (K) operates the changeover switch etc. (not shown) provided on each of the wireless headphones 50 (a) to 50 (K), respectively. It is also possible to switch between voice and sub-voice respectively.

  Also, the plurality of viewers U (1) to U (K) wear not only the wireless headphones 50 (a) to 50 (K) to view the video content, but also the wireless headphones 50 (a) to 50 Motion sensors 70 (a) to 70 (K) attached with (K) may be attached. In one embodiment, motion sensors 70 (a) -70 (K) may be integrated with wireless headphones 50 (a) -50 (K), respectively.

  Specifically, the motion sensor 70 (i) includes the wireless headphones 50 (i) such that the motion sensor 70 (i) (1 ≦ i ≦ K) is disposed toward the body of the user U (i). i) It may be installed at an appropriate position on the top with an appropriate orientation. Thus, when the user U (i) wears the wireless headphone 50 (i), the motion sensor 70 (i) may be worn on the measurement target site of the body of the user U (i) .

  Also, the motion sensors 70 (a) to 70 (K) measure physical responses of the users U (1) to U (K) while viewing an image respectively as time measurement data, and manage the video and audio It may be wirelessly transmitted to the device 100. How the biometric data measured by the motion sensors 70 (a) to 70 (K) is used in the video and audio management apparatus 100 will be described later.

  Also, the audio information output unit 120 outputs the viewing history of the corresponding audio information to the viewing position information L (i, j) indicating which video scene the user U (i) has viewed to which video content mv (j). Record based on Then, the audio information output unit 120 distributes the viewing position information L (i, j) to the user terminal 60 (i) (1 ≦ i ≦ n) owned by the user U (i).

  The viewing position information L (i, j) distributed to the user terminal 60 (i) is required, for example, in the following case. Screening of the video content mv (j) while the user U (i) watching the video content mv (j) in front of any of the screens 2a-2c is taking a seat for restroom or meal break Suppose that he has moved a long way ahead. In that case, when the video content mv (j) is screened again later, the user U (i) wants to resume viewing from the video scene seen last in the previous screening, not from the first video scene. Sometimes I think.

  Therefore, the above-mentioned viewing position information L (i, j) of the video content mv (j) is distributed to the user terminal 60 (i), and the waiting time from the re-screening start time to the last viewed video scene is used It is displayed on the display screen of the user terminal 60i. Then, the user U (i) can easily know how many minutes and minutes it should return to the original seat in order to resume viewing from the last viewed video scene.

  The analysis unit 130 is configured to acquire data regarding the usage status of the wireless headphones 50 (a) to 50 (K) during video viewing for use in analysis processing to be described later. The above data acquired regarding the use status of the wireless headphones 50 (a) to 50 (K) during video viewing by the analysis unit 130 is associated with each of the users U (1) to U (K) in a user information database It is accumulated in 43. Here, data relating to the usage status of the wireless headphones 50 (a) to 50 (K) includes recorded data for the users U (1) to U (K) while viewing a video.

  In one embodiment, such recorded data for each user while viewing a video may include wireless headphones 50 (a) to 50 (K) while each of the users U (1) to U (K) is viewing video. A record of the operations performed above) is included. In another embodiment, such recorded data may be motion sensors 70 (a) to 70 (M) that describe physical responses of users U (1) to U (K) while viewing an image. A series of time-series measured biometric data is included.

  The screening schedule management unit 140 receives the analysis result each time the analysis unit 130 generates the result of the analysis process regarding the optimization of the video content to be screened and the screening schedule. In that case, the screening schedule management unit 140 reads the current screening schedule from the schedule database 44. Then, the presentation schedule management unit 140 reorganizes the presentation schedule of the video content in accordance with the analysis result received from the analysis unit 130. Finally, the screening schedule management unit 140 stores the screening schedule after reorganization in the schedule database 44 as the updated screening schedule.

  The synchronization control unit 150 is configured as a relay function unit that relays the exchange of signals between the video information output unit 110, the audio information output unit 120, the analysis unit 130, and the screening schedule management unit 140. Specifically, among the video information output unit 110, the audio information output unit 120, the analysis unit 130, and the screening schedule management unit 140, the synchronization control unit 150 routes a signal from an appropriate transmission source to an appropriate transmission destination. Do.

  Here, the signals and data relayed by the synchronization control unit 150 can include the following signals and data. For example, the signal or data relayed by the synchronization control unit 150 may be a signal stream continuously transmitted from the transmission source to the transmission destination according to a desired synchronization timing. In addition, the signal or data relayed by the synchronization control unit 150 is transmitted intermittently according to a desired synchronization timing as soon as transmission data is prepared at the transmission source, so that discontinuous data transmission is repeatedly performed intermittently. May be a signal stream.

  As described above, the synchronization control unit 150 is configured to repeatedly transmit the signal stream as described above from the transmission source to the transmission destination in synchronization with appropriate transmission timing. Therefore, according to which of the video information output unit 110, the audio information output unit 120, the analysis unit 130, and the screening schedule management unit 140 becomes a transmission source and which becomes a transmission destination, an appropriate synchronous clock signal is internally To generate Then, the synchronization control unit 150 routes the signal stream from the transmission source to the transmission destination in synchronization with the synchronization clock signal appropriately generated according to which transmission source and which becomes the transmission destination. .

<Transfer of synchronization and signals via synchronization control unit>
Hereinafter, referring to FIG. 3, the synchronization control unit 150 among the video information output unit 110, the audio information output unit 120, the analysis unit 130 and the screening schedule management unit 140 continuously or intermittently according to the desired synchronization timing. An example of relay transmission of various signal streams and various information will be described. FIG. 3 shows what kind of signals and data are transmitted and received among the screening schedule management unit 140, the video information output unit 110 and the audio information output unit 120 in the form of being relayed by the synchronization control unit 150. FIG.

  As shown in FIG. 3, according to the screening schedule acquired from the schedule database 44, the screening schedule management unit 140 notifies the video information output unit 110 in real time of the start of screening of a specific video content. For example, the screening schedule management unit 140 refers to the screening schedule, and when the time to start screening of a specific video content mv (x) is scheduled, the video information output unit instructs to start screening the video content mv (x). Notify 110 immediately.

  In order to realize this function, the screening schedule management unit 140 and the video information output unit 110 must be synchronized with each other so that the clocks tick the same time. Therefore, the synchronization control unit 150 sets the pulse signal generated by the clock of the screening schedule management unit 140 as the master side. Then, the synchronization control unit 150 synchronizes the clock pulse signal for driving the clock in the video information output unit 110 with the clock pulse signal on the master side.

  When the video information output unit 110 outputs a series of video frames for screening, the synchronization control unit 150 starts an operation of generating a frame synchronization signal which rises in synchronization with the start time of each video frame. Then, the synchronization control unit 150 outputs the video information so that the operation of the video information output unit 110 outputting each video frame to any of the video display devices 20a to 20c in synchronization with the frame synchronization signal. It instructs the part 110. At the same time, the synchronization control unit 150 performs an operation of the audio information output unit 120 outputting the audio information corresponding to each video frame to the wireless headphones 50 (a) to 50 (K) in synchronization with the frame synchronization signal. In this way, the voice information output unit 120 is instructed.

  Subsequently, the video information output unit 110 notified of an instruction to start screening of the video content mv (x) requests the content database 41 to transmit the video content mv (x). When transmission of the video content mv (x) from the content database 41 starts in response to the request, the video information output unit 110 instructs the output start of the audio information to be output in synchronization with the video content mv (x). And notifies the audio information output unit 120 via the synchronization control unit 150. At the same time, the video information output unit 110 performs an operation of outputting a video frame of the video content mv (x) to any of the video display devices 20a to 20c in synchronization with the frame synchronization signal.

  Thereby, the audio information output unit 120 transmits the audio information to the wireless headphones 50 (a) to 50 (k) in synchronization with the video frame of the video content mv (a) that the video information output unit 110 outputs for screening. Start the output operation. While the video information output unit 110 and the audio information output unit 120 respectively output the video information and audio information of the video content mv (x) for screening in accordance with the frame synchronization signal generated by the synchronization control unit 150 The information output unit 110 repeats the following operation.

  First, the video information output unit 110 transmits the audio information output unit via the synchronization control unit 150 to the viewing position information L (x) indicating how far the video content mv (x) has been screened from the beginning at the start of the screening. Send to 120 The viewing position information corresponds to information indicating the current reproduction position of the video content mv (x), and user terminals 60 (i) (1 ≦ 1 ≦) owned by each of the viewers U (1) to U (k). It is distributed as viewing position information L (i, x) (1 <i <n) in i <n. The user terminal 60 (i) that has received the distribution of the viewing position information L (i, x) displays the waiting time from the start time of the re-screening to the video scene seen at the end as the display screen of the user terminal 60 (i) Make it appear on the screen. As a result, the user U (i) can easily know how long and when to return to the original seat in order to resume viewing from the last viewed video scene.

  Also, the video information output unit 110 constantly monitors whether the reproduction position of the video content mv being screened has come to the video scene boundary position. The video scene boundary position is a reproduction position at which a video scene in the video content mv being screened changes to another video scene. When the reproduction position reaches the video scene boundary position, the video information output unit 110 transmits the video scene identification information and the video attribute information shown in FIG. 3 to the analysis unit 130 via the synchronization control unit 150. Subsequently, the analysis unit 130 stores the video scene identification information and the video attribute information received from the video information output unit 110 in the user information database 43.

  Here, the video scene identification information means information for identifying a new video scene immediately after the switching of the video scene, and the video attribute information is information on video attributes describing characteristics of the new video scene. means. The video scene identification information and the video attribute information transmitted to the analysis unit 130 immediately after the video scene is switched are necessary to analyze the user information collected by the analysis unit 130 for each user according to the method described later. It is information.

  The analysis unit 130 executes the above analysis processing while reading out the video scene identification information and the video attribute information temporarily stored in the user information database 43 as needed. During execution of this analysis process, the analysis unit 130 voices data on the operation record of the wireless headphones 50 (i) (1 ≦ i ≦ K) worn by each of the users U (1) to U (K). It receives from the information output unit 120 as input information for performing analysis processing. In addition, during the execution of this analysis process, the analysis unit 130 receives measurement data on the physical response of the user from the motion sensor 70 (i) (1 ≦ i ≦ K) as input information for performing the analysis process.

  The “measurement data on the physical response of the user” mentioned here means that the motion sensor 70 (i) (1 ≦ i ≦ K) worn by each of the users U (1) to U (K) measures Data output. For example, this measurement data may be a sensor output value obtained by measuring, as biometric measurement data, a time-series transition of physical reaction of each user while viewing an image. When this analysis process is completed, the analysis unit 130 analyzes the analysis result into user information λ (i) (1 ≦ i ≦ P) (for each of the users U (1) to U (K)) for each user. , And stored in the user information database 43.

  When the analysis unit 130 receives from the user information database 43 a screening schedule reorganization instruction to instruct that the screening schedule should be reorganized, the screening schedule adjustment information, which will be described later, is managed via the synchronization control unit 150. The operation to transmit to the unit 140 is started. The analysis unit 130 may be configured to receive a presentation schedule reorganization instruction from the user information database 43 when the following cases apply.

  The first case corresponds to the case where a sufficient amount of data for performing the above-described analysis processing by the analysis unit 130 is accumulated in the user information database 43. In the second case, as a result of the above-described analysis processing by the analysis unit 130, it is necessary to reorganize the screening schedule in order to prevent the improvement in the degree of satisfaction of customers who visit video content and the decline in satisfaction. And the analysis unit 130 makes a determination. The third case corresponds to the case where a notification is received from a marketing support system (not shown) operating outside the screening system 1 to support marketing of video content and market trend research. That is, the video and audio management apparatus 100 receives from the marketing support system information suggesting that reorganization of the screening schedule is necessary to improve customer satisfaction.

  As described above, the analysis unit 130 that has received the screening schedule reorganization instruction reads out the user information λ (i) (1 ≦ i ≦ P) accumulated in the user information database 43. Subsequently, the analysis unit 130 generates screening schedule adjustment information which is information indicating how to reorganize or adjust the screening schedule to improve customer satisfaction. Subsequently, the analysis unit 130 transmits the generated screening schedule adjustment information to the screening schedule management unit 140 via the synchronization control unit 150.

  The screening schedule management unit 140 that has received the screening schedule adjustment information reads the current screening schedule from the schedule database 44, and reorganizes the screening schedule according to the screening schedule adjustment information. Finally, the screening schedule management unit 140 overwrites and updates the old screening schedule in the schedule database 44 by writing the screening schedule after reorganization into the schedule database 44.

<About analysis processing based on user information>
Hereinafter, the analysis processing performed by the analysis unit 130 will be described in detail. This analysis process is for the purpose of obtaining basic information to determine how to reorganize the screening schedule to prevent the improvement or decrease in satisfaction of the customers who visit to view the video content. It may be performed. Also, this analysis process may be performed for the purpose of generating feedback information that is useful to a person or organization who plans and produces or promotes video content. This feedback information may be transmitted to a marketing support system operating outside the screening system 1 shown in FIG. 1 and may be provided to a content creator (or artist) or an organization that promotes content promotion.

  In the analysis process performed by the analysis unit 130, the analysis unit 130 receives as an input data regarding the usage status of the wireless headphone 50 (i) (1 ≦ i ≦ K) while viewing a video, analyzes the data, and views the video It analyzes the behavior and reaction of each user. In an exemplary analysis process performed by the analysis unit 130, data relating to the usage of the wireless headphones 50 (i) (1 ≦ i ≦ K) during video viewing may be analyzed as follows. That is, the data described above analyzes the viewing condition regarding how the video content mv (j) (1 ≦ j ≦ J) is viewed by the user U (i) (1 ≦ i ≦ K) It may be used to For example, the above-mentioned data is compared with the attributes of each video scene and video content constituting the video content being viewed, and in order to analyze what behavior and reaction the user shows in what video scene It may be used.

  First, information input to the analysis unit 130 for analysis processing will be described. The analysis process performed by the analysis unit 130 is the user information λ (i) (for each user U (i) (1 ≦ i ≦ P)) stored in the user information database 43 (for each user U (i) (1 ≦ i ≦ P)). It is assumed that 1 ≦ i ≦ P). The user information λ (i) (1 ≦ i ≦ P) includes, as initial information, personal information for each user obtained as a result of authentication and charging performed by the authentication and charging processing unit 32 for the user. Also, the user information λ (i) (1 ≦ i ≦ P) further includes user attribute information that describes the attributes of the user for each of the users U (i) (1 ≦ i ≦ P). It is also good.

  As attributes of each user in this case, it is possible to consider the age and gender of the user, viewing history data of other content distribution services, and information reflecting the user's hobbies and preferences. Here, as the above-mentioned viewing history data, what kind of genre or casting video each user has viewed before using another content distribution site that has a business alliance with the managing agency of the screening system 1 It may be history data in which Further, as information that reflects the tastes and preferences of each user, there can be considered information that records the status of membership registration on other mania Web sites and the status of subscription to other entertainment services.

  Then, each time the user U (i) viewing a video operates the wireless headphone 50 (i), operation record data is sequentially added to the user information λ (i). Further, each time biometric data on the physical reaction of the user U (i) while viewing a video is obtained by the motion sensor 70 (i), the biometric data is sequentially added to the user information λ (i). To go.

  Also, this analysis process may output the above-mentioned screening schedule adjustment information as an analysis result. In addition, this analysis processing may output feedback information that is useful to a person or organization who performs planning and production or promotion of video content as an analysis result. Hereinafter, a scenario will be described in detail in the case where screening schedule adjustment information indicating how to rearrange or adjust the screening schedule is output as an analysis result as a result of the analysis process.

  The analysis unit 130 is configured to analyze the video data to be screened and the optimization of the screening schedule by analyzing the recorded data of the users U (1) to U (K) while viewing the video. . In one embodiment, the analysis unit 130 which has collected the above-mentioned recorded data for each user who is viewing a video obtains the following information useful for optimizing the screening schedule by analyzing the collected recorded data. be able to. For example, according to the attributes of each user, it is possible to obtain information indicating what genre and casting movie titles and video content can be screened to enhance customer satisfaction as a whole.

  The above-mentioned recorded data recorded for each user while viewing a video may be collected by the analysis unit 130 as follows. First, the recording data recorded for each of the users U (1) to U (K) viewing the video is wirelessly transmitted from the wireless headphone 50 (i) (1 ≦ i ≦ K) to the video and audio management device 100. Will be sent. Subsequently, the recording data received as a wireless signal is output to the analysis unit 130.

  In one embodiment, each of the users U (1) to U (K) records the wireless headphones 50 (a) to 50 (K) while the user U (1) to U (K) are viewing video, in the recording data recorded for each user while viewing the video. It contains a record of each of the operations performed above. In that case, the operations available on the wireless headphones 50 (a) to 50 (K) include a reception channel switching operation for switching which of a plurality of audio channels synchronized with different video information is to be received. Further, operations that can be performed on the wireless headphones 50 (a) to 50 (K) include volume adjustment operation and on / off switching operation of the power supply for audio signal reception. The recorded data to be recorded regarding the usage status of the wireless headphones 50 (a) to 50 (K) is recorded for each of the viewers U (1) to U (K) as input data used for the analysis process as described above. The user information is stored in the user information database 43 in a readable form for each user.

  The analysis unit 130 reads out, from the user information database 43, the recording data of the users U (1) to U (K) currently viewing the video as needed, and analyzes the recording data. As a result, the analysis unit 130 can obtain an analysis result indicating what kind of content video scene the viewers U (1) to U (K) show strong interest. Alternatively, according to the genre and title of the video content, the analysis unit 130 may select what casting (selection of performers and cast during a play) is preferred by the viewers U (1) to U (K) (or It may be configured to obtain an analysis result that suggests (dislike).

  As an example of analysis processing performed using a record of operations performed by each of the users U (1) to U (K) on the wireless headphones 50 (a) to 50 (K) while viewing an image, An example of the analysis process that may be performed is described below. Here, the term "video attribute" used in the following description refers to a concept including performers appearing in the video content mv to be screened and the genre of the video. Further, each of a series of video scenes constituting the video content mv and video attributes for each video scene may be identified using metadata μ (FIG. 2) included in the video information of the video content mv.

  First, operation record data of the volume and / or sound quality adjustment operation performed by each of the users U (1) to U (K) while viewing the video with each of the wireless headphones 50 (a) to 50 (K) Are read out from the user information database 43 for each user as input data to the analysis process.

  Subsequently, the correlation observed between the time series of the series of video scenes constituting the video content and the time series of the headphone operation recording data is examined, and the user U (1) to U (K) is determined from the correlation. Detects video scenes each of which is of interest. At the same time, a video attribute in which each of the users U (1) to U (K) is interested is detected for each video scene from the correlation. As described above, the analysis unit 130 acquires an analysis result indicating what kind of content video scene the viewers U (1) to U (K) show a strong interest.

  Further, in another embodiment, the analysis unit 130 may perform the voice switching operation performed by each of the users U (i) (1 ≦ i ≦ K) in the wireless headphones 50 (i) (1 ≦ i ≦ K). The following analysis process may be performed from the record. That is, from the history in which each user U (i) has performed the above-mentioned audio switching operation to switch the audio channel of the video content mv (j) (1 ≦ j ≦ J) to be viewed, the following (a) and (a) It may be further configured to output the result of analysis processing of at least one or more of b).

(A) Movement recording in which the history of movement of the user U (i) who is viewing _one video content mv (j ₁ ) to view another video content mv (j ₂ ) is recorded for each user, And (b) Recording of the transition of the ratio of the number of people who view and listen to each of the video content mv (j) (1 ≦ j ≦ J) being shown to the total number of users.
The analysis unit 130 may be configured to distribute the analysis results of (a) and (b) above to the information terminal in the screening system 1 as reporting information.

  In another embodiment, the analysis unit 130 identifies the video attributes including the performer and the genre of the video and each video scene using the metadata μ of the video information, and the motion sensor 70 (i) (1 ≦ i ≦ N) may obtain biometric information on the physical response of the user U (i). Subsequently, the wireless headphone 50 (i is detected by detecting the video attribute and the video scene in which the user U (i) is interested from the time change of the physical response of the user U (i) (1 ≦ i ≦ N). ) May be analyzed.

  That is, in this embodiment, the analysis unit 130 measures a series of time-series physical responses of each user while viewing the video, as the information related to the usage state of the wireless headphones 50 (a) to 50 (K). Biometric data may be acquired. In other words, in this embodiment, the recorded data recorded for each user regarding the use situation of the wireless headphone 50 (i) (1 ≦ i ≦ K) is the physical properties of the user U (i) who is viewing the video. It includes data obtained by recording biological measurement data obtained by measuring a reaction with the motion sensor 70 (i).

  In this embodiment, the analysis unit 130 may be configured to analyze the optimization of the video content to be screened and the screening schedule by analyzing the biometric data measured for each user. In one embodiment, the analysis unit 130 can obtain biometric information useful for optimization of a presentation schedule by collecting and analyzing biometric data of physical reactions for each user while viewing a video. The biometric data may be collected by the analysis unit 130 as follows.

  For example, the analysis unit 130 may receive the biological measurement data as a wireless signal from the motion sensor 70 (i) attached to the body of the user U (i) (1 ≦ i ≦ K). Specifically, living body measurement data obtained by measuring the physical reaction of the user U (i) while viewing a video in time series is the video / audio management device 100 from the motion sensor 70 (i) (1 ≦ i ≦ K). Wirelessly transmitted to. Subsequently, the living body measurement data received as a wireless signal by the bus and communication interface 160 is output to the analysis unit 130.

  In one embodiment, biometric measurement data in which physical responses are measured for each user while viewing a video include the degree of eye pupil opening during viewing of a video for each of the users U (1) to U (K). It includes what was measured. Moreover, what measured the movement of the neck and the movement of the limbs in video viewing and listening about each of the users U (1)-U (K) may be contained in the said living body measurement data. Further, the living body measurement data may include, for each of the users U (1) to U (K), measurement of a temporal change in body temperature during viewing of an image or a temporal change in pulse rate. The living body measurement data measured for each of the users U (1) to U (K) while viewing the video are input data used for the analysis processing as described above as the input data for the viewers U (1) to U (K). The information is recorded for each and stored in the user information database 43 in a readable form for each user.

  The analysis unit 130 reads out the living body measurement data of the users U (1) to U (K) currently viewing the video from the user information database 43 as needed, and analyzes the living body measurement data. As a result, the analysis unit 130 can obtain an analysis result indicating what kind of content video scene the viewers U (1) to U (K) show strong interest. Alternatively, according to the genre and title of the video content, the analysis unit 130 may select what casting (selection of performers and cast during a play) is preferred by the viewers U (1) to U (K) (or It may be configured to obtain an analysis result that suggests (dislike).

  The following is an example of analysis processing that may be executed by the analysis unit 130 as an example of analysis processing performed using the living body measurement data measured for each of the users U (1) to U (K) while viewing a video. Describe to. First, the analysis unit 130 reads, from the user information database 43, biometric measurement data measured for each of the users U (1) to U (K) who are viewing an image, as input data for analysis processing. . This biometric data includes data obtained by measuring the degree of opening of the pupil in each user's eye, the movement of the neck, and the movement of the hands and feet measured for each user.

  Subsequently, the correlation observed between the time series of a series of video scenes constituting the video content and the time series of the biometric data of each user is examined, and the user U (1) to U is determined from the correlation. A video scene where each of (K) shows interest is detected. At the same time, a video attribute in which each of the users U (1) to U (K) is interested is detected for each video scene from the correlation. As described above, the analysis unit 130 acquires an analysis result indicating what kind of content video scene the viewers U (1) to U (K) show a strong interest.

  As described above, the analysis unit 130 identifies the video attributes including the performer and the genre of the video and the respective video scenes using the metadata μ of the video information, and the motion sensor 70 (i) (1 ≦ i ≦ N) It is possible to acquire biometric information on the physical response of the user U (i). Subsequently, the wireless headphone 50 (i is detected by detecting the video attribute and the video scene in which the user U (i) is interested from the time change of the physical response of the user U (i) (1 ≦ i ≦ N). Can analyze the use situation of

<Flow of processing operation according to the present embodiment>
The flow of the processing operation performed inside the video and audio management device 100 will be described in detail below according to the present embodiment. The timing chart shown in FIG. 4 represents the flow of cooperative operations among the synchronization control unit 150, the screening schedule management unit 140, the video information output unit 110, and the audio information output unit 120. The timing chart shown in FIG. 5 includes the synchronization control unit 150, the screening schedule management unit 140, the video information output unit 110, the analysis unit 130, the motion sensor 70 (i) (1 ≦ i ≦ N), and the wireless headphone 50 (i). This shows the flow of cooperative operation between (1 ≦ i ≦ N).

  The processing flow of FIG. 4 starts from step S100, and the screening schedule management unit 140 notifies the video information output unit 110 of the start of screening of a specific video content mv (x) according to the screening schedule acquired from the schedule database 44. . For example, the screening schedule management unit 140 refers to the screening schedule, and when the time to start screening of a specific video content mv (x) is scheduled, the video information output unit instructs to start screening the video content mv (x). Notify 110 immediately.

  In the example of FIG. 4, the notification of the instruction to start the screening of the video content mv (x) is from the screening schedule management unit 140 via the synchronization control unit 150 as shown by m100 and m101. It is sent to 110. As a result, in step S101 of FIG. 4, the video information output unit 110 recognizes that the video content mv (x) should be screened, and requests the synchronization control unit 150 to execute a synchronization setting operation described later. Signal m102 to the synchronization control unit 150.

  Subsequently, the process proceeds to step S102, and the synchronization control unit 150 causes the operation of the video information output unit 110 to output the video information and the operation of the audio information output unit 120 to output the audio information in synchronization with each other. Set frame synchronization to Specifically, when the video information output unit 110 outputs video information in frame units for screening, the audio information output unit 120 outputs the corresponding audio frame in synchronization with the output timing of the video frame. To perform the synchronization setting operation.

  Subsequently, transmission of the video content mv (x) starts from the content database 41 to the video information output unit 110, and when the video information output unit 110 receives a notification m103 indicating that the synchronization setting operation has succeeded, from the synchronization control unit 150. The process proceeds to step S103 and step S105.

  In step S103, the video information output unit 110 starts output of a video frame of the video content mv (x). At the same time, in step S105, the audio information output unit 120 starts outputting an audio information frame to be output in synchronization with each of the video frames of the video content mv (x). Subsequently, in step S104, the video information output unit 110 prepares to receive the next video frame.

  The audio information frame m105 output from the audio information output unit 120 is broadcasted by wireless transmission to the plurality of wireless headphones 50 (i) (1 ≦ i ≦ K). As shown in FIG. 4, when the wireless headphone 50 (w) is turned off, the audio information frame m105 broadcasted by wireless transmission from the audio information output unit 120 is the wireless headphone 50 (w not received by w).

  Further, in the wireless headphone 50 (w), the audio information frame m105 is not received even when the audio channel used to transmit the audio information frame m105 is not selected as the active audio channel for audio reception. Specifically, in the wireless headphone 50 (w), the audio information frame m105 is selected from among a plurality of audio channels for transmitting audio information of the plurality of video contents mv (1) to mv (3) being screened. It corresponds when the voice channel used for transmission is not selected.

  In the example illustrated in FIG. 4, in step S107, the power for sound reception of the wireless headphone 50 (w) is turned on. Furthermore, in step S107, the audio channel used to transmit the audio information frame m105 is selected as the active audio channel for audio reception on the wireless headphone 50 (w). Then, on the wireless headphone 50 (w), a notification m106 indicating that the audio channel used to transmit the audio information frame m105 is selected is transmitted to the audio information output unit 120. As a result, in step S106, the audio information output unit 120 detects that the subsequent audio information frame on the same audio channel as the audio information frame m105 can be received by the wireless headphone 50 (w).

  Subsequently, when the video information output unit 110 receives the subsequent video frame of the video content mv (x) from the content database 41, the synchronization control unit 150 performs frame synchronization between the video information and the audio information in step S108. Execute processing (synchronization setting operation).

  When the video information output unit 110 and the audio information output unit 120 respectively receive notification m107 and m108 indicating that the synchronization setting operation has succeeded from the synchronization control unit 150, the process proceeds to step S109 and step S110. In step S109, the video information output unit 110 outputs a video frame of the video content mv (x). At the same time, in step S110, the audio information output unit 120 outputs the corresponding audio information frame in synchronization with each of the video frames of the video content mv (x).

  In step S111, the wireless headphone 50 (w) having received the audio information frame m109 from the audio information output unit 120 reproduces the audio information frame m109 and executes a reproduction process for the user U (w) to hear it.

  Subsequently, the process proceeds to step S112, and the screening schedule management unit 140 notifies the video information output unit 110 of the start of screening of the promotion video mv-p in accordance with the screening schedule acquired from the schedule database 44. The promotional video mv-p is a commercial video etc. which is screened for a short time during screening of the video content mv (x), and the screening of the video content mv (x) is interrupted when the screening of the promotional video mv-p is finished. Resume from.

  For example, the screening schedule management unit 140 refers to the screening schedule, and transmits the following notification to the video information output unit 110 at the time when the start of the screening of the promotion video mv-p is scheduled. That is, the video information output unit 110 transmits a notification including an instruction to temporarily suspend the screening of the video content mv (x) and start the screening of the promotion video mv-p.

  In the example of FIG. 4, the notification of the instruction to start screening of the promotion video mv-p is shown by m110 and m111 from the screening schedule management unit 140 via the synchronization control unit 150 to the video information output unit 110. Sent to. As a result, in step S113 of FIG. 4, the video information output unit 110 recognizes that the screening of the promotion video mv-p should be started.

  Subsequently, when the video information output unit 110 receives the video frame of the promotion video mv-p from the content database 41, the synchronization control unit 150 performs processing for synchronizing the video information and the audio information in step S114 (synchronization Execute setting operation).

  When the video information output unit 110 and the audio information output unit 120 respectively receive the notification m112 and m113 indicating that the synchronization setting operation has succeeded from the synchronization control unit 150, the process proceeds to step S115 and step S116. In step S115, the video information output unit 110 outputs a video frame of the promotion video mv-p. At the same time, in step S116, the audio information output unit 120 outputs the corresponding audio information frame in synchronization with each of the video frames of the promotion video mv-p.

  In step S117, the wireless headphone 50 (w) that has received the audio information frame m114 from the audio information output unit 120 reproduces the audio information frame m114 and executes reproduction processing for the user U (w).

  Next, using the timing chart shown in FIG. 5, the synchronization control unit 150, screening schedule management unit 140, video information output unit 110, analysis unit 130, motion sensor 70 (i) (1 ≦ i ≦ N), and wireless The flow of cooperative operation between the headphones 50 (i) (1 ≦ i ≦ N) will be described.

  The processing flow of FIG. 5 starts from step S200, and the screening schedule management unit 140 notifies the video information output unit 110 of the start of screening of a specific video content mv (x) according to the screening schedule acquired from the schedule database 44. . For example, the screening schedule management unit 140 refers to the screening schedule, and when the time to start screening of a specific video content mv (x) is scheduled, the video information output unit instructs to start screening the video content mv (x). Notify 110 immediately.

  In the example of FIG. 5, as indicated by m200 and m201, notification of an instruction to start screening of the video content mv (x) is from the screening schedule management unit 140 via the synchronization control unit 150 to the video information output unit It is sent to 110. As a result, in step S201 of FIG. 4, the video information output unit 110 recognizes that the video content mv (x) should be started to be screened.

  Subsequently, the process proceeds to step S202, and the video information output unit 110 acquires video scene identification information for identifying the current video scene in the video content mv (x). At the same time, the video information output unit 110 acquires video attribute information indicating video attributes in the video scene. The video scene acquired in step S202 corresponds to the opening scene of the video content mv (x) because it is immediately after the instruction to start displaying the video content mv (x).

  The video scene identification information for identifying the video scene is obtained from the content database 41 from the metadata μ embedded in the video frame that the video information output unit 110 first receives. Furthermore, the video attribute information that characterizes this video scene is also obtained from the content database 41 from the metadata μ embedded in the video frame that the video information output unit 110 initially receives.

  Subsequently, the process proceeds to step S203, and the synchronization control unit 150 relays and transfers the video scene identification information and the video attribute information video corresponding to the beginning portion from the video information output unit 110 to the analysis unit 130 (shown in FIG. 5). m202 and m203). In the process flow shown in FIG. 5, steps S204, S205 and S206 are executed in parallel as follows in parallel with the relay transfer by the synchronization control unit 150.

  In step S206, the video information output unit 110 acquires the next video frame from the content database 41 for screening. In step S204, the operation record data m204 in which the headphone operation by the user U (i) is recorded from the wireless headphones 50 (i) (1 ≦ i ≦ K) is transmitted to the analysis unit 130. In step S205, biological measurement data m205 obtained by measuring the physical response of the user U (i) from the motion sensor 70 (i) (1 ≦ i ≦ K) is transmitted to the analysis unit 130.

  Subsequently, the process proceeds to step S208, and the analysis unit 130 correlates the video scene identification information and the video attribute information video received from the video information output unit 110, the operation record data m204, and the living body measurement data m205. Analyze Thereby, the analysis unit 130 suggests what degree of interest (or preference or aversion) the viewers U (1) to U (K) show with respect to the content and image attribute of the current image scene. It is possible to obtain analysis results.

  In parallel to step S208 described above, is the type of video scene or video attribute described by the metadata μ included in each video frame of the video content mv (x) currently being screened changed? Always monitor whether or not. When the video information output unit 110 detects a change in video scene type or video attribute, the video information output unit 110 determines that the playback position is at a video scene boundary position (a playback position at which the video scene is switched). , And execution of step S207.

  In step S207, the synchronization control unit 150 relays and transfers the video scene identification information and the video attribute information video corresponding to the newly detected video scene from the video information output unit 110 to the analysis unit 130 (see m202 shown in FIG. 5). m203), parallel to this, steps S210 and S211 are performed in parallel as follows. In step S210, the operation record data m208 in which the headphone operation by the user U (i) is recorded from the wireless headphones 50 (i) (1 ≦ i ≦ K) is transmitted to the analysis unit 130. In step S211, biological measurement data m209 obtained by measuring the physical response of the user U (i) from the motion sensor 70 (i) (1 ≦ i ≦ K) is transmitted to the analysis unit 130.

  Subsequently, the process proceeds to step S212, and the analysis unit 130 correlates the video scene identification information and the video attribute information video received from the video information output unit 110, the operation record data m204, and the living body measurement data m205. Analyze Thereby, the analysis unit 130 suggests what degree of interest (or preference or aversion) the viewers U (1) to U (K) show with respect to the content and image attribute of the current image scene. It is possible to obtain analysis results.

  Meanwhile, in step S214, the video information output unit 110 performs an operation of sequentially acquiring, from the content database 41, new video frames following the video frame for which processing has been completed. When the video information output unit 110 detects a change in video scene type or video attribute, the video information output unit 110 determines that the playback position is at a video scene boundary position (a playback position at which the video scene is switched), and the step Proceed to the execution of S215. In step S215, the synchronization control unit 150 relays and transfers the video scene identification information and the video attribute information video corresponding to the newly detected video scene from the video information output unit 110 to the analysis unit 130 (see m202 shown in FIG. 5). m203) In parallel with this, processing operations similar to steps S210 and S211 are performed in parallel.

  Thereafter, screening of the video content mv (x) proceeds, and at a certain point in time, the analysis unit 130 receives input data for analysis from a marketing support system (not shown) installed outside the video and audio management apparatus 100. Do. In one example, the input data for analysis includes, for example, data obtained by digitizing what kind of reaction has been received from the customer as a result of performing promotion of a specific video content outside the screening system 1. It is also good.

  In this case, the process proceeds to step S 213, and the analysis unit 130 reads the user information λ (i) (1 ≦ i ≦ P) stored in the user information database 43. Subsequently, the analysis unit 130 generates screening schedule adjustment information which is information indicating how to reorganize or adjust the screening schedule to improve customer satisfaction. Subsequently, the analysis unit 130 transmits the generated screening schedule adjustment information m 211 to the screening schedule management unit 140 via the synchronization control unit 150.

  Subsequently, the process proceeds to step S216, the screening schedule management unit 140 that has received the screening schedule adjustment information reads the current screening schedule from the schedule database 44, and reorganizes the screening schedule according to the screening schedule adjustment information. Finally, the screening schedule management unit 140 overwrites and updates the old screening schedule in the schedule database 44 by writing the screening schedule after reorganization into the schedule database 44.

Second Embodiment
Hereinafter, configurations and operations of the video and audio management apparatus 100 ′ and the screening system 1 ′ according to the second embodiment of the present invention will be described with reference to FIGS. As compared with the video and audio management apparatus 100 shown in FIGS. 1 to 3 in the first embodiment, a feedback output unit 135 is added in the video and audio management apparatus 100 ′ shown in FIGS. 6 to 8 in the second embodiment. The only difference is that The feedback output unit 135 sends the user U (i) (1) to the creator (creator) C (h) (1 h h H H) who planned or produced each of the video contents mv (j) (1 j j J J). It plays a role of feeding back the echo from 1 ≦ i ≦ K).

  Further, compared to the screening system 1 shown in FIGS. 1 to 3 in the first embodiment, the following points are different in the screening system 1 ′ shown in FIGS. 6 to 8 in the second embodiment. First, an imaging device (web camera or the like) 80 such as a camera and an audio distribution terminal / headphone usage detection terminal 90 are connected to the video and audio management device 100 '. More specifically, the imaging device (web camera etc.) 80 is for imaging the user U (i) (1 ≦ i ≦ K) while viewing a video, and the analysis inside the video and audio management device 100 ′ The unit 130 is communicably connected to the unit 130. Furthermore, the video and audio management apparatus 100 'is configured to exchange data and information with information terminals (personal computers etc.) 91-93.

  From the above, of the configuration and operation of the video and audio management apparatus 100 ′ and the screening system 1 ′ according to the second embodiment of the present invention shown in FIGS. 6 to 8, the same as the first embodiment shown in FIGS. The description of the configuration and operation of will be omitted. Similarly, among the configurations and operations of the video and audio management apparatus 100 ′ and the screening system 1 ′ according to the second embodiment, the configurations and operations similar to those of the first embodiment shown in FIGS. Illustration in 8 is omitted.

  FIG. 6 is a configuration diagram illustrating the device configuration of a screening system 1 'according to the second embodiment of the present invention. FIG. 7 is a view showing a configuration example of a video and audio management device 100 'according to the second embodiment of the present invention. FIG. 8 is a diagram showing synchronization and information exchange via the synchronization control unit 150 between functional units constituting the video and audio management apparatus 100 'according to the second embodiment of the present invention.

  In the embodiment shown in FIG. 6, the user performs member registration by registering his / her personal information in the screening system 1 in advance using an information terminal (personal computer etc.) 92, and enters when the user enters. The exit management devices 6a and 6b may be configured to be able to authenticate and charge the user. At that time, the user's personal information registered in advance using the information terminal (personal computer etc.) 92 also includes payment information such as the user's credit card number.

  The information terminal (personal computer or the like) 92 operated by the user may be a terminal installed in a store or movie theater which cooperates with the screening system 1 by the managing company of the screening system 1. In this case, when the user performs member registration by inputting his / her personal information to an information terminal (personal computer etc.) 92, a card issued to the information terminal (personal computer etc.) 92 is issued. A membership card may be issued from the machine to the user.

  In one embodiment, authentication / charging processing unit 32 transmits to credit sales company based on the credit card number input from information terminal (personal computer etc.) 92 shown in FIG. 6 as payment information at the time of member registration by each user. An inquiry process may be performed to charge. This charge may be in the form of charging a single admission fee each time the user enters, and is a form in which the equivalent of the valid free pass fee is charged over a period of one month to several months. May be

  The latest screening schedule managed by the screening schedule management unit 140 and the schedule / database 44 is displayed on the screen of the information terminal (personal computer etc.) 91 shown in FIG. It is possible. The users U (1) to U (K) can check the latest screening schedule at any time on the information terminal (personal computer etc.) 91.

  Furthermore, in the second embodiment shown in FIGS. 6 to 8, an imaging device (web camera or the like) 80 may be connected to the video and audio management device 100. In this case, the imaging device (web camera, etc.) 80 detects the position of the wireless headphones 50 (i) (1.ltoreq.i.ltoreq.K) detected by the voice distribution terminal / headphone use detection terminal 90, and the users U (1) to It becomes possible to identify the position of each of U (K). Then, the imaging device (web camera or the like) 80 can direct the lens to the detected position, and acquire motions of the bodies of the users U (1) to U (K) as moving images.

  The moving image from the imaging device (web, camera, etc.) 80 is output to the analysis unit 130 for analysis processing, and the result of the analysis processing is for the creator C (h) of the video content (1 ≦ h ≦ H). The information to be fed back is output to the feedback output unit 135. In this case, as in the first embodiment described above with reference to FIGS. 1 to 3, in the analysis processing performed by the analysis unit 130, the analysis processing of the wireless headphones 50 (i) (1 ≦ i ≦ K) during video viewing is performed. Receive usage data as input. In addition, the above-mentioned data is viewed by the user U (i) (1 ≦ i ≦ K) as to how the video content mv (j) (1 ≦ j ≦ J) is viewed. It may be used to analyze. For example, the analysis process performed by the analysis unit 130 may analyze the data to analyze the behavior or reaction for each user while viewing the video. Then, the analysis unit 130 outputs the result of the analysis process as information to be fed back to the creator C (h) (1 ≦ h ≦ H). As in the first embodiment described above with reference to FIGS. 1 to 3, each of a series of video scenes constituting the video content mv (j) and the video attributes for each video scene are the video content mv (j). (FIG. 2) may be used for identification.

  In an exemplary analysis process performed by the analysis unit 130, data relating to the usage of the wireless headphones 50 (i) (1 ≦ i ≦ K) during video viewing may be analyzed as follows. That is, the data described above is compared with the attributes of each video scene and video content constituting the video content being watched by the user U (i) (1 ≦ i ≦ K), and the user can check in any video scene It may be used to analyze what kind of behavior or reaction it shows.

  In an exemplary embodiment, the moving image output from the imaging device (web camera or the like) 80 to the analysis unit 130 is image-analyzed by the analysis unit 130, and the result of the image analysis is the user U (1 ) To U (K) are each correlated with the video scene currently being viewed. As a result, it is possible to analyze physical responses of the users U (1) to U (K) in each video scene from the moving image captured by the imaging device (web camera etc.) 80. It becomes possible to analyze whether you are excited or interested in various video scenes.

In another embodiment, the imaging device (web camera etc.) 80 is a plurality of users U (views of the same video content mv (x) simultaneously facing the same screen) among the screens 2a to 2c. Alternatively, i ₁ ) to U (i _h ) may be captured together and output to the analysis unit 130 in the video and audio management apparatus 100. By analyzing the image captured in this way, the analysis unit 130 extracts the behavior characteristic of the entire crowd viewing the same video content at the same time, and the entire crowd is excited about or interested in the video scene of what content It is possible to analyze or indicate.

  Further, as described in the first embodiment with reference to FIGS. 1 to 3, the operation history and the like in the wireless headphone 50 (i) (1 ≦ i ≦ K) are recorded as recording data for each user who is viewing an image. However, this recording data is handled as follows in the second embodiment shown in FIGS. First, the recording data recorded for each of the users U (1) to U (K) viewing the video is wirelessly transmitted from the wireless headphone 50 (i) (1 ≦ i ≦ K) to the video and audio management device 100. Will be sent. Subsequently, the recording data received as a wireless signal by the voice distribution terminal / headphone usage detection terminal 90 shown in FIG. 6 is output to the analysis unit 130.

  At that time, in the sound distribution terminal / headphone usage detection terminal 90 shown in FIG. 6, the wireless headphones 50 (i) (1.ltoreq.i.ltoreq.K) worn by each of the users U (1) to U (K) are the screening system It may be detected at which position in the internal space of 1. This detection may be performed, for example, by beam steering processing on the radio signal received by the sound distribution terminal / headphone usage detection terminal 90.

  The screening schedule management unit 140 is configured to manage the screening schedule of video content and promotion video in units of organization frames. The screening schedule management unit 140 shown in FIG. 7 and FIG. 8 manages the screening schedule of the video content mv (j) (1 ≦ j ≦ J) in units of organization frames, and plans and / or produces the video content. The purchase information of the organization frame is accepted from the person, and the screening schedule is organized according to the purchase situation of the organization frame.

  In one embodiment, when the screening schedule management unit 140 receives the sales information of the organization frame from the organization frame sales information receiving unit 31 connected to the outside of the video and audio management apparatus 100, the current screening schedule is displayed from the schedule database 44. read out. Here, as shown in FIG. 6, the purchasing procedure of the organization frame is an information terminal (personal computer) in which the video creator C (h) (1 ≦ h ≦ H) is connected to the organization frame sales information accepting unit 31 Etc.) 93 is performed. Then, the screening schedule management unit 140 rearranges the screening schedule according to the sales situation of the organization frame. Finally, the screening schedule management unit 140 stores the screening schedule after reorganization in the schedule database 44 as the updated screening schedule.

  In one embodiment, the identification information of each creator C (h) may be stored in the user information database 43 together with the user information λ (i) (1 ≦ i ≦ P). More specifically, identification information of each creator C (h) (1 ≦ h H H) is included in creator information η (h) (1 h h H H), and creator information η (h) ) (1 ≦ h ≦ H) may be stored in the user information database 43. Also, creator information η (h) (1 ≦ h ≦ H) stored in the user information database 43 is a settlement for managing personal information of creator C (h) and a deposit account of creator C (h) It may further include system information.

  Note that the information terminal (personal computer or the like) 93 operated by the creator C (h) may be a terminal installed in a store or movie theater where the managing company of the screening system 1 makes a tie-up with the screening system 1. In that case, if creator C (h) performs registration by inputting his / her personal information to information terminal (personal computer etc.) 93, creator information 創作 (of creator C (h) h) is generated and stored in the user information database 43. At the same time, from the card issuing machine connected to the information terminal (personal computer etc.) 93 to the creator C (h), the IC card in which the creator information 創作 (h) is written is the creator C (h) authentication May be issued for use and for identification.

  The feedback output unit 135 that feeds back the echo from the user U (i) to the creator of the video content mv (j) is an imaging device (web camera, etc.) that captures the user U (i) while viewing the video. ) The video from 80 is received from the analysis unit 130. Subsequently, during screening of the video content mv (h) of the creator C (h) in the organization frame purchased by the creator C (h), the feedback output unit 135 uses the creator C (h) as a video. Deliver to the information terminal to use. Here, the information terminal used by creator C (h) is a terminal that creator C (h) can view and listen to, the information terminal (personal computer etc.) 93 shown in FIG. The mobile terminal 61 owned by (h) may be used.

Further, in the second embodiment as well as in the first embodiment described above with reference to FIGS. 1 to 3, in the second embodiment, each of the users U (i) (1 ≦ i ≦ K) is wireless The following analysis processing may be performed from the recording of the sound switching operation performed by the headphones 50 (i) (1 ≦ i ≦ K). That is, from the history in which each user U (i) has performed the above-mentioned audio switching operation to switch the audio channel of the video content mv (j) (1 ≦ j ≦ J) to be viewed, the following (a) and (a) The analysis result of at least one or more of b) may be further output to the feedback output unit 135.
(A) Movement recording in which the history of movement of the user U (i) who is viewing _one video content mv (j ₁ ) to view another video content mv (j ₂ ) is recorded for each user, And (b) Recording of the transition of the ratio of the number of people who view and listen to each of the video content mv (j) (1 ≦ j ≦ J) being shown to the total number of users.

  Thereafter, the feedback output unit 135 distributes the analysis results of the above (a) and (b) received from the analysis unit 130 to the information terminal of the creator C (h) (1 ≦ h ≦ H) as reporting information. It may be configured as follows. The information terminal of creator C (h) (1 ≦ h ≦ H) may be an information terminal (personal computer etc.) 93 shown in FIG. 6 or a portable terminal owned by creator C (h).

  Moreover, in one embodiment, the users U (1) to U (K) are video contents which seem to be very good in the past screening schedule displayed on the information terminal (personal computer etc.) 92. If you find a movie, you may be able to pay the coin to the creator of the video. For example, the information terminal (personal computer, etc.) 92 displaying the past screening schedule should be operated to click on the screening frame of the video content displayed in the screen with a mouse and pay the creator as a dumped coin The amount of money may be keyboard input.

  In this embodiment, the feedback output unit 135 receives dumps from users U (i) (1 ≦ i ≦ K) after the start of viewing of each of the video content mv (j) (1 ≦ j ≦ J), respectively. The money is distributed to the deposit account of creator C (h) (1 ≦ h ≦ H) who respectively created the video content mv (j) (1 ≦ j ≦ J).

  More specifically, the feedback output unit 135 associates the amount of change with the identification information of the user U (i) and receives it from the user terminal 60 (i) owned by the user U (i). , Accepting the change from user U (i) after viewing of the video content mv (j), and associating the total amount of each change of video content with the identification information of the respective creator C (h), the respective creators By distributing to the settlement system that manages the deposit account of C (h), the change is distributed to the deposit account of creator C (h).

In addition, the feedback output unit 135 is based on the total amount of change sent from the user U (i) (1 ≦ i ≦ K) and the electronic vote from the user U (i) (1 ≦ i ≦ K). The creators C (h) (1 ≦ h ≦ H) who respectively created the video content mv (j) (1 ≦ j ≦ J) may be ranked. In addition, the screening schedule management unit 140 prefers the creator C (z ₁ ) ranked higher than the creator creator C (z ₂ ) ranked lower than the creator C (z ₂ ) ranked lower. May be configured to assign a composition frame.

In addition, the feedback output unit 135 highly evaluates the user (i ₁ ) who pays a large amount of money for the video content mv (z ₁ ) of the creator C (z ₁ ) ranked high. You may give it. On the other hand, the feedback output unit 135 gives a low rating to the user (i ₂ ) who only obviously pays a lower payment than other users among the users who have watched the video content mv (z ₁ ). May be By doing this, the feedback output unit 135 may rank the users U (i) (1 ≦ i ≦ K) based on the evaluation for each user. Such ranking for each user can be used as reference information when deciding what kind of special treatment or promotion should be given to which user.

1, 1 'screening system 2 (2a, 2b, 2c) screen 3 inner wall 4 (4a, 4b, 4c) long chair 5 lending counter 6 (6a, 6b) entrance and exit management device 20 (20a, 20b, 20c) image display Device 31 organization frame sales information reception unit 32 authentication charge processing unit 33 rental management unit 41 content database 42 voice information database 43 user information database 44 schedule database 50 (50a to 50K) wireless headphone 60 (60a to 60K) user Terminal 70 (70a to 70K) Motion sensor 80 Imaging device (web, camera etc.)
90 voice distribution terminal / headphone use detection terminal 91 information terminal (personal computer etc.)
92 Information terminal (personal computer etc.)
93 Information terminal (personal computer etc.)
100, 100 'video and audio management apparatus 110 video information output unit 120 audio information output unit 130 analysis unit 140 screening schedule management unit 150 synchronization control unit 160 bus and communication interface

Claims (16)

A video information output unit for outputting video information to a plurality of video display devices for respectively screening a plurality of different videos simultaneously;
An audio information output unit that outputs audio information synchronized with the video information so that the audio information can be switchably received by a plurality of wireless headphones lent to the user;
Audio-visual management device equipped with The audio information output unit is configured to output a plurality of audio information including at least a main audio and a sub audio with respect to one piece of the video information so that the plurality of wireless headphones can switchably receive the audio information.
The video and audio management device according to claim 1. An analysis unit for acquiring data on a usage state of the wireless headphone while viewing a video;
The video / audio management device according to claim 1, further comprising: The data relating to the usage of the wireless headphone is
Including a record of operations performed by the user on the wireless headphone while viewing a video,
The recording includes a reception switching operation among a plurality of audio information synchronized with the different video information, a volume adjustment operation, and an on / off switching operation of a power source for audio signal reception,
The video and audio management device according to claim 3. The analysis unit is connected to an imaging device that captures the user who is watching a video as a moving image.
The video and audio management device according to claim 3 or 4. The analysis unit
The video attribute including the performer and the genre of the video and each video scene are identified using the metadata of the video information,
Acquiring physical measurement information on the physical response of the user from a motion sensor, or acquiring a physical response of the user by analyzing a moving image obtained by imaging the user while viewing a video,
The usage of the wireless headphone is analyzed by detecting the video attribute and the video scene in which the user is interested from the time change of the physical response of the user.
The video and audio management device according to claim 5, further comprising: The analysis unit
The video attribute including the performer and the genre of the video and each video scene are identified using the metadata of the video information,
By detecting the video attribute and the video scene in which the user is interested from the operation record of the volume and / or sound quality adjustment operation performed by the user while viewing the video with the wireless headphone, the wireless headphone Analyze the usage situation,
The video and audio management device according to claim 5 or 6, further comprising: The data relating to the use status of the wireless headphone includes recorded data of the user while viewing a video,
The analysis unit is configured to perform analysis regarding optimization of video content to be screened and a screening schedule by analyzing the recorded data of the user while viewing a video.
The video and audio management device according to any one of claims 5 to 7. Manage the screening schedule of video content in a unit of organizing frame, receive purchase information of the organizing frame from the creator who planned and / or produced the video content, and organize the screening schedule according to the purchase status of the organizing frame Further comprising a screening schedule management unit,
The video and audio management device according to any one of claims 5 to 8. The system further comprises a feedback output unit that feeds back the user's feedback to the creator,
The feedback output unit is
Receiving from the analysis unit the moving image from the imaging device imaging the user while viewing a video;
During screening of the creator's video content in the organization frame purchased by the creator, the moving image is distributed to the creator's information terminal as a video that can be viewed by the creator.
The video and audio management device according to claim 9, configured as follows. The analysis unit may record the operation performed by the user while viewing the video with the wireless headphone.
(A) movement recording in which the user who is watching one of the video contents has moved to view another of the video contents and recorded for each user, and (b) the video contents being screened A record of the transition of the number of people watching each one,
Are further configured to output the result of analysis processing of at least one of the above to the feedback output unit for distribution to the creator's information terminal,
The video and audio management device according to claim 10. The voice information output unit is
Viewing position information indicating which video scene the video content has been viewed by the user based on the output history of the corresponding audio information;
Delivering the viewing position information to a user terminal owned by the user;
The video and audio management device according to any one of claims 1 to 11, further configured as follows. The feedback output unit is
Accepting a change from the user after the start of viewing the video content,
Distributing the coin to the deposit account of the creator of the video content,
The video and audio management device according to claim 10, wherein the video and audio management device is configured as follows. The feedback output unit is
The amount of the coin is associated with the identification information of the user and received from the user terminal held by the user, thereby accepting the coin from the user after the start of viewing of the video content,
The amount of money sent to the creator's deposit account is distributed to a payment system that manages the deposit account of each creator by associating the total amount of each video content of the dump money with the identification information of each creator. Distribute,
The video and audio management device according to claim 13 configured as follows. A plurality of video display devices for displaying and screening a plurality of different videos simultaneously on a plurality of screens;
A video information output unit that outputs video information to each of the plurality of video display devices;
An audio information output unit for wirelessly transmitting audio information synchronized with the video information so that the audio information can be switchably received by a plurality of wireless headphones lent to the user;
An internal space in which a plurality of the screens are provided along the inner wall surface;
An authentication charge processing unit for authenticating the user and charging the user to the user receiving the rental of the wireless headphone;
Screening system equipped with A lending management unit that lends wireless headphones to the user who has performed charging or authentication in association with the user information generated as a result of the charging or authentication,
The screening system according to claim 15, further comprising