WO2013061389A1

WO2013061389A1 - Conference-call system, content-display system, and digest-content playback method and program

Info

Publication number: WO2013061389A1
Application number: PCT/JP2011/006590
Authority: WO
Inventors: 雄一郎板倉
Original assignee: 株式会社シナジードライブ
Priority date: 2011-10-27
Filing date: 2011-11-26
Publication date: 2013-05-02
Also published as: JPWO2013061389A1

Abstract

Provided are: a conference-call system that makes it possible to see changes in listeners' satisfaction levels over time; and a method that allows the incorporation of listeners' opinions and automatic digest playback. Said conference-call system comprises the following: call terminals each provided with a speech means, an audio output means, a communication interface, and a GUI comprising a conference-information display means and a conference-participation registration means; monitor terminals each provided with an audio output means, a communication interface, and a GUI comprising a conference-information display means, a monitor-participation registration means, and a satisfaction-level input means; and a host computer that exchanges audio packets with each call terminal. The host computer generates conference-call packets by combining audio packets received from each call terminal. The generated conference-call packets are transmitted to each call terminal and monitor terminal. Satisfaction-level-data time information received from the monitor terminals is used to compute received count totals for prescribed time periods. The distribution of the satisfaction-level-data received count totals from the beginning of a conference call to the end thereof is organized chronologically and transmitted to the call terminals and monitor terminals.

Description

Conference call system, content display system, summary content playback method and program

The present invention relates to a technology for a conference call system, a content display system, and a summary content reproduction method via a communication network such as the Internet.

In a normal conference call system, there is a communication network that connects a plurality of communication terminals, whereby the communication terminals can transmit and receive information to and from each other by a call or other communication event. The information is not limited to audio data, and can include text data, image data, and video data.

The Internet is known as a typical communication network suitable for such data transmission. In the Internet, a protocol used to transmit voice data is called Voice over IP (VoIP). VoIP routes voice conversation over the Internet or an IP (Internet Protocol) based network.

Now, the voice conversation performed simultaneously with at least three communication terminals is called a conference call. For example, assume that six communication terminals (T ₀ to T ₅ ) shown in FIG. 1 perform a conference call. Communication terminal T ₀ serves as a host communication terminals of the conference call. Other communication terminals (T ₁ to T ₅ ) participating in the conference call transmit audio data signals (D ₁ to D ₅ ) to the host communication terminal T ₀ , respectively. Then, the host communication terminal T ₀ synthesizes the audio data signals D ₁ to D ₅ sent from the communication terminals (T ₁ to T ₅ ). The synthesized voice data signal Dc is transmitted to the other communication terminals (T ₁ to T ₅ ). In this case, the host communication terminal T ₀ is not only the other communication terminals (T ₁ to T ₅ ) participating in the conference, but also monitors that are present on the network (here, the monitor simply speaks a conference call and speaks). The synthesized audio data signal Dc can also be transmitted to a monitor terminal that desires a person who does not perform it.

Special Table 2007-507190 JP 2005-269347 A JP 2010-093479 A

Conventionally, an audio data signal Dc synthesized in a conference call is stored as a file in a server computer as it is, and is transmitted to a client terminal as a streaming data file as necessary. Here, as the content of the conference call, only the conference theme or the beginning of the first call is displayed as text, or a summary of the conference is separately displayed as text.
If the conference has a scenario in advance, it is possible to divide the conference theme into sub-themes and divide the time. It is also possible to search for an interesting part using this as an index. However, there are a limited number of conference calls with scenarios, and there are many cases where most proceed without a scenario. This is especially true in a conference call where there is no person responsible for the progress of the conference call.

In this way, in the case of a conference call where there is no predetermined scenario and the conversation can be freely conducted, it is very laborious to create a digest version (summary version) that summarizes the content of the conference call. It was.
For example, let's take an example of a debate program that discusses from midnight to the morning, which is also a popular TV program. In this type of discussion program, the debate sits on a round table and speaks freely according to the theme. Rather than being a moderator who manages the theme progress, there is a coordinator who encourages the debate to speak, and excites the discussion. In addition, there are viewers who watch the discussion content, and they are seated in the outside seats around the discussion table. In such a debate program, the debate freely speaks about the debate theme, and the contents of those remarks are listened to by the viewers on the spot and the TV viewers through the TV screen to share information. . The debater gestures, but basically only sits and speaks. There are scenes where slides are used, but they are rarely needed. Viewers are interested in the content of the debate.

In the future, it is expected that the number of conference call opportunities for discussing various discussion themes on the Internet will increase more and more, and there is a demand for an environment in which many viewers can monitor each conference call place.
With regard to the content of conference calls, if there is a mechanism that can capture the opinions of the listeners from the viewpoint of the listeners, and edit and automatically summarize only those places where the listeners are highly satisfied, Convenience can be further enhanced.
In addition, the conference call is not an audio-only conference, but also includes video content including video. There is also content that sequentially switches still image content. Concerning the contents of these contents, if there is a mechanism that can take in the viewer's opinions from the viewer's viewpoint, and automatically edit and summarize only the places where the viewer's satisfaction is high, the convenience of the contents Can be further enhanced.

In view of the above situation, the present invention provides a system that can capture the change over time of the satisfaction level of the listener / viewer regarding the content of the conference call and the content, and incorporates the opinion of the viewer / viewer in the conference call It is an object of the present invention to provide a method and program capable of automatically reproducing contents or contents automatically.
Here, the satisfaction level of the listener / viewer means a real-time satisfaction level or an interest level / interest level with respect to the content of the conference call or the content. Further, in this specification, the conference call includes not only a conversation in which a plurality of callers exist but also a talk given by one speaker. The audio data in the conference call includes not only human conversation but also performance and music using musical instruments.

In order to achieve the above object, a conference call system of the present invention includes a network for transferring packets using the Internet protocol, a graphical user interface comprising conference information display means and conference participation registration means, speech means and voice output. At least one call terminal having means and a network interface, a graphical user interface comprising conference information display means, monitor participation registration means and satisfaction input means, at least one voice output means and network interface In a conference call system composed of a monitor terminal and a host computer that transmits and receives audio data packets between each call terminal,
The host computer generates a conference call data packet by synthesizing the voice data packets received from each call terminal, and transmits the generated conference call data packet to all call terminals and monitor terminals through the network. From the time information of the received satisfaction data, calculate the cumulative reception count within a predetermined time, and time-series the distribution of the total reception count of the satisfaction data from the start to the end of the conference call. The reception count cumulative distribution is transmitted to the call terminal and the monitor terminal, and the conference call data file obtained by combining the generated conference call data packets and the reception count cumulative distribution data file of the satisfaction data in time series are associated or integrated. And storing it in a memory.

According to the conference call system configured as described above, the host computer of the conference call can distribute the synthesized speech from the communication terminal that can speak to the conference to all communication terminals and monitor terminals, and can listen to the content of the conference call. Change in the satisfaction level of the user (monitor terminal user).
The host computer not only synthesizes speech from the communication terminal, but also starts and ends a conference call (hereinafter referred to as a session in the specification), distributes session information, and participates in the session of the call terminal and the monitor terminal. Inquiries, authentication of call terminals and monitor terminals, and management of network addresses of call terminals and monitor terminals.

The reason for using at least one telephone terminal is that it is assumed that there are multiple listeners in one utterance, such as a lecture or speech. In a normal conference call, there are a plurality of call terminals such as two people and three people. In addition, at least one monitor terminal means that there is at least one listener who does not speak.
Here, the call terminal and the monitor terminal are computers that can be connected to a network that transfers packets using an Internet protocol, such as a mobile computer, a mobile phone, and a PC (Personal Computer).

The speech means is a sound collection device such as a microphone, and the sound output means is a speaker or an earphone.
The conference information display means also displays information related to the conference distributed from the host computer, such as conference theme, conference start time, conference participant information, conference participant count, monitor count (listener number), etc. It is displayed on the screen.
The conference participation registration unit and the monitor participation registration unit are for authenticating a user by inputting a user ID (identifier), a password, etc. from the browser screen of the terminal.

Here, the satisfaction input means is specifically a satisfaction button displayed on the screen of the monitor terminal, and when the button is pressed, the satisfaction data is hosted through the network at predetermined intervals. Send to computer. The listener can press the satisfaction button when the listener himself or herself agrees with or agrees to the utterance content according to the progress of the conference call from the monitor terminal. The name of the satisfaction level button can be freely set such as “good”, “like”, “satisfied”, “interested”, “interested”. Specifically, on the screen of the monitor terminal, “satisfied”, “sympathy”, “good”, “bad”, “like”, “interested”, “interested”, “nice”, “scary” , “Thrill”, “dislike”, “looks good”, “does not look good”, “fun”, “good”, “bad”, “impressed”, “want”, “does not want”, “approves”, “ An expression containing either “opposite” is displayed.

Further, the higher the satisfaction level is, the more times the satisfaction button is pressed. For example, it may be possible to input satisfaction data having a high degree of satisfaction by inputting the satisfaction data twice or more at a predetermined time. For example, when satisfaction data can be input only once every 15 seconds, the satisfaction data is counted multiple times by inputting the satisfaction data multiple times (for example, pressing the button several times), and the satisfaction level is counted. Data that can be distinguished in size is sent to the host computer.
In addition, a selection button may be provided as a means for inputting a satisfaction level such as “very satisfied”, “satisfied”, “slightly satisfied”, and the like.

Also, depending on the content, the meaning of satisfaction may be replaced with “scary”, “thrilling”, or “dislike”. For example, in the case of content such as a horror movie or reading a mystery novel, the name of the satisfaction button may be changed as appropriate.

A listener who uses the monitor terminal can input the degree of satisfaction of the content of the conference call between the start and end of the conference call (session).
The satisfaction data reception count from the start to the end of a conference call (session) is the number of satisfaction data received by the host computer from the session start time to the session end time. Although it is possible to calculate the total reception count of satisfaction data every second, in evaluating the satisfaction level of a conference call, instead of taking a short total count such as every second, 30 The total reception count within a predetermined time such as seconds, 1 minute, and 2 minutes is calculated. The time series of the received count cumulative distribution of the satisfaction degree data from the start to the end of the conference call means that the horizontal axis represents time, and the vertical axis represents the received count cumulative within a predetermined time.
The conference call (session) listener includes both a real-time listener from the start to the end of the session and a session listener recorded (recorded) after the session ends.

Here, it is preferable that the reception count cumulative distribution data file of the satisfaction data in time series described above can be updated by the satisfaction data received from the monitor terminal. This is because the satisfaction data of the listener of the recorded session is also added as the reception count of the satisfaction data.

The call terminal further includes a satisfaction degree input means, and the host computer calculates a cumulative reception count within a predetermined time from time information of satisfaction data received from each call terminal and each monitor terminal, It is preferable to time-series the reception count cumulative distribution of satisfaction data from the start to the end of a call.
Since the call terminal is provided with the satisfaction degree input means in the same manner as the monitor terminal, not only the conference call listener but also the caller himself / herself can send satisfaction data regarding the content of the conference call to the host computer. This is because the caller can be a listener of the utterances of others.

Note that it is preferable that the session listener can reserve the session to be monitored by the calendar function. In this case, for example, before the reserved session starts, an alarm notification or a message notification is automatically displayed on its own monitor terminal, and the listener can observe the conference call in real time.

Next, the content display system of the present invention will be described.
The content display system of the present invention comprises a network for transferring packets using the Internet protocol, a graphical user interface comprising content information display means, monitor participation registration means, and satisfaction input means, audio output means, and network interface. In a content display system including at least one monitor terminal provided and a host computer that transmits and receives data between the monitor terminals described above,
The host computer calculates the received count cumulative within a predetermined time from the time information of the satisfaction data received from each monitor terminal, and time-series the received count cumulative distribution of the satisfaction data from the start to the end of the content. Send the serialized distribution count of satisfaction data to the monitor terminal, and store the content data file and the time series satisfaction data reception count cumulative distribution data in the memory in association with each other. It is characterized by doing.

According to the content display system having the above-described configuration, the host computer can capture the temporal change in the degree of satisfaction of the viewer (monitor terminal user) regarding the content content from the start to the end of the content.
Here, the satisfaction input means is the same as in the case of the conference call system described above.

In the conference call system and content display system described above, the host computer preferably includes means for associating the user attribute acquired from the monitor participation registration means with the satisfaction degree data.
Here, user attributes include name, age, gender, occupation, hobby, date of birth, zodiac, blood type, marriage history, family composition, birthplace, child age, worries, worries, future dreams, past It is selected from the group of content information that has transmitted empathy data.

More preferably, in the conference call system and the content display system described above, the host computer associates the conference call data information of the conference call data file or the content information of the content data file with the satisfaction data when the satisfaction level data is received. Means for analyzing the user tendency of inputting satisfaction data into specific conversation call data information or specific content information using the user attributes provided, and from the analysis results, at least survey data, market research data, statistical data Means for generating one.
For example, the age distribution (for example, teens, 20s ...) of users who feel satisfaction with conference call data information or content information at a certain timing, sex type, blood type, place of origin, occupation, etc. Statistical data can be obtained. In this way, since it is possible to analyze the tendency of users who have entered satisfaction data into conference call data information or content information at a certain timing, various questionnaire data and market research data can be controlled by controlling conference call data information or content information. Statistical data can be generated.

In the conference call system and the content display system described above, the host computer associates user attributes associated with individual satisfaction data received during a predetermined time period, and stores them as a database of user attributes having the same kind of empathy. It is preferable to further include means for By associating user attributes with satisfaction data, users having the same kind of empathy can be collected on the host computer side.

In the conference call system and the content display system described above, when the host computer issues a request for searching using a specific user attribute as a search key from the monitor terminal, a time series of satisfaction data associated with the user attribute The distribution is preferably sent to the monitor terminal.
To use a specific user attribute as a search key means, for example, a search by a certain individual, a boy only, an age range, a zodiac sign of a birth year, a place of birth, or the like. The host computer then displays the time series distribution of the satisfaction data associated with the user attribute so that the monitor terminal can display a graph or the like of the time series distribution of the satisfaction data associated with the user attribute as the search key. Send to monitor terminal.

Next, the summary content reproduction method of the present invention will be described.
The summary content playback method of the present invention is a summary content playback method in the conference call system of the present invention described above or the content display system of the present invention described above, and includes the following steps a) to c).
a) Step of calculating the accumulated reception count within a predetermined time from the time information of the satisfaction data received from the monitor terminal b) The reception count of satisfaction data from the start to the end of the conference call data file or content data file Step c) Cumulative distribution time series c) From the conference call data file or content data file described above, the time before the highest peak time of the reception count number of satisfaction data is taken as an index point, and a conference for a predetermined time from the index point Step of reproducing call data or content data

Here, the index point in the above step c) is specifically the time returned by a preset time from the upper peak time of the reception count number of the satisfaction data.
In addition, the index point in step c) is preferably a time before the time when the utterance stops, before the time returned by a preset time from the upper peak time of the reception count number of satisfaction data.
In addition, the index point in step c) is preferably a time before the time when the content scene is switched before the time returned by a preset time from the upper peak time of the reception count number of satisfaction data.
Here, the peak time is an absolute time or an offset time from the session start time in the case of a real-time session. In particular, when listening to a recorded session, the time series information of the reception count of the satisfaction data of the listener is an offset time from the session start time.
Data reproduction is performed from one of the above index points. For example, when the user requests the next index point, the playback end timing may be jumped to another index point.

In the summary content playback method of the present invention, the determination of the upper rank of the reception count number of the satisfaction data is that the reception count number of the satisfaction data is larger than a threshold parameter, and the threshold parameter is a conference call data file. Or, it is more preferable that the parameters can be adjusted manually or automatically according to any one selected from the time from the start to the end of the content data file, the required size of the summary playback time, the number of viewers or the number of viewers. .

In addition, the time for reproducing data from the index point depends on the time from the start to the end of the conference call data file or the content data file, or on the number of peaks larger than the threshold parameter of the reception count number of the satisfaction data. Preferably, it can be automatically adjusted.

Here, the end point of data reproduction from the index point is specifically the time when the utterance stops after a predetermined time has elapsed.
Alternatively, the end point of data reproduction from the index point is a time when the scene of the content is switched after a predetermined time has elapsed.

Further, in the above step c), it is preferable that the reproduction is performed in order from the index point with the earliest time, or the reproduction is performed in descending order of satisfaction.
Alternatively, in the above step c), it is preferable that the playback time with the higher satisfaction is set longer than that with the lower level.

The summary content playback program of the present invention includes a step (a) for calculating the total reception count within the predetermined time in the above summary content playback method, and a step (b) for time-sequentially receiving the total reception count distribution of the satisfaction data. The step c) to be reproduced is executed by a computer.

In addition, as a method for generating the summary content of the conference call, the above-mentioned conference call data signal of the upper time with a large reception count of satisfaction data is cut out and connected to generate a data file summarizing the conference call data signal. You can do it. The contents of conference calls can be automatically summarized by taking in the opinions of viewers and viewers. That is, the session contents before and after the session time with a high degree of satisfaction of the listener are cut out and connected (summarized and edited) to obtain a summary version (digest version) of the session.

Here, the summary editing has the following modes.
(1) Summarized edits are connected in order from the earliest session time according to the session time schedule. (2) Summarized edits are connected in order from the top session with the highest content satisfaction. (3) Summary edits are: When the session content before and after the upper session time with a high content satisfaction is cut out, the one with the higher content satisfaction is cut out for a longer time.
(4) Summary editing connects sessions in which a particular session participant with a high content satisfaction level is spoken. In addition, a delimiter (sounds, characters, designs, etc.) may be provided in the portion to be connected. Is possible. The session summary data file can also be inserted into the terminal browser as a hyperlink.

In the above conference call system and content display system, the conference call data file also includes a conference call data file or content data file partially cut out from the original conference call data file or content data file and edited. In the case of an edited conference call data file or content data file, the host computer regards the edited conference call or content start time as an offset time from the starting point of the original conference call data file or content data file. In addition, the end time of the edited conference call or content is regarded as the offset time from the starting point of the original conference call data file or content data file, and from each monitor terminal From the time information of the received satisfaction data, the total reception count within a predetermined time is calculated, and the total distribution of reception counts of the satisfaction data from the start to the end of the edited conference call is the original conference call data file or content Time series using the timeline of the data file, and the cumulative distribution of the received count of the satisfaction data that has been time-series sent to the monitor terminal, the original conference call data file or content data file and the time-series satisfaction data And the received count cumulative distribution data file are stored in the memory in association with each other.

The original conference call data file or content data file may be distributed as a conference call data file or content data file edited by another service. For example, a 150-minute data file may be shortened to 120 minutes under some restrictions, or may be divided into a plurality of files (for example, divided into five files every 30 minutes).
Even for such an edited conference call data file or content data file, the host computer determines the start time of the edited conference call or content from the starting point of the original conference call data file or content data file. Ending from the start of the edited conference call by regarding the offset time and the end time of the edited conference call or content as the offset time from the starting point of the original conference call data file or content data file The cumulative distribution of received counts up to the above is time-series using the original conference call data file or content data file timeline.
Thereby, the received count cumulative distribution of satisfaction data of the original data file and the edited data file can be merged, and time series can be made using the same timeline.

According to the present invention, there is an effect that it is possible to capture a temporal change in satisfaction of the listener / viewer regarding the content of the conference call and the content. In addition, it has an effect that the contents of the conference call and the contents can be summarized and reproduced by taking in the opinions of the observer and viewer.

Configuration of conventional conference call system Configuration diagram of conference call system of embodiment 1 Functional block diagram of a telephone terminal Functional block diagram of the monitor terminal Session explanation diagram Illustration of session participants and listeners Sample screen showing session status Session satisfaction time series chart Session satisfaction peak value extraction flow chart Session satisfaction time series chart 1 Time series chart of session satisfaction 2 Explanatory drawing of aspect A of summary reproduction method Explanatory drawing of aspect B of summary reproduction method Explanatory drawing of aspect C of summary reproduction method Explanatory drawing of aspect D of summary reproduction method Process flow of host computer (1) Process flow of host computer (2) Explanatory diagram of threshold parameter for satisfaction (1) Explanatory drawing of threshold parameter for satisfaction (2) Index point acquisition flow (1) Index point acquisition flow (2) Index point acquisition flow (3) Configuration diagram of content display system of embodiment 2 Example of user attribute table Explanatory drawing when user attributes are associated with satisfaction data (1) Explanatory drawing when user attributes are associated with satisfaction data (2) Explanatory drawing when user attributes are associated with satisfaction data (3)

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The scope of the present invention is not limited to the following examples and illustrated examples, and many changes and modifications can be made.

FIG. 2 shows a configuration diagram of the conference call system of the present invention. As shown in FIG. 2, the conference call system of the present invention includes one host computer T ₀ , five communication terminals (T ₁ to T ₅ ), and four monitor terminals (M ₁ to M ₄ ). Suppose you are connected to the Internet. Communication terminals (T ₁ to T ₅ ) participating in the conference call respectively transmit audio data signals (D ₁ to D ₅ ) to the host computer T ₀ . Then, the host computer T ₀ synthesizes audio data signals D ₁ to D ₅ sent from the communication terminals (T ₁ to T ₅ ). The synthesized audio data signal Dc is transmitted to all five communication terminals (T ₁ to T ₅ ) and all four monitor terminals (M ₁ to M ₄ ).

The monitor terminals (M ₁ to M ₄ ) can listen to the conference call after transmitting monitor requests (MR ₁ to MR ₄ ) to the host computer T ₀ . In addition, the monitor terminals (M ₁ to M ₄ ) can transmit the satisfaction data (S ₁ to S ₄ ) of the content of the conference call.

Next, the functional block diagram of the call terminal and the functional block diagram of the monitor terminal are shown in FIGS. 3 and 4, respectively. As shown in FIG. 3, the call terminal 10 includes a graphical user interface (GUI) 19 including a conference information display unit 11 and a conference participation registration unit 12, a speech unit 13, a voice output unit 14, and a network interface 15. As shown in FIG. 4, the monitor terminal 20 includes a conference information display means 21, a monitor participation registration means 22, and a satisfaction input means 23, a graphical user interface (GUI) 29, an audio output means 24, and a network interface. 25.

Next, the session will be described with reference to FIG. In general, a session is a term that has the meaning of an activity period, a semester, a session period, a holding period, a gathering, etc. In computer system and network communication, it is a series from communication connection or login to communication disconnection or logoff. Operation and communication.
A session in the description of the present invention means a period from the start to the end of a conference call and a period from the start to the end of moving image content (including one that sequentially switches still images). As shown in FIG. 5, when the time axis is taken on the horizontal axis, the conference call time and content display time from the session start to the session end are expressed as session time.
As shown in FIG. 5, the session is held between the opening and closing of the conference room (referred to as a room here). The time from room opening to room closing is the room opening time.

In the conference call system of the present invention, a conference room (room) is virtually provided on the host computer, and the owner information of the conference room or the main user information, the conference name, the caller information, the session holding, as the room attribute information Time, call language, conference theme, number of monitors, etc. are registered. These room attribute information is disclosed or partially disclosed on the Internet. Partial disclosure refers to a case where only a part of room attribute information (for example, conference name, session opening time, call language information) is disclosed, or a case where it is disclosed only to a specific limited member. Such public information is displayed on the screen by the respective conference information display means of the call terminal and the monitor terminal.
The monitor terminal can pre-register with the host computer that it wishes to monitor.

As shown in Fig. 5, the room opens before the session starts and closes after the session ends. When the host computer opens the room, the host computer transmits a holding message to the monitor terminal that has registered in advance that the monitor is desired. In addition, the monitor terminal of the session reserves the session you want to hear using the calendar function of your terminal, and automatically displays an alarm notification or message notification on your monitor terminal before the reserved session starts. But you can.

The concept of session participants and session listeners will be described with reference to FIG. The session participant and the session listener are separate terminals, and the session participant's terminal is called a call terminal, and the session listener's terminal is called a monitor terminal.
In the case of FIG. 6, there are eight session participants H1 to H8, and session listeners are an unspecified number of K1 to Kn. An upper limit is set for the number of session participants, that is, speakers, but it is sufficient to set an upper limit necessary for maintaining the performance of the system as the number of session listeners. The session listener can replace the session participant during the session, and the session participant can also replace the session listener during the session. These changes can be made by the meeting room owner or the primary user.

FIG. 7 shows an example of a screen showing the state of the session. In the screen example of FIG. 7, the conference room name 51 is “Room1”, and the main user information is an image display area 52 and a name display area of a face photo (may be an avatar-like illustration or image content showing individuality). 53. Photo and name “Yuichiro”
“Itakura” is displayed, and in the conference theme display area 54, “Yuichiro Itakura's love course” is displayed.
If the session is currently in progress, the “Live” notation is displayed in an active state, and if the session has already ended and the recorded content has been listened to, the “REC” notation is displayed in an active state.
Also, if the session room is open, the “open” notation is displayed in an active state, and if the session room is already closed, “closed” is displayed.
The notation is displayed in the active state.

Furthermore, as shown in FIG. 7, the display area 61 for the number of monitors in the session, the display area 62 for the count number of satisfaction data, the display area for the number of people who want to speak, or the display area 63 for the number of people who answered questions during the session. Each is displayed as a count value. In addition, a graph display area 64 showing a time series change in the number of monitors in the session and a graph display area 65 showing a time series change in the count number of the satisfaction degree data are provided.

FIG. 8 shows a time series chart of session satisfaction. The horizontal axis of the graph of FIG. 8 is time, and the vertical axis is the count number of satisfaction data. The graph of FIG. 8 represents a time-series change in the count number of satisfaction data from the session start to the session end.
The listener using the monitor terminal can transmit the satisfaction level data to the host computer by the satisfaction level input means of the content of the conference call between the start and end of the session. The reception count of satisfaction data from the start to the end of the session is the number of satisfaction data received from the monitor terminal by the host computer from the session start time to the session end time. Although it is possible to calculate the total reception count of satisfaction data every second, in evaluating the satisfaction of the session, instead of taking a short total of counts like every second, 30 seconds The total reception count within a predetermined time such as 1 minute or 2 minutes is calculated. The time series of the reception count cumulative distribution of satisfaction data from the start to the end of the session means that the horizontal axis represents time and the vertical axis represents the reception count cumulative within a predetermined time. The graph of FIG. 8 shows the cumulative reception count of satisfaction data within a predetermined time in time series.

FIG. 9 shows a flow for extracting the peak value of the satisfaction level of the session.
In the peak value extraction of the satisfaction level of the session, a cumulative reception count value of satisfaction (S) data within a predetermined time, for example, a time interval of 2 minutes (INT) is acquired (step S10). Then, a time period in which the cumulative value of satisfaction (S) is high between the session start and the session end is extracted (step S12).

FIG. 10 shows the first to sixth ranks of satisfaction (S) in the time series chart of session satisfaction. Between the session start and session end, values 1 to 6 are assigned near the peak in descending order of the cumulative count value of satisfaction (S). This is because, when the session terminal is in progress, if the monitor terminal listener gains morals such as “good”, “like”, “satisfied”, etc., the degree of satisfaction is actively sent to the host computer. It shows that it is possible to capture the temporal changes in satisfaction of the listener / viewer regarding the session contents.
Also, as shown in FIG. 11, in the time series chart of the satisfaction level of the session, the session content having a large cumulative count value of satisfaction (S) (for example, as shown in FIG. If only the session content) is reproduced, it is possible to automatically summarize and reproduce the conference call contents by taking in the opinions of the observer.

In the first embodiment, some specific examples of the summary reproduction method are shown. With reference to FIGS. 12 to 15, four modes of the summary reproduction method will be described. In the above-mentioned session satisfaction time series chart, as shown in FIG. 11, it is assumed that only the session contents before and after the top 1 to 3 are reproduced. The four modes described here are as follows (a) to (d).
(A) A mode in which playback is performed for a preset time in order from the earliest session time according to the session time axis direction (see FIG. 12).
(B) A mode of reproducing for a preset time in descending order of the satisfaction level (S) of the session contents (see FIG. 13).
(C) According to the time axis direction of the session, the playback is performed in order from the earliest session time, and the playback time is longer for the higher session content satisfaction (S) (see FIG. 14). ).
(D) Mode in which session content satisfaction (S) is reproduced in descending order, and the reproduction time is such that the higher the session content satisfaction (S) is, the longer the reproduction time is reproduced (see FIG. 15). .

Next, processing of the host computer in the conference call system of the present invention will be described with reference to the flowcharts of FIGS.
As shown in the flow of FIG. 16, the host computer receives voice data packets from each call terminal (step S20), synthesizes the received voice data packets (step S22), and generates a conference call data packet (step S22). Step S24). Then, the generated conference call data packet is transmitted to all call terminals and monitor terminals through the network (step S26).
The data structure of the voice data packet and the transmission / reception sequence of the voice data packet conform to the Voice over IP (VoIP) protocol.
Also, as shown in the flow of FIG. 17, the host computer receives satisfaction data from each monitor terminal (step S30), and calculates the total reception count within a predetermined time from the time information of the received satisfaction data. (Step S32). Then, the reception count cumulative distribution of satisfaction data from the start to the end of the conference call is time-series (step S34), and the time-series reception count cumulative distribution of satisfaction data is transmitted to the call terminal and the monitor terminal (step S34). S36).

Then, the host computer associates the generated conference call data file with the generated conference call data packet and stores the received count cumulative distribution data file of the satisfaction data in time series in the memory. In this case, associating and saving in the memory means that the two files are related to each other in a relational database. More specifically, as the attribute information of the conference call data file, the reception count cumulative distribution data file name and its storage address (for example, which directory on which disk) are made into a database. At that time, the total number of monitor terminals that have listened to the session (corresponding to the number of listeners), the total reception count of satisfaction data from the start to the end of the session, and the data update date are stored together.

Next, the satisfaction threshold parameter will be described with reference to FIG. The satisfaction threshold parameter is used to determine the upper rank of the reception count number of satisfaction data. When the reception count number of the satisfaction degree data is larger than the threshold parameter, it is determined that the satisfaction degree is high. The difference is obtained by subtracting the value of the threshold parameter from the reception count number of the satisfaction degree data, and the peak time when the difference value is large is determined. This will be described with reference to FIG. As shown in FIG. 18, it is assumed that there are three types of threshold parameters S ₁ to S ₃ .
In the case of the threshold parameter S ₁ , when the reception count number of the satisfaction level data is larger than the threshold parameter S ₁ , there are three peak times of upper, _first , second and third.
Further, in the case of the threshold parameter S ₂ that requires higher satisfaction than the threshold parameter S ₁ , there are only the top two peak times when the reception count number of the satisfaction data is larger than the threshold parameter S _2. Will not.
Further, in the case of the threshold parameter S ₃ that requires a satisfaction level lower than the threshold parameter S ₁ , those having a reception count number of satisfaction data larger than the threshold parameter S ₃ are 5 There will be one peak time.

By adjusting the threshold parameter in this way, it is possible to control the number of extraction times with a high degree of satisfaction for discrimination. Here, the peak time may be an absolute time in the case of a real-time session. Usually, it is an offset time from the session start time. In particular, when listening to a recorded session, the time series information of the reception count of the satisfaction data of the listener is an offset time from the session start time.
This threshold parameter can be set manually or arbitrarily depending on the time selected from the start to the end of the conference call data file, the required size of the summary playback time, the number of viewers or the number of viewers. Parameters can be adjusted.

Next, a summary content playback method in the conference call system will be described with reference to FIGS. In the conference call system, the summary content playback method includes a step of calculating the total reception count within a predetermined time from the time information of the satisfaction data received from the monitor terminal, and the satisfaction data from the start to the end of the conference call data file. Steps of chronologically receiving the cumulative distribution of received counts, and reproducing conference call data for a predetermined time from the index point, using the time before the peak time higher than the reception count number of satisfaction data as an index point from the conference call data file And a step of performing.

Here, the index point has three modes. In the first mode, the index point is a time returned by a preset time from the upper peak time of the reception count number of the satisfaction data.
In the second mode, an index point is a time before utterance stops before a time returned by a preset time from a higher peak time of the reception count number of satisfaction data.
In the third mode, an index point is a time before a time when a content scene is switched before a time set by a preset time from a higher peak time of the reception count number of satisfaction data.

For example, in the graph of FIG. 19, the reception count of the peak time of greater satisfaction data than the threshold parameter S ₁ satisfaction are three, each time assume has a t _{1 ~} t _3.
As shown in the acquisition flow of FIG. 20, the index point of the first aspect is the time (Ip _n = t _n −T _i ; n) when the time is returned by a predetermined time T _i from each time t ₁ to t _3. = 1 to 3), and there are three index points.
As shown in the acquisition flow of FIG. 21, the index point of the second aspect is the time (Ip _n = t _n −T _i ; n) when the time is returned by a predetermined time T _i from each of the times t ₁ to t _3. = 1 to 3) This is the time before speech stops and there are three index points as described above. Here, utterance is stopped when the caller's speech or conversation breaks.
As shown in the acquisition flow of FIG. 22, the index point of the third aspect is the time (Ip _n = t _n −T _i ; n) when the time is returned by a predetermined time T _i from each time t ₁ to t _3. = 1 to 3) It is the time before the scene of the content is switched, and there are three index points as described above. Here, the content scene switching refers to the time when the scene and background of the video content change greatly.

Also, there are three modes similar to the index point for the point at which data playback from the index point is finished and the playback ends. In other words, in the first aspect, the reproduction is terminated after a certain period of reproduction. In the second mode, after a predetermined time has elapsed and when the utterance stops, the reproduction is terminated. In the third mode, after a predetermined time has elapsed and the content scene is switched, the reproduction is terminated.

As described above, in the conference call system and the summary playback method of the present invention, it is possible to capture the time change of the satisfaction data of the monitor terminal that is the listener about the content of the conference call, and capture the opinion of the listener. It will be understood that the conference call contents can be summarized and played.

In the second embodiment, a content display system will be described. The mechanism that utilizes the time information of the reception count number of the satisfaction data transmitted from the monitor terminal of the conference call system to the host computer, the contents of the threshold parameter, and the mechanism of summary playback can be used in common.
In the case of the content display system, unlike the conference call system described above, there is no call terminal, and all are monitor terminals.
The session concept can be used as it is. For example, the start and end of video content are regarded as session start and session end. The room is regarded as a virtual theater that shows video content.
By capturing in this way, it is possible to capture temporal changes in the satisfaction data of the monitor terminal that is the viewer for the content of the video content, and it is possible to summarize and reproduce the content of the content by capturing the viewer's opinions. I understand.

FIG. 23 shows a configuration diagram of the content display system of the second embodiment. As shown in FIG. 23, the monitor terminal 30 in the content display system includes a graphical user interface (GUI) 39 comprising content information display means 31, monitor participation registration means 32, and satisfaction input means 33, audio output means 34, A network interface 35 is provided.

In the third embodiment, a case will be described in which, in the conference call system of the first embodiment and the content display system of the second embodiment, the host computer associates the user attribute acquired from the monitor participation registration unit with the satisfaction degree data.
As described above, user attributes include name, age, gender, occupation, hobby, date of birth, zodiac, blood type, marriage history, family composition, birthplace, child age, worries, worries, future dreams, For example, as shown in FIG. 24, a user attribute table is stored in the storage medium of the host computer. These user attributes are associated with satisfaction data.

For example, as shown in FIG. 25, it is assumed that there is a cumulative reception count distribution of satisfaction data in a time series of a certain content data file (the same applies to a conference call data file). It is assumed that there are four satisfaction data peaks 1 to 4, which are at the points of I _A , I _B , I _C , and _ID time from the start of the content data. Then, as shown in FIG. 26, it is assumed that user A and user B input satisfaction data at their respective timings. In FIG. 26, the user A frequently inputs the satisfaction level near the times I _C and _ID , and the user B frequently inputs the satisfaction level near the times I _A and I _B. Here, the user attribute A is described as the user A attribute, and the user attribute B is expressed as the user B attribute. That is, the user B is satisfied near the satisfaction peaks A and B, and the user A is satisfied near the satisfaction peaks C and D.
It is possible to easily grasp what kind of conference call has been made at these timings or what kind of content was displayed. From this, it can be seen that the user who is satisfied with a specific conference call content or content content can be analyzed.
Furthermore, as shown in FIG. 27, when there are a large number of users (in FIG. 27, four users A to D are shown for convenience), the tendency of users who are satisfied with specific conference call content and content content (for example, age group) Can be analyzed). In Figure 27, are you satisfied with the timing I _A is the user B and the user C, are you satisfied with the timing I _B it can be seen that were the user B and the user C and user D.
In this way, by associating user attributes with satisfaction data, various questionnaire data, market research data, and statistical data can be generated, and a database of user attributes having the same kind of empathy (satisfaction) can be easily created. It can be built.

The present invention is useful as a conference call system or content display system using the Internet.

100 Communication network T ₀ Host computer T ₁ to T ₅ Call terminal M ₁ to M ₄ Monitor terminal D ₁ to D ₅ , Dc Audio data signal S ₁ to S ₄ Satisfaction data

Claims

A network that forwards packets using Internet protocols;
A graphical user interface comprising conference information display means and conference participation registration means; at least one call terminal comprising speech means, voice output means, and network interface;
A graphical user interface comprising conference information display means, monitor participation registration means and satisfaction input means; at least one monitor terminal comprising audio output means and network interface;
In a conference call system composed of a host computer that transmits and receives voice data packets to and from each call terminal,
The host computer
The voice data packet received from each call terminal is synthesized to generate a conference call data packet, and the generated conference call data packet is transmitted to all call terminals and monitor terminals through the network.
From the time information of the satisfaction data received from each monitor terminal, the reception count cumulative within a predetermined time is calculated, and the cumulative distribution of the reception count of satisfaction data from the start to the end of the conference call is time-series and time-series. Send the cumulative distribution of received count of satisfaction data to the call terminal and monitor terminal,
The conference call data file obtained by combining the generated conference call data packets and the time-series satisfaction data reception count cumulative distribution data file are associated or integrated and stored in the memory.
A conference call system characterized by that.
A network that forwards packets using Internet protocols;
A graphical user interface comprising content information display means, monitor participation registration means and satisfaction input means; at least one monitor terminal comprising audio output means and network interface;
In a content display system composed of a host computer that transmits and receives data to and from the monitor terminal,
The host computer
From the time information of satisfaction data received from each monitor terminal, the reception count cumulative within a predetermined time is calculated, and the reception count cumulative distribution of the satisfaction data from the start to the end of the content is time-series, and the time-series satisfaction Send the cumulative distribution of received data to the monitor terminal,
The content data file and the received count cumulative distribution data file of the satisfaction data time-sequentially associated or integrated and stored in the memory,
A content display system characterized by that.
The conference call system according to claim 1, wherein the time-sequential satisfaction data reception count cumulative distribution data file can be updated by satisfaction data received from a monitor terminal.
The above call terminal further includes a satisfaction input means,
The host computer
From the time information of the satisfaction data received from each call terminal and each monitor terminal, the reception count cumulative within a predetermined time is calculated, and the reception data cumulative distribution of the satisfaction data from the start to the end of the conference call is time-series. ,
The conference call system according to claim 1.
The host computer
5. The conference call system according to claim 1, further comprising means for associating user attributes acquired from the monitor participation registration means with satisfaction data.
The host computer
The content display system according to claim 2, further comprising means for associating user attributes acquired from the monitor participation registration means with satisfaction data.
The host computer
Conversation call data information of the conference call data packet at the timing of receiving the satisfaction data,
User attributes associated with satisfaction data, and
A means of analyzing user trends that have entered satisfaction data into specific conversation call data information;
Means for generating at least one of questionnaire data, market research data, and statistical data from the analysis results,
The conference call system according to claim 5.
The host computer
Content information of the content data file at the timing of receiving the satisfaction data,
User attributes associated with satisfaction data, and
A means of analyzing user trends that have entered satisfaction data into specific content information;
Means for generating at least one of questionnaire data, market research data, and statistical data from the analysis results,
The content display system according to claim 6.
The host computer
Associate user attributes associated with individual satisfaction data received during a given time period,
Means for storing as a database of user attributes having the same kind of empathy;
The conference call system according to claim 5.
The host computer
Associate user attributes associated with individual satisfaction data received during a given time period,
Means for storing as a database of user attributes having the same kind of empathy;
The content display system according to claim 6.
The user attributes include name, age, gender, occupation, hobby, date of birth, zodiac, blood type, marriage history, family structure, birthplace, child age, worries, worries, future dreams, past sympathy data. Is selected from the group of content information transmitted.
The conference call system according to any one of claims 5, 7, and 9.
The user attributes include name, age, gender, occupation, hobby, date of birth, zodiac, blood type, marriage history, family structure, birthplace, child age, worries, worries, future dreams, past sympathy data. Is selected from the group of content information transmitted.
The content display system according to any one of claims 6, 8, and 10.
In the satisfaction input means,
A means of entering satisfaction,
Or
Satisfaction data with a high degree of satisfaction can be input by inputting the satisfaction data twice or more at a predetermined time.
The conference call system according to any one of claims 5, 7, 9, and 11.
In the satisfaction input means,
A means of entering satisfaction,
Or
Satisfaction data with a high degree of satisfaction can be input by inputting the satisfaction data twice or more at a predetermined time.
The content display system according to any one of claims 6, 8, 10, and 12.
The host computer
When a request for searching for a specific user attribute as a search key is issued from the monitor terminal, the monitor terminal includes means for transmitting a time series distribution of satisfaction data associated with the user attribute to the monitor terminal.
The conference call system according to any one of claims 5, 7, 9, 11, and 13.
The host computer
When a request for searching for a specific user attribute as a search key is issued from the monitor terminal, the monitor terminal includes means for transmitting a time series distribution of satisfaction data associated with the user attribute to the monitor terminal.
The content display system according to any one of claims 6, 8, 10, 12, and 14.
In the satisfaction input means,
On the terminal screen,
“Satisfied”, “sympathy”, “good”, “bad”, “like”, “interested”, “interested”, “nice”, “scary”, “thrilled”, “disliked”, “suitable” ", Not suitable", "fun", "good", "poor", "impressed", "desired", "not wanted", "agree", or "opposite"
The conference call system according to any one of claims 5, 7, 9, 11, 13, and 15.
In the satisfaction input means,
On the terminal screen,
“Satisfied”, “sympathy”, “good”, “bad”, “like”, “interested”, “interested”, “nice”, “scary”, “thrilled”, “disliked”, “suitable” ", Not suitable", "fun", "good", "poor", "impressed", "desired", "not wanted", "agree", or "opposite"
The content display system according to any one of claims 6, 8, 10, 12, 14, and 16.
A conference call system according to any one of claims 1, 3, 4, 5, 7, 9, 11, 13, 15 or a content display system according to any one of claims 2, 6, 8, 10, 12, 14, 16 Summary content playback method,
From the time information of the satisfaction data received from the monitor terminal, calculating a reception count cumulative within a predetermined time;
Time-series reception count cumulative distribution of satisfaction data from the start to the end of the conference call data file or content data file;
From the conference call data file or the content data file, a time before the peak time higher than the reception count number of satisfaction data is set as an index point, and the conference call data or content data for a predetermined time is reproduced from the index point; ,
A summary content reproduction method characterized by comprising:
The above index points are
It is a time returned by a preset time from the upper peak time of the reception count number of satisfaction data,
The summary content reproduction method according to claim 19, wherein:
The above index points are
It is a time before utterance stops before the time returned by a preset time from the upper peak time of the reception count number of satisfaction data,
The summary content reproduction method according to claim 19, wherein:
The above index points are
It is before the time returned by a preset time from the upper peak time of the reception count number of satisfaction data, and is the time when the scene of the content is switched.
The summary content reproduction method according to claim 19, wherein:
The above determination of the reception count number of the satisfaction data is that the reception count number of the satisfaction data is larger than the threshold parameter,
The threshold parameter is set manually or automatically according to any one selected from the time from the start to the end of the conference call data file or the content data file, the required size of the summary playback time, the number of viewers or the number of viewers. Parameter adjustable,
The summary content reproduction method according to any one of claims 19 to 22, wherein:
The time for data playback from the index point is
It can be automatically adjusted according to the time from the start to the end of the conference call data file or content data file, or according to the number of peaks larger than the threshold parameter of the reception count number of satisfaction data,
The summary content reproduction method according to any one of claims 19 to 22, wherein:
The end point of data playback from the index point is
It is the time when the utterance stops after a predetermined time has elapsed,
The summary content reproduction method according to claim 21, wherein:
The end point of data playback from the index point is
It is the time when the scene of the content switches after a predetermined time has elapsed,
The summary content reproduction method according to claim 22, wherein:
In the playback step,
Play from the index point with the earliest time,
Or, play in order from the highest satisfaction,
The summary content reproduction method according to any one of claims 19 to 22, wherein:
In the playback step,
Make the watch time with the highest satisfaction level longer than the lower one,
The summary content reproduction method according to claim 27, wherein:
The summary content playback method according to any one of claims 19 to 28,
Calculating a cumulative reception count within the predetermined time;
Time series of the received count cumulative distribution of the satisfaction data,
The step of playing,
Is a summary content playback program that causes a computer to execute.
The conference call system according to any one of claims 1, 3 to 5, 7, 9, 11, 13, and 15,
In the conference call data file,
Also included is a conference call data file that is partially extracted from the original conference call data file and edited.
For an edited conference call data file:
The host computer
The edited conference call start time is regarded as the offset time from the starting point of the original conference call data file, and
The edited conference call end time is regarded as the offset time from the starting point of the original conference call data file,
From the time information of the satisfaction data received from each monitor terminal, the cumulative reception count within a predetermined time is calculated, and the cumulative distribution of received counts of satisfaction data from the start to the end of the edited conference call is calculated as the original conference call. Time series using the timeline of the data file, send the received count cumulative distribution of satisfaction data time-series to the monitor terminal,
The original conference call data file and the time-series satisfaction data received count cumulative distribution data file are associated or integrated and stored in the memory.
A conference call system characterized by that.
The content display system according to any one of claims 2, 6, 8, 10, 12, 14, and 16,
In the content data file,
Includes content data files that have been partially extracted from the original content data file and edited,
For edited content data files,
The host computer
The start time of the edited content is regarded as the offset time from the starting point of the original content data file, and
Consider the end time of the edited content as the offset time from the starting point of the original content data file,
From the time information of the satisfaction data received from each monitor terminal, the reception count cumulative within a predetermined time is calculated, and the reception count cumulative distribution of the satisfaction data from the start to the end of the edited content is stored in the original content data file. Time series using the timeline of the time, the reception count cumulative distribution of the satisfaction data that has been time-series is sent to the monitor terminal,
The original content data file and the received count cumulative distribution data file of satisfaction data time-sequentially associated or integrated and stored in the memory,
A content display system characterized by that.