JP2018032096A - Information processing device, information processing method, program, and information processing system - Google Patents

Abstract

In a conference using a remote conference system, participants can easily show their reactions. An information processing apparatus comprising a display device and one or more terminal devices, comprising an acquisition unit, a first storage unit, a display device specifying information selection unit, and a reaction image display control unit. The acquisition unit acquires reaction information including user identification information and reaction identification information from the terminal device, and the first storage unit includes user identification information and a display device installed in the conference room for each conference identification information. The display device specifying information selecting unit refers to the first correspondence information and is associated with the user identification information included in the reaction information acquired by the acquiring unit. The display device specifying information is selected, and the reaction image display control unit is configured to display the reaction device included in the reaction information acquired by the acquiring unit on the display device specified by the display device specifying information selected by the display device specifying information selecting unit. A reaction image corresponding to the reaction identified by the information is displayed. [Selection] Figure 7

Description

  The present invention relates to an information processing apparatus, an information processing method, a program, and an information processing system.

  A system in which each of a plurality of users uses a terminal device such as a computer and communicates via a network is known. For example, a remote conference system in which an interactive whiteboard and a computer are connected via a network is known (for example, Patent Document 1).

  However, in a conference using a conventional remote conference system, there is a problem that it may be difficult for a participant to show his reaction (will) due to various factors such as the atmosphere of the conference and remote participation.

  The present invention provides an information processing apparatus, an information processing method, a program, and an information processing system in which a participant can easily show his / her reaction even during a conference using a remote conference system. With the goal.

  In order to solve the above-described problems and achieve the object, the present invention provides a display device and an information processing device that can be connected to each of one or more terminal devices via a network, from the terminal device, For each of the meeting identification information for identifying the meeting, the obtaining unit for obtaining the reaction information including at least the user identification information for identifying the user who uses the terminal device, the reaction identification information for identifying the reaction of the user, and the meeting identification information First correspondence information that associates at least the user identification information of the users who participate in the display with display device specifying information that can specify the display device installed in the conference room where the conference is held. The display device specifying information associated with the user identification information included in the reaction information acquired by the acquisition unit is selected with reference to the storage unit and the first correspondence information The reaction identification information included in the reaction information acquired by the acquisition unit in the display device specified by the display device identification information selection unit and the display device identification information selected by the display device identification information selection unit A reaction image display control unit that performs control to display a reaction image corresponding to the reaction identified in (1).

  According to the present invention, a participant can easily show his / her reaction in a conference using a remote conference system.

FIG. 1 is a diagram illustrating an example of a configuration of an information processing system. FIG. 2 is a diagram illustrating an example of a hardware configuration of the information processing apparatus. FIG. 3 is a diagram illustrating an example of functions of the information processing apparatus. FIG. 4 is a diagram illustrating an example of a project selection screen. FIG. 5 is a diagram illustrating an example of project data. FIG. 6 is a diagram illustrating an example of user data. FIG. 7 is a diagram illustrating an example of the functions of the project management unit. FIG. 8 is a diagram illustrating an example of a conference management screen. FIG. 9 is a diagram illustrating an example of an agenda creation screen. FIG. 10 is a diagram illustrating an example of a bibliographic item input screen. FIG. 11 is a diagram illustrating an example of conference data. FIG. 12 is a partial enlarged view of the page area of the conference management screen. FIG. 13 is a diagram illustrating an example of a conference start screen. FIG. 14 is a diagram illustrating an example of the electronic blackboard address data. FIG. 15 is a diagram illustrating an example of a reaction selection screen. FIG. 16 is a diagram illustrating an example of icon data. FIG. 17 is a diagram illustrating a display example of reaction icons. FIG. 18 is a diagram illustrating an example of a history image. FIG. 19 is a flowchart illustrating an operation example of the information processing apparatus. FIG. 20 is a flowchart illustrating an operation example of the information processing apparatus. FIG. 21 is a flowchart illustrating an operation example of the information processing apparatus. FIG. 22 is a diagram illustrating an example of the second correspondence information. FIG. 23 is a diagram illustrating an example of functions of the project management unit according to the modification. FIG. 24 is a diagram illustrating an example of third correspondence information.

  Hereinafter, embodiments of an information processing apparatus, an information processing method, a program, and an information processing system according to the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a diagram illustrating an example of a configuration of an information processing system 1 according to the present embodiment. As shown in FIG. 1, the information processing system 1 includes an information processing device 10, a plurality of terminal devices 20 a connected to the information processing device 10 via a network 12 such as a LAN (Local Area Network), and each conference room. A conference terminal 25 installed one by one and an electronic whiteboard (IWB: Interactive Whiteboard) 30 as a display device installed one by one for each conference room are included. The information processing system 1 further includes one or more terminal devices 20b connected via an external network 40 such as the Internet. Hereinafter, when the terminal device 20a and the terminal device 20b are not distinguished from each other, they may be simply referred to as “terminal device 20”.

  Here, it is assumed that the remote conference using the information processing system 1 is performed while a participant in the conference room writes on the electronic blackboard 30. The conference terminal 25 includes a camera that captures a subject including at least the screen of the electronic blackboard 30 (main screen of the conference) at a predetermined frame rate, and a microphone array for collecting audio in the conference room. The information processing apparatus 10 acquires from the conference terminal 25 a captured image obtained by imaging with a camera and audio data collected by a microphone array. Then, the information processing apparatus 10 causes the data (captured image and audio data) acquired from the conference terminal 25 to be output from the terminal device 20 of each user participating in the conference. Thereby, the screen of the electronic blackboard 30 installed in the conference room is displayed on the terminal device 20a of a user who directly participates in the conference (a user existing in the conference room) and a user who participates in the conference from a remote location (in the conference room). Can be shared with each of the terminal devices 20b of users who do not exist), and a remote conference can be performed while sharing the audio in the conference room. Note that, for example, a configuration in which data acquired from the conference terminal 25 is not output from the terminal device 20a of the user directly participating in the conference may be used.

  Here, it is assumed that the terminal device 20a is used in a conference room. Further, the terminal device 20b is assumed to be used at a remote place different from the conference room. For example, the terminal device 20 is assumed to be used by a user who participates in the conference from a remote place such as a telecommuter. In this example, as a form of participation in a meeting, a form of directly participating in a meeting in a conference room (hereinafter sometimes referred to as “direct participation”), a form of participating in a meeting from a remote location (hereinafter referred to as “remote participation”) 3), which are only viewed from a remote location (not remarked) (hereinafter may be referred to as “semi-participation”), but are not limited thereto.

  The terminal device 20 is a device having an information processing function, an information input function, an information output function, a communication function, and the like. The terminal device 20 may be a general computer such as a notebook type or a desktop type, a tablet terminal, a smartphone, or the like. Further, the terminal device 20 accesses the information processing apparatus 10 by executing an application program such as a web browser.

  The information processing apparatus 10 is a computer such as a server having an information processing function and a communication function. In addition, the information processing apparatus 10 may be configured by a single server or the like, or may be configured in cooperation with a plurality of servers. The information processing apparatus 10 receives access from a plurality of terminal apparatuses 20 that execute a web browser or the like. Then, the information processing apparatus 10 provides information requested by the terminal device 20 to each of the plurality of terminal devices 20.

  FIG. 2 is a diagram illustrating an example of a hardware configuration of the information processing apparatus 10. The information processing apparatus 10 has the same configuration as a normal computer. That is, the information processing apparatus 10 includes a CPU (Central Processing Unit) 301, a ROM (Read Only Memory) 302, a RAM (Random Access Memory) 303, a storage device 304, and a communication device 305. The CPU 301, ROM 302, RAM 303, storage device 304 and communication device 305 are connected by a bus.

  The CPU 301 expands and executes a program stored in the storage device 304 in the RAM 303, and controls each unit to perform input / output and process data. The ROM 302 stores a start program for reading an OS startup program from the storage device 304 to the RAM 303. The RAM 303 stores data as a work area for the CPU 301.

  The storage device 304 is, for example, a hard disk drive or a flash memory. The storage device 304 stores an operating system, application programs, and data. These programs are files in an installable or executable format, and are recorded and distributed on a computer-readable recording medium. The program may be distributed by downloading from a server. The communication device 305 is an interface device for connecting to a network, for example.

  FIG. 3 is a diagram illustrating an example of functions of the information processing apparatus 10. For convenience of explanation, FIG. 3 mainly illustrates functions related to the present embodiment, but the functions of the information processing apparatus 10 are not limited to these.

  The information processing apparatus 10 implements the functions shown in FIG. 3 when the CPU 301 executes a predetermined application program. As illustrated in FIG. 3, the information processing apparatus 10 includes a project selection unit 42, at least one project management unit 44, and a data storage unit 46.

  The information processing apparatus 10 forms a group of a plurality of users for each project. The information processing apparatus 10 realizes communication between users for each project. The information processing apparatus 10 includes a project management unit 44 for each project. A project is a plan for achieving some purpose.

  When accessed from the terminal device 20, the project selection unit 42 displays a project selection screen as shown in FIG. 4 on the terminal device 20 (provides the project selection screen to the terminal device 20 for display). The project selection screen is an image for causing the terminal device 20 to select one project to participate from at least one managed project. When any project is selected by the user, the terminal device 20 transmits selection information indicating the selected project to the information processing apparatus 10.

  The project selection unit 42 selects a project in which the terminal device 20 participates in accordance with selection information from the terminal device 20. The project selection unit 42 can call the project management unit 44 corresponding to the project selected according to the selection information from the terminal device 20, and can exchange information between the project management unit 44 and the terminal device 20. To do.

  The project management unit 44 receives access from each terminal device 20 participating in the corresponding project. The project management unit 44 executes various types of information processing related to the corresponding project.

  The data storage unit 46 stores data managed by the corresponding project management unit 44 (hereinafter referred to as “project data”) for each project. FIG. 5 is a diagram illustrating an example of project data. In the example of FIG. 5, the project data includes, for each project ID that identifies a project, a user ID that identifies a member who participates in the project, the name of the project, the date and time of a meeting that is regularly held, This is data in which conference terminal information (identifier for identifying the conference terminal 25 or an address indicating the position of the conference terminal 25 on the network 12) that can identify the conference terminal 25 used in the project is associated with each other. .

  The data storage unit 46 stores user data indicating data related to the user. FIG. 6 is a diagram illustrating an example of user data. In the example of FIG. 6, the user data corresponds to the user ID for identifying the user, the user name, the password used for user authentication, the e-mail address, and the connection destination information in the case of remote participation or semi-participation. It is the attached data. In addition, an address indicating a position on the network (network 12 or network 40) of the terminal device 20 used by the user may be further associated (in order to receive various notifications from the information processing device 10). Further, the data storage unit 46 stores conference data (described later) regarding the conference.

  FIG. 7 is a diagram illustrating an example of functions that the project management unit 44 has. As shown in FIG. 7, the project management unit 44 includes a conference management screen display control unit 401, an input screen display control unit 402, a conference data management unit 403, a conference management screen update unit 404, and a conference start control unit 405. A reaction selection screen display control unit 406, an acquisition unit 407, a reaction icon selection unit 408, a display device identification information selection unit 409, and a reaction image display control unit 410.

  The conference management screen display control unit 401 performs control to display a conference management screen for managing a conference in the corresponding project on the terminal device 20. Control for displaying the conference management screen on the terminal device 20 means control for providing and displaying the conference management screen on the terminal device 20. FIG. 8 is a diagram illustrating an example of a conference management screen. In this example, the conference management screen includes a common region 47 that is a display region common to each conference, and a page region 48 that switches for each conference.

  In the common area 47, a list of conferences held so far is displayed. When the user selects any conference, the conference management screen display control unit 401 performs control to switch the image in the page area 48 to an image corresponding to the selected conference. In the common area 47, a button 50 for instructing addition of a conference (hereinafter referred to as “conference addition button 50”) is displayed.

  In the page area 48, status information 55 indicating members who participated in the selected conference, a method of participating in the conference, an attached file (agenda (meeting material) created by the member), and the like is displayed. In the page area 48, a display component 60 (in this example, a button indicating “Preview”) for receiving an instruction to display the previous conclusion is displayed. In the page area 48, a display component 65 (in this example, a display area indicating “+ ADD Agenda”) for receiving an agenda creation instruction is displayed. When the conference management screen display control unit 401 receives an agenda creation instruction via the display component 65, the conference management screen display control unit 401 performs control to display an agenda creation screen as illustrated in FIG. 9 on the terminal device 20. The agenda creation screen includes an area 70 for inputting a title and an area 80 for inputting detailed information. By pressing the upload button, the agenda is uploaded and reflected in the status information 55.

  Returning to FIG. 7, the description will be continued. The input screen display control unit 402 performs control to display a bibliographic item input screen as shown in FIG. In this example, when the terminal device 20 on which the conference management screen is displayed accepts the press of the conference addition button 50, the terminal device 20 transmits button press information indicating that the press of the conference addition button 50 has been accepted to the information processing device 10. . The button press information received from the terminal device 20 is passed to the input screen display control unit 402. The input screen display control unit 402 that has confirmed the button press information performs control to display a bibliographic item input screen as shown in FIG. 10 on the terminal device 20 that has transmitted the button press information. The bibliographic item input screen shown in FIG. 10 includes an area 421 for inputting a meeting name, an area 422 for inputting a participant name (user name participating in the meeting), and an area 423 for inputting the meeting date and time. And a region 424 for inputting the meeting place, and a button 425 for instructing confirmation of the input (hereinafter referred to as “OK button 425”).

  When the terminal device 20 on which the bibliographic item input screen is displayed accepts the pressing of the OK button 425, the terminal device 20 displays information already input to the bibliographic item input screen (hereinafter referred to as “bibliographic item input information”). It transmits to the information processing apparatus 10. The bibliographic item input information received from the terminal device 20 is passed to the conference data management unit 403 and the conference management screen update unit 404.

  The conference data management unit 403 manages conference data. For example, every time the conference data management unit 403 receives the bibliographic item input information, the conference data management unit 403 issues a new conference ID for identifying the conference. The conference data management unit 403 then identifies the corresponding project, the newly issued conference ID, and various information indicated by the bibliographic information input information (conference name, participant name, conference date, conference location). Is registered in the data storage unit 46. FIG. 11 is a diagram illustrating an example of conference data. The conference data further includes participation information indicating a user participation method, but the participation information is not registered at this stage. Details regarding the participation information will be described later.

  For example, the above-described bibliographic item input screen may accept input of the above-described conference terminal information, and the conference terminal information that has received the input may be included in the above-mentioned bibliographic item input information. In this case, the conference terminal information is stored in the conference data instead of the project data described above.

  In addition, the conference data management unit 403 performs control to notify the terminal device 20 used by the user with the participant name included in the conference data newly registered in the data storage unit 46 that the conference is held. In this example, the conference data management unit 403 refers to the user data (FIG. 6) stored in the data storage unit 46, and the participant name (user name) included in the conference data newly registered in the data storage unit 46. ), A corresponding e-mail address is specified, and control is performed to notify that the meeting is held with the specified e-mail address as a destination.

  Since this notification includes link information indicating the link destination of the conference management screen (address for acquiring and browsing the web page of the conference management screen), the terminal device 20 receives information from the information processing device 10. A conference management screen can be acquired from the information processing apparatus 10 and displayed using link information included in the notification. Here, in the page area 48 of the conference management screen, a display component (in this example, a pull-down menu) 80 for selecting a participation method is displayed for each user participating in the conference. FIG. 12 is an enlarged view of an area corresponding to a certain participant in the page area 48. An operation in which the user selects the icon of the down arrow at the right end of the pull-down menu 80 (hereinafter may be referred to as “participation method button”) (for example, a touch operation or an operation of clicking the mouse with the cursor positioned) Since a list of selectable participation methods is displayed, the user can perform an operation of selecting one of the participation methods. When receiving this selection operation, the terminal device 20 transmits information indicating the selected participation method (hereinafter referred to as “participation information”) to the information processing device 10. In this example, the terminal device 20 transmits the user ID together with the participation information to the information processing device 10. The participation information and the user ID received from the terminal device 20 are passed to the conference data management unit 403, and the conference data management unit 403 refers to the above-described user data (FIG. 6) to determine the user ID received from the terminal device 20. A corresponding user name is specified, and conference data including the specified user name is specified. Then, in the identified conference data, the participation information received from the terminal device 20 is associated with the identified user name and registered. In this manner, participation information is associated with each of one or more user names (participants) included in the conference data.

  As described above, here, three participation methods (participation form) are assumed: direct participation, remote participation, and semi-participation. In addition, for the user name associated with participation information indicating remote participation or semi-participation, the conference data management unit 403 notifies the connection destination information with the mail address corresponding to the user name as the destination.

  The description of FIG. 7 is continued. The conference management screen update unit 404 updates the conference management screen. For example, each time the conference management screen update unit 404 receives the bibliographic item input information, the conference management screen update unit 404 reflects the bibliographic item input information and updates the conference management screen. In this example, the meeting management screen update unit 404 creates a page area 48 corresponding to a newly added meeting, and a newly added meeting option in the meeting list displayed in the common area 47. Add The conference management screen update unit 404 also has a function of updating the conference management screen by reflecting the above-described participation information received from the terminal device 20.

  When the meeting start timing comes, the meeting start control unit 405 displays a meeting start screen for starting the meeting as shown in FIG. 13 on the electronic blackboard 30 installed in the meeting room where the meeting is held. Control. The conference start control unit 405 checks for each conference data managed by the conference data management unit 403 whether or not the conference date and time included in the conference data has been reached. A meeting start screen as shown in FIG. 13 is provided and displayed on the electronic blackboard 30 installed at the meeting place included in the data. In this example, electronic blackboard address data (see FIG. 14) in which a meeting place (conference room) and an address indicating the position of the electronic blackboard 30 on the network 12 are associated is stored in the data storage unit 46, and the conference The start control unit 405 can identify the electronic blackboard 30 installed at the conference location included in the conference data by referring to the electronic blackboard address data.

  In the example of FIG. 13, a button 85 for instructing the start of the conference is displayed on the conference start screen, and when pressing of this button 85 is accepted, the conference is joined (excluding semi-participation here). A reaction selection screen described later is displayed on each terminal device 20 of the user. When the electronic blackboard 30 receives the pressing of the button 85, the electronic blackboard 30 transmits information indicating that the pressing of the button 85 has been received (hereinafter, sometimes referred to as “conference start information”) to the information processing apparatus 10. In addition, the conference start control unit 405 receives data (captured image and audio data) from the conference terminal 25 (which can be specified from the conference data and project data in this example) used at the conference when the conference is started. Control to start acquisition of. Thereafter, the information processing apparatus 10 periodically acquires data from the conference terminal 25.

  The description of FIG. 7 is continued. The reaction selection screen display control unit 406 performs control to display on the terminal device 20 a reaction selection screen for selecting any one of a plurality of reactions. In this example, the reaction selection screen display control unit 406 receives meeting start information from the electronic blackboard 30 as a trigger, and includes meeting data corresponding to the electronic blackboard 30 (including the meeting place where the electronic blackboard 30 is installed). Among a plurality of user names included in (conference data), a user name associated with participation information indicating remote participation is specified. A screen including at least a reaction selection screen and a captured image acquired from the conference terminal 25 with respect to the terminal device 20 (identifiable by referring to the user data in FIG. 6) corresponding to the identified user name. Control to display. In addition, the information processing apparatus 10 performs control to output the voice data acquired from the conference terminal 25 from the terminal device 20 of the user who is remotely participating. Further, in this example, the information processing apparatus 10 uses time information such as audio data during the meeting, captured images of the electronic blackboard 30, various data received from the terminal device 20 (text data such as reaction icons and chats described later), and the like. And the function of managing information associated with the conference ID as a conference log of the conference identified by the conference ID.

  FIG. 15 is a diagram illustrating an example of a reaction selection screen. The reaction selection screen includes a plurality of icons corresponding to a plurality of reactions one-on-one. In the example of FIG. 15, the reaction selection screen has an icon 91 (an example of a reaction image) corresponding to a reaction indicating that it is requested to change the direction of the camera, and an icon 92 corresponding to a reaction indicating that no sound can be heard. And an icon 93 corresponding to a response indicating gratitude, but the type and number of responses are not limited to these. In the following description, when the icons 91, 92, and 93 are not distinguished from each other, they may be simply referred to as “reaction icons”.

  The user of the terminal device 20 on which the reaction selection screen is displayed can select a reaction icon that matches his reaction during the meeting. For example, when the direction of the camera is desired to be changed, an operation of selecting the icon 91 (a touch operation or an operation of clicking the mouse with the cursor positioned) may be performed. Upon receiving this operation, the terminal device 20 receives a user ID (an example of user identification information) for identifying a user who uses the terminal device 20, and any reaction selected from the reaction selection screen (the selected reaction icon). Reaction information including a reaction ID (an example of reaction identification information) for identifying the corresponding reaction) and time information indicating the time when the reaction icon is selected is transmitted to the information processing apparatus 10. In short, the reaction information may be information including at least user identification information for identifying a user who uses the terminal device 20 and reaction identification information for identifying a user's reaction. In this example, a reaction ID for identifying a reaction indicated by the reaction icon is associated with each of the plurality of reaction icons on the reaction selection screen in advance. When the user of the terminal device 20 selects any reaction icon, the above-described reaction information including the reaction ID associated with the selected reaction icon is transmitted to the information processing apparatus 10.

  However, the present invention is not limited to this. For example, when the terminal device 20 detects the user's leaving (the detection method can use various known techniques, for example, the detection may be performed using a camera). Alternatively, the response information including the reaction ID indicating leaving and the time information indicating the leaving time may be transmitted (automatically transmitted) to the information processing apparatus 10. That is, the above-described reaction information may be automatically transmitted without the user performing an operation of selecting a reaction icon.

  In this example, the reaction selection screen is displayed only on the terminal device 20 of the remotely participating user. However, the present invention is not limited to this. For example, the reaction selection screen is also displayed on the terminal device 20 of the directly participating user. There may be. Thereby, the user of direct participation can also show an own reaction, without speaking.

  The description of FIG. 7 is continued. The acquisition unit 407 acquires the above-described reaction information from any terminal device 20. The reaction icon selection unit 408 selects a reaction icon corresponding to the reaction identified by the reaction ID included in the reaction information acquired by the acquisition unit 407. In this example, the data storage unit 46 holds icon data in which the content of a reaction and a reaction icon are associated with each other for each of a plurality of reaction IDs as shown in FIG. The reaction icon selection unit 408 selects a reaction icon associated with the reaction ID included in the reaction information acquired by the acquisition unit 407 with reference to the icon data.

  The display device specifying information selection unit 409 refers to the user data and the conference data, and selects a conference location associated with the user ID included in the reaction information acquired by the acquisition unit 407. In this example, since the electronic blackboard 30 is installed for each meeting place, the selection of the meeting place is synonymous with the selection of the electronic blackboard 30. In this example, the display device specifying information selection unit 409 refers to the electronic blackboard address data (see FIG. 14) described above, and the address (electronic blackboard) corresponding to the user ID included in the reaction information acquired by the acquisition unit 407. 30 addresses). Here, the meeting place or the address corresponds to the display device specifying information that can specify the display device (in this example, the electronic blackboard 30). In addition, here, for each meeting identification information for identifying a meeting, a combination of user data and meeting data is a user identification information of a user who participates in the meeting and a display installed in a meeting room in which the meeting is held. It may be considered that it corresponds to the first correspondence information that associates at least the display device identification information that can identify the device, and the combination of user data, conference data, and electronic blackboard address data is the first correspondence information described above. You may think that it corresponds to.

  The reaction image display control unit 410 includes the reaction included in the reaction information acquired by the acquisition unit 407 on the electronic blackboard 30 specified by the address (an example of display device specification information) selected by the display device specification information selection unit 409. Control is performed to display a reaction icon corresponding to the reaction identified by the ID. In this example, the reaction image display control unit 410 is selected by the reaction icon selection unit 408 on the electronic blackboard 30 specified by the address selected by the display device specification information selection unit 409 (an example of display device specification information). Control to present and display the reaction icon is performed (see FIG. 17). At this time, it is also possible to perform control for emphasizing (for example, enlarging) a user who has shown a reaction. Further, the reaction icon selected by the user is associated with time information and recorded as a history of text data of chats during the meeting. When the electronic blackboard 30 accepts an operation for calling a history of chat text data, the information processing apparatus 10 can also provide and display a history image as shown in FIG.

  FIG. 19 is a flowchart illustrating an operation example of the information processing apparatus 10 when new conference data is added. Here, the organizer of the new conference operates his / her own terminal device 20 to access the information processing apparatus 10. Then, the information processing apparatus 10 (project selection unit 42) performs control to display the above-described project selection screen for the terminal apparatus 20 that has accessed (step S1). The organizer can perform an operation of selecting any project from the project selection screen displayed on the terminal device 20. As described above, when any project is selected by the organizer, selection information indicating the selected project is transmitted from the terminal device 20 to the information processing device 10.

  After step S1, the information processing apparatus 10 waits for reception of selection information from the terminal device 20 (step S2). When the selection information is received (step S2: Yes), the information processing apparatus 10 (the project management unit 44 corresponding to the selected project) provides the above-described conference management screen to the terminal device 20 that has transmitted the selection information. Is displayed (step S3). The organizer can request the addition of a new conference by pressing the conference addition button 50 on the conference management screen displayed on the terminal device 20. For convenience of explanation, the explanation here assumes that the conference addition button 50 has been pressed by the organizer. As described above, when the conference addition button 50 is pressed, button pressing information indicating that the pressing of the conference addition button 50 has been received is transmitted from the terminal device 20 to the information processing device 10.

  When receiving the button press information from the terminal device 20 (step S4: Yes), the information processing apparatus 10 performs control to display the bibliographic item input screen on the terminal device 20 (step S5). As described above, the organizer performs an operation of inputting a bibliographic item from the bibliographic item input screen displayed on the terminal device 20, and presses an OK button 425 after the input is completed. Thereby, the bibliographic item input information is transmitted from the terminal device 20 to the information processing device 10.

  After step S5, the information processing apparatus 10 waits for reception of bibliographic item input information from the terminal device 20 (step S6). When the bibliographic item input information is received (step S6: Yes), the information processing apparatus 10 (conference data management unit 403) generates new conference data and registers it in the data storage unit 46 (step S7). In addition, the information processing apparatus 10 performs control to notify the terminal apparatus 20 used by the user having the participant name included in the newly registered conference data that the conference is to be held (step S8). The specific contents are as described above. The order of each step can be arbitrarily changed.

  FIG. 20 is a flowchart illustrating an operation example of the information processing apparatus 10 when an access from the terminal device 20 that has received the notification in step S8 of FIG. 19 (access that requests a web page of the conference management screen) is received. The information processing apparatus 10 that has received this access performs control to display the conference management screen on the terminal apparatus 20 (the terminal apparatus 20 that has accessed) (step S11). As described above, the user of the participant (the user of the terminal device 20 that has received the notification in step S8) can input the participation method from the conference management screen displayed on the terminal device 20. For convenience of explanation, it is assumed here that an operation for selecting any participation method is performed by the user of the participant. As described above, when any participation method is selected, participation information indicating the selected participation method is transmitted from the terminal device 20 to the information processing device 10.

  After step S11, the information processing apparatus 10 waits for reception of participation information from the terminal apparatus 20 (step S12). When the participation information is received (step S12: Yes), the information processing apparatus 10 (conference data management unit 403) registers the received participation information in the corresponding conference data (step S13). The specific contents are as described above. Note that the order of the above steps can be arbitrarily changed.

  FIG. 21 is a flowchart illustrating an operation example of the information processing apparatus 10 after receiving the conference start information described above. As described above, the information processing apparatus 10 (reaction selection screen display control unit 406) performs control to display the above-described reaction selection screen on the terminal device 20 of the remotely participating user (step S21). As described above, the user of the terminal device 20 on which the reaction selection screen is displayed can select a reaction icon that matches his reaction during the meeting. For convenience of explanation, it is assumed here that any reaction icon has been selected by the user. As described above, when any reaction icon is selected, reaction information including a user ID, a reaction ID associated with any selected reaction icon, and time information indicating the selected time is displayed on the terminal. The information is transmitted from the device 20 to the information processing device 10.

  After step S21, the information processing apparatus 10 waits for reception of reaction information from the terminal device 20 (step S22). When the reaction information is received (step S22: Yes), the information processing apparatus 10 (reaction icon selection unit 408) selects a reaction icon corresponding to the reaction ID included in the received reaction information (step S23). The specific contents are as described above. Next, the information processing apparatus 10 (display device specific information selection unit 409) selects the address of the electronic blackboard 30 (step S24). Next, the information processing apparatus 10 (reaction image display control unit 410) performs control to display the reaction icon selected in step S23 on the electronic blackboard 30 specified by the address selected in step S24 (step S25). Note that the order of the above steps can be arbitrarily changed.

  As described above, the information processing apparatus 10 according to the present embodiment performs control to display a reaction selection screen including a plurality of reaction icons on each terminal apparatus 20, and the user of each terminal apparatus 20 has its own terminal apparatus. From the reaction selection screen displayed at 20, a reaction icon corresponding to the own reaction can be selected. The terminal device 20 that has received the selection operation by the user transmits reaction information including at least the user ID and the reaction ID associated with the selected reaction icon to the information processing device 20. Then, the information processing apparatus 10 refers to the first correspondence information stored in the data storage unit 46 (in this example, user data, conference data, electronic blackboard address data), and displays the response information received from the terminal device 20. The address of the electronic blackboard 30 associated with the user ID included is selected, and a reaction icon (corresponding to the reaction identified by the reaction ID included in the reaction information is displayed on the electronic blackboard 30 specified by the selected address. In this example, control is performed to display (which can be selected from the above icon data). Thereby, even if the user of each terminal device 20 is in a meeting, it can show an own reaction, without speaking. That is, according to the present embodiment, the participant can easily show his / her reaction in the conference using the remote conference system.

  Although the embodiments according to the present invention have been described above, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described embodiments. For example, some components may be deleted from all the components shown in the embodiment.

  Hereinafter, modifications will be described. The following modifications can be arbitrarily combined with the above-described embodiment.

(1) Modification 1
For example, the above-described data storage unit 46 may be configured to store second correspondence information in which reaction icon display times are associated for each of a plurality of reaction IDs. FIG. 22 is a diagram illustrating an example of the second correspondence information. For example, the data storage unit 46 may be configured to store data obtained by integrating the icon data (see FIG. 16) described above and the second correspondence information.

  FIG. 23 is a diagram illustrating an example of functions of the project management unit 44 according to the present modification. As illustrated in FIG. 23, the project management unit 44 further includes a display time determination unit 411. The display time determination unit 411 determines the display time associated with the reaction ID included in the reaction information acquired by the acquisition unit 407 with reference to the second correspondence information. Then, the reaction image display control unit 410 performs control to display the reaction icon according to the display time determined by the display time determination unit 411.

(2) Modification 2
For example, the above-described data storage unit 46 may store the third correspondence information in which display time information that can specify the display time of the reaction icon is associated with each of a plurality of categories that classify the reaction type. Good. FIG. 24 is a diagram illustrating an example of third correspondence information. In the example of FIG. 24, the third correspondence information is information in which one or more reaction IDs belonging to the category are associated with the display time information for each category such as request, reward, and comment. For example, as display time information associated with a category indicating “request”, information indicating that a reaction icon is displayed until another comment (reaction information) is received is associated.

  For example, the data storage unit 46 may be configured to store data obtained by integrating the icon data and the third correspondence information.

  The function of the project management unit 44 of this modification is the same as that of the example of FIG. 23, and the reaction image display control unit 410 performs control to display the reaction icon according to the display time determined by the display time determination unit 411. . The display time determination unit 411 refers to the third correspondence information, and based on the display time information associated with the category to which the reaction identified by the reaction ID included in the reaction information acquired by the acquisition unit 407 belongs, The display time of the reaction icon corresponding to the reaction is determined.

(3) Modification 3
For example, when the acquisition unit 407 acquires a plurality of reaction information corresponding to the plurality of terminal devices 20 on a one-to-one basis, the reaction image display control unit 410 displays a plurality of reaction information on a one-to-one basis. It is also possible to perform control to display icons alternately. For example, the reaction image display control unit 410 can alternately display a plurality of reaction information and a plurality of reaction icons corresponding one-on-one at predetermined time intervals (for example, 1 second).

  For example, when the acquisition unit 407 acquires a plurality of reaction information corresponding to the plurality of terminal devices 20 on a one-to-one basis, the reaction image display control unit 410 corresponds to a plurality of reaction information on a one-to-one basis. It is also possible to perform control to display the reaction icons side by side.

  In addition, this modification can be arbitrarily combined with each of the above-described embodiment, modification 1, and modification 2.

  The program executed by the information processing apparatus 20 is a file in an installable format or an executable format, and is a CD-ROM, flexible disk (FD), CD-R, DVD (Digital Versatile Disk), USB ( It may be configured to be recorded and provided on a computer readable recording medium such as Universal Serial Bus), or may be configured to be provided or distributed via a network such as the Internet. Various programs may be provided by being incorporated in advance in a ROM or the like.

DESCRIPTION OF SYMBOLS 1 Information processing system 10 Information processing apparatus 12 Network 20 Terminal apparatus 25 Conference terminal 30 Electronic blackboard 40 Network 42 Project selection part 44 Project management part 46 Data storage part 401 Conference management screen display control part 402 Input screen display control part 403 Conference data management Unit 404 conference management screen update unit 405 conference start control unit 406 reaction selection screen display control unit 407 acquisition unit 408 reaction icon selection unit 409 display device specific information selection unit 410 reaction image display control unit 411 display time determination unit

JP 2010-28389 A

Claims (9)

An information processing device connectable to a display device and each of one or more terminal devices via a network,
An acquisition unit that acquires reaction information including at least user identification information that identifies a user who uses the terminal device and reaction identification information that identifies a user's reaction from the terminal device;
For each meeting identification information for identifying a meeting, at least correspondence between the user identification information of users participating in the meeting and display device specifying information capable of specifying the display device installed in the meeting room where the meeting is held A first storage unit for storing the attached first correspondence information;
A display device specifying information selecting unit that selects the display device specifying information associated with the user identification information included in the reaction information acquired by the acquiring unit with reference to the first correspondence information;
The display device specified by the display device specifying information selected by the display device specifying information selecting unit corresponds to the reaction identified by the reaction identification information included in the reaction information acquired by the acquiring unit. A reaction image display control unit that performs control to display a reaction image,
Information processing device. A reaction selection screen display control unit that performs control to display a reaction selection screen for selecting any of a plurality of reactions on the terminal device;
The reaction information includes at least the user identification information and the reaction identification information for identifying any reaction selected from the reaction selection screen.
The information processing apparatus according to claim 1. A second storage unit that stores second correspondence information in which a display time of the reaction information is associated for each of a plurality of the reaction identification information;
A display time determination unit that refers to the second correspondence information and determines a display time associated with the reaction identification information included in the reaction information acquired by the acquisition unit;
The reaction image display control unit performs control to display the reaction image according to the display time determined by the display time determination unit.
The information processing apparatus according to claim 1 or 2. A third storage unit for storing third correspondence information in which display time information capable of specifying the display time of the reaction information is associated with each of a plurality of categories for classifying the types of reaction;
With reference to the third correspondence information, based on the display time information associated with the category to which the reaction identified by the reaction identification information included in the reaction information obtained by the obtaining unit belongs, A display time determination unit for determining a display time of the reaction information corresponding to the reaction,
The reaction image display control unit performs control to display the reaction image according to the display time determined by the display time determination unit.
The information processing apparatus according to claim 1 or 2. When the acquisition unit acquires a plurality of the reaction information corresponding to a plurality of the terminal devices, the reaction image display control unit includes a plurality of the reaction information corresponding to the plurality of the reaction information. Control to alternately display the reaction images,
The information processing apparatus according to any one of claims 1 to 4. When the acquisition unit acquires a plurality of the reaction information corresponding to a plurality of the terminal devices, the reaction image display control unit includes a plurality of the reaction information corresponding to the plurality of the reaction information. Control to display the reaction images side by side;
The information processing apparatus according to any one of claims 1 to 4. An information processing method by an information processing apparatus connectable to a display device and each of one or more terminal devices via a network,
An acquisition step of acquiring reaction information including at least user identification information for identifying a user who uses the terminal device and reaction identification information for identifying a user reaction from the terminal device;
For each meeting identification information for identifying a meeting, at least correspondence between the user identification information of users participating in the meeting and display device specifying information capable of specifying the display device installed in the meeting room where the meeting is held A display device specifying information selecting step of selecting the display device specifying information associated with the user identification information included in the reaction information acquired by referring to the attached first correspondence information;
The display device specified by the display device specifying information selected in the display device specifying information selection step corresponds to the reaction identified by the reaction identification information included in the reaction information acquired by the acquisition unit. A reaction image display control step for performing control to display a reaction image,
Information processing method. A display device and a computer connectable to each of the one or more terminal devices via a network;
An acquisition step of acquiring reaction information including at least user identification information for identifying a user who uses the terminal device and reaction identification information for identifying a user reaction from the terminal device;
For each meeting identification information for identifying a meeting, at least correspondence between the user identification information of users participating in the meeting and display device specifying information capable of specifying the display device installed in the meeting room where the meeting is held A display device specifying information selecting step of selecting the display device specifying information associated with the user identification information included in the reaction information acquired by referring to the attached first correspondence information;
The display device specified by the display device specifying information selected in the display device specifying information selection step corresponds to the reaction identified by the reaction identification information included in the reaction information acquired by the acquisition unit. And a reaction image display control step for performing a control to display a reaction image. An information processing system including a display device, one or more terminal devices, the display device, and an information processing device connectable to each of the one or more terminal devices via a network,
An acquisition unit that acquires reaction information including at least user identification information that identifies a user who uses the terminal device and reaction identification information that identifies a user's reaction from the terminal device;
For each meeting identification information for identifying a meeting, at least correspondence between the user identification information of users participating in the meeting and display device specifying information capable of specifying the display device installed in the meeting room where the meeting is held A first storage unit for storing the attached first correspondence information;
A display device specifying information selecting unit that selects the display device specifying information associated with the user identification information included in the reaction information acquired by the acquiring unit with reference to the first correspondence information;
The display device specified by the display device specifying information selected by the display device specifying information selecting unit corresponds to the reaction identified by the reaction identification information included in the reaction information acquired by the acquiring unit. A reaction image display control unit that performs control to display a reaction image,
Information processing system.

Images