JP2014179714A - Communication device, image display method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a communication device capable of improving the visibility of a displayed image.
A conference device is a communication device used for information sharing by transmitting and receiving image data and audio data between a plurality of bases via the Internet, and two display devices 200a and 200b are communicably connected. A part of at least one image transmitted from at least one other base is displayed on the two display devices 200a and 200b, and at least another part of the at least one image is displayed on the built-in display 14. Can be displayed.
[Selection] Figure 16

Description

  The present invention relates to a communication device, an image display method, and a program. More specifically, the present invention relates to a communication device used for information sharing by transmitting and receiving at least images via a communication network between a plurality of bases, and an image display in the communication device. The present invention relates to a method and a program used for the communication apparatus.

  Conventionally, a conference apparatus used for a conference (information sharing) by transmitting and receiving image data and audio data via the Internet (communication network) between a plurality of bases is known (see, for example, Patent Document 1).

  For example, the conference apparatus displays a plurality of images individually transmitted from a plurality of other bases on the image display apparatus.

  However, in the conference apparatus disclosed in Patent Document 1, it has been desired to improve the visibility of the displayed image.

  The present invention is a communication device having an image display unit, which is used for information sharing by at least image transmission / reception via a communication network between a plurality of bases, wherein at least one image display device is communicably connected, A part of at least one image transmitted from at least one other base is displayed on the image display device, and at least another part of the at least one image is displayed on the image display unit. It is a communication device that can do this.

  According to this, the visibility of the displayed image can be improved.

It is a figure which shows the structure of the conference system which concerns on one Embodiment. FIGS. 2A and 2B are perspective views (No. 1 and No. 2), respectively, in the reference form of the conference apparatus. It is a top view in the standard form of a conference apparatus. It is a block diagram which shows the structure of control of a conference apparatus. It is the side view (the 1) in the standard form of a conference apparatus. It is a side view (the 2) in the standard form of a conference apparatus. It is a bottom view in the standard state of a conference apparatus. It is a side view in the opening form of a conference apparatus. It is a perspective view in the maximum opening form of a conference apparatus. It is a figure which shows the aspect (the 1) of the video conference performed using a conference system. It is a figure which shows the aspect (the 2) of the video conference performed using a conference system. It is a figure which shows the aspect (the 3) of the video conference performed using a conference system. FIG. 13A is a diagram showing a display mode (part 1) on the built-in display of the conference device, and FIG. 13B is a diagram showing a display mode (part 2) on the built-in display of the conference device. is there. It is a flowchart (the 1) for demonstrating the image display method in a conference system. It is a flowchart (the 2) for demonstrating the image display method in a conference system. It is a figure which shows an example of the image display method in a conference system. It is a figure which shows the data structure corresponding to FIG. It is a flowchart (the 3) for demonstrating the image display method in a conference system. FIG. 19A and FIG. 19B are diagrams showing another example (part 1 and part 2) of the image display method in the conference system, respectively. It is a figure which shows the data structure corresponding to FIG.19 (B). It is a figure for demonstrating the several example of matching with a base and a display means.

  Hereinafter, an embodiment will be described with reference to FIGS. FIG. 1 schematically shows a conference system 1000 according to an embodiment. The conference system 1000 is used for a video conference (information sharing) via a network between a plurality of bases, for example, the Internet (communication network). Here, one conference system 1000 is arranged at each site.

  As shown in FIG. 1, the conference system 1000 includes the conference device 100 and at least one (for example, two) display devices 200a and 200b as an example.

  The conference devices 100 arranged at each site are connected to each other via the Internet so that two-way communication of voice and images is possible. Each conference apparatus 100 has a built-in display 14 as will be described in detail later.

  When each display apparatus is energized and connected to the conference apparatus 100 with, for example, a cable C with a distributor of the HDMI standard, image data is supplied from the conference apparatus 100 via the cable C, and the image data is received. The corresponding image is displayed on the display screen. In addition, although the conference apparatus 100 and each display apparatus are shown by the wire connected by the cable C, you may connect by radio | wireless. Further, instead of the cable C, for example, a cable conforming to the VGA standard may be used.

  As an example, each display device includes a liquid crystal panel having a display surface on which an image is displayed, two electrodes disposed at a position sandwiching the liquid crystal panel, and two polarizations disposed at a position sandwiching the two electrodes. A liquid crystal structure including a plate, and a backlight disposed on one side of the liquid crystal structure, and has a flat outer shape as a whole. That is, the display device is a so-called liquid crystal display. In addition, an organic EL (electroluminescence) display etc. are mentioned as an example as a display apparatus.

  FIGS. 2A and 2B are perspective views showing an appearance of one form of the conference apparatus 100 (hereinafter referred to as a reference form) seen from different directions.

  As shown in FIGS. 2A and 2B, the conference apparatus 100 has, as a whole, a substantially rectangular plate-like outer shape (for example, a thickness of 20 mm to 40 mm) of A4 size, for example, as a whole. Have.

  Thus, the conference apparatus 100 is designed to be thin and compact in the standard form. Further, as will be described in detail later, the conference apparatus 100 is configured between a reference configuration and an open configuration suitable for use in a state where the conference device 100 is mounted on a top surface (mounting surface) such as a desk or table. Can be migrated.

  FIG. 3 shows a state in which the conference apparatus 100 in the standard form is placed on a horizontal placement surface. Hereinafter, the longitudinal direction of the conference apparatus 100 is the X-axis direction, the direction orthogonal to the X-axis direction in the horizontal plane is the Y-axis direction, and the direction orthogonal to both the X-axis direction and the Y-axis direction (vertical direction) is the Z-axis direction. Will be described. In addition, the conference device 100 is assumed to be in a reference form unless otherwise specified.

  As shown in FIGS. 2A to 3, the conference apparatus 100 includes a first housing 10, a second housing 12, an electronic camera 16, a speaker 18, a microphone 20, and a control device in addition to the built-in display 14. 24 (see FIG. 4).

  As an example, as shown in FIGS. 2A and 2B, the first housing 10 includes a control device housing portion 10a in which the control device 24 is housed and a plurality of operation members. And an operation panel unit 10b.

  The control device 24 encodes or decodes image data and audio data, and controls transmission and reception of images and audio via the Internet.

  As shown in FIG. 4, the control device 24 includes a main board 62 as a control board, a sub board 63 as a voice processing and operation board, and the like.

  As an example, the main board 62 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 104, an HDD (Hard Disk Drive) 106 (or a storage or recording device), and data storage. Each component of an output I / F (Interface) 108, a network I / F 110, an image input I / F 112, an image output I / F 114, an energization detection unit 142, and a display control unit 140 is mounted. The CPU 101, the ROM 102, the RAM 104, the HDD 106, the data input / output I / F 108, the network I / F 110, the image input I / F 112, the energization detection unit 142, and the display control unit 140 are connected via a bus line 116 such as an address bus or a data bus. It is connected so that two-way communication is possible. Note that the above-described image data is data of moving images or intermittent images (still images with a fixed time interval).

  The CPU 101 controls the operation of the entire conference apparatus 100 based on a predetermined program (conference apparatus program). A series of operations related to bidirectional audio and image communication via a network (for example, the Internet) according to a command from the CPU 101 according to the conference apparatus program will be described later.

  The ROM 102 stores a program used for driving the CPU 101 such as an IPL (Initial Program Loader). The RAM 104 is used as a work area for the CPU 101.

  The HDD 106 stores various data such as the conference device program, image data, and audio data. In addition, not only HDD but SSD (Solid State Drive) etc. may be used, for example. The conference apparatus program may be installed in an installable or executable format, and may be recorded and distributed on a computer-readable recording medium such as a recording medium. The conference apparatus program may be stored in the ROM 102 instead of the HDD 106. The HDD 106 controls reading or writing of various data with respect to the HDD 106 according to the control of the CPU 101.

  The data input / output I / F 108 controls reading or writing (storage) of data with respect to a recording medium M such as a flash memory connected to a plurality of USB terminals, which will be described later, and for example a PC (personal computer) connected to the USB terminal. The transmission of data from the computer) to the conference device at the other site is controlled.

  The recording medium M is detachably attached to one of the plurality of USB terminals. For example, if the recording medium M is an SD memory, a compact flash (registered trademark) or the like that cannot be directly attached to or detached from the USB terminal, the memory reading drive may be attached to or detached from the USB terminal. The conference device 100 may be provided with a memory reading drive in advance. The recording medium M is not limited to a flash memory as long as it is a non-volatile memory that reads or writes data according to the control of the CPU 101, and may be an EEPROM (Electrically Erasable and Programmable ROM) or the like.

  The network I / F 110 includes a LAN terminal 38 (for example, Ethernet (registered trademark) terminal) described later, and performs input / output (transmission / reception) of data (image data and audio data) via the Internet. That is, the network I / F 110 includes a function as image data transmission means. The network I / F 110 may be provided so as to be connectable to a wired LAN terminal, or may be a wireless LAN network I / F that can be connected to a wireless LAN.

  The image input I / F 112 takes in the image signal of the subject (user) at the local site, which is output from the electronic camera 16, as predetermined image data.

  The image output I / F 114 converts the image data via the display control unit 140 into an image signal that can be displayed on the built-in display 14 and outputs the image signal to the built-in display 14. Further, when the image output I / F 114 is connected to a display device via an image output terminal 42 and a cable C, which will be described later, an image that can display a part of the image data via the display control unit 140 on the display device. It converts into a signal and outputs it to a display apparatus.

  Examples of the image signal include an analog RGB signal (VGA), a component video signal, an HDMI (High-Definition Multimedia Interface) signal, and a DVI (Digital Video Interactive) signal.

  The energization detection unit 142 detects whether or not the display device is energized when each display device is connected to the image output I / F 114, and sends the detection result to the CPU 101.

  As will be described in detail later, the display control unit 140 causes the two display devices 200a and 200b to display a partial image of at least one image sent from the conference device 100 of at least one other site, and It is possible to display at least another part of the at least one image on the built-in display 14. The display control unit 140 has a function of separating a part of the image from the part of the other image from an image transmitted from at least one other base, and displays the part of the image as the image. The other part of the image can be displayed on the image display unit while being displayed on the apparatus.

  The sub-board 63 is provided with components such as a plurality of operation terminals 118 corresponding to the plurality of operation buttons described above, a voice input / output I / F 120, and a voice control unit 122. The plurality of operation terminals 118 and the audio control unit 122 are connected to each other via the bus line 116 so as to be capable of bidirectional communication with each other, and are mounted on the main board 62 and connected via the bus line 116. It is connected so that it can communicate with the other.

  The voice input / output I / F 120 takes in the voice signal input from the microphone 20 as predetermined voice data, sends the voice data to the voice control unit 122, and receives it through the network I / F 110 and the voice control unit 122. The audio data thus converted is converted into an audio signal that can be reproduced by the speaker 18.

  The sound control unit 122 adjusts the volume of sound output from the speaker 18 when a pair of volume buttons 62a and 62b described later is operated, and a microphone mute button 64 described later is pressed down (ON / OFF). ), The sound input / non-input by the microphone 20 is switched.

  In addition, the voice control unit 122 receives sound output from the speaker 18 through the microphone 20 during two-way communication with the conference device 100 at another site, and creates a sound wave loop with the conference device 100 at the other site. It has an echo cancellation processing function that suppresses echoes and howling that are formed, and a noise cancellation processing function that reduces sound input by the microphone 20 such as an operating sound of an indoor air conditioner.

  As can be seen from a combination of FIGS. 5 and 6, the control device accommodating portion 10 a includes, as an example, a box-shaped portion having a substantially rectangular flat plate-like outer shape whose longitudinal direction is the X-axis direction.

  In addition, as shown in FIG. 5, four openings are formed in the side wall on the + X side of the control device housing portion 10a, and the four openings are for communication mounted on the main board 62, respectively. LAN terminal 38, HDMI image output terminal 40, VGA image output terminal 42, and power terminal 44 (power jack) are fitted. Instead of or in addition to the image output terminals 40 and 42, a DVI-I terminal, a component terminal, a D terminal, an S terminal, and a composite terminal may be provided.

  As shown in FIG. 6, as an example, two openings are formed at the −X side end of the −Y side side wall of the control device housing portion 10 a, and the two openings are respectively connected to the main opening. USB terminals 28 and 30 mounted on the board 62 are fitted. Also, as an example, three openings are formed at the + X side end of the −Y side side wall of the control device accommodating portion 10 a, and the three openings are respectively mounted on the main board 62. A headphone connection terminal 32, a microphone connection terminal 34, and a USB terminal 36 are fitted.

  Further, as shown in FIG. 7, as an example, four openings are formed in the four corners of the −Z side wall (bottom wall) of the control device housing portion 10 a, and the four openings include: Four connectors 46 mounted on the main board 62 for connecting an external battery are fitted.

  As can be understood from FIG. 3, FIG. 5 and FIG. 6, the operation panel portion 10b is composed of a box-shaped portion having an elongated, substantially rectangular, flat plate shape whose longitudinal direction is the X-axis direction. It is continuous to the + Z side end of the −Y side end.

  As shown in FIG. 3, in the region on the −X side of the + Z side wall of the operation panel unit 10b, as an example, five openings are formed side by side in the X-axis direction. Five operation members are individually fitted. As an example, these five operation members are a power button 48, a menu button 50, a cursor 52, a decision button 54, and a disconnect button 56 for disconnecting the Internet line with the communication partner in order from the -X side to the + X side. ing.

  The power button 48 is an operation member for turning on / off the power to the conference apparatus 100. In the vicinity of the power button 48 in the operation panel unit 10b, a power lamp 49 that is turned on when the power is turned on is provided.

  The menu button 50 is an operation member for calling a menu screen on the built-in display 14.

  The cursor 52 is an operation member for selecting an item displayed in the menu screen displayed on the built-in display 14. That is, by operating the cursor 52, items in the menu screen can be selected.

  The determination button 54 is an operation member for determining an item selected on the menu screen. As an item selected and determined in the menu screen, for example, a destination of the conference apparatus 100 at another base can be cited.

  The disconnect button 56 is an operation member for disconnecting the Internet line with the communication partner conference apparatus 100.

  For example, in the + X side region of the + Z side wall of the operation panel unit 10b, five openings are formed side by side in the X-axis direction, and five operation members are individually fitted into the five openings. ing. As an example, these five operation members are a view switching button 58, a brightness adjustment button 60, a pair of volume buttons 62a and 62b, and a microphone mute button 64 in order from the -X side to the + X side.

  The view switching button 58 is an operation member for switching an image to be transmitted to another site among images captured by the electronic camera 16. That is, for example, when there are a plurality of users (conference participants) at a certain base, by pressing the view switching button 58, one of a plurality of images selectively displayed by at least one of the plurality of users is displayed. Can be sent to other locations.

  The brightness adjustment button 60 is an operation member for adjusting the brightness of an image displayed on the built-in display 14. By appropriately pressing the brightness adjustment button 60 according to the ambient brightness of the conference apparatus 100, the brightness of the screen of the built-in display 14 can be adjusted to an appropriate brightness with good visibility. Here, as an example, the lightness adjusted by the lightness adjustment button 60 is set to N levels (N is a natural number), and the lightness gradually increases or decreases each time the lightness adjustment button 60 is pressed. When the brightness adjustment button 60 is pressed N times, the original brightness is restored.

  The pair of volume buttons 62 a and 62 b are operation members for adjusting the volume of the sound output from the speaker 18. The volume can be lowered by pressing the -X side volume button 62a of the pair of volume buttons 62a and 62b, and the volume can be raised by pressing the + X side volume button 62b. .

  The microphone mute button 64 is an operation member for switching ON / OFF of the microphone 20. Note that when the microphone 20 is ON, it means a state in which sound is input via the microphone 20, and when the microphone 20 is OFF, it means a state where no sound is input via the microphone 20.

  As shown in FIGS. 2A and 2B, the second housing 12 accommodates the built-in display 14, a part of the electronic camera 16, a part of the speaker 18, and a part of the microphone 20. The first housing portion 12a, the remaining portion of the electronic camera 16 (excluding the photographing lens 16a), the remaining portion of the speaker 18, and the second housing portion 12b in which the remaining portion of the microphone 20 is housed.

  As can be understood from FIGS. 3, 5, and 6, the first housing portion 12 a is composed of a box-shaped portion having a substantially rectangular flat plate-like outer shape whose longitudinal direction is the X-axis direction. It is on the + Z side and is located on the + Y side of the operation panel unit 10b. Here, as an example, when the conference apparatus 100 is in the reference form, the −Z side surface of the first housing portion 12a is in contact with the + Z side surface of the control device housing portion 10a.

  The built-in display 14 is housed in a state parallel to the XY plane at the approximate center in the first housing portion 12a.

  As an example, the built-in display 14 includes a liquid crystal panel having a display surface on which an image is displayed, two electrodes disposed at a position sandwiching the liquid crystal panel, and two polarizations disposed at a position sandwiching the two electrodes. A liquid crystal structure including a plate, and a backlight disposed on one side of the liquid crystal structure, and has a flat outer shape as a whole. That is, here, the built-in display 14 is a so-called liquid crystal display.

  As an example, the + Z side surface of the first housing portion 12a is formed with a rectangular opening that is one or more times larger than the built-in display 14, and a cover panel 26 made of reinforced plastic is fitted into the rectangular opening. Yes. That is, the built-in display 14 is covered from the + Z side by the cover panel 26. In the cover panel 26, a portion corresponding to (facing) the built-in display 14 is transparent, and a portion surrounding the portion is black, for example. Hereinafter, the transparent portion of the cover panel 26 is referred to as a clear panel portion CP, and the black portion of the cover panel 26 is referred to as a black panel portion BP. In this case, the liquid crystal panel of the built-in display 14 is visible from the + Z side via the clear panel portion CP.

  As can be understood from FIGS. 5 and 6, the second housing portion 12 b is composed of a substantially rectangular plate-like box-shaped portion whose longitudinal direction is the X-axis direction, and the end portion on the + Y side of the first housing portion 12 a. It continues to the end on the -Z side. That is, the 2nd accommodating part 12b protrudes in the -Z side rather than the -Z side end of the 1st accommodating part 12a.

  As shown in FIG. 3, FIG. 5, and FIG. 6, an electronic camera is provided at the center in the X-axis direction of the space formed by the + Y side end of the first housing portion 12 a and the second housing portion 12 b. A portion excluding the 16 photographing lenses 16 a is accommodated, and the photographing lens 16 a protrudes outside the second housing 12 from an opening formed in the black panel portion BP.

  As the photographic lens 16a, for example, a substantially hemispherical wide-angle lens having a viewing angle in the X-axis direction of 170 ° and a viewing angle in the Y-axis direction of 135 ° is used.

  As shown in FIGS. 3, 5, and 6, a pair of lens protection protrusions 66 a for protecting the photographing lens 16 a are provided near the + Y side and the −Y side of the photographing lens 16 a in the black panel portion BP. 66b protrudes. The outer surface of each lens protection projection is formed of a curved surface so that it will not be injured when touched by a finger or the like.

  The electronic camera 16 captures an image of a subject via the photographing lens 16a, converts the captured image into an image signal (electric signal), and outputs the image signal to the image input I / F 112 (see FIG. 4). As an example of the image pickup device of the electronic camera 16, a CCD, a CMOS, or the like is used.

  Also, as shown in FIG. 3, a speaker 18 is connected to the sound output direction at the −X side end of the space formed by the + Y side end of the first storage portion 12a and the second storage portion 12b. Are arranged in the + Z direction.

  Here, as the speaker 18, for example, a full range type round shape is adopted, but other types may be used. The speaker 18 is connected to the voice input / output I / F 120, and outputs a voice signal transmitted from the voice input / output I / F 120 as voice (see FIG. 4).

  In a portion corresponding to the speaker 18 in the black panel portion BP, a sound emission port 68 configured to include a plurality of small through holes for discharging sound output from the speaker 18 to the outside is formed ( (See FIG. 3).

  In addition, in the space on the + X side of the electronic camera 16 in the space formed by the + Y side end of the first housing portion 12a and the second housing portion 12b, the microphone 20 has a voice input direction approximately in the −Z direction. It is arranged to be.

  Here, for example, a small omnidirectional microphone is adopted as the microphone 20, but a microphone having directivity may be used. The microphone 20 is connected to the voice input / output I / F 120 and transmits the input voice to the voice input / output I / F 120 as a voice signal (see FIG. 4).

  A portion corresponding to the microphone 20 of the black panel portion BP is formed with a sound intake port 70 including at least one small through hole for capturing sound input via the microphone 20. .

  Further, at the -X side and -Y side corners of the black panel portion BP, there are a remaining amount lamp 72 that displays the remaining amount of charge of the external battery, and a line lamp 74 that displays the connection status of the Internet line. Is provided.

  Hereinafter, as shown in FIG. 8, an axis orthogonal to the X axis and parallel to the cover panel 26 is referred to as an α axis, and an axis orthogonal to the X axis and the α axis is referred to as a β axis. Therefore, when the conference apparatus 100 is in the reference form, the α axis coincides with the Y axis, and the β axis coincides with the Z axis.

  Here, the end portion on the −Y side of the first housing portion 12a, that is, the end portion on the −α side, is connected to the first housing 10 via a torque hinge (not shown) whose axial direction is the X-axis direction. ing. The liquid crystal panel of the built-in display 14 is visible from the + β side, the photographing lens 16a is exposed to the + β side, the sound output direction of the speaker 18 is approximately + β side, and the sound input direction of the microphone is approximately −−. β side.

  That is, the second housing 12 is separated from the first housing 10 by a contact position (see FIGS. 5 and 6) where the second housing 12 is in contact with the first housing 10 around the X axis. It can be rotated relative to the position (see FIG. 8) about the X axis. Therefore, in the following, the form of the conference apparatus 100 when the second housing 12 is located at the separated position is also referred to as an open form.

  The rotation angle θ around the X axis of the second housing 12 with respect to the first housing 10 is θ = 0 ° when the conference apparatus 100 is in the reference form, that is, when the second housing 12 is located at the contact position. Then, for example, 0 ° ≦ θ ≦ 90 ° is set. In FIG. 9, θ = 90 °, and the conference apparatus 100 is in the maximum opening form. The second casing 12 can be held at a rotational angle θ around the X axis with respect to the first casing 10 by the action of the torque hinge. In addition, the form of the conference apparatus 100 when the second housing 12 is located at the contact position is the reference form. Therefore, hereinafter, the reference form is also referred to as a closed form.

  An example of a video conference using the conference system 1000 configured as described above will be described below. Here, the video conference is performed using, for example, a conference system 1000 disposed at each base between four bases (see FIGS. 10 to 12). As an example, among the four bases, the number of users at the first base is two (see FIG. 10), the number of users at the second base is four (see FIG. 11), and the third base The number of users at the fourth base is one (see FIG. 12). Here, “user” means a conference participant.

  As shown in FIGS. 10 to 12, the user at each base is seated in a state where the table T is directed to the + X side, the −X side, or the −Y side of the table T arranged in one room, for example.

  The user places the conference apparatus 100 in the reference form, for example, at the corners on the + X side and the + Y side of the upper surface of the table T so that the operation panel unit 10b is positioned on the −Y side. In contrast, the second housing 12 is rotated around the X axis by an angle φ (for example, 60 ° ≦ φ ≦ 90 °). As a result, the built-in display 14 is in a state in which the first casing 10 is used as a pedestal and stands substantially facing the −Y side, that is, a state that is visible from the −Y side. Further, in this state, the photographing lens 16a, the speaker 18 and the microphone 20 are located at substantially the same height as the height of the user's face. In this state, the photographic lens 16a is generally directed to the -Y side so that all users are within the photographing field of view of the electronic camera 16, the sound output direction of the speaker 18 is approximately the -Y side, and the sound input direction of the microphone 20 is Generally on the + Y side.

  In addition, the user arranges the two display devices 200a and 200b, for example, on the upper surface of the table T on the −X side of the conference device 100 and in the X-axis direction with the respective display surfaces facing the −Y side. As a result, all the users can visually recognize the display surface of each display device.

  In addition to the placement of the conference device 100 on the table T, the user uses a connection of wiring related to electricity and communication to the conference device 100 (for example, the cable C between the image output terminal 40 and each display device). Connection, connection using a LAN cable between the LAN terminal 38 and a terminal connected to the Internet, connection using a power cable between the power supply terminal 44 and an external power supply, and the like. Note that wireless connection may be performed instead of wiring connection.

  Next, the user presses the power button 48 to activate the conference device 100. At this time, a menu screen is displayed on the built-in display 14. In this menu screen, various items such as various adjustments, start of a conference (start of bidirectional communication), and the like are displayed with icons and text information. Therefore, the user operates the cursor 52 to select an item related to the start of the conference on the menu screen, and presses the determination button 54 to determine the start of the conference.

  When the start of the conference is determined, the destination list of three other sites is displayed on the menu screen of the built-in display 14 of the conference device 100 at one site, and the user at one site operates the cursor 52 to operate the destination list. Then, another site where the video conference (two-way communication) is to be performed is selected, and the determination button 54 is pressed to determine. Here, three other bases are selected and determined. As a result, a request for bidirectional communication is transmitted from the conference device 100 at one site to the conference devices 100 at three other sites.

  When the conference device 100 at each other site receives the request for bidirectional communication, the items regarding the acceptance and rejection of the request are displayed on the menu screen displayed on the built-in display 14.

  Therefore, the user at each other site selects and decides one of the items regarding the acceptance and the rejection by operating the cursor 52 and the decision button 54 of the conference apparatus 100 at the other site. Here, the items relating to acceptance are selected and determined, and as a result, the four conference apparatuses 100 are connected to each other via the Internet so as to be capable of two-way communication.

  When two-way communication is started between the four conference apparatuses 100, the image data of the users at the bases captured by the electronic camera 16 of the conference apparatus 100 at each base is transferred to the conference apparatuses at the other three bases via the Internet. The image corresponding to the image data can be displayed on the built-in display 14 of the conference apparatus 100.

  In addition, the voice of the user at the base captured by the microphone 20 of the conference apparatus 100 at each base is transmitted to the conference apparatus 100 at the other three bases via the Internet and output from the speaker 18 of the conference apparatus 100. The

  In this way, a video conference is performed by bidirectional communication of images and sounds between the four bases.

  Here, the conference device 100 at each site simultaneously outputs three images corresponding to the three image data individually transmitted from the conference devices 100 at the other three sites at different positions on the display surface of the built-in display 14. It can be displayed.

  In this case, the user at each base places the appearances (images) of the users at the three other bases displayed on the built-in display 14 of the conference apparatus 100 in the field of view, and the voices of the users at the respective bases output from the speaker 18. Listen and conduct a dialogue with the user at the other site.

  As an example, FIG. 13A shows a display mode (No. 1) of the built-in display 14 of the conference apparatus 100 arranged at the first base where two users are present. Here, the conference device 100 at the first site displays on the built-in display 14 a large image of the second site with four users among the images at the other three sites, and the first device with one user. For example, the images of the third and fourth sites and the image of the first site (own site) are displayed in a small size at the edge of the image of the second site in a picture-in-picture, for example. Note that the image of the local site is an image captured by the electronic camera 16 at the local site, and is mainly displayed to adjust the orientation of the electronic camera 16 at the local site. A rectangular parallelepiped with letters A to F in FIG. 13A indicates a user.

  In this case, since the users at the first site are difficult to visually recognize the facial expressions, gestures, etc. of the users at the third and fourth sites, it is difficult to understand the user's intentions, thoughts, etc., which may hinder the progress of the conference. There is.

  As an example, FIG. 13B shows a display mode (part 2) of the conference apparatus 100 arranged at the first base. Here, the conference apparatus 100 at the first site (own site) displays a large image of the second site on the built-in display 14, and the image of the first site (own site) is displayed, for example, as a picture-in-picture. A small image is displayed in the corner of the image. A rectangular parallelepiped with alphabetic characters A to D in FIG. 13B indicates a user.

  Even in this case, it is desirable for the user at the first base to easily see the facial expressions, gestures, etc. of the users at the second base.

  The above problems are also considered to occur at the second base, the third base, and the fourth base as well, and the more the number of bases and the greater the number of users at each base, the more serious it becomes. Become.

  Therefore, the control device 24 performs the control described below. The flowcharts of FIGS. 14, 15, and 18 correspond to the processing algorithm of the CPU 101. In the following description, it is assumed that the number of locations for video conferences is K, and the conference device 100 and at least one display device are arranged at each location.

  First, with reference to FIG. 14, a series of processes executed after the conference apparatus 100 is activated will be described.

  In the first step S1, whether or not at least one of the plurality of display devices is in an energized state is determined based on a detection result (for example, a current value) obtained through the cable C in the energization detecting unit 142. Is done. Therefore, if at least one display device is connected to the image output I / F 114 and is in the energized state, the determination in step S1 is affirmed, and otherwise, the determination in step S1 is negative. If the determination in step S1 is negative, the process proceeds to step S2. On the other hand, if the determination in step S1 is affirmed, the process proceeds to step S3. In addition, when connected by wire, examples include current values and connection response signals from the display device side. When connected wirelessly, it is possible to determine whether there is a connection response signal or a ping command. It is. Therefore, although it has been described as an energization detection unit, it only needs to have a function of detecting connection with a display device.

  In step S2, images of the local site and at least one other site are displayed on the built-in display 14 (see FIG. 13A or FIG. 13B). When this process is executed, the process returns to step S1.

  In step S3, the number N of display devices determined to be in the energized state in step S1 is acquired. For example, the number N is acquired by the CPU 101 based on the detection result of the energization detection unit 142.

  In the next step S5, it is determined whether or not the base image whole display mode is set. Here, on the menu screen displayed on the built-in display 14, the user can select and determine (set) either the base image whole display mode or the base image partial display mode. Therefore, if the base image whole display mode is set, the determination in step S5 is affirmed, and the process proceeds to step S7. On the other hand, if the base image whole display mode is not set, the determination in step S5 is denied, and the process proceeds to step S9.

  In step S7, a base image whole display process is executed. The entire base image display process will be described in detail later. When step S7 is executed, the flow ends.

  In step S9, it is determined whether the base image partial display mode is selected. Therefore, if the base image partial display mode is set, the determination in step S9 is affirmed, and the process proceeds to step S11. On the other hand, if the base image partial display mode is not set, the determination in step S9 is denied and the process proceeds to step S2. If the determination in step S9 is negative, the process may return to step S5.

  In step S11, a base image partial display process is executed. The base image partial display processing will be described in detail later. When step S11 is executed, the flow ends.

  Next, the base image whole display process (step S7) will be described with reference to FIG.

  In the first step S101, device numbers (for example, 1 to N) are assigned to N display devices that are energized.

  In the next step S103, base numbers (for example, 1 to K-1) are assigned to K-1 other bases.

  In the next step S105, the image of the other site and the image of the own site are displayed on the built-in display 14 (see FIG. 16).

  In the next step S107, it is determined whether N ≦ K−1. If the determination here is affirmed, the process proceeds to step S109. On the other hand, if the determination in step S107 is negative, the process proceeds to step S121.

  In step S109, 1 is set to n. When step S109 is executed, the process proceeds to step S111.

  In step S111, the image of the other site of the site number n + 1 is displayed on the display device of the device number n (see FIG. 16).

  In the next step S113, it is determined whether or not n ≦ N. If the determination here is affirmed, the process proceeds to step S115. On the other hand, if the determination in step S113 is negative, the process proceeds to step S117.

  In step S115, n is incremented. When step S115 is executed, the process returns to step S111. As described above, by repeating Steps S111 to S115, N images of other sites are individually displayed on the N display devices (see FIG. 16).

  In step S117, it is determined whether or not there is another base that is not displayed, that is, another base that is not displayed on the display device. If N <K-1, the determination here is affirmed, and the routine goes to Step S119. On the other hand, if N = K-1, the determination in step S117 is denied and the flow ends.

  In step S119, the other sites that are not displayed are displayed small on the built-in display 14, for example, in picture-in-picture.

  In step S121, 2 is set to n. When step S121 is executed, the process proceeds to step S123.

  In step S123, the image of the other site of the site number n is displayed on the display device of the device number n-1 (see FIG. 16).

  In the next step S125, it is determined whether or not n ≦ K. If the determination here is affirmed, the process proceeds to step S127. On the other hand, if the determination in step S125 is negative, the flow ends.

  In step S127, n is incremented. When step S127 is executed, the process returns to step S123. As described above, by repeating Step S123 to Step S127, as a result, K images of other bases are individually displayed on the K display devices.

  FIG. 17 shows a specific data configuration example (corresponding to FIG. 16) in the entire base image display process (step S7). In FIG. 17, first, terminal information (conference device information), image data, and audio data are mainly sent as a set. Then, image data and audio data are separated. Therefore, when attention is paid only to the image data, the separated image data is divided and arranged for each site. Here, since there are four sites, the header information of the own site (first site), the image data of the own site, the header information of the second site, the image data of the second site, the header information of the third site, the third The image data of the base, the header information of the fourth base, and the image data of the fourth base are divided and arranged. When the display device is connected and the display method is selected and determined, the image data of the local site and the image data of the second site are assigned to the built-in display. The image data of the third base is assigned to one display device. The image data of the fourth base is assigned to the other display device.

  Next, the base image partial display process (step S11) will be described with reference to FIG.

  In the first step S201, device numbers are assigned to N display devices that are energized.

  In the next step S203, it is determined whether or not one other site as an image clipping target has been determined. This determination is performed, for example, when the user operates the cursor 52 and the determination button 54 on the display surface of the built-in display 14. Specifically, the user selects a desired other site with the cursor 52 and decides with the decision button 54. For example, when there is only one other base, the other base may be automatically determined. If the determination in step S203 is affirmed, the process proceeds to step S205. On the other hand, if the determination in step S203 is negative, the same determination is repeated.

  In step S205, it is determined whether or not the determined cutout location of the image of another base is designated. This designation is performed, for example, by the user operating the cursor 52 or the like on the display surface of the built-in display 14 by the user. Here, for example, a location where a user at another site is displayed is specified as the cutout location (see the broken line portion in FIG. 19A).

  In the next step S206, numbers (for example, 1 to M) are assigned to the designated M cutout locations.

  In the next step S207, each cutout portion is corrected according to the resolution of the display device. Specifically, when the cutout portion is larger than the display resolution of the display device, the whole is adjusted for reduction. If the shape does not fit, an image outside the specified range is added and adjusted. On the other hand, when the cutout portion is smaller than the display resolution of the display device, the whole is enlarged and displayed, and when the image is rough, interpolation processing between pixels is performed.

  In the next step S209, it is determined whether or not N ≦ M. If the determination here is affirmed, the process proceeds to step S211. On the other hand, if the determination in step S209 is negative, the process proceeds to step S219.

  In step S211, 1 is set to n. When step S211 is executed, the process proceeds to step S212.

  In step S212, the cutout location of number n is displayed on the display device of device number n (see FIG. 19B).

  In the next step S213, it is determined whether or not n ≦ N. If the determination here is affirmed, the process proceeds to step S215. On the other hand, if the determination in step S213 is negative, the flow ends. Here, when N <M, (M−N) cutout portions are not displayed, and the fact may be notified to the user on the display surface of the built-in display 14, for example.

  In step S215, n is incremented. When step S215 is executed, the process returns to step S212. As described above, by repeating Step S212 to Step S215, as a result, images of N cutout portions are individually displayed on the N display devices (see FIG. 19B).

  In step S219, 1 is set to n. When step S219 is executed, the process proceeds to step S221.

  In step S221, the cutout location of the number n is displayed on the display device of the device number n (see the broken line portion in FIG. 19A).

  In the next step S223, it is determined whether or not n ≦ M. If the determination in step S223 is affirmed, the process proceeds to step S225.

  In step S225, n is incremented. When step S225 is executed, the process returns to step S221. As described above, by repeating Step S221 to Step S225, as a result, images of M cutout portions are individually displayed on the M display devices (see FIG. 19B).

  FIG. 20 shows a specific data configuration example (corresponding to FIG. 19B) in the base image partial display process (step S11). In FIG. 20, as in the data configuration example of FIG. 17, terminal information (conference device information), image data, and audio data are mainly sent as a set, and the image data and audio data are separated. Therefore, when attention is paid only to the image data, the separated image data is divided and arranged for each of the own base and the second base. Here, since there are two sites, the header information of the local site (first site), the image data of the local site, the header information of the second site, and the image data of the second site are arranged and arranged. When the display device is connected and the display method is selected and determined, the image data of the local site and the image data of the second site are assigned to the built-in display. A part of the image of the second site is cut out and displayed on one display device. On the other display device, a part of the image of the second site is cut out and displayed.

  As described above, the conference apparatus 100 according to the present embodiment is a communication apparatus used for information sharing by transmitting and receiving image data and audio data via a communication network (for example, the Internet) between a plurality of (for example, four) bases. The two display devices 200a are communicably connected, and a part of at least one image transmitted from at least one other base is displayed on the two display devices 200a and 200b. It is possible to display at least another part of one image on the built-in display 14.

  In this case, a part of at least one image of at least one other base is displayed on the two display devices 200a and 200b, and at least another part of the at least one image is displayed on the built-in display 14. Can be displayed. As a result, the visibility of the displayed image can be improved.

  In addition, the plurality of bases are at least three (for example, four) bases, and the conference apparatus 100 includes some images (for example, two of the plurality of images individually transmitted from the other bases). Can be displayed individually on the two display devices 200a and 200b, and the remaining image (for example, an image of one other site) can be displayed on the built-in display 14 among the plurality of images. is there. In this case, images of a plurality of other bases can be displayed in a size with good visibility.

  Further, the plurality of bases are at least four (for example, four) bases, the at least one display device is a plurality of (for example, two) display devices 200a and 200b, and the conference device 100 is the other. Among the at least three (for example, three) images individually transmitted from at least three (for example, three) sites, a plurality of (for example, two) images are displayed as a plurality (for example, two) of display devices 200a, It is possible to display on the built-in display 14 separately from the at least three (for example, three) images among the at least three (for example, three) images. In this case, images of at least three other bases can be displayed in a size with good visibility.

  In addition, the conference apparatus 100 can individually display a plurality of different portions of images transmitted from other bases on the two display devices 200 a and 200 b and display the images on the built-in display 14. In this case, it is possible to display a plurality of portions having different images at other locations in a size with good visibility.

  In the above embodiment, as shown in the upper part of FIG. 21, site numbers are automatically assigned to a plurality of other sites, listed, and displayed on the display surface of the built-in display 14. However, it is not limited to this. For example, as shown in the middle part of FIG. 21, the user may be able to manually change the correspondence between the base and the display device on the display surface of the built-in display 14. Specifically, the user can replace the line connecting the list items. Furthermore, for example, as shown in the lower part of FIG. 21, the user may be able to manually change base numbers of a plurality of other bases.

  In the above-described embodiment, the conference system 1000 includes two display devices. However, the present invention is not limited to this, and it is only necessary to include at least one display device.

  Moreover, in the said embodiment, although the image of the own base is displayed on the built-in display 14, it is not restricted to this. For example, the image of the local site may be displayed on the display device, or may not be displayed on either the built-in display or the display device.

  In the above embodiment, as an example of the base image partial display processing, all users at other bases (second bases) are displayed on the built-in display 14 (see FIG. 19B). For example, two display devices It is good also as displaying only at least one of the user B and the user C which are not displayed on 200a, 200b. In this case, for example, an image that displays all the users at the second site on the built-in display 14 may be displayed in a small size, for example, a picture-in-picture.

  Moreover, in the said embodiment, although only the image of one other base is displayed on each display apparatus as an example of the whole base image display process (refer FIG. 16), two or more of the grade which does not deteriorate visibility Images of other bases may be displayed at the same time.

  Moreover, in the said embodiment, although one part of the image of another base is displayed on each display apparatus as an example of a base image partial display process (refer FIG.19 (B)), it is a grade which does not deteriorate visibility. A plurality of different parts of images at other bases may be displayed simultaneously.

  Moreover, in the said embodiment, although it is set as the location where the user is displayed as a clipping location in base image partial display processing (step S11), it is not restricted to this, For example, the image displayed on the display, the screen, etc. May be at least part of the document, a document, a drawing, or the like.

  In the above embodiment, in the base image partial display process (step S11), the selection of the cutout portion is performed by a cursor operation, but the present invention is not limited to this. For example, an input device such as a touch panel may be provided, and the cutout portion may be selected using the input device. Further, for example, the cutout portion may be selectable by a drag operation using a mouse, a marking using a stylus, or the like.

  Moreover, in the said embodiment, in the base image partial display process (step S11), although the user has specified the clipping part, for example, the user specifies the user to be clipped and only the identified user's face is identified. Alternatively, it may be automatically cut out using a face recognition technique.

  Moreover, in the said embodiment, although the conference apparatus 100 and each display apparatus are wire-connected, you may connect wirelessly.

  Moreover, in the said embodiment, although the video conference is performed between four bases, it is not restricted to this, In short, what is necessary is just to be performed between several bases. And it is preferable to arrange | position the conference system 1000 in at least 1 base.

  Moreover, in the said embodiment, what is called a liquid crystal display is employ | adopted as a built-in display and a display apparatus, However, Not only this but other displays, such as a plasma display and EL (electroluminescence) display, are employ | adopted, for example. good.

  In the above-described embodiment, the so-called portable type (portable) conference apparatus 100 is employed, but a so-called stationary conference apparatus may be employed.

  In the above-described embodiment, the conference apparatus 100 capable of bi-directional communication (transmission / reception) of images and sounds has been described as an example of a communication apparatus. However, the present invention is not limited thereto, and in short, at least bi-directional communication of images. Anything that is possible.

  That is, the communication apparatus of the present invention can be used in various modes as an apparatus used for information sharing by transmitting and receiving at least images via a communication network between a plurality of bases.

  14 ... Built-in display (image display unit), 100 ... Conference device (communication device), 200a, 200b ... Display device (image display device).

JP 2012-54813 A

Claims (7)

A communication device having an image display unit, which is used for information sharing by at least image transmission / reception via a communication network between a plurality of bases,
At least one image display device is communicably connected;
A part of at least one image transmitted from at least one other base is displayed on the image display device, and at least another part of the at least one image is displayed on the image display unit. Communication device that can do. Having a function of separating a part of an image and another part of an image from an image transmitted from at least one other base;
The communication apparatus according to claim 1, wherein the partial image is displayed on the image display device and the other partial image is displayed on the image display unit.   The communication apparatus according to claim 1, wherein the communication apparatus has a function of detecting whether or not the image display apparatus is connected. An image display method in a communication apparatus having an image display unit, which is used for information sharing by at least image transmission / reception via a communication network between a plurality of bases,
At least one image display device is communicably connected to the communication device,
A part of at least one image transmitted from at least one other base is displayed on the image display device, and at least another part of the at least one image is displayed on the image display unit. The image display method including the process to do. The communication device has a function of separating a part of an image and another part of an image from an image transmitted from at least one other base.
5. The image display method according to claim 4, wherein in the displaying step, the part of the image is displayed on the image display device, and the other part of the image is displayed on the image display unit.   The image display method according to claim 4, wherein the communication device has a function of detecting whether or not the image display device is connected. A program used for a communication device having an image display unit, used for information sharing by transmitting and receiving images at least via a communication network between a plurality of bases,
At least one image display device is communicably connected to the communication device,
A part of at least one image transmitted from at least one other base is displayed on the image display device, and at least another part of the at least one image is displayed on the image display unit. A program that contains procedures to do.