WO2015059736A1

WO2015059736A1 - Sns user interface system

Info

Publication number: WO2015059736A1
Application number: PCT/JP2013/006277
Authority: WO
Inventors: 雄一郎板倉
Original assignee: 株式会社シナジードライブ
Priority date: 2013-10-23
Filing date: 2013-10-23
Publication date: 2015-04-30
Also published as: JPWO2015059736A1

Abstract

Provided is a social networking service (SNS) user interface system that enables sharing of user information streaming data obtained from individual user terminals. A still image display area and an avatar image display area as individual user information are movable to arbitrary positions on a user terminal screen as if icons, with a moving image of streaming data being displayed in the display areas. A speaker connected to the user terminal outputs the sound (including voice) of the streaming data acquired in real time from individual microphones connected to the individual user terminals. The display areas are resizable to an arbitrary display area size and selectively switchable between still image display or avatar image display and moving image display of the streaming data. The moving image of the streaming data is streaming picture data acquired in real time from a camera connected to the user terminal.

Description

SNS user interface system

The present invention relates to a user interface technology in a social networking service (SNS).

Access to obtain streaming data such as music data and video data has been devised to be user-friendly. In order to show the contents of streaming data, text information such as a title name is not sufficient. For this reason, there are some icons that make the streaming data content easy to associate with the user by displaying still images or some moving images that match the streaming data content on the streaming data icon. .

For example, when the client side (user terminal) acquires and reproduces streaming video data from a server, video data composed of a part of the streaming video data or similar data is used as the icon data. There is known a technique in which a client side holds an address and a file name from which streaming video data can be acquired, and a moving image based on the held data is displayed on a screen as an icon (Patent Document 1). As a result, a moving image icon is displayed, and the user can easily grasp and associate an outline of streaming video data from the moving image display.

On the other hand, in the recent social networking service (SNS), it is a user interface screen as shown in FIG. 3, and as a display method of participating user information, a still image such as a photograph or an avatar image is displayed. , Making it easy to remind who the user is posting.
A display area for still images and avatar images is provided in the vicinity of the posting area, and the position on the screen can be moved by scrolling or the like.
However, although the display area of a still image or an avatar image can be moved on the screen by scrolling or the like, there is no such thing as an icon that can be moved by freely dragging the position on the screen. Moreover, if not only a still image and an avatar image but also a user's real-time moving image can be displayed as user information, a user's information amount will increase and the transmission power of user information can increase.

Japanese Patent Laid-Open No. 2004-112086

As described above, in the current social networking service (SNS), the display area of still images and avatar images as user information cannot be moved by freely dragging the position on the screen like an icon. . Therefore, there is a problem that a user of a social networking service (SNS) can view other people's information only on a fixed framework on the screen of his / her terminal.

In addition, when a moving image is to be displayed as user information, for example, a method of playing a moving image by clicking on a link where text or a still image is displayed to display a separate window is generally used. -It does not display each user's moving image with respect to the area always displayed, such as the display area of a still image and an avatar image in a networking service (SNS).

In the social networking service (SNS) that will continue to evolve in the future, it is important to transmit real-time user information. Therefore, it is necessary to incorporate streaming data such as video and audio obtained from individual user terminals into a social networking service (SNS) user interface.

In view of the above situation, the present invention can arrange user information streaming data obtained from individual user terminals on the screen as a component having a high operability like an icon, such as video or audio of individual user information. It is an object of the present invention to provide a user interface system of a social networking service (SNS) that can share the network.

In order to achieve the above object, in the SNS user interface system of the present invention, a still image display area or an avatar image display area for displaying individual user information is iconized, and the icon is placed at an arbitrary position on the screen of the user terminal like an icon. It is movable. The moving image of the streaming data acquired from the camera means connected to the user terminal of the user information to be displayed among the user terminals connected to the SNS system is output and displayed in the iconified display area. .

Here, the moving image of streaming data refers to both a streaming data file of a moving image that has been recorded or edited by the camera means in advance and a moving image streaming data acquired in real time by a camera means such as a Web camera. Including. The individual user information is information on related users who participate in the SNS system.

A still image display area or an avatar image display area for displaying individual user information is arbitrarily displayed on the screen of the user terminal like an icon (here, the screen is an image in a window). The user information streaming data can be shared by displaying the moving image of the user information streaming data in the display area.

Since it is displayed in a fixed area like the conventional SNS system (here, moving the area by scrolling the window screen up / down / left / right with a slider etc. is included in the fixed category) It was difficult to display once. In addition, it is difficult to freely arrange user images on the screen and to move / replace user images depending on the situation.

As in the present invention, it is possible to move to an arbitrary position by converting it into an icon, so that a large number of users on the screen can be displayed once, images of users can be freely arranged on the screen, Images can be moved / replaced.
Then, the moving image of the streaming data of the user information to be displayed among the user terminals connected to the SNS system is displayed in the iconified display area, so that the amount of information of the user is further increased, and the user information Transmission power increases, and users can exchange information more closely.

In the SNS user interface system of the present invention, the sound of streaming data (including voice) acquired in real time from the microphone means connected to each user terminal connected to the SNS system is connected to the speaker means connected to the user terminal. ) Is preferably output.
Here, the speaker means connected to the user terminal includes any of speakers externally attached to the computer, headphones, and built-in speakers. The microphone means connected to the user terminal includes both a microphone external to the computer and a built-in microphone.

As the individual user information, the sound (including audio) of the streaming data acquired in real time is output from the individual microphone means connected to the individual user terminal, thereby enabling information sharing by image and audio. Even if each user is at a distant place in the world, the facial expressions, gestures, voices, etc. of the individual users can be shared by many users in real time on the screen.

As individual user information, in addition to real-time user moving images, streaming data sound (including audio) acquired in real time from individual microphone means connected to individual user terminals is output. And voice information sharing. Even if each user is at a distant place in the world, the facial expressions, gestures, voices, etc. of the individual users can be shared by many users in real time on the screen.

In the SNS user interface system of the present invention, it is preferable that the iconified display area can be resized to an arbitrary display area size.
The iconized display area can be freely moved with a mouse or the like like an icon on a computer screen, and can be resized to an arbitrary display area size. Since the display area size can be freely resized, user information can be easily acquired. Also, a large number of user information can be arranged on one screen, and a large number of user information can be acquired simultaneously.

In the SNS user interface system according to the present invention, it is preferable that the icon display area can be switched between still image display or avatar image display and streaming data moving image display.
By switching between conventional SNS still image display or avatar image display and moving image display of the present invention, unnecessary moving image display can be cut and the amount of information can be controlled.

In the SNS user interface system of the present invention, it is more preferable that the moving image of the streaming data is a moving image of streaming data acquired in real time from camera means connected to the user terminal.
Here, the camera means can convert a video image such as a Web camera into digital data and transmit the data to a computer via the Internet.

In addition, in the SNS user interface system, when the sound (including sound) of the streaming data acquired in real time from each microphone unit connected to the user terminal is output, the display of the user of the user terminal that acquires the sound More preferably, the area is deformed (including color change, shape change, area resizing) or moved in accordance with the strength of the sound.
Here, to change the shape of the display area according to the strength of the sound (including change in color, change in shape, and resizing of the area), for example, the display area is resized and jerky. That is. Further, the color or shape surrounding the display area may change.
Further, to move the display area in accordance with the intensity of the sound means, for example, that the display area reciprocates on the screen in accordance with the intensity of the sound, resulting in a display as if it is vibrating.

Further, in the SNS user interface system, mute can be set for each iconified display area, and the user information to be displayed in the display area set for mute is acquired in real time from the microphone means connected to the user terminal. It is preferable that the sound (including sound) of the streaming data is not output.
“Mute setting is possible for each iconified display area” means that, for example, when the iconified display area is right-clicked, a mute setting ON / OFF toggle button is displayed to enable mute setting operation.
Among all user terminals connected to the SNS system, the sound output from the speaker can be selected for each iconized display area, so that only the sound that the user wants to listen to can be selected.

Next, the SNS user interface method of the present invention will be described.
The SNS user interface method of the present invention is an SNS user interface method in an SNS system in which an SNS server and a plurality of user terminals are connected to a network, and includes the following steps.
1) The user terminal logs in to the SNS system using the user ID 2) The video data is acquired in real time from the camera attached to the user terminal 3) The user terminal sends the streaming data of the video data to the SNS server, Step 4) The SNS server receives the streaming data. Step 5) Sends the streaming data of moving images to all user terminals logged in to the SNS system. Step 6) The user terminal receives streaming data of moving images from the SNS server. Step 7) The user terminal extracts the user ID from the header portion of the received streaming data. Step 8) The icon of the user ID on the window screen of the SNS system of the user terminal. If the icon for determining 9) the user ID whether the display is being displayed, the image display area of the user ID of the icon, the step of displaying a moving image streaming data received

According to the present invention, streaming data of user information obtained from individual user terminals can be arranged on the screen as a component having a high operability like an icon, and video or audio of individual user information can be shared. Has an effect.

System configuration example of SNS system Example of user terminal window with iconized display area Window screen example of user terminal in conventional SNS system Processing flow of SNS system of embodiment 1 (1) Processing flow of SNS system of embodiment 1 (2)

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The scope of the present invention is not limited to the following examples and illustrated examples, and many changes and modifications can be made.

FIG. 1 shows a system configuration example of the SNS. The SNS system configuration shown in FIG. 1 includes one server T ₀ , five user terminals (T ₁ to T ₅ ) that emit voices, and a user terminal (M ₁ ) who listens without producing four voices. To M ₄ ) are connected via the Internet. The user terminals (T ₁ to T ₅ ) transmit real-time image data (S ₁ to S ₅ ) and audio data (D ₁ to D ₅ ), respectively, to the server T ₀ . The server T ₀ receives the image data and audio data sent from the user terminals (T ₁ to T ₅ ), and receives them from the five user terminals (T ₁ to T ₅ ) and the four user terminals ( Data (D _c ) is transmitted to all of M ₁ to M ₄ ).
Real-time image data (S ₁ to S ₅ ) is acquired by a Web camera, and audio data is acquired by a microphone built in the user terminal, converted into digital data by a computer, and transmitted to a server via the Internet.

FIG. 3 is an example of a window screen in a conventional SNS system. On the window screen in the conventional SNS system, still image display areas (21, 26) of still image such as photographs and user information of avatar images are fixedly displayed.
These user information static (avatar) image display areas (21, 26) can only be moved by scrolling the window screen up and down and left and right with a slider 53 or the like, and cannot be moved freely like icons.

On the other hand, FIG. 2 is an example of a window screen of a user terminal having an iconized display area. In FIG. 2, the first screen area 10 has a circle shape, and the second screen area 12 is a ring that surrounds the first screen area 10. In the first screen area 10, user information display areas (referred to herein as icons) 10a to 10e are displayed on the area. In the second screen area 12, user information display areas (icons) 12a to 12g are displayed on the area.

More specifically, in the circle area of the first screen area 10, user information display areas (icons) 10a to 10e of five speakers (speakers) corresponding to the user terminals (T ₁ to T ₅ ) are displayed. Has been. The number of displayed images changes according to the number of speaker (speaker) terminals. Further, in the ring area of the second screen area 12, user information display areas (icons) 12a to 12g of the listeners (listeners) corresponding to the user terminals (M ₁ to M ₄ and other) are displayed. Yes.

These user information display areas (icons) (10a to 10e, 12a to 12g) can be moved to arbitrary positions as icons, and can display a large number of users on the screen as shown in FIG. The user's image can be freely arranged on the screen, and the user's image can be moved / replaced depending on the situation.

In these user information display areas (icons) (10a to 10e, 12a to 12g), moving images of streaming data of user information are displayed. As a result, the amount of information of the user is further increased, the transmission power of the user information is increased, and the users can exchange information more closely. The streaming data of user information includes not only moving images but also audio data.
As individual user information, sound (including audio) of streaming data acquired in real time from individual microphone means connected to individual user terminals is output, enabling information sharing by image and audio, Even if each user is at a distant place in the world, the facial expressions, gestures, voices, etc. of each user can be shared with many users in real time on the screen.

4 and 5 show the processing flow of the SNS system of the first embodiment.
First, the processing flow of FIG. 4 is a moving image of streaming data acquired from a web camera connected to a user terminal of user information to be displayed among user terminals connected to the SNS system in an iconized display area. Shows a processing flow in which is output.

(Step 1) The user terminal logs in to the SNS system using the user ID (S101).
Here, the user ID may be a unique number or character string for identifying the user, or any user ID that can identify the user such as a fingerprint.
(Step 2) Video data is acquired in real time from a camera attached to the user terminal (S103).
(Step 3) The user terminal transmits the streaming data of the video data to the SNS server with the user ID added as header information (S105).
(Step 4) The SNS server receives the streaming data (S107).
(Step 5) The streaming data of the moving image is transmitted to all user terminals logged in to the SNS system (S107).
(Step 6) The user terminal receives streaming video data from the SNS server (S109).
(Step 7) The user terminal extracts the user ID from the header portion of the received streaming data (S111).
(Step 8) It is determined whether the icon of the user ID extracted from the header part in Step 7 is displayed on the window screen of the SNS system of the user terminal (S113).
(Step 9) When the icon of the user ID extracted from the header portion is displayed, the moving image of the received streaming data is displayed in the image display area of the icon of the user ID (S115). If the user ID icon extracted from the header portion is not displayed, the received streaming data is discarded.

Next, the processing flow of FIG. 5 shows the audio data of the streaming data acquired from the microphone connected to the user terminal of the user information to be displayed among the user terminals connected to the SNS system in the iconified display area. Shows a processing flow in which is output.

(Step 21) The user terminal logs in to the SNS system using the user ID (S201).
(Step 22) Voice data is acquired in real time from a microphone attached to the user terminal (S203).
(Step 23) The user terminal transmits the audio data streaming data to the SNS server with the user ID added as header information (S205).
(Step 24) The SNS server receives the streaming data (S207).
(Step 25) The audio data streaming data is transmitted to all user terminals logged in to the SNS system (S207).
(Step 26) The user terminal receives streaming data of audio data from the SNS server (S209).
(Step 27) The user terminal extracts the user ID from the header portion of the received streaming data (S211).
(Step 28) It is determined whether the icon of the user ID extracted from the header part in Step 7 is displayed on the window screen of the SNS system of the user terminal (S213).
(Step 29) It is determined whether or not mute is set for the user ID icon on the window screen of the SNS system of the user terminal (S215).
(Step 30) When the icon of the user ID extracted from the header portion is displayed and there is no mute setting, audio streaming data is output to the speaker of the user terminal (S217). When the icon of the user ID extracted from the header part is not displayed or the mute setting is made, the streaming data of the received audio data is discarded.

The present invention is useful for a user interface system of a social networking service (SNS).

10 First screen area 12 Second screen area 10a to 10e, 12a to 12g User information display area (icon)
21, 26 User information still (avatar)

image display area

22, 27 User

name display area

23, 28 User message display area 24 Image display area 25 Comment message display area 50

Window

51, 52, 53 Scroll bar A, B Information field

Claims

A user interface system in a social networking service (SNS),
A still image display area or an avatar image display area for displaying individual user information is iconized, and can be moved to an arbitrary position on the screen of the user terminal like an icon.
The moving image of the streaming data acquired from the camera means connected to the user terminal of the user information to be displayed among the user terminals connected to the SNS system is output and displayed in the iconified display area. A featured SNS user interface system.
The sound (including audio) of streaming data acquired in real time from the microphone means connected to each user terminal connected to the SNS system is output to the speaker means connected to the user terminal.
The SNS user interface system according to claim 1.
The SNS user interface system according to claim 1 or 2, wherein the iconified display area can be resized to an arbitrary display area size.
The SNS according to any one of claims 1 to 3, wherein the SNS can be selectively switched between still image display or avatar image display and streaming data moving image display for the iconified display area. User interface system.
The SNS user interface system according to any one of claims 1 to 4, wherein the moving image of streaming data is a moving image of streaming data acquired in real time from camera means connected to a user terminal.
When the sound (including sound) of the streaming data acquired in real time is output from each microphone means connected to the user terminal, the display area of the user information of the user terminal that acquires the sound is made strong or weak. The SNS user interface system according to any one of claims 1 to 5, wherein the SNS user interface system is changed in shape (including color change, shape change, and area resizing) or moved in combination.
The mute setting is possible for each iconified display area, and the sound (sound of the streaming data acquired in real time from the microphone means connected to the user terminal of the user information to be displayed in the display area where the mute setting is set. 3) The SNS user interface system according to claim 2, wherein the SNS user interface system is not output.
An SNS user interface method in an SNS system in which a social networking service (SNS) server and a plurality of user terminals are connected to a network,
A user terminal logging into the SNS system using a user ID;
Acquiring video data in real time from a camera attached to the user terminal;
A step in which the user terminal transmits the streaming data of the video data to the SNS server with the user ID added as header information;
An SNS server receiving the streaming data;
Transmitting the streaming data of the moving image to all user terminals logged in to the SNS system;
A user terminal receiving moving image streaming data from an SNS server;
The user terminal extracts the user ID from the header portion of the received streaming data;
Determining whether the icon of the user ID is displayed on the window screen of the SNS system of the user terminal;
Displaying a moving image of the received streaming data in an image display area of the user ID icon when the user ID icon is displayed;
An SNS user interface method comprising: