CN112528050B - Multimedia interaction system and method - Google Patents

Abstract

The invention relates to the technical field of interactive systems, in particular to a multimedia interactive system and a method thereof, wherein the system comprises a user terminal, a positioning auxiliary device and a service system, wherein the positioning auxiliary device is used for detecting the position and the orientation of the user terminal; the service system comprises a user information acquisition module, an interactive display information generation module, an interactive information screening module and a play control module; the interactive information screening module is used for screening out interactive information corresponding to a user of which the current position is in the meeting place and faces the multimedia display screen, and the interactive display information generating module is used for generating interactive display content; the playing control module is used for controlling the multimedia display system to display the playing content and the interactive display information. According to the multimedia interaction system and method, the interaction information of the user can be screened according to the position of the user to be displayed, the possibility that the field user finds the interaction information is increased, and the enthusiasm of user interaction is improved.

Description

A multimedia interactive system and method

technical field

The invention relates to the technical field of interactive systems, in particular to a multimedia interactive system and method.

Background technique

Multimedia interactive system combines audio system, interactive system, etc., based on multimedia and digital technology, combines video, sound, animation and other media, plays multimedia content in a novel way, and then realizes commodities, cultural relics, works, etc. It is widely used in exhibition halls, shopping malls, squares and other places.

Through the multimedia interactive system, users can send interactive information and display it, but the number of users participating in the activity at the same time is usually large, and there are online users and offline users, and the interactive information cannot be displayed at the same time. In the prior art, it is usually randomly selected. Interactive information is displayed, but since there are often more online users than offline users, a completely random selection will make it difficult for offline users to see their interactive information on the multimedia display, reducing the enthusiasm of on-site users to interact. .

In addition, the existing multimedia interactive systems basically display cyclically according to the preset playback content, the audience is in a passive reception state, and the displayed content is less targeted, which is not conducive to conveying activities, advertisements, publicity and other content to target customers. , if users miss the part they are interested in, they need to wait for the next round of display, image user experience.

SUMMARY OF THE INVENTION

The present invention aims to provide a multimedia interactive system and method, which can screen the user's interactive information for display according to the user's location, increase the possibility of on-site users viewing their own interactive information, improve the enthusiasm of the user's interaction, and can also display the user's interactive information according to the user's point of interest. Adjusting the playback content can improve the pertinence of the playback content, reduce user waiting time, and improve user experience.

This application provides the following technical solutions:

A multimedia interactive system, comprising:

A user terminal, where a positioning tag is provided on the user terminal, and the user terminal is used to send interactive information to the service system;

A positioning aid device, which is deployed in the venue, the positioning aid device is used to detect the position of the user terminal according to the signal of the positioning tag and send the detection result to the service system;

A service system, the service system includes a user information acquisition module, an interactive display information generation module, an interactive information screening module, a storage module and a playback control module; the user information acquisition module is used for acquiring user information corresponding to the interactive information; the interactive information screening module is used for In order to obtain the position of the user terminal according to the user information, the interactive information screening module is also used to screen out the interactive information corresponding to the users who meet the screening conditions, and the screening conditions include that the current position of the user terminal is in the venue; the interactive display information generation module uses generating interactive display content according to the filtered interactive information and corresponding user information; the storage module stores playback content, and the playback control module is used to control the multimedia display system to display the playback content and the interactive display information;

Multimedia display screen for displaying playback content and interactive information.

Further, the positioning assistance device is further configured to detect the orientation of the user terminal and send it to the service system, and the screening condition further includes the orientation of the user terminal to the multimedia display screen.

Further, the service system further includes a lighting management module, and the lighting management module is configured to turn off the lighting in the area without the user in the venue according to the position of the user terminal.

Further, the service system further includes an interactive information filtering module for filtering illegal interactive information.

Further, the service system also includes:

The eye-catching user acquisition module is used for taking the user whose current visual field of interest is on the multimedia display screen as the eye-catching user and obtaining the user identity of the eye-catching user;

The user interest acquisition module is used to acquire the interest points of each interested user according to the user identity;

The interest data statistics module is used to count the interest points of each eye-catching user, and sort each interest point according to the number of the corresponding eye-catching users;

The playback adjustment module is used to adjust the playback of the subsequent display content of the multimedia display screen according to the sorting result of the interest data statistics module.

Further, the playback adjustment module includes:

A playback content acquisition module, used to acquire playback content that matches the user's point of interest;

Playing order sorting module, used to sort the playing content according to the number of attention users of the corresponding points of interest;

A playback duration adjustment module, configured to calculate the playback duration of the playback content corresponding to each point of interest according to the number of attention users of each point of interest;

The playback content editing module is used to perform editing processing on the playback content according to the playback duration.

Further, the noted user acquisition module includes:

The image acquisition module is used to acquire the image near the current multimedia display screen;

The eye-catching user detection module is used to detect the current visual attention point of each user according to the image, and the user whose current visual field attention point is on the multimedia display screen is regarded as the attention user;

The attention user identification module obtains the face image of the attention user and identifies the user identity according to the face image.

Further, the playback content includes a variety of presentation modes, and the service system further includes a user type division module and a multi-mode playback module, the user type division module is used to obtain the user type according to the user identity, and the playback content acquisition module is also used for The display mode of the corresponding playback content is matched according to the user type; the multi-mode playback module is used to synchronously play the playback content on the multimedia display screen in multiple display modes through the multi-window playback mode.

Further, the service system further includes a distance detection module, and the playback adjustment module further includes a content size adjustment module; the distance detection module is used to detect the distance between the attention user and the multimedia display screen towards which he is directed according to the position of each attention user , the content size adjustment module is used to adjust the screen size of the playing content according to the distance between each attention user and the multimedia display screen to which the user faces.

Further, the present application also discloses a multimedia interaction method, which uses the above-mentioned multimedia interaction system.

The beneficial effects of the technical solution of the present invention are:

1. In the technical solution of the present invention, by detecting the on-site user terminal, the location and orientation of the on-site user can be obtained, and then it can be confirmed whether the user corresponding to the interactive information is on-site and whether he is viewing the multimedia display screen. The user's location and orientation can be screened to ensure that the interactive information displayed on the on-site multimedia display screen is sent by the on-site user, thereby increasing the possibility of the on-site user seeing their own interactive information and improving the enthusiasm of the user interaction.

2. In the technical solution of the present invention, the user's attention to the multimedia display screen is detected, and then the attention users are screened out, and the user identity is obtained based on image recognition, and the interest points of each user are obtained according to the user identity. statistics and analysis, to sort the playing content, the playing time of each content, the playing order, etc., so that the most attentive users can quickly see the content they are interested in, thereby improving the pertinence of the content played on the multimedia display screen, and more It is conducive to conveying activities, advertisements, publicity and other content to target customers, achieving accurate content broadcast, reducing user waiting time and viewing uninteresting content, and improving user experience.

3. In the technical solution of the present application, each playback content can have multiple display modes, such as the explanation for the exhibits, there can be an expert version, a normal version, a children's version, etc., and then can be adapted to various types of users. Matching the presentation mode of the corresponding playback content can make the playback content easier for users to accept.

4. Through the multi-mode playback module, the playback content can be played in multiple display modes at the same time, which can meet the needs of different types of users at the same time. This display mode allows everyone to understand the broadcast content in a way that they can understand, which is conducive to improving the dissemination effect of the broadcast content, thereby avoiding the situation that children are not interested and parents cannot continue to watch.

5. The position of each user is detected by the positioning system, and the identity of the attention user can be verified twice by combining the image data. At the same time, by calculating the position of each user, the screen size of the playback content can be adjusted, so that most You can see the appropriate size of the screen.

Description of drawings

1 is a logical block diagram in Embodiment 1 of a multimedia interactive system of the present application;

FIG. 2 is a logical block diagram of Embodiment 5 of a multimedia interactive system of the present application.

Detailed ways

The technical solution of the present application is further described in detail below by specific embodiments:

Example 1

As shown in FIG. 1 , a multimedia interactive system disclosed in this embodiment is applied to an exhibition hall and venue, and includes on-site equipment, a service system, and a user terminal. The on-site equipment includes a multimedia display screen, a speaker system, a monitoring system, and a lighting system. ; The monitoring system includes a camera, which is used to collect images of people around the multimedia display screen.

The equipment in the venue also includes a positioning aid device. The user terminal is provided with a positioning label. The positioning aid device is deployed in the venue. The positioning aid device is used to detect the position and orientation of the user terminal according to the signal of the positioning label and send the detection result to the site. Service system; specifically, in this embodiment, the positioning system includes several UWB base stations set in the scene, the positioning label is a UWB label, and the position and orientation of the user terminal are detected by the UWB indoor positioning technology.

The user terminal is an intelligent terminal such as a mobile phone and a tablet according to the corresponding APP. The user terminal is used to send interactive information to the service system.

The service system includes a user information acquisition module, an interactive display information generation module, an interactive information screening module, a storage module, a lighting management module, an interactive information filtering module and a playback control module;

The storage module stores the playback content, and the storage module is also connected to a database, which stores various data required for system operation, such as user information, activity information, and playback content information.

The user information acquisition module is used to acquire user information corresponding to the interactive information; the user information includes user basic information, user identification information, user type, user interest points and preference information, and the like.

The interactive information filtering module is used to filter illegal interactive information; the interactive information filtering module is used to obtain the position and orientation of the user terminal according to the user information, and the interactive information filtering module is also used to filter out the interactive information corresponding to the users who meet the filtering conditions. Including that the current position of the user terminal is in the conference venue and the user terminal is facing the multimedia display screen.

The interactive display information generation module is used to generate interactive display content according to the filtered interactive information and corresponding user information; the playback control module is used to control the multimedia display system to display the playback content and the interactive display information;

Multimedia display screen for displaying playback content and interactive information.

The lighting management module is used for turning off the lighting in the area without users in the conference site according to the position of the user terminal.

Embodiment 2

The difference between this embodiment and the first embodiment is that, in this embodiment, the service system further includes an attention user acquisition module, a user interest acquisition module, an interest data statistics module, and a playback adjustment module.

The eye-catching user acquisition module is used to take the user whose current visual field of interest is on the multimedia display screen as the eye-catching user and obtain the user identity of the eye-catching user; specifically, the eye-catching user obtaining module includes:

The image acquisition module is used to acquire the image near the current multimedia display screen captured by the camera.

The eye-catching user detection module is used to detect the current visual attention point of each user according to the image, and the user whose current visual field attention point is on the multimedia display screen is regarded as the attention user; Focus on the visual field, and determine whether the user is the attention user according to whether the user's face is facing the multimedia display screen.

The attention user identification module obtains the face image of the attention user and identifies the user identity according to the face image.

The user interest acquisition module is used to acquire the interest points of each attention user from the database according to the user identity;

The interest data statistics module is used to count the interest points of each attention user, and sort each interest point according to the number of the corresponding attention users;

The play adjustment module is used to adjust the play of subsequent display contents of the multimedia display screen according to the sorting result of the interest data statistics module.

In this embodiment, the playback adjustment includes playback content adjustment, playback order adjustment, and playback duration adjustment, and the playback adjustment module includes:

A playback content acquisition module, used to acquire playback content that matches the user's point of interest;

Playing order sorting module, used to sort the playing content according to the number of attention users of the corresponding points of interest;

The playback duration adjustment module is used to calculate the playback duration of the playback content corresponding to each point of interest according to the number of attention users at each point of interest. Click the proportion of the number of corresponding attention users to the total number of attention users to generate the playback duration. Specifically, the duration is calculated according to the formula:

T=t _min +2*(t _max -t _min) *b

Where T is the playback duration, t _max and t _min are the maximum playback duration and the minimum playback duration of the currently played content, respectively, and b is the proportion of the number of attention users corresponding to the currently played content to the total number of attention users.

The playback content editing module is used to perform editing processing on the playback content according to the playback duration.

When the technical solution of this embodiment is running, the service system obtains images of people near the multimedia display screen through the camera, and identifies the identity information of the attention user, obtains the user's point of interest according to the user's identity, and plays the current image at the same time. According to the statistical results, the subsequent playback content can be adjusted to ensure that users around the multimedia display screen can see the content they are interested in as soon as possible, and improve the publicity effect.

Embodiment 3

The difference between this embodiment and Embodiment 2 is that, in this embodiment, the playback content includes multiple presentation modes, and also includes a user type division module, which is used to obtain the user type according to the user identity. In this embodiment, the user type division module The types include expert, ordinary and children. Each content is displayed in corresponding display modes for three types of users. For example, for the introduction of the same exhibit in the exhibition hall, it is divided into three display modes: expert, ordinary and children. , to play for different types of users. The playback content acquisition module is further configured to match the presentation mode of the corresponding playback content according to the user type. It also includes a presentation mode generation module, which is used to generate a corresponding presentation mode according to the playback content. Specifically, the presentation mode generation module can generate two presentation modes of ordinary and children based on the existing expert presentation modes, including ordinary presentation modes. The generation module is used to generate a common presentation mode on the basis of the expert presentation mode. The ordinary presentation mode generation module includes a removal module and an addition module, and the removal module is used to remove the principle explanation in the playback content corresponding to the expert presentation mode, and add The module is used to obtain new terms or concepts in the playback content, and call a third-party interface to obtain concept explanations, and add the concept explanations to the playback content; the child presentation mode generation module is used for the playback content corresponding to the normal presentation mode Technically, the play content of the children's presentation mode is generated, and specifically, it includes a timbre replacement module and an animation addition module, and the timbre replacement module is used to replace the voice explanation of the playback content with a popular cartoon character timbre, and the animation addition module uses for adding cartoon animations to playback content.

In this embodiment, a multi-mode playback module is further included, and the multi-mode playback module is configured to synchronously play the playback content on the multimedia display screen in multiple presentation modes through the multi-window playback mode.

Embodiment 4

The difference between this embodiment and the third embodiment is that in this embodiment, the service system further includes a distance detection module, and the playback adjustment module further includes a content size adjustment module; the distance detection module is used to detect the attention users and their orientations according to the positions of the attention users The distance between the multimedia display screens, the content size adjustment module is used to adjust the screen size of the playing content according to the distance between each attention user and the multimedia display screen towards which it is directed. In this embodiment, the content size adjustment module includes a representative distance calculation module and a screen zoom calculation module. The representative distance calculation module is used to calculate the representative distance according to the distance between each eye-catching user and the multimedia display screen to which it is directed. In this embodiment, , using the mode of the distance between each eye-catching user and the multimedia display screen towards which it is facing as the representative distance, and the screen zoom calculation module is used to calculate the screen zoom according to the representative distance and the preset rule. For example, according to the proportional rule, the farther the distance, the more The larger the magnification, etc., the specific zoom ratio can be set according to the size of the multimedia display screen.

Embodiment 5

As shown in FIG. 2 , the difference between this embodiment and the fourth embodiment is that, in this embodiment, the service system further includes an interactive address generation module, the interactive address generation module is used to generate a graphic code including an interactive address, and the playback content editing module also includes Used to add graphic codes to playback content. In this embodiment, the playback content editing module is used to add a graphic code between video frames of the playback content, and the graphic code is a two-dimensional code. The user terminal is used to scan the graphic code and access the service system according to the interactive address in the graphic code.

The above are only the embodiments of the present invention, and the invention is not limited to the field involved in this implementation case. The common knowledge such as the well-known specific structure and characteristics in the scheme has not been described too much here, and those of ordinary skill in the art know the filing date or priority. All the common technical knowledge in the technical field of the invention before the date, can know all the prior art in this field, and have the ability to apply the routine experimental means before the date, those of ordinary skill in the art can be given by the present application. Perfecting and implementing this solution in combination with one's own capabilities, some typical well-known structures or well-known methods should not become obstacles for those of ordinary skill in the art to implement the present application. It should be pointed out that for those skilled in the art, some modifications and improvements can be made without departing from the structure of the present invention. These should also be regarded as the protection scope of the present invention, and these will not affect the implementation of the present invention. Effectiveness and utility of patents. The scope of protection claimed in this application shall be based on the content of the claims, and the descriptions of the specific implementation manners in the description can be used to interpret the content of the claims.

Claims (8)

1. a multimedia interactive system, is characterized in that: comprise: A user terminal, where a positioning tag is provided on the user terminal, and the user terminal is used to send interactive information to the service system; A positioning aid device, which is deployed in the venue, the positioning aid device is used to detect the position of the user terminal according to the signal of the positioning tag and send the detection result to the service system; A service system, the service system includes a user information acquisition module, an interactive display information generation module, an interactive information screening module, a storage module and a playback control module; the user information acquisition module is used for acquiring user information corresponding to the interactive information; the interactive information screening module is used for In order to obtain the position of the user terminal according to the user information, the interactive information screening module is also used to screen out the interactive information corresponding to the users who meet the screening conditions, and the screening conditions include that the current position of the user terminal is in the venue; the interactive display information generation module uses generating interactive display content according to the filtered interactive information and corresponding user information; the storage module stores playback content, and the playback control module is used to control the multimedia display system to display the playback content and the interactive display information; Multimedia display screen, used to display playback content and interactive information; The positioning assistance device is further configured to detect the orientation of the user terminal and send it to the service system, and the screening condition further includes the orientation of the user terminal to the multimedia display screen; The service system also includes: The eye-catching user acquisition module is used for taking the user whose current visual field of interest is on the multimedia display screen as the eye-catching user and obtaining the user identity of the eye-catching user; The user interest acquisition module is used to acquire the interest points of each interested user according to the user identity; The interest data statistics module is used to count the interest points of each eye-catching user, and sort each interest point according to the number of the corresponding eye-catching users; The playback adjustment module is used to adjust the playback of the subsequent display content of the multimedia display screen according to the sorting result of the interest data statistics module. 2 . The multimedia interactive system according to claim 1 , wherein the service system further comprises a lighting management module, and the lighting management module is configured to turn off the lighting in the area without users in the venue according to the position of the user terminal. 3 . 3. The multimedia interactive system according to claim 2, wherein the service system further comprises an interactive information filtering module for filtering illegal interactive information. 4. The multimedia interactive system according to claim 3, wherein the playback adjustment module comprises: A playback content acquisition module, used to acquire playback content that matches the user's point of interest; Playing order sorting module, used to sort the playing content according to the number of attention users of the corresponding points of interest; A playback duration adjustment module, configured to calculate the playback duration of the playback content corresponding to each point of interest according to the number of attention users of each point of interest; The playback content editing module is used to perform editing processing on the playback content according to the playback duration. 5. The multimedia interactive system according to claim 4, wherein: the attention user acquisition module comprises: The image acquisition module is used to acquire the image near the current multimedia display screen; The eye-catching user detection module is used to detect the current visual attention point of each user according to the image, and the user whose current visual field attention point is on the multimedia display screen is regarded as the attention user; The attention user identification module obtains the face image of the attention user and identifies the user identity according to the face image. 6. The multimedia interactive system according to claim 5, wherein the playback content includes multiple presentation modes, and the service system also includes a user type division module and a multi-mode playback module, and the user type division module is used for The user identity acquires the user type, and the playback content acquisition module is also used to match the presentation mode of the corresponding playback content according to the user type; the multi-mode playback module is used for synchronously playing the playback content in multiple presentation modes through a multi-window playback mode to the multimedia display. 7. The multimedia interactive system according to claim 6, characterized in that: the service system further comprises a distance detection module, and the playback adjustment module further comprises a content size adjustment module; the distance detection module is used to The position of the device detects the distance between the attention user and the multimedia display screen toward which it is directed, and the content size adjustment module is used to adjust the screen size of the playing content according to the distance between each attention user and the multimedia display screen toward which it is directed. 8. A multimedia interactive method, characterized in that: the multimedia interactive system according to any one of claims 1-7 is used.

Images