WO2019155311A1 - Communication system with automatically appearing augmented reality effects - Google Patents

Abstract

A method of organizing user interaction in a communication system includes placing a received main virtual object in a set position that is displayed by means of an image capture device of a recipient user device and displaying said object as an augmented reality object, wherein during and/or after placement of the main virtual object, the recipient user device recognizes real-world objects around the recipient, said objects being displayable on a recipient user device screen by means of the image capture device of said device, and when the distance between a recognized real-world object and the main virtual object is less than or equal to a threshold value, the position of the main virtual object, or of the main virtual object and a virtual copy of a real-world object that was pre-superimposed over a corresponding real-world object, will automatically at least warp or change.

Description

 INTERACTION OF USERS IN A COMMUNICATION SYSTEM USING AUTOMATICALLY ARISING EFFECTS OF ARRANGED REALITY

FIELD OF THE INVENTION The invention relates to the field of supplementing with virtual objects and effects of the physical, real world surrounding the user, when interacting with other users.

BACKGROUND

Messaging systems - communication systems - allow users to communicate by sending messages to each other. Currently, with the development of augmented reality technologies, many communication systems have been implemented that allow the exchange of augmented reality messages, i.e. complement the physical, real, world displayed on the screen of the user device with the image capture device of the user device, objects of the virtual world. However, this method of communication does not go beyond the traditional method of messaging, which includes sending and receiving messages sequentially, and there is the possibility of improving the known methods of user interaction in communication systems by expanding and complementing the capabilities of such communication systems, providing an extension of the range of experiences experienced by the user after receiving a message.

SUMMARY OF THE INVENTION

The idea of the present invention is that both the sender and the receiver of the virtual object, when sending and receiving the virtual object, respectively, place the latter on the screen of their the user device at a predetermined location displayed by the image capturing device of the user device, and the indicated virtual object is displayed in each of them as an augmented reality object. After the recipient receives the augmented reality message containing the main virtual object, the recipient recognizes the main virtual object contained in the received message by the user device. The recipient opens the message and places the main virtual object at the specified location displayed by the image capture device of the recipient user device. In the process of selecting a predetermined location of the main virtual object, when the image pickup device of the recipient user device is turned on, and real-life objects surrounding the recipient are displayed on the screen of the recipient user device, and / or after the main virtual object is placed at the specified location, when the user image pickup device the recipient’s device also remains on, recognition occurs through the user device the recipient of the real world objects of the recipient displayed on the screen of the recipient user device by the image capturing device of the recipient user device. After the main virtual object is placed at a specified location, the main virtual object interacts with the recognized real-world object, and when the main virtual object is at a certain boundary distance or a distance less than the boundary, then at least the deformation or change of location of the main virtual object is carried out within the framework of the interaction or the main virtual object and virtual object - copies of the real world object, previously laid ennogo to the appropriate object in the real world. The interaction is carried out without the participation of the recipient automatically in accordance with the existing software algorithm. To create a virtual object - a copy of the real world object occurs copying recognized real-world objects displayed on the screen of the recipient’s user device to a new virtual layer that is superimposed on the corresponding real-world objects, and when interacting, this layer changes in accordance with the automatic action, and real-world objects remain unchanged. When the interaction is completed, the virtual modified layer disappears, and the recipient sees real-world objects on the screen of the user device.

This summary of the invention is provided to familiarize with the idea of the invention in a simplified form, which is further disclosed below in the Detailed description of the invention. This Summary of the invention is not aimed at determining the essential features of the claimed objects of the invention, and is also not aimed at using to limit the scope of the invention.

BRIEF DESCRIPTION OF GRAPHIC MATERIALS

The invention is illustrated using the following figures, which are non-limiting examples of the implementation of the present invention: FIG. 1 is a flowchart of an embodiment of a method for organizing user interaction in a communication system according to one embodiment of the present invention; FIG. 2a is a schematic diagram illustrating a screen of a user device of a sender at the stage of selecting and placing a main virtual object; FIG. 2b is a schematic view illustrating a screen of a sender user device with a primary virtual object located at a given location; FIG. 2c is a schematic diagram illustrating a screen of a recipient user device on which a notification of receipt of a message is displayed; FIG. 2d is a schematic diagram illustrating a screen of a recipient user device in a step of recognizing recipient real world objects; FIG. 2e is a schematic diagram illustrating a screen of a recipient user device in a step of placing a main virtual object; FIG. 2f is a schematic view illustrating a screen of a recipient user device with a primary virtual object located at a predetermined location when the distance from the primary virtual object to the recognized real world object is equal to a threshold value; FIG. 2g is a schematic diagram illustrating a screen of a recipient user device in a step of changing a location of a main virtual object and effecting its deformation; FIG. 2h is a schematic view illustrating a screen of a recipient user device with a deformed virtual object — a copy of a real-world object; FIG. 2i is a schematic diagram illustrating a screen of a recipient user device displaying real-time objects of the recipient in real time and the main virtual object; FIG. 3 is a schematic illustration of an embodiment of a user device according to one preferred embodiment of the present invention; FIG. 4 is a schematic illustration of an embodiment a communication system according to one of the preferred embodiments of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

The present invention relates to a method for organizing user interaction in a communication system, a user device for organizing user interaction in a communication system, a communication system that enables the interaction of user devices and a server with each other, and a computer-readable medium that stores program instructions that initiate the execution of aspects of the organization method user interactions in a communication system according to this of Bretenoux.

In accordance with a first aspect of the present invention, there is provided a method for organizing user interaction in a communication system, comprising: selecting a main virtual object from selectable virtual objects through a user interface on a screen of a sender user device; placing the selected primary virtual object on the screen of the sender user device at a predetermined location displayed by the image pickup device of the sender user device, and displaying it as an augmented reality object; transmitting by the user device the sender of the message containing the selected primary virtual object to the user device of at least one receiver, receiving the message by the user device of the receiver; recognition by the user device of the recipient of the main virtual object contained in the received message; placing by the user device of the recipient the main virtual object at a predetermined location displayed by the image capturing device of the user device of the recipient, and displaying it as an augmented reality object; at the same time, during and / or after the placement of the main virtual object, recognition is performed by the recipient user device of the real world objects of the recipient displayed on the screen of the recipient user device by the image capturing device of the recipient user device; and when the distance from the recognized real-world object to the main virtual object is less than or equal to the threshold value, at least a deformation or change of location of the main virtual object or the main virtual object and the virtual object is automatically carried out - a copy of the real world object previously superimposed on the corresponding real-world object .

In accordance with a second aspect of the present invention, there is provided a user device for organizing user interaction in a communication system, comprising an image capturing device, at least one processor, a computer-readable medium connected to at least one processor and containing program instructions that, when executed, are executed at least one processor provides the ability to select a virtual object from a choice of virtual objects ctv through the user interface on the screen of the user device; providing the ability to place the selected virtual object on the screen of the user device at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; enabling the user device to transmit a message containing the selected primary virtual object, at least one other user device, receiving a message containing at least one primary virtual object, the user device; recognition by the user device of the main virtual object contained in the received message; providing the ability to place through the user device the main virtual object at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; recognition by the user device of real-world objects displayed on the screen of the user device by the image capturing device of the user device during and / or after the placement of the main virtual object, automatic implementation of at least deformation or relocation of the main virtual object or the main virtual object and virtual object - copies of a real-world object previously superimposed on the corresponding real-world object When the distance of the detected object in the real world to the virtual main object is less than or equal to the threshold.

In accordance with a third aspect of the present invention, there is provided a communication system that enables communication the user devices and the server between them, containing program instructions located on the machine-readable medium of the user device, which when executed by at least one processor of the user device provide the ability to select a virtual object from selectable virtual objects through a user interface on the screen of the user device ; providing the ability to place the selected virtual object on the screen of the user device at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; allowing a user device to transmit a message containing the selected primary virtual object to at least one other user device, to receive a message containing at least one primary virtual object by the user device; recognition by the user device of the main virtual object contained in the received message; providing the ability to place through the user device the main virtual object at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; recognition by the user device of real-world objects displayed on the screen of the user device by the image capturing device of the user device during and / or after the placement of the main virtual object, automatic implementation, at the least measure of deformation or change of location, of the main virtual object or the main virtual object and the virtual object - a copy of the real world object previously superimposed on the corresponding real world object when the distance from the recognized real world object to the main virtual object is less than or equal to a threshold value; and program instructions located on a machine-readable medium of the server, which when executed by at least one server processor ensure that the server receives the transmitted message from the user device of the sender, stores the received virtual object, transfers the stored message from the server to the user device of at least one receiver .

In accordance with a fourth aspect of the present invention, there is provided a computer-readable medium comprising software instructions for user interaction in a communication system, which, when executed by at least one processor of a user device, provides the ability to select a virtual object from selectable virtual objects through a user interface on User device screen providing the ability to place the selected virtual object on the screen of the user device at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; allowing the user device to transmit a message containing the selected primary virtual object to at least one other user device, receiving a message containing at least one main virtual object by a user device; recognition by the user device of the main virtual object contained in the received message; providing the ability to place through the user device the main virtual object at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; recognition by the user device of real-world objects displayed on the screen of the user device by the image capturing device of the user device during and / or after the placement of the main virtual object, automatic implementation of at least deformation or relocation of the main virtual object or the main virtual object and virtual object - copies of a real-world object previously superimposed on the corresponding real-world object When the distance of the detected object in the real world to the virtual main object is less than or equal to the threshold.

Thus, after receiving the message by the recipient, the recipient recognizes the main virtual object contained in the received message, and in the process of selecting the specified location of the main virtual object, when the image pickup device of the recipient user device is turned on, and objects of the real recipient are displayed on the screen of the recipient user device the world surrounding the recipient, and / or after the placement of the main virtual object At a given location, when the image pickup device of the recipient user device also remains turned on, recognition by the user the recipient device real-world objects of the recipient displayed on the screen of the recipient user device by the image capturing device of the recipient user device. And when the recipient places the main virtual object and determines the distance from it to the recognized objects of the real world, and when the main virtual object is at a certain boundary distance or a distance less than the boundary, then the main virtual object interacts with the recognized object of the real world, namely within at least a deformation or a change in the location of the main virtual object or the main virtual object and virtual nogo object - a copy of the object of the real world, previously imposed on the corresponding object in the real world. The interaction is carried out without the participation of the recipient automatically in accordance with the existing software algorithm. To create a virtual object - a copy of the real world object, the recognized real world objects are displayed on the screen of the recipient’s user device in a new virtual layer, which is superimposed on the corresponding real world objects, and when interacting, this layer changes in accordance with the automatic action, and the objects of the real world remain unchanged. When the interaction is completed, the virtual modified layer disappears, and the recipient sees real-world objects on the screen of the user device. Also, the interaction does not occur after the distance between the main virtual object and the recognized object of the real world becomes greater than the threshold value.

The above-described features provide the user with a new type and format of communication, provide an extension of the range of experiences and sensations experienced by the user after receiving the message, affect the emotional atmosphere that is created between the interacting users, and increase the interest of users in such interaction. The recipient may receive a notification on his user device about the receipt of the message. Such a notification may also be a publication in the feed of interacting users with the ability for the recipient to open the publication.

The message is sent from the user device of the sender to the user device of the recipient through the server. The user devices and the server in the communication system are communicated through the network, by means of which they establish connections between the server and the user devices of the sender and recipient to interact with them in the communication system, including without limitation the Internet, wireless communication networks, networks using standard communication technologies and / or protocols.

The described method can be implemented and the described communication system can operate on any suitable user devices, regardless of the operating systems installed on them.

The described method can be implemented and user access to the communication system can be carried out using the appropriate application installed on the user device, as well as using a browser - application software designed to view web pages and manage web applications via the network.

By an application is meant a program installed on a user's device of a user, or a web application or an interactive web site where a user interacts with a server using a browser, intended for user interaction in a communication system. Also, the application can be understood as any other pre-installed or web-based program, where it can be implemented and it is appropriate to carry out at least the deformation or location changes at least one of the main virtual object or virtual object - a copy of the real world object previously superimposed on the corresponding real world object, for example, games, video editors, advertising with elements of augmented reality, etc.

As a sender’s user device, for example, a smartphone, tablet computer, augmented reality glasses, virtual reality glasses, augmented reality helmet, virtual reality helmet, or any other device that contains an image capture device capable of displaying the world surrounding the sender (for example, can be used) , camera), a display component capable of providing the sender with the ability to see the surrounding world displayed by the image capture device (e.g., screen user devices) and a network component that allows a server to communicate with and / or at least one recipient user device. Such devices should have the computing ability and components sufficient to create and transmit messages containing virtual objects.

As the recipient’s user device, for example, a smartphone, tablet computer, augmented reality glasses, virtual reality glasses, augmented reality helmet, virtual reality helmet, or any other device that contains a display component capable of providing the recipient with the ability to see the displayed recipient world can be used (e.g. user device screen), a network component that allows communication with a server and / or at least one user sender device, speaker, and vibration module. Such devices should have the computing ability and components sufficient to place and display virtual objects as objects of augmented reality, recognition of real-world objects surrounding the recipient, as well as reproducing effects assigned to virtual objects and recognized objects of the real world.

Obviously, when the recipient, in response to the received message, transmits a message containing at least one main virtual object to the sender, it automatically becomes the sender, and the user interacting with it becomes the receiver.

It is preferable that during and / or after the selected main virtual object is placed by the sender, the sender recognizes real-world objects of the sender displayed on the screen of the sender user device by the image pickup device of the sender user device by the user device.

Preferably, recognition of the user's real-world objects (i.e., both the sender and the recipient) is carried out by accessing a library containing real-world objects to compare the user's real-world objects displayed on the screen of his user device with the image capturing device of his user device, with examples of real-world objects contained in the library. The library can be hosted on a user device or on a server. Obviously, some real-world objects may not necessarily be recognized, in which case when the distance from the recipient's user device to such an object is less than or equal to a threshold value, nothing will happen.

When the distance from the recognized real-world object to the main virtual object is less than or equal to the threshold value, at least deformation or change of location of the main virtual object or the main virtual object and the virtual object is carried out - a copy of the real world object previously superimposed on the corresponding real-world object. So when the sender places the main virtual object, and the distance from it to the recognized objects of the real world is determined, and when the main virtual object is at a certain boundary distance or distance less than the boundary, the main virtual object can also interact with the recognized object of the real world of the sender. Interaction is carried out without the participation of the sender automatically in accordance with the existing software algorithm. In this case, the recognized real world objects displayed on the screen of the sender’s user device are copied to a new virtual layer, which is superimposed on the corresponding real world objects, and when interacting, this layer changes in accordance with the automatic action, and the real world objects remain unchanged . The interaction does not occur if the distance between the main virtual object and the recognized object of the real world is greater than the threshold value. After the interaction is completed, the sender can send a message to the recipient.

It is preferable for the deformation of the main virtual object and / or virtual object — copies of the real world object turn to a library containing types of deformation assigned to various real world objects and main virtual objects. Thus, it is advisable to have a library located on a user device or on a server that stores strain types that can be implemented with respect to various real-world objects and various virtual objects. In this case, the type of deformation can be assigned and transmitted in the message by the sender together with the main virtual object by first selecting the desired type of deformation, or the type of deformation assigned to the main virtual object can be initiated by the recipient. Obviously, some objects of the real world may not necessarily be recognized or the type of deformation may not be stored in the library, corresponding to any recognized object of the real world, in this case, when the distance from the virtual object to the object of the real world is less than or equal to the threshold value, nothing will happen. Obviously, both the receiver and the sender can access the library.

It should be noted that deformation or change of location of the main virtual object or the main virtual object and the virtual object - copies of the real world object, previously superimposed on the corresponding real world object, can be accompanied by sound and / or visual effects associated with these types of interaction. Thus, it is advisable to have at least one library located on the user device or on the server that stores sound and / or visual effects corresponding to various types of deformations or associated with any or certain changes in the location of the main virtual object or main virtual object and virtual object - copies of a real world object previously superimposed on the corresponding real world object. Obviously, some types of deformation or change of location will not necessarily be accompanied by sound and / or visual effects, in other words, implementation options are possible in which both sound and visual effects will be realized, only sound or only visual effects, or deformation or change of location The objects listed above will be carried out without any effects.

In one preferred embodiment, the distance from the recognized real-world object to the main virtual object (in other words, the location of the recognized real-world object relative to the main virtual object) is calculated based on the x, y, and z coordinates of the recognized real-world object and x ', y' coordinates and z 'of the main virtual object. More specifically, the specified coordinates may be coordinates of two different points, one of which can belong to a recognized object of the real world, and the second to the main virtual object, respectively.

Preferably, to change the location of the main virtual object and / or virtual object - copies of the real world object turn to a library containing the values Dc, Ay, Dz and Ax ’, Ay’, Dz ’assigned to various real world objects and main virtual objects, respectively. Obviously, some real-world objects may not necessarily be recognized, or the library may not contain the values Ax, Au, Dz and Ax ', Au', Dz 'assigned to certain real-world objects and certain basic virtual objects, in which case the distance from the recipient user device to such an object is less than or equal to the threshold value, nothing will happen.

Preferably, when creating the message, the displayed primary virtual object is combined with at least one additional virtual object.

In this case, preferably, at least one of the 2d static or animated virtual object, 3d static or animated virtual object, text, audio or video is used as the main or additional virtual object.

In a preferred embodiment of the present invention, positioning by both the sender when creating the message and the receiver when placing the main virtual object is provided by linking the main virtual object to the geographical location displayed by the image pickup device of the user device.

Preferably, during and / or after the placement of the main virtual object, the sender and the recipient are given the opportunity at least one of the following operations: text message transmission, voice message transmission, video message transmission, multimedia message transmission, video call.

Preferably, after the location of the main virtual object, both the sender and the recipient provide the possibility of its display on the screen of the user device at different angles and from different points of view.

The described embodiments of the present invention equally apply to all its claimed aspects, namely, to a method for organizing user interaction in a communication system, a user device for organizing user interaction in a communication system, a communication system that provides interaction between user devices and a server, and a computer-readable medium on which program instructions are stored that initiate execution of aspects of cn soba organization user interaction in the communication system according to the present invention.

Aspects of the present invention are further disclosed herein with reference to graphic materials, which are non-limiting examples of the implementation of the present invention. FIG. 1 illustrates a flow chart of an embodiment of a method for organizing user interaction in a communication system according to one embodiment of the present invention. The steps of the illustrated flowchart will now be described in more detail with reference to FIGS. 2a - 2i. In FIG. 2a is a schematic diagram illustrating a screen 200 of a sender user device 202 in a step of selecting and placing a primary virtual object. Moreover, on the screen 200 of the user device 202 of the sender using the capture device images of the sender user device 202 display real-world objects 204 surrounding the sender that are captured by the image capture device, as well as a panel 206 of selectable virtual objects for subsequent transmission to the recipient. Thus, the sender is given the opportunity to select a virtual object from selectable virtual objects on the panel 206 through the user interface on the screen 200 of the user device 202 of the sender.

After selecting a virtual object 208 (this step is described in block 100 of the flowchart shown in FIG. 1), the sender places the selected primary virtual object 208. For this, the sender sets the location 210 of the main virtual object 208, as illustrated in FIG. 2a. The specified location 210 is displayed by the image capturing apparatus of the sender user device 202 on the screen 200 of the sender user device 202. The sender can set the location of the object, for example, by touching a certain place on the touch screen 200 with a finger or, for example, by dragging the selected main virtual object 208 on the touch screen 200 with a finger to a specific location, after which the specified object 208 is snapped to a specified geographical location displayed the image capturing apparatus of the sender user device 202, and is displayed as an augmented reality object, as illustrated FIG. 2b. This step is described in block 102 of the flowchart of FIG. 1. The sender can view the virtual object 208 from different sides through the screen 200 of the user device 202 of the sender, changing the viewing angle using the image capturing device of the user device 202 of the sender. Also, the sender can combine the main virtual object 208 with other virtual objects, for example, 2d static or animated virtual object, 3d static or animated virtual object, text, audio or video (not shown in the figures). Next, the sender transmits a message containing the main virtual object 208 from the sender user device 202 to the recipient user device 212, as described in block 104 of the flowchart of FIG. 1. After receiving the transmitted message by the user device

212 of the recipient (this step is described in block 106 of the flowchart of FIG. 1) recognition is automatically performed by the recipient user device 212 of the main virtual object 208 contained in the received message, as described in block 108 of the flowchart of FIG. 1, and a notification 216 on the receipt of a message is displayed on the screen 214 of the recipient user device 212, as illustrated in FIG. 2c, and the recipient is given the opportunity to open the message (this step is described in block 110 of the flowchart shown in Fig. 1). After the recipient has opened the received message, the image capturing device of the recipient user device 212 is activated. Thus, on the screen 214 of the recipient user device 212, the real world objects of the recipient will be displayed, as illustrated in FIG. 2d. Further, recognition by means of the user device 212 of the recipient of the specified objects of the real world of the recipient will automatically occur. Recognized real-world objects of the recipient in FIG. 2d are outlined with a dashed line. The stage of recognition of real-world objects of the recipient is described in block 112 of the flowchart shown in FIG. 1. Recognition can be carried out using standard algorithms used in the technical field.

Further, according to the described embodiment of the present invention, the recipient, by means of the recipient user device 212, arranges the main virtual object 208 contained in the message transmitted by the sender in a predetermined location. For this, the recipient sets the location 218 of the main virtual object 208, as illustrated in FIG. 2e. The specified location 218 is displayed by the image capturing apparatus of the recipient user device 212 on the screen 214 of the recipient user device 212. The recipient can set the location of the virtual object, for example, by touching a certain place on the touch screen 214 with a finger, or, for example, by dragging a virtual object 208 on the touch screen 214 with a finger to a specific location, after which the specified object 208 is tied to a specified geographical location displayed by the device capturing an image of the recipient user device 212, and displayed as an augmented reality object, as illustrated in FIG. 2f. This step is described in block 114 of the flowchart of FIG. 1. The recipient can view the virtual object 208 from different sides through the screen 214 of the user device 212 of the recipient, changing the viewing angle using the image capturing device of the user device 212 of the recipient.

After the virtual object 208 is placed by the recipient at a predetermined location, the algorithm estimates the distance between the recognized real world objects and the main virtual object 208, and when the distance between the main virtual object 208 and the recognized real world object 220, which is a pillow in this particular example, lying on the chair, less than or equal to the threshold value, the location and deformation of the main virtual object 208. The location is changed automatically. Proposition primary virtual object 208 is placing it on the recognized real world object 220 - cushion, and the main deformation of the virtual object 208 represents that the primary virtual object 208 sits on the recognized real world object 220 that is displayed in FIG. 2g, while the previously indicated primary virtual object 208 was in a vertical position, as shown in FIG. 2f. Described change of location and deformation of the main of the virtual object 208 are accompanied by a sound effect associated with the indicated types of change of location and deformation of the main virtual object 208, schematically displayed for better understanding as an icon 222. The specified sound effect may be, for example, the sound that occurs when a person lands on the surface of upholstered furniture, it can be any other sound that is not specific to a given action. Also described the change in location and deformation of the main virtual object 208 may be accompanied by visual effects (not shown in the figure), for example, a color flash or any other visual effect associated with these types of changes in the location and deformation of the main virtual object 208. This step is described in block 116 the block diagram of FIG. 1. Such a change in location and deformation of the main virtual object 208 occurs automatically, since in the described example, the recognized real-world object 220 is a pillow, which is contained in the library of various real-world objects, and the action for automatically performing the main “sit” virtual object 208 is contained in library of actions assigned to various main virtual objects, and can be performed with respect to the recognized object 220 of the real world (in this example, with respect to Yew on the pillow).

Moreover, after determining the distance from the recognized real-world object 220 to the main virtual object 208, the algorithm can superimpose a virtual object on the recognized real-world object, which is a copy of the specified recognized real-world object. In the described example, a virtual object 224 — a copy of the real world object 220 — is superimposed on a real-world object 220 — a pillow. Creating a copy of recognized objects of the real world and overlaying a copy can be carried out using standard algorithms used in the field of technology. Thus, not only can the deformation of the main virtual object 208 be performed, but also the deformation of the virtual object 224 are copies of a real-world object 220 — a pillow (in the described example, the pillow bends and bends 226 appear on it), as shown in FIG. 2h. This step is described in block 118 of the flowchart of FIG. one.

After the selected action is performed by the main virtual object 208, the deformed copy of the real-world objects disappears, and the recipient sees the real-world objects of the recipient in real time, as shown in FIG. 2i. This step is described in block 120 of the flowchart of FIG. one.

In FIG. 3 is a schematic illustration of an embodiment of a user device according to one embodiment of the present invention. The specified user device includes a processor 300 and associated screen 302, a computer-readable medium 304, a network component 306, and an image capturing device 308.

In FIG. 4 is a schematic illustration of an embodiment of a communication system according to one embodiment of the present invention. The specified communication system includes a server 400 and associated user devices 402 and 404 of the sender and receiver, respectively. As can be seen from the figure, the message is transmitted from the user device of the sender to the user device of the recipient through the server 400.

It should be noted that the method of organizing user interaction in a communication system, a user device for organizing user interaction in a communication system, a communication system that enables the interaction of user devices and a server with each other, and a machine-readable medium on which program instructions that initiate the execution of aspects are stored a method for organizing user interaction in a communication system according to the present invention eniyu are not limited to specific features or steps described above. In contrast, the specific features and steps described above are disclosed as examples implementing the present invention, and other equivalent features and steps may be encompassed by the scope of the present invention.

Claims

Claim 1. A method of organizing user interaction in a communication system, including selecting a main virtual object from the available virtual objects through a user interface on the screen of the sender's user device; placing the selected primary virtual object on the screen of the sender user device at a predetermined location displayed by the image pickup device of the sender user device, and displaying it as an augmented reality object; transmitting by the user device the sender of the message containing the selected primary virtual object to the user device with at least one recipient; receiving a message by the recipient user device; recognition by the user device of the recipient of the main virtual object contained in the received message; placing by the user device of the recipient the main virtual object at a predetermined location displayed by the image capturing device of the user device of the recipient, and displaying it as an augmented reality object; during and / or after the placement of the main virtual object, recognition is performed by the recipient user device of the real world objects of the recipient displayed on the screen of the recipient user device by the image capturing device of the recipient user device, and when the distance from the recognized real world object to of the main virtual object is less than or equal to the threshold value, at least a deformation or change of location of the main virtual object or the main virtual object and the virtual object — a copy of the real world object previously superimposed on the corresponding real world object — is automatically performed. 2. The method according to p. 1, characterized in that during and / or after the selected main virtual object is placed by the sender, the sender recognizes sender real-world objects displayed on the screen of the sender user device by the image pickup device of the sender user device by the user device; and when the distance from the recognized real-world object to the main virtual object is less than or equal to the threshold value, at least a deformation or change of location of the main virtual object or the main virtual object and the virtual object is automatically carried out - a copy of the real world object previously superimposed on the corresponding real-world object . 3. The method according to p. 1 or p. 2, characterized in that for the deformation of the main virtual object and / or virtual object — copies of the real world object turn to a library containing types of deformation assigned to various real-world objects and main virtual objects. 4. The method according to and. 1 or and. 2, characterized in that the distance from the recognized real world object to the main virtual object is calculated based on the x, y and z coordinates of the recognized real world object and the x ’, y’ and z ’coordinates of the main virtual object. 5. The method according to p. 1 or. 2, characterized in that for changing the location of the main virtual object and / or virtual object - copies of the real-world object turn to a library containing the values Dc, Ay, Dz and Dc ', Dg', Dz 'assigned to various real-world objects and main virtual objects, respectively. 6. The method according to and. 1, characterized in that when creating the message, the displayed main virtual object is combined with at least one additional virtual object. 7. The method according to p. 6, characterized in that at least one of 2d static or animated virtual object, 3d static or animated virtual object, text, audio or video is used as the main or additional virtual object. 8. The method according to p. 1, characterized in that the location is provided by linking the main virtual object to the geographical location displayed by the image capture device of the user device. 9. The method according to p. 1, characterized in that during and / or after the placement of the main virtual object, the user is given the opportunity to carry out at least one of the following operations: transmitting a text message, transmitting a voice message, transmitting a video message, transmitting a multimedia message, video call. 10. The method according to and. 1, characterized in that it provides the ability to display on the screen of the user device the main virtual object from different angles and from different points of view. 11. A user device for organizing user interaction in a communication system, including an image capturing device, at least one processor, a computer-readable medium connected to at least one processor and comprising software instructions that, when executed by at least one processor, provide the ability to select a virtual object from selectable virtual objects through a user interface on a user device screen; providing the ability to place the selected virtual object on the screen of the user device at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; allowing the user device to transmit a message containing the selected primary virtual object to at least one other user device; receiving a message containing at least one primary virtual object by a user device; recognition by the user device of the main virtual object contained in the received message; providing the ability to place through the user device the main virtual object at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; recognition by the user device of real-world objects displayed on the screen of the user device by the image capturing device of the user device during and / or after placement of the main virtual object, automatic implementation of at least deformation or relocation of the main virtual object or main virtual object and virtual object - copies of a real world object previously superimposed on the corresponding real world object when the distance from the recognized real world object to the main virtual object is less than or equal to the threshold value. 12. The device according to claim 11, characterized in that the program instructions contain instructions that, prior to providing the possibility of sending a message, provide recognition by the user device of real-world objects displayed on the screen of the user device by the image capturing device of the user device, during and / or after placement main virtual object; automatic implementation of at least deformation or change of location of the main virtual object or the main virtual object and the virtual object - a copy of the real world object previously superimposed on the corresponding real world object when the distance from the recognized real world object to the main virtual object is less than or equal to a threshold value. 13. The device according to p. 11 or p. 12, characterized in that the program instructions contain instructions that, for the deformation of the main virtual object and / or virtual object - copies of the real world object provide access to the library containing the types of deformation assigned to various objects real world and major virtual objects. 14. The device according to and. 11 or and. 12, characterized in that the program instructions contain instructions that provide a calculation of the distance from the recognized real-world object to the main virtual object based on the x, y and z coordinates of the recognized real-world object and the x, y, and z coordinates of the main virtual object. 15. The device according to p. 11 or p. 12, characterized in that the program instructions contain instructions that, for changing the location of the main virtual object and / or virtual object - copies of the real world object, provide access to the library containing the values Dc, Ay, Dz and Ax ', Ay', Dz'3, assigned to various real-world objects and main virtual objects, respectively. 16. The device according to p. 11, characterized in that the program instructions contain instructions that, when creating a message, provide the possibility of combining the displayed main virtual object with at least one additional virtual object. 17. The device according to p. 16, characterized in that the primary or secondary virtual object is at least one of 2d static or animated virtual object, 3d static or animated virtual object, text, audio or video. 18. The device according to p. 11, characterized in that the program instructions contain instructions that provide setting the location by linking the main virtual object to the geographical location displayed by the image capture device of the user device. 19. The device according to p. 11, characterized in that the program instructions contain instructions that, during and / or after the placement of the main virtual object, provide the possibility of at least one of the following operations: sending a text message, transmitting a voice message, transmitting video Messages, multimedia messaging, video call. 20. The device according to and. 11, characterized in that the program instructions contain instructions that provide display on the screen the user device of the main virtual object from different angles and from different points of view. 21. A communication system that provides interaction between user devices and the server with each other, containing software instructions located on the machine-readable medium of the user device, which, when executed by at least one processor of the user device, provides the ability to select a virtual object from a choice of virtual objects through the user interface on the screen of the user device; providing the ability to place the selected virtual object on the screen of the user device at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; allowing the user device to transmit a message containing the selected primary virtual object to at least one other user device; receiving a message containing at least one primary virtual object by a user device; recognition by the user device of the main virtual object contained in the received message; providing the ability to place through the user device the main virtual object at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; object recognition through a user device the real world displayed on the screen of the user device by the image capturing device of the user device during and / or after the placement of the main virtual object, automatic implementation of at least the deformation or change of location of the main virtual object or the main virtual object and the virtual object - a copy of the real world object, previously superimposed on the corresponding real-world object, when the distance from the recognized real-world object to the base an explicit virtual object is less than or equal to a threshold value; and program instructions located on a machine-readable medium of the server, which, when executed by at least one server processor, ensure that the server receives the transmitted message from the user device of the sender, stores the received message, transfers the stored message from the server to the user device of at least one recipient. 22. The system according to p. 21, characterized in that the program instructions contain instructions that, prior to providing the possibility of sending a message, provide recognition by the user device of real-world objects displayed on the screen of the user device by the image capturing device of the user device, during and / or after placement main virtual object; automatic implementation of at least deformation or change of location of the main virtual object or the main virtual object and the virtual object - a copy of the real world object previously superimposed on the corresponding real world object when the distance from the recognized real world object to the main virtual object is less than or equal to a threshold value. 23. The system of claim 21 or. 22, characterized in that the program instructions located on the computer-readable medium of the user device contain instructions that, for realizing the deformation of the main virtual object and / or virtual object, copies of the real world object, provide access to the library containing the types of deformation assigned to various real world objects and core virtual objects. 24. The system according to and. 21 or and. 22, characterized in that the program instructions located on the computer-readable medium of the user device contain instructions that provide for calculating the distance from the recognized real-world object to the main virtual object based on the x, y and z coordinates of the recognized real-world object and x 'coordinates, y 'and z' of the main virtual object. 25. The system according to and. 21 or and. 22, characterized in that the program instructions located on the machine-readable medium of the user device contain instructions that, to change the location of the main virtual object and / or virtual object - copies of the real-world object, provide access to a library containing the values Dc, Ay, Dz and Dc ', Ny Dz' assigned to various real-world objects and main virtual objects, respectively. 26. The system according to and. 21, characterized in that the program instructions located on the computer-readable medium of the user device contain instructions that, when creating a message, provide the possibility of combining the displayed main virtual object with at least one additional virtual object. 27. The system according to and. 26, wherein the primary or secondary virtual object is at least one of 2d static or animated virtual object, 3d static or animated virtual object, text, audio or video. 28. The system according to p. 21, characterized in that the program instructions located on the machine-readable medium of the user device, contain instructions that provide the location by linking the main virtual object to the geographical location displayed by the image capture device of the user device. 29. The system according to p. 21, characterized in that the program instructions located on the computer-readable medium of the user device contain instructions that, during and / or after the placement of the main virtual object, provide at least one of the following operations: text transmission messaging, voice messaging, video messaging, multimedia messaging, video calling. 30. The system according to p. 21, characterized in that the program instructions located on the computer-readable medium of the user device contain instructions that ensure that the main virtual object is displayed on the screen of the user device from different angles and from different points of view. 31. A computer-readable medium containing software instructions for user interaction in a communication system, which when executed by at least one processor of a user device provides the ability to select a virtual object from selectable virtual objects through the user interface on the screen of the user device; providing the ability to host the selected virtual an object on the screen of the user device at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; enabling the user device to transmit a message containing the selected primary virtual object, at least one other user device; receiving a message containing at least one primary virtual object by a user device; recognition by the user device of the main virtual object contained in the received message; providing the ability to place through the user device the main virtual object at a predetermined location displayed by the image capture device of the user device, and displaying it as an augmented reality object; recognition by the user device of real-world objects displayed on the screen of the user device by the image capturing device of the user device during and / or after the placement of the main virtual object, automatic implementation of at least deformation or relocation of the main virtual object or the main virtual object and virtual object - copies of a real-world object previously superimposed on the corresponding real-world object When the distance of the detected object in the real world to the virtual main object is less than or equal to the threshold. 32. The medium according to p. 31, characterized in that the program instructions contain instructions that before providing the ability to transmit messages recognition by the user device of real-world objects displayed on the screen of the user device by the image capturing device of the user device during and / or after the placement of the main virtual object; automatic implementation, at the least measure of deformation or change of location, of the main virtual object or the main virtual object and the virtual object - a copy of the real world object previously superimposed on the corresponding real world object when the distance from the recognized real world object to the main virtual object is less than or equal to the threshold value. 33. The medium according to claim 31 or claim 32, wherein the program instructions contain instructions that, for realizing the deformation of the main virtual object and / or virtual object — copies of the real world object — provide access to a library containing deformation types assigned to various objects real world and major virtual objects. 34. Media by and. 31 or and. 32, wherein the program instructions comprise instructions that provide a calculation of the distance from the recognized real-world object to the main virtual object based on the x, y and z coordinates of the recognized real-world object and the x ’, y’ and z ’coordinates of the main virtual object. 35. The media according to and. 31 or and. 32, characterized in that the program instructions contain instructions that, for changing the location of the main virtual object and / or virtual object — copies of the real world object — provide access to a library containing the values Dc, Ay, Dz and Dc ', Ny Dz' assigned to various real world objects and main virtual objects, respectively. 36. The media according to p. 31, characterized in that the program instructions contain instructions that, when creating a message, provide the possibility of combining the displayed main virtual object with at least one additional virtual object. 37. The media according to and. 36, wherein the primary or secondary virtual object is at least one of 2d static or animated virtual object, 3d static or animated virtual object, text, audio or video. 38. The media according to and. 31, characterized in that the program instructions contain instructions that provide the location by linking the main virtual object to the geographical location displayed by the image capture device of the user device. 39. Media by and. 31, characterized in that the program instructions contain instructions that, during and / or after the placement of the main virtual object, provide the possibility of at least one of the following operations: transmitting a text message, transmitting a voice message, transmitting a video message, transmitting a multimedia message, video call. 40. The media according to and. 31, characterized in that the program instructions contain instructions that ensure that the main virtual object is displayed on the screen of the user device at different angles and from different points of view.