CN107077216A - Method and mobile terminal that a kind of picture is shown - Google Patents

Abstract

A kind of method and mobile terminal shown the embodiment of the invention discloses picture, the display for the mobile control interface according to real-time video transmission device.Present invention method includes：The picture that the actual three-dimensional coordinate, actual moving direction and destination object of destination object are shot is obtained, destination object has locomotive function and shoot function；Virtual objects are generated in the virtual three-dimensional coordinate system set up according to actual three-dimensional coordinate, the coordinate of virtual objects is the first virtual three-dimensional coordinate, and the moving direction of virtual objects is identical with actual moving direction；Virtual identifying thing is set on the moving direction of virtual objects, and the coordinate of virtual identifying thing is the second virtual three-dimensional coordinate；By virtual objects and virtual identifying thing be added to destination object shooting picture, obtain target picture；When the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default threshold value, preset picture corresponding with virtual identifying thing is shown on the basis of target picture.

Description

A screen display method and mobile terminal

technical field

The invention relates to the field of computer augmented reality, in particular to a screen display method and a mobile terminal.

Background technique

With the development of technology, products that can realize real-time video transmission have been widely used. For example, drones and remote control cars are widely used in aerial photography, environmental monitoring, forest fire prevention, etc. Some manufacturers have launched first-person perspective (FPV, First Person View) transmission devices, which can use virtual reality (VR, Virtual Reality) glasses to achieve immersive experience. Existing FPV devices are mainly for shooting purposes, carrying flat-screen cameras or panoramic cameras, players can use mobile terminals or dedicated remote controls to connect to FPV products, and watch the pictures taken by FPV devices in real time.

Existing FPV devices use the pictures captured by the camera to perform certain digital processing and adapt to the display of VR glasses, which brings strong playability to players, and the immersive experience can bring more excitement. The FPV installation sees the world from a first-person perspective, bringing a certain virtual reality effect.

However, these FPV devices can only provide the actual picture captured by the camera, and combined with VR glasses or mobile terminals, only the most basic virtual reality experience is provided. In other words, the existing display screen devices cannot control and change the content of the displayed screen .

Contents of the invention

An embodiment of the present invention provides a method for displaying a picture, which is used for controlling the display of a picture according to the movement of a real-time video transmission device.

In view of this, the first aspect of the present invention provides a method for displaying a picture, including: acquiring the actual three-dimensional coordinates of the target object, the actual moving direction and the picture taken by the target object, the target object has a moving function and a shooting function; according to The actual three-dimensional coordinates generate a virtual object in the established virtual three-dimensional coordinate system, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction; A virtual marker is set in the moving direction of the object, and the coordinates of the virtual marker are the second virtual three-dimensional coordinates; the virtual object and the virtual marker are superimposed on the picture taken by the target object to obtain the target picture; when When the straight-line distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than a preset threshold, a preset picture corresponding to the virtual marker is displayed on the basis of the target picture.

With reference to the first aspect of the embodiments of the present invention, in the first implementation manner of the first aspect of the embodiments of the present invention, the virtual object is established in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinates, and the virtual The coordinates of the object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction including: converting the actual three-dimensional coordinates into the first virtual three-dimensional coordinates according to a preset ratio; The three-dimensional coordinates generate a virtual object in the established virtual three-dimensional coordinate system, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction.

With reference to the first aspect of the embodiments of the present invention, in the second implementation manner of the first aspect of the embodiments of the present invention, when the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than a preset When the threshold value is , displaying the preset picture corresponding to the virtual marker on the basis of the target picture includes: calculating the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates according to a preset formula; When the straight-line distance is less than a preset threshold, a preset picture corresponding to the virtual marker is displayed on the basis of the target picture.

In combination with any of the implementation manners from the first aspect to the second implementation manner of the first aspect of the embodiments of the present invention, in the third implementation manner of the first aspect of the embodiments of the present invention, the acquisition of the actual three-dimensional Before the coordinates, the actual moving direction and the picture taken by the target object, the method further includes: starting the 3D engine, and establishing a virtual three-dimensional coordinate system.

In combination with any implementation manner of the first aspect to the second implementation manner of the first aspect of the embodiments of the present invention, in the fourth implementation manner of the first aspect of the embodiments of the present invention, the virtual object and the The virtual marker is superimposed on the picture taken by the target object, after the target picture is obtained, and before the preset picture corresponding to the virtual marker is displayed on the basis of the target picture, the method further includes: according to the user's operation The command adjusts the moving direction of the virtual object.

The second aspect of the present invention provides a mobile terminal, the mobile terminal includes: an acquisition unit, used to acquire the actual three-dimensional coordinates of the target object, the actual moving direction and the picture taken by the target object, the target object has a moving function and a shooting Function; generating unit, used to generate a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinates, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is consistent with the actual The moving direction is the same; the setting unit is used to set the virtual marker in the moving direction of the virtual object, and the coordinates of the virtual marker are the second virtual three-dimensional coordinates; the superimposing unit is used to combine the virtual object and the The virtual marker is superimposed on the picture taken by the target object to obtain the target picture; the display unit is configured to, when the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than a preset threshold, A preset screen corresponding to the virtual marker is displayed on the basis of the target screen.

With reference to the second aspect of the embodiments of the present invention, in the first implementation manner of the second aspect of the embodiments of the present invention, the generation unit includes: a conversion module, configured to convert the actual three-dimensional coordinates into the first A virtual three-dimensional coordinates; a generating module, configured to generate a virtual object in the established virtual three-dimensional coordinate system according to the first virtual three-dimensional coordinates, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the virtual object The moving direction of is the same as the actual moving direction.

With reference to the second aspect of the embodiments of the present invention, in the second implementation manner of the second aspect of the embodiments of the present invention, the display unit includes: a calculation module, configured to calculate the first virtual three-dimensional coordinates and The straight-line distance of the second virtual three-dimensional coordinates; a display module, configured to display a preset picture corresponding to the virtual marker on the basis of the target picture when the straight-line distance is less than a preset threshold.

In combination with any implementation manner of the second aspect to the second implementation manner of the second aspect of the embodiments of the present invention, in the third implementation manner of the second aspect of the embodiments of the present invention, the mobile terminal further includes: establishing The unit is used to start the 3D engine and establish a virtual three-dimensional coordinate system.

In combination with any implementation manner of the second aspect to the second implementation manner of the second aspect of the embodiments of the present invention, in the fourth implementation manner of the second aspect of the embodiments of the present invention, the mobile terminal further includes: adjusting A unit, configured to adjust the moving direction of the virtual object according to the user's operation instruction.

It can be seen from the above technical solutions that the embodiments of the present invention have the following advantages:

In the embodiment of the present invention, the actual three-dimensional coordinates of the target object, the actual moving direction and the picture taken by the target object are obtained, and the target object has a moving function and a shooting function; according to the actual three-dimensional coordinates in the established virtual three-dimensional coordinate system Generate a virtual object, the coordinates of the virtual object are the first virtual three-dimensional coordinates, the moving direction of the virtual object is the same as the actual moving direction; a virtual marker is set on the moving direction of the virtual object, and the virtual marker The coordinates of the object are the second virtual three-dimensional coordinates; the virtual object and the virtual marker are superimposed on the picture taken by the target object to obtain the target picture; when the first virtual three-dimensional coordinates and the second virtual three-dimensional When the linear distance of the coordinates is less than a preset threshold, a preset picture corresponding to the virtual marker is displayed on the basis of the target picture. In the present invention, by setting corresponding virtual markers, when the preset conditions are met, in addition to displaying the real picture taken by the real-time video transmission device, the mobile terminal also controls the display of the virtual picture according to the movement of the real-time video transmission device and different virtual markers .

Description of drawings

FIG. 1 is a schematic framework diagram of a specific application scenario in an embodiment of the present invention;

FIG. 2 is a schematic diagram of an embodiment of a method for screen display in an embodiment of the present invention;

FIG. 3 is a schematic diagram of another embodiment of the screen display method in the embodiment of the present invention;

FIG. 4 is a schematic diagram of an embodiment of a mobile terminal in an embodiment of the present invention;

FIG. 5 is a schematic diagram of another embodiment of the mobile terminal in the embodiment of the present invention;

Fig. 6 is a schematic diagram of another embodiment of the mobile terminal in the embodiment of the present invention.

detailed description

An embodiment of the present invention provides a method for displaying a picture, which is used for controlling the display of a picture according to the movement of a real-time video transmission device.

In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only It is an embodiment of a part of the present invention, but not all embodiments.

The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and not necessarily Used to describe a specific sequence or sequence. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein can be practiced in sequences other than those illustrated or described herein. Furthermore, the term "comprising" or "having" and any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, method, system, product or device comprising a sequence of steps or elements is not necessarily limited to those explicitly listed instead, may include other steps or elements not explicitly listed or inherent to the process, method, product or apparatus.

Existing real-time video transmission devices can only shoot and transmit videos. As shown in FIG. Relevant information can be transmitted between man and machine, a wireless connection is established between the UAV and the satellite, and the UAV obtains the actual latitude and longitude information through the satellite.

For ease of understanding, the following describes the specific process in the embodiment of the present invention. Please refer to FIG. 2. An embodiment of the method for displaying the screen in the embodiment of the present invention includes:

201. Acquire the actual three-dimensional coordinates of the target object, the actual moving direction, and the picture taken by the target object, where the target object has a moving function and a shooting function.

A connection relationship has been established between the mobile terminal and the target object. The target object is a real-time video transmission device with mobile and shooting functions, and data transmission can be performed between the mobile terminal and the target object. The mobile terminal remotely receives the actual three-dimensional coordinates, the actual moving direction and the photographed picture sent by the target object, and the actual three-dimensional coordinates include the longitude, latitude and height information of the target object.

202. Generate a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinates, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction.

The mobile terminal receives the actual three-dimensional coordinates sent by the target object, simulates the actual three-dimensional coordinates to the three-dimensional coordinate system through the virtual engine to obtain the first virtual three-dimensional coordinates, and generates a virtual object in the established virtual three-dimensional system according to the coordinates. For example, when the real-time video transmission device is a drone, a corresponding virtual drone is generated in the virtual coordinate system established by the mobile terminal, and the moving direction of the virtual drone is the same as that of the actual drone.

203. Set a virtual marker in the moving direction of the virtual object, where the coordinates of the virtual marker are the second virtual three-dimensional coordinates.

The mobile terminal can obtain the moving direction of the virtual object in real time, and set a virtual marker in the current moving direction of the virtual object. The coordinates of the virtual marker are the second virtual three-dimensional coordinates. The virtual marker can be a gold coin or an obstacle. It can be a virtual object with other meanings, which is not limited here.

204. Superimpose the virtual object and the virtual marker on the frame captured by the target object to obtain the target frame.

The mobile terminal extracts the relevant parameters of the virtual object and the virtual marker, generates a corresponding virtual picture through the virtual engine according to the relevant parameters, and then superimposes the virtual picture and the picture taken by the target object to obtain the target picture, which has the target image at the same time. The real picture taken by the subject and the virtual picture generated by the mobile terminal.

205. When the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than a preset threshold, display a preset screen corresponding to the virtual marker on the basis of the target screen.

When the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than the preset threshold, the mobile terminal not only displays the superimposed target screen, but also displays the corresponding preset screen according to the difference of the virtual identifier, for example, when When the virtual marker is a gold coin, the mobile terminal displays a preset screen indicating that the gold coin increases.

In the present invention, by setting corresponding virtual markers, when the preset conditions are met, in addition to displaying the real picture taken by the real-time video transmission device, the mobile terminal also controls the display of the virtual picture according to the movement of the real-time video transmission device and different virtual markers .

Please refer to FIG. 3 , another embodiment of the screen display method of the embodiment of the present invention includes:

301. Start the 3D engine, and establish a virtual three-dimensional coordinate system.

The mobile terminal starts a preset 3D engine, establishes a virtual three-dimensional coordinate system through the 3D engine, and renders a corresponding virtual world picture. For example, the virtual three-dimensional coordinate system is established through the Direct engine, and the 3D engine may also be other engines, such as an OpenGL engine, etc., which are not limited here.

302. Acquire the actual three-dimensional coordinates of the target object, the actual moving direction, and the picture taken by the target object, where the target object has a moving function and a shooting function.

A connection relationship has been established between the mobile terminal and the target object. The target object is a real-time video transmission device with mobile and shooting functions, and data transmission can be performed between the mobile terminal and the target object. The mobile terminal remotely receives the actual three-dimensional coordinates, the actual moving direction and the photographed picture sent by the target object, and the actual three-dimensional coordinates include the longitude, latitude and height information of the target object.

303. Convert the actual three-dimensional coordinates into first virtual three-dimensional coordinates according to a preset ratio.

The actual 3D coordinates are converted into the first virtual 3D coordinates according to the preset ratio, and the converted ratio is set according to actual needs, for example, the ratio of the actual 3D coordinates to the first virtual 3D coordinates is set to 100:1.

304. Generate a virtual object in the established virtual three-dimensional coordinate system according to the first virtual three-dimensional coordinates, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction.

The mobile terminal obtains the converted first virtual three-dimensional coordinates, simulates the first virtual three-dimensional coordinates on the three-dimensional coordinate system through the virtual engine, and generates virtual objects in the established virtual three-dimensional system according to the virtual coordinates.

305. Set a virtual marker in the moving direction of the virtual object, where the coordinates of the virtual marker are the second virtual three-dimensional coordinates.

The mobile terminal can obtain the moving direction of the virtual object in real time, and set a virtual marker in the current moving direction of the virtual object. The coordinates of the virtual marker are the second virtual three-dimensional coordinates. The virtual marker can be a gold coin or an obstacle, etc., specifically There is no limit here.

306. Superimpose the virtual object and the virtual marker on the frame captured by the target object to obtain the target frame.

The mobile terminal extracts the relevant parameters of the virtual object and the virtual marker, generates a corresponding virtual picture through the virtual engine according to the relevant parameters, and then superimposes the virtual picture and the picture taken by the target object to obtain the target picture, which has the target image at the same time. The real picture taken by the subject and the virtual picture generated by the mobile terminal.

307. Adjust the moving direction of the virtual object according to the user's operation instruction.

The mobile terminal receives an operation instruction from the user, and the mobile terminal adjusts the virtual object according to the operation instruction. The operation instruction is used to change the moving direction of the virtual object.

308. Calculate a linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates according to a preset formula.

The mobile terminal calculates the linear distance between the virtual marker and the virtual object according to the obtained coordinate information of the virtual marker and the virtual object and according to a preset formula.

309. When the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than a preset threshold, display a preset screen corresponding to the virtual marker on the basis of the target screen.

When the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than the preset threshold, the mobile terminal not only displays the superimposed target screen, but also displays the corresponding preset screen according to the difference of the virtual identifier, for example, when When the virtual marker is a gold coin, the mobile terminal displays a preset screen indicating that the gold coin increases.

In the present invention, by setting corresponding virtual markers, when the preset conditions are met, in addition to displaying the real picture taken by the real-time video transmission device, the mobile terminal also controls the display of the virtual picture according to the movement of the real-time video transmission device and different virtual markers .

For ease of understanding, the following describes specific application scenarios:

The mobile phone starts the preset Direct engine, establishes a virtual three-dimensional coordinate system through the Direct engine, and renders a corresponding virtual world picture. A connection relationship has been established between the mobile phone and the drone, and data transmission can be performed between the mobile phone and the drone. The longitude, latitude and height information of the man-machine. The mobile phone converts the actual 3D coordinates into the first virtual 3D coordinates at a ratio of 10:1. For example, the actual coordinates are (x: 113, y: 23, z: 100), and the first virtual 3D coordinates are (x: 11.3, y : 2.3, z: 10), the unit is meter. According to different application scenarios, the mobile phone has multiple ways to obtain relevant information. For example: when the UAV is in an open environment, the mobile phone can obtain the actual latitude and longitude of the UAV according to the satellite positioning, and then obtain the actual horizontal height of the UAV through the altimeter installed on the UAV; When the man-machine is in an indoor or semi-closed environment, the mobile phone can judge the distance between the drone and the surrounding walls or obstacles through the distance detector installed on the drone, and then calculate another set of virtual coordinates. The mobile phone generates a virtual drone in the virtual three-dimensional coordinate system according to the obtained first virtual coordinates (x: 11.3, y: 2.3, z: 10), and the coordinates of the virtual drone are (x: 11.3, y: 2.3, z : 10). At this time, the UAV is flying from south to north, then the moving direction of the virtual UAV is consistent with the actual flying direction of the UAV, and it is also flying from south to north, and the virtual sign is set in the forward direction of the virtual UAV Object gold coins, in addition to displaying the real picture captured by the drone, the mobile phone also displays the virtual marker gold coins and virtual drone created by the virtual engine. The coordinates of the virtual marker are (x: 8.3, y: 2.3, z: 6), then the straight-line distance is S, S=5, the user operates on the mobile phone and controls the virtual drone to move towards the virtual marker gold coin. When the virtual drone is close to the gold coin and the straight-line distance S between the virtual drone and the gold coin is less than 0.1 meters, it is regarded as a virtual The drone collides with the gold coins, and on the basis of the current display screen, the mobile phone additionally displays the screen of the gold coins increasing.

The method for displaying the screen in the embodiment of the present invention is described above, and the mobile terminal in the embodiment of the present invention is described below. Please refer to FIG. 4, the mobile terminal in the embodiment of the present invention includes:

The acquisition unit 401 is used to acquire the actual three-dimensional coordinates of the target object, the actual moving direction and the picture taken by the target object, and the target object has a moving function and a shooting function;

The generating unit 402 is configured to generate a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinates, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction;

A setting unit 403, configured to set a virtual marker in the moving direction of the virtual object, where the coordinates of the virtual marker are the second virtual three-dimensional coordinates;

A superimposing unit 404, configured to superimpose the virtual object and the virtual marker on the picture taken by the target object to obtain the target picture;

The display unit 405 is configured to display a preset picture corresponding to the virtual marker on the basis of the target picture when the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than a preset threshold.

In the embodiment of the present invention, the acquisition unit 401 acquires the actual three-dimensional coordinates of the target object, the actual moving direction and the picture taken by the target object, and the target object has a moving function and a shooting function; The virtual object is generated in the system, the coordinates of the virtual object are the first virtual three-dimensional coordinates, the moving direction of the virtual object is the same as the actual moving direction; the setting unit 403 sets the virtual marker in the moving direction of the virtual object, and the coordinate of the virtual marker is the first Two virtual three-dimensional coordinates; superposition unit 404 superimposes the virtual object and the virtual marker on the picture taken by the target object to obtain the target picture; when the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than a preset threshold, display Unit 405 displays a preset screen corresponding to the virtual marker on the basis of the target screen. In the present invention, by setting corresponding virtual markers, when the straight-line distance between the virtual marker and the virtual object is less than a preset value, in addition to displaying the real picture taken by the real-time video transmission device, the mobile terminal also The virtual marker of controls the display of the virtual screen.

Referring to Fig. 5, another embodiment of the mobile terminal in the embodiment of the present invention includes:

The acquisition unit 401 is used to acquire the actual three-dimensional coordinates of the target object, the actual moving direction and the picture taken by the target object, and the target object has a moving function and a shooting function;

The generating unit 402 is configured to generate a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinates, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction;

A setting unit 403, configured to set a virtual marker in the moving direction of the virtual object, where the coordinates of the virtual marker are the second virtual three-dimensional coordinates;

A superimposing unit 404, configured to superimpose the virtual object and the virtual marker on the picture taken by the target object to obtain the target picture;

The display unit 405 is configured to display a preset picture corresponding to the virtual marker on the basis of the target picture when the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than a preset threshold.

Wherein, the generating unit 402 includes:

A conversion module 4021, configured to convert the actual three-dimensional coordinates into the first virtual three-dimensional coordinates according to a preset ratio;

The generating module 4022 is configured to generate a virtual object in the established virtual three-dimensional coordinate system according to the first virtual three-dimensional coordinates, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction.

Wherein, the display unit 405 may further include:

Calculation module 4051, configured to calculate the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates according to a preset formula;

The display module 4052 is configured to display a preset picture corresponding to the virtual marker on the basis of the target picture when the straight-line distance is less than a preset threshold.

In the embodiment of the present invention, the acquisition unit 401 acquires the actual three-dimensional coordinates of the target object, the actual moving direction, and the picture taken by the target object. The target object has a moving function and a shooting function; A virtual three-dimensional coordinates; the generation module 4022 generates a virtual object in the established virtual three-dimensional coordinate system according to the first virtual three-dimensional coordinates, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction; set The unit 403 sets the virtual marker on the moving direction of the virtual object, and the coordinates of the virtual marker are the second virtual three-dimensional coordinates; the superposition unit 404 superimposes the virtual object and the virtual marker on the picture taken by the target object to obtain the target picture; the calculation module 4051 calculates the straight-line distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates according to a preset formula; when the straight-line distance is less than a preset threshold, the display module 4052 displays a preset picture corresponding to the virtual marker on the basis of the target picture . In the present invention, by setting corresponding virtual markers, when the straight-line distance between the virtual marker and the virtual object is less than a preset value, in addition to displaying the real picture taken by the real-time video transmission device, the mobile terminal also The virtual marker of controls the display of the virtual screen.

Referring to Fig. 6, another embodiment of the mobile terminal in the embodiment of the present invention includes:

The acquisition unit 401 is used to acquire the actual three-dimensional coordinates of the target object, the actual moving direction and the picture taken by the target object, and the target object has a moving function and a shooting function;

The generating unit 402 is configured to generate a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinates, the coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction;

A setting unit 403, configured to set a virtual marker in the moving direction of the virtual object, where the coordinates of the virtual marker are the second virtual three-dimensional coordinates;

A superimposing unit 404, configured to superimpose the virtual object and the virtual marker on the picture taken by the target object to obtain the target picture;

The display unit 405 is configured to display a preset picture corresponding to the virtual marker on the basis of the target picture when the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than a preset threshold.

The mobile terminal also includes:

The establishing unit 406 is configured to start the 3D engine and establish a virtual three-dimensional coordinate system.

The mobile terminal may further include:

The adjusting unit 407 is configured to adjust the moving direction of the virtual object according to the user's operation instruction.

In the embodiment of the present invention, the establishing unit 406 starts a 3D engine to establish a virtual three-dimensional coordinate system. The acquisition unit 401 acquires the actual three-dimensional coordinates of the target object, the actual moving direction and the picture taken by the target object, and the target object has a movement function and a shooting function; the generation unit 402 generates a virtual object in the established virtual three-dimensional coordinate system according to the actual three-dimensional coordinates, The coordinates of the virtual object are the first virtual three-dimensional coordinates, and the moving direction of the virtual object is the same as the actual moving direction; the setting unit 403 sets a virtual marker in the moving direction of the virtual object, and the coordinates of the virtual marker are the second virtual three-dimensional coordinates; The unit 404 superimposes the virtual object and the virtual marker on the picture taken by the target object to obtain the target picture; the adjustment unit 407 adjusts the moving direction of the virtual object according to the user's operation instruction. When the linear distance between the first virtual three-dimensional coordinates and the second virtual three-dimensional coordinates is less than a preset threshold, the display unit 405 displays a preset screen corresponding to the virtual marker on the basis of the target screen. In the present invention, by setting corresponding virtual markers, when the straight-line distance between the virtual marker and the virtual object is less than a preset value, in addition to displaying the real picture taken by the real-time video transmission device, the mobile terminal also The virtual marker of controls the display of the virtual screen.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, and other media that can store program codes.

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still understand the foregoing The technical solutions recorded in each embodiment are modified, or some of the technical features are replaced equivalently; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims (10)

1. a kind of method that picture is shown, it is characterised in that including：

Obtain the picture that the actual three-dimensional coordinate, actual moving direction and destination object of destination object are shot, the destination object With locomotive function and shoot function；

Virtual objects are generated in the virtual three-dimensional coordinate system set up according to the actual three-dimensional coordinate, the virtual objects Coordinate is the first virtual three-dimensional coordinate, and the moving direction of the virtual objects is identical with the actual moving direction；

Virtual identifying thing is set on the moving direction of the virtual objects, and the coordinate of the virtual identifying thing is second virtual three Dimension coordinate；

The virtual objects and the virtual identifying thing are added to the picture that the destination object shoots, target picture is obtained；

When the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default threshold value, Preset picture corresponding with the virtual identifying thing is shown on the basis of the target picture.

2. according to the method described in claim 1, it is characterised in that it is described according to the actual three-dimensional coordinate in the void set up Intend setting up virtual objects in three-dimensional system of coordinate, the coordinate of the virtual objects is the first virtual three-dimensional coordinate, the virtual objects Moving direction it is identical with the actual moving direction including：

The actual three-dimensional coordinate is converted into the first virtual three-dimensional coordinate according to preset proportion；

Virtual objects are generated in the virtual three-dimensional coordinate system set up according to the first virtual three-dimensional coordinate, it is described virtual right The coordinate of elephant is the first virtual three-dimensional coordinate, and the moving direction of the virtual objects is identical with the actual moving direction.

3. according to the method described in claim 1, it is characterised in that described to work as the first virtual three-dimensional coordinate and described second When the air line distance of virtual three-dimensional coordinate is less than default threshold value, display and the virtual mark on the basis of the target picture Knowing the corresponding preset picture of thing includes：

The air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is calculated according to preset formula；

When the air line distance is less than default threshold value, display and the virtual identifying thing on the basis of the target picture Corresponding preset picture.

4. according to the method in any one of claims 1 to 3, it is characterised in that described to obtain actual the three of destination object Before the picture that dimension coordinate, actual moving direction and destination object are shot, methods described also includes：

Start 3D engines, set up virtual three-dimensional coordinate system.

5. according to the method in any one of claims 1 to 3, it is characterised in that by virtual objects and described virtual Marker is added to the picture that the destination object is shot, and obtains after target picture, shows on the basis of the target picture Show before preset picture corresponding with the virtual identifying thing, methods described also includes：

The moving direction of the virtual objects is adjusted according to the operational order of user.

6. a kind of mobile terminal, it is characterised in that including：

Acquiring unit, for obtaining the picture that the actual three-dimensional coordinate, actual moving direction and destination object of destination object are shot, The destination object has locomotive function and shoot function；

Generation unit, for generating virtual objects in the virtual three-dimensional coordinate system set up according to the actual three-dimensional coordinate, The coordinate of the virtual objects is the first virtual three-dimensional coordinate, the moving direction of the virtual objects and the actual moving direction It is identical；

Setting unit, for setting virtual identifying thing, the seat of the virtual identifying thing on the moving direction of the virtual objects It is designated as the second virtual three-dimensional coordinate；

Superpositing unit, for the picture for the destination object shooting that the virtual objects and the virtual identifying thing are added to, Obtain target picture；

Display unit, when the air line distance of the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate is less than default During threshold value, for showing preset picture corresponding with the virtual identifying thing on the basis of the target picture.

7. mobile terminal according to claim 6, it is characterised in that the generation unit includes：

Modular converter, for the actual three-dimensional coordinate to be converted into the first virtual three-dimensional coordinate according to preset proportion；

Generation module, it is virtual right for being generated according to the first virtual three-dimensional coordinate in the virtual three-dimensional coordinate system set up As the coordinate of the virtual objects is the first virtual three-dimensional coordinate, the moving direction of the virtual objects and the reality Moving direction is identical.

8. mobile terminal according to claim 6, it is characterised in that the display unit includes：

Computing module, for calculating the first virtual three-dimensional coordinate and the second virtual three-dimensional coordinate according to preset formula Air line distance；

Display module, when the air line distance be less than default threshold value when, on the basis of the target picture display with The corresponding preset picture of the virtual identifying thing.

9. the mobile terminal according to any one of claim 6 to 8, it is characterised in that the mobile terminal also includes：

Unit is set up, for starting 3D engines, virtual three-dimensional coordinate system is set up.

10. the mobile terminal according to any one of claim 6 to 8, it is characterised in that the mobile terminal also includes：

Adjustment unit, the moving direction for adjusting the virtual objects according to the operational order of user.