CN106534800A - Drawing assistant system based on AR augmented reality technology and wireless communication technology - Google Patents

Abstract

The invention discloses a drawing auxiliary system based on AR augmented reality technology and wireless communication technology, comprising: the video acquisition unit is used for acquiring original pictures of a target object and a scene; the image processing unit is used for processing the original picture and generating a line image corresponding to the original picture; the system comprises a projection display unit, a video acquisition unit and a remote server, wherein the projection display unit is used for acquiring the current height of the system, the size of a standard target paper, the deflection angle of a screen relative to the target standard paper and the size of the screen, calculating to obtain the projection relation drawing process of a line image on the target paper observed by a user through the display screen, acquiring the drawing process video of a painter by the video acquisition unit, sending the drawing process video to the remote server for storage, and playing the process video to a downloading user when other users in the system download the corresponding line images to give drawing guidance.

Description

Drawing assistant system based on AR augmented reality technology and wireless communication technology

technical field

The invention relates to a drawing assistance system based on AR augmented reality technology and wireless communication technology. It involves patent classification H04 electric communication technology, H04N image communication, such as television, H04N13/00 stereoscopic television system; its parts, H04N13/04 image reproduction device.

Background technique

The drawing book for adults provides the basic lines for painting. You only need to add corresponding colors to the blank spaces between the lines to form a complete painting. The whole painting process is simple and feasible. During the drawing process, the painter concentrates on it, can capture distracting thoughts and cultivate sentiment, so that people can get a rare chance to relax in the fast-paced life, which is very beneficial to the physical and mental health of modern people.

However, there are two main problems in this type of picture book. One is that there are borders when the draft is finished. Unless heavy paints, such as oil paints, are used to cover it, it will affect the overall painting effect. Oil paints are complicated and require palettes and special Oil paint brushes can be used effectively, which deviates from the original intention of picture books.

Another problem is that picture books need to be purchased specially, and the subject matter is relatively limited. For example, the mysterious garden picture book that was popular in the circle of friends for a while, because the theme is too single, many users have little interest after purchasing and discard it, resulting in waste.

With the continuous development of computer graphics, the functions that can be realized by image processing algorithms have become increasingly mature. After color pictures are binarized and denoised, very accurate contour maps can be obtained, as shown in Figures 1 and 2. It can be converted into a contour map by existing image processing software.

With the continuous development of augmented reality technology based on smart terminals such as mobile phones, through electronic screens such as mobile phones, virtual images that do not exist in the real world can be observed. The combination of graphics and graphics has laid a technical foundation for solving the above technical problems. .

Contents of the invention

Aiming at the above problems, the present invention develops a drawing assistance system based on AR augmented reality technology and wireless communication technology, including:

The video acquisition unit acquires the original pictures of the target object and the scenery;

An image processing unit, processing the original picture to generate a line image corresponding to the original picture;

The projection display unit obtains the current height of the system and the size of the standard target paper, calculates the projection relationship of the line image observed by the user through the display screen on the target paper, and the display screen in the projection display unit The line image adjusted by the projection relationship is displayed in the display, so that when the user observes the target paper through the display screen, the virtual line draft of the original picture is obtained; the user fills the corresponding color in the blank area of the virtual line draft to complete the painting.

It also includes a storage unit, a wireless communication unit, and a remote server. The storage unit stores the line images generated by the image processing unit and the drawings completed by the user; the wireless communication unit sends them to the remote server, and the remote server sends them to the remote server. The users in the system are open, and the users in the system give evaluation scores to the paintings, and set the download costs of paintings and corresponding line images according to the evaluation scores.

During the drawing process, the video acquisition unit acquires the drawing process video of the painter and sends it to the remote server for storage. When other users in the system download their corresponding line images, the process video is played to the downloading user to give drawing instructions.

As a preferred embodiment, the auxiliary system is an intelligent mobile terminal, including a camera as a video acquisition unit, a processor as an image processing unit, and a display screen as the projection display unit.

As a preferred embodiment, there is also a fixed mount for fixing the mobile smart terminal;

The fixed frame includes four fixed blocks, the opposite inner corners of each fixed block are provided with rectangular notches to fix the four corners of the standard projection target paper, and the fixed blocks are connected by connecting rods to form the four corners of the rectangle;

A bracket is fixed on two fixed blocks close to the user, and the mobile terminal is fixed on the beam of the bracket.

Furthermore, the connecting rod is a telescopic connecting rod, and the telescopic parts at both ends control the telescopic feeding length through fixing bolts.

Further, the beam is a telescopic beam with adjustable height.

The bolts for pressing the paper are arranged on the fixed block.

Due to the adoption of the above-mentioned technical scheme, a painting assistance system based on AR augmented reality technology and wireless communication technology disclosed in the present invention realizes the process of displaying on the screen of the mobile phone by using existing smart terminals such as mobile phones and existing algorithms. The scaled line image is projected so that when the blank paper is observed through the mobile phone screen, the line outline of the painting is presented. At the same time, a simple and stable paper and terminal fixing structure are set up to ensure the relative position of the paper and the mobile phone during use. Fixed, so that the photos taken by terminals such as mobile phones can be converted into the virtual outline of picture books, which has high practical value.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are only some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to these drawings without any creative effort.

Fig. 1 is the original color image mentioned in the background technology of the present invention

Fig. 2 is the contour image obtained after the original image mentioned in the background technology of the present invention is processed by an algorithm

Fig. 3 is the schematic diagram of fixing frame of the present invention

Fig. 4 is the side view of fixing frame of the present invention

Fig. 5 is a schematic diagram of the use state of the fixing frame of the present invention

Fig. 6 is a schematic diagram of the expansion and contraction state of the fixing frame of the present invention

Fig. 7 is a system block diagram of the present invention

detailed description

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention are clearly and completely described below in conjunction with the drawings in the embodiments of the present invention:

As shown in Figure 1-6: a painting assistance system based on AR augmented reality technology and wireless communication technology, mainly including: a video acquisition unit, which acquires the original pictures of the target object and the scene, such as using a mobile phone to take pictures, etc. Others can also be used Digital imaging equipment to collect pixel photos of people and scenery of interest.

The image processing unit processes the original picture to generate a line image or contour image corresponding to the original picture, as shown in Figure 2, and other algorithms can also be added to remove redundant pixel interference and generate an image with less noise .

As well as the projection display unit as the core of the system, the current height of the system and the size of the standard target paper are obtained. The necessary calculation parameters also include the deflection angle and screen size information of the mobile phone screen. Calculate the projection relationship of the line image observed by the user through the display screen on the target paper, and display the line image adjusted by the projection relationship on the display screen in the projection display unit, so that the user can pass through the display screen When the target paper is observed, a virtual line draft of the original picture is obtained. The user observes the display screen through the screen, fills the corresponding color in the blank area of the virtual line draft, and completes the painting.

Regarding the calculation of the projection relationship, such as the patent 201610420931.6 "A Method for Augmenting Virtual Reality Glasses Using a Monocular Camera of a Mobile Phone" to complete the calculation of the projection relationship and the proportional relationship.

As a preferred embodiment, the auxiliary system is an intelligent mobile terminal, including a camera as a video acquisition unit, a processor as an image processing unit, and a display screen as the projection display unit.

It also includes a storage unit, a wireless communication unit, and a remote server. The storage unit stores the line images generated by the image processing unit and the drawings completed by the user; the wireless communication unit sends them to the remote server, and the remote server sends them to the remote server. The users in the system are open, and the users in the system give evaluation scores to the paintings, and set the download costs of paintings and corresponding line images according to the evaluation scores, such as paid downloads, etc.

During the drawing process, the video acquisition unit acquires the process video of the painter's painting and sends it to the remote server for storage. When other users in the system download their corresponding line images, they can choose to download to the extended display screen or split screen. The user plays the process video and gives drawing instructions.

In order to be able to securely fix the mobile phone while keeping the relative positions of the mobile phone and the paper fixed, as a preferred embodiment, there is also a fixed frame for fixing the mobile smart terminal; the fixed frame includes four fixed blocks 1, each fixed block The opposite inner corners are provided with rectangular notches 11 to fix the four corners of the standard projection target paper, the fixed blocks 1 are connected by connecting rods 2 to form the four corners of the rectangle; brackets are fixed on the two fixed blocks 1 close to the user 3. The mobile terminal is fixed on the beam 5 of the bracket 3 .

In order to adapt to drawing papers of different sizes and users of different heights and sitting postures, as a preferred embodiment, the connecting rod 2 is a telescopic connecting rod, and the telescopic parts at both ends control the telescopic feeding length through fixing bolts 21 ,As shown in Figure 6. Correspondingly, the beam 5 is a telescopic beam with adjustable height.

As an embodiment selected later, the fixing block 1 is provided with bolts 12 for pressing the paper.

The above is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto, any person familiar with the technical field within the technical scope disclosed in the present invention, according to the technical solution of the present invention Any equivalent replacement or change of the inventive concepts thereof shall fall within the protection scope of the present invention.

Claims (6)

1. a kind of drawing accessory system based on AR augmented realities and wireless communication technology, it is characterised in that include：

Video acquisition unit, obtains the original image of target object and scenery；

Graphics processing unit, processes described original image, generates lines image corresponding with original image；

Projection display unit, obtains the size and screen of the current height of system and standard target paper relative to target criteria The deflection angle and screen size of paper, calculates lines image that user observed by the display screen in target basis The projection relation of the lines image on, shows the lines through projection relation adjustment in the display screen in projection display unit Image so that when user passes through display screen object observing paper, that is, obtain the dummy line original text of the original image；User, Corresponding color is filled in the white space of dummy line original text, drawing is completed；

Also include, memory cell and wireless communication unit, and remote server, described memory cell is stored by image procossing The drawing that the lines image and user that unit is generated is completed；Sent to remote server by wireless communication unit, by arranging Disclose to user in system in remote server, give evaluation score for drawing by user in system, paint by evaluation score setting Draw and correspondence lines image downloads cost；

In painting process, described video acquisition unit obtains the process video of the drawing of painter, sends to remote server Storage, when other users download its correspondence lines image in system, to download user's playing process video, gives drawing and refers to Lead.

2. the drawing accessory system based on AR augmented realities and wireless communication technology according to claim 1, which is special It is intelligent mobile terminal to levy and also reside in described accessory system, including the camera as video acquisition unit, at as image The processor and the display screen as the projection display unit of reason unit.

3. the drawing accessory system based on AR augmented realities and wireless communication technology according to claim 1, which is special Levy and also reside in the fixed mount with fixed mobile intelligent terminal；

Described fixed mount includes four fixed blocks (1), and the relative interior angle of each fixed block is provided with the fixation standard and throws The rectangular indentation (11) of the corner of shadow target paper, fixed block (1) are connected by connecting rod (2), form four angles of rectangle；

Support (3) is fixed with two fixed blocks (1) for being close to user, fixed described shifting on the crossbeam (5) of support (3) Dynamic terminal.

4. the drawing accessory system based on AR augmented realities and wireless communication technology according to claim 3, which is special It is shrinking connecting-rod to levy and also reside in described connecting rod (2), and the pars contractilis at two ends is by the control telescopic feed length of fixing bolt 21.

5. the drawing accessory system based on AR augmented realities and wireless communication technology according to claim 3, which is special It is telescoping crossbeam to levy and also reside in described crossbeam (5), height adjustable.

6. the drawing accessory system based on AR augmented realities and wireless communication technology according to right will go 1, which is special Levy to also reside in and there is on described fixed block (1) bolt (12) for compressing paper.