CN106973224B - Control method, control device and electronic device for auxiliary composition - Google Patents

Abstract

The invention discloses a control method for auxiliary composition. The control method comprises the following steps: processing scene data to obtain depth information of a cached main image; acquiring a foreground part of a cached main image according to the depth information; determining the current three-dimensional space structure type according to the foreground part and the orientation; and finding a current composition suggestion in the memory corresponding to the current three-dimensional spatial structure type. In addition, the invention also discloses a control device for assisting composition and an electronic device. The control method, the control device and the electronic device for auxiliary composition determine the current three-dimensional space structure type by using the depth information and the direction sensor information, so that a current composition suggestion corresponding to the current three-dimensional space structure type is obtained, and the composition can be assisted.

Description

Control method, control device and electronic device for auxiliary composition

technical field

The present invention relates to imaging technology, in particular to a control method, control device and electronic device for assisting composition.

Background technique

Composition in photography is a relatively professional skill, and many ordinary consumers do not have this skill, resulting in poor visual effects of images.

SUMMARY OF THE INVENTION

The present invention aims to solve at least one of the technical problems existing in the prior art. Therefore, the present invention needs to provide a control method, a control device and an electronic device for assisting composition.

A control method for assisting composition, for controlling an electronic device, the electronic device includes an imaging device, an orientation sensor and a memory, the imaging device is used for collecting scene data, the scene data includes a cached main image, the orientation sensor For sensing the orientation of the imaging device, the memory stores multiple three-dimensional spatial structure types and corresponding composition suggestions; the control method includes the following steps:

processing the scene data to obtain depth information of the cached main image;

Acquire the foreground part of the cached main image according to the depth information;

determining a current three-dimensional spatial structure type according to the foreground portion and the orientation; and

Searching for a current composition suggestion corresponding to the current three-dimensional spatial structure type in the memory.

A control device for assisting composition, used for controlling an electronic device, the electronic device includes an imaging device, a direction sensor and a memory, the imaging device is used for collecting scene data, the scene data includes a cached main image, the direction sensor For sensing the orientation of the imaging device, the memory stores various three-dimensional spatial structure types and corresponding composition suggestions; the control device includes a processing module, an acquisition module, a determination module and a search module.

The processing module is configured to process the scene data to obtain the depth information of the cached main image.

The obtaining module is configured to obtain the foreground part of the cached main image according to the depth information.

The determining module is configured to determine the current three-dimensional spatial structure type according to the foreground part and the orientation.

The searching module is used for searching the memory for a current composition suggestion corresponding to the current three-dimensional spatial structure type.

An electronic device includes an imaging device, an orientation sensor, a memory, and the control device.

The imaging device is used for capturing a scene image, and the scene image includes a cached main image.

The orientation sensor is used to sense the orientation of the imaging device.

The memory stores various three-dimensional spatial structure types and corresponding composition suggestions.

The control method, control device, and electronic device of the embodiments of the present invention determine the current three-dimensional spatial structure type by using depth information and direction sensor information, thereby obtaining the current composition suggestion corresponding to the current three-dimensional spatial structure type, and then assisting the composition.

Additional aspects and advantages of the present invention will be set forth, in part, from the following description, and in part will be apparent from the following description, or may be learned by practice of the invention.

Description of drawings

The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from the following description of embodiments taken in conjunction with the accompanying drawings, wherein:

FIG. 1 is a schematic flowchart of a control method for auxiliary composition according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of functional modules of an electronic device according to an embodiment of the present invention.

3 is a schematic plan view of an electronic device according to an embodiment of the present invention.

FIG. 4 is a schematic flowchart of a control method according to some embodiments of the present invention.

5 is a functional block diagram of a processing module of a control device of an electronic device according to some embodiments of the present invention.

FIG. 6 is a schematic flowchart of a control method according to some embodiments of the present invention.

FIG. 7 is a schematic diagram of another functional module of a processing module according to some embodiments of the present invention.

FIG. 8 is a schematic flowchart of a control method according to some embodiments of the present invention.

FIG. 9 is a functional block diagram of an acquisition module of a control apparatus according to some embodiments of the present invention.

FIG. 10 is a schematic flowchart of a control method according to some embodiments of the present invention.

FIG. 11 is a schematic flowchart of a control method according to some embodiments of the present invention.

FIG. 12 is a schematic diagram of another functional module of the control device according to some embodiments of the present invention.

FIG. 13 is a schematic diagram of a cached main image according to some embodiments of the present invention.

FIG. 14 is a schematic diagram of a depth image of some embodiments of the present invention.

Figure 15 is a schematic diagram of a three-dimensional space system according to some embodiments of the present invention.

FIG. 16 is a schematic diagram of a three-dimensional space structure of some embodiments of the present invention.

Description of main component symbols:

The electronic device 100, the control device 10, the processing module 11, the first processing unit 112, the second processing unit 114, the third processing unit 116, the fourth processing unit 118, the obtaining module 13, the fifth processing unit 132, the searching unit 134, A determination module 15 , a search module 17 , a control module 19 , an imaging device 20 , an orientation sensor 30 , a memory 40 , and a display 50 .

Detailed ways

Embodiments of the present invention are described in detail below, and embodiments of the present invention are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary, only used to explain the present invention, and should not be construed as a limitation of the present invention.

Please refer to FIG. 1 and FIG. 3 together, the control method of the auxiliary composition according to the embodiment of the present invention can be used to control the electronic device 100 . The electronic device 100 includes an imaging device 20 , an orientation sensor 30 and a memory 40 . The imaging device 20 is used to collect scene data, and the scene data includes a cached main image. The orientation sensor 30 is used to sense the orientation of the imaging device 20 . The memory 40 stores various three-dimensional spatial structure types and corresponding composition suggestions. The control method includes the following steps:

S11: Process the scene data to obtain the depth information of the cached main image;

S13: Acquire the foreground part of the cached main image according to the depth information;

S15: Determine the current three-dimensional spatial structure type according to the foreground part and the orientation; and

S17: Search the memory 40 for a current composition suggestion corresponding to the current three-dimensional spatial structure type.

Specifically, the orientation of the imaging device 20 can be understood as the shooting direction of the imaging device 20. For example, if the imaging device 20 is oriented downward, it means that the imaging device 20 is shooting the scene on the ground; if the imaging device 20 is oriented upward, it means that the imaging device 20 is shooting a scene on the ground. Sky scenes, etc.

Please refer to FIG. 2 and FIG. 3 together. The control device 10 for assisting composition according to the embodiment of the present invention can be used to control the electronic device 100 . The control device 10 includes a processing module 11 , an acquisition module 13 , a determination module 15 and a search module 17 . The processing module 11 is used for processing the scene data to obtain the depth information of the cached main image. The obtaining module 13 is configured to obtain the foreground part of the cached main image according to the depth information. The determining module 15 is configured to determine the current three-dimensional spatial structure type according to the foreground part and the orientation. The searching module 17 is used for searching the memory 40 for the current composition suggestion corresponding to the current three-dimensional spatial structure type.

That is to say, the control method of the embodiment of the present invention may be implemented by the control device 10 of the embodiment of the present invention, wherein step S11 may be implemented by the processing module 11, step S13 may be implemented by the acquisition module 13, and step S15 may be implemented by the determination module 15 To implement, step S17 can be implemented by the search module 17 .

In some embodiments, the control device 10 of the embodiment of the present invention may be applied to the electronic device 100 of the embodiment of the present invention, or the electronic device 100 of the embodiment of the present invention may include the control device 10 of the embodiment of the present invention.

The control method, control device 10 and electronic device 100 according to the embodiments of the present invention determine the current three-dimensional spatial structure type by using the depth information and the direction sensor 30 information, so as to obtain the current composition suggestion corresponding to the current three-dimensional spatial structure type, and then can assist the composition.

In some embodiments, the electronic device 100 includes a cell phone or tablet. In the embodiment of the present invention, the electronic device 100 is a mobile phone.

In some embodiments, imaging device 20 includes a front-facing camera and/or a rear-facing camera. In the embodiment of the present invention, the imaging device 20 is a front camera.

Referring to FIG. 4, in some embodiments, the scene data includes a depth image corresponding to the cached main image, and step S11 includes the following steps:

S112: Process the depth image to obtain the depth data of the cached main image; and

S114: Process the depth data to obtain depth information.

Referring to FIG. 5 , in some embodiments, the scene data includes a depth image corresponding to the cached main image, and the processing module 11 includes a first processing unit 112 and a second processing unit 114 . The first processing unit 112 is used for processing the depth image to obtain the depth data of the buffered main image. The second processing unit 114 is used for processing the depth data to obtain depth information.

That is to say, step S112 may be implemented by the first processing unit 112 , and step S114 may be implemented by the second processing unit 114 .

In this way, the depth information of the cached main image can be quickly obtained by using the depth image.

It can be understood that the cached main image is an RGB color image, and the depth image contains a large amount of depth data, that is, the depth information of each person or object in the scene, and the depth information includes the size and/or range of the depth. Since there is a one-to-one correspondence between the color information of the cached main image and the depth information of the depth image, the depth information of the cached main image can be obtained.

In some embodiments, the acquisition method of the depth image corresponding to the cached main image includes two methods of acquiring the depth image by using structured light depth ranging and acquiring the depth image by using a time of flight (TOF) depth camera.

When a depth image is acquired by using structured light depth ranging, the imaging device 20 includes a camera and a projector.

It can be understood that structured light depth ranging is to use a projector to project a certain pattern of light structures on the surface of an object, and to form a three-dimensional image of a light bar on the surface that is modulated by the shape of the object to be measured. The three-dimensional image of the light strip is detected by the camera to obtain the two-dimensional distortion image of the light strip. The degree of distortion of the light bar depends on the relative position of the projector and the camera and the surface profile or height of the object. The displacement shown along the light bar is proportional to the height of the object's surface, the kinks represent changes in the plane, and the discontinuities show the physical gaps in the surface. When the relative position between the projector and the camera is fixed, the three-dimensional contour of the surface of the object can be reproduced from the coordinates of the distorted two-dimensional light bar image, so that depth information can be obtained. Structured light depth ranging has high resolution and measurement accuracy.

When the TOF depth camera is used to acquire the depth image, the imaging device 20 includes the TOF depth camera.

It can be understood that the TOF depth camera records the phase change of the modulated infrared light emitted from the light-emitting unit to the object and then reflected back from the object through the sensor. According to the speed of light within a wavelength range, the depth distance of the entire scene can be obtained in real time. The TOF depth camera is not affected by the grayscale and features of the object's surface when calculating depth information, and can quickly calculate depth information with high real-time performance.

Referring to FIG. 6, in some embodiments, the scene data includes a cached sub-image corresponding to the cached main image, and step S11 includes the following steps:

S116: Process the cached main image and the cached sub-image to obtain the depth data of the cached main image; and

S118: Process the depth data to obtain depth information.

Referring to FIG. 7 , in some embodiments, the scene data includes a cached secondary image corresponding to the cached main image, and the processing module 11 includes a third processing unit 116 and a fourth processing unit 118 . The third processing unit 116 is configured to process the cached main image and the cached sub-image to obtain the depth data of the cached main image. The fourth processing unit 118 is used for processing depth data to obtain depth information.

That is to say, step S116 may be implemented by the third processing unit 116 , and step S118 may be implemented by the fourth processing unit 118 .

In this way, the depth information of the cached main image can be obtained by processing the cached main image and the cached sub-image.

In some embodiments, imaging device 20 includes a primary camera and a secondary camera.

It can be understood that the depth information can be obtained by the binocular stereo vision ranging method, and the scene data in this case includes a cached main image and a cached sub-image. The cached main image is captured by the main camera, and the cached sub-image is captured by the sub-camera. Binocular stereo vision ranging is to use two identical cameras to image the same subject from different positions to obtain a stereo image pair of the subject, and then use an algorithm to match the corresponding image points of the stereo image pair to calculate the parallax , and finally a triangulation-based method is used to recover the depth information. In this way, the depth information of the cached main image can be obtained by matching the stereoscopic image pair of the cached main image and the cached sub-image.

Referring to FIG. 8, in some embodiments, step S13 includes the following steps:

S132: Obtain the foremost point of the cached main image according to the depth information; and

S134: Find a region that is continuously connected to the frontmost point and whose depth changes continuously as a foreground part.

Referring to FIG. 9 , in some embodiments, the obtaining module 13 includes a fifth processing unit 132 and a finding unit 134 . The fifth processing unit 132 is configured to obtain the foremost point of the cached main image according to the depth information. The finding unit 134 is used to find an area that is continuously connected to the frontmost point and whose depth changes continuously as a foreground part.

That is to say, step S132 may be implemented by the fifth processing unit 132 , and step S134 may be implemented by the searching unit 134 .

In this way, it is possible to obtain the foreground parts that cache the physical connection of the main image, that is, in the real scene, the foreground parts are connected together. Taking the physically connected foreground part as the subject, the relationship of the foreground part can be obtained intuitively.

Specifically, the depth of each pixel in the cached main image is obtained first according to the depth information, and the pixel with the smallest depth is obtained as the frontmost point of the cached main image, and the frontmost point is equivalent to the beginning of the foreground part. Regions where the frontmost points are continuously connected and whose depth varies continuously, these regions and the frontmost points are merged into the foreground region.

It should be noted that the foremost point refers to the pixel point corresponding to the object with the smallest depth, that is, the pixel point corresponding to the object with the smallest object distance or the closest object to the imaging device 20 . Adjacency means that two pixels are connected together. When the depth changes continuously, it means that the depth difference of two adjacent pixels is less than a predetermined difference, or the depths of two adjacent pixels whose depth difference is less than the predetermined difference are continuously changed.

Referring to FIG. 10, in some embodiments, step S13 may include the following steps:

S136: obtain the foremost point of the cached main image according to the depth information; and

S138: Find a region whose depth difference from the frontmost point is smaller than a predetermined threshold as a foreground part.

In this way, the foreground part of the logical connection of the cached main image can be obtained, that is, in the real scene, the foreground part may not be connected together, but it conforms to a certain logical relationship, such as the scene of the eagle diving down to catch the chicken, the eagle and the chicken are physically It may not be connected together, but logically, it can be judged that they are connected.

Specifically, first obtain the frontmost point of the cached main image according to the depth information. The frontmost point is equivalent to the beginning of the foreground part. Diffusion is performed from the frontmost point to obtain the areas whose depth difference from the frontmost point is less than a predetermined threshold. These areas are merged with the frontmost point. for the foreground area.

In some embodiments, the predetermined threshold may be a value set by the user. In this way, the user can determine the range of the foreground part according to his own needs, so as to obtain an ideal composition suggestion and realize an ideal composition.

In some embodiments, the predetermined threshold value may be a value determined by the control device 10, which is not limited herein. The predetermined threshold determined by the control device 10 may be a fixed value stored internally, or may be a value calculated according to different situations, such as the depth of the foremost point.

In some embodiments, step S13 may include the following steps:

Look for areas where the depth is in a predetermined interval as the foreground part.

In this way, a foreground portion whose depth is in a suitable range can be obtained.

It is understandable that in some shooting situations, the foreground part is not the front part, but the front part is slightly behind. The area with the depth in the predetermined interval is used as the foreground part, which can effectively avoid the problem of incorrect subject selection.

In some embodiments, the orientation sensor 30 includes a gravity sensor through which the orientation of the imaging device 20 can be obtained.

In a certain embodiment, the method for determining the current three-dimensional spatial structure type according to the foreground part and the orientation is as follows: first, the orientation of the imaging device 20 is obtained according to the gravity sensor, and the current orientation of the image can be reversed from the orientation of the imaging device 20, such as the current orientation of the image. When the imaging device 20 is facing forward, it can be deduced that the image is distributed before and after, and the image content in the foreground part can be analyzed.

Please refer to FIG. 3 and FIG. 11 together. In some embodiments, the electronic device 100 includes the display 50, and the control method includes the following steps:

S19: Control the display 50 to display the current composition suggestion.

Referring to FIG. 12 , in some embodiments, the control device 10 includes a control module 19 . The control module 19 is used to control the display 50 to display the current composition suggestion.

That is to say, step S19 may be implemented by the control module 19 .

In this way, the user can be informed of the current composition suggestion and guided to operate the electronic device 100, so as to complete the composition according to the current composition suggestion.

It can be understood that, after obtaining the current composition suggestion, the control device 10 needs to inform the user to realize the current composition, and the current composition suggestion is displayed on the display so that the user can quickly understand how to operate.

In some embodiments, the electronic device 100 includes an electro-acoustic device, and the control method includes the following steps:

Control the electro-acoustic device to prompt the current composition suggestion.

In this way, the user can be prompted how to realize the composition by means of voice.

Please refer to FIGS. 13-16 together. In one embodiment, the control device 10 controls the imaging device 20 to obtain scene data. The scene data includes the cached main image as shown in FIG. 13 and the depth image as shown in FIG. 14 . The foreground part of the image can be obtained as the main body of the image, the three-dimensional space system shown in FIG. 15 is established according to the foreground part and the orientation of the imaging device 20 obtained by the direction sensor 30, and then the current three-dimensional space shown in FIG. 16 is determined according to the three-dimensional space system. structure type, and finally find the current composition suggestion corresponding to the current three-dimensional spatial structure type from the memory 40, so as to prompt the user how to complete the current composition.

In the description of the embodiments of the present invention, the terms "first" and "second" are only used for description purposes, and cannot be understood as indicating or implying relative importance or implying the number of indicated technical features. Thus, features defined as "first", "second" may expressly or implicitly include one or more of said features. In the description of the embodiments of the present invention, "plurality" means two or more, unless otherwise expressly and specifically defined.

In the description of the embodiments of the present invention, it should be noted that, unless otherwise expressly specified and limited, the terms "installed", "connected" and "connected" should be understood in a broad sense, for example, it may be a fixed connection or a It is a detachable connection, or an integral connection; it can be a mechanical connection, an electrical connection or can communicate with each other; it can be directly connected or indirectly connected through an intermediate medium, it can be the internal connection of two components or two components interaction relationship. For those of ordinary skill in the art, the specific meanings of the above terms in the embodiments of the present invention can be understood according to specific situations.

In the description of this specification, reference to the terms "one embodiment," "some embodiments," "exemplary embodiment," "example," "specific example," or "some examples" or the like is meant to be used in conjunction with the described embodiments. A particular feature, structure, material or characteristic described by way or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.

Any description of a process or method in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing a specified logical function or step of the process , and the scope of the preferred embodiments of the invention includes alternative implementations in which the functions may be performed out of the order shown or discussed, including performing the functions substantially concurrently or in the reverse order depending upon the functions involved, which should It is understood by those skilled in the art to which the embodiments of the present invention belong.

The logic and/or steps represented in flowcharts or otherwise described herein, for example, may be considered an ordered listing of executable instructions for implementing the logical functions, may be embodied in any computer-readable medium, For use by an instruction execution system, apparatus or apparatus (such as a computer-based system, a system including a processing module, or other system that can fetch instructions from and execute instructions from an instruction execution system, apparatus or apparatus), or in conjunction with such instruction execution system, apparatus or equipment. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport the program for use by or in connection with an instruction execution system, apparatus, or apparatus. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections with one or more wiring (electronic devices), portable computer disk cartridges (magnetic devices), random access memory (RAM), Read Only Memory (ROM), Erasable Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program may be printed, as the paper or other medium may be optically scanned, for example, followed by editing, interpretation, or other suitable medium as necessary process to obtain the program electronically and then store it in computer memory.

It should be understood that various parts of the embodiments of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or a combination of the following techniques known in the art: Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.

Those skilled in the art can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing the relevant hardware through a program, and the program can be stored in a computer-readable storage medium, and the program can be stored in a computer-readable storage medium. When executed, one or a combination of the steps of the method embodiment is included.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically alone, or two or more units may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware, and can also be implemented in the form of software function modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.

The above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, and the like.

Although the embodiments of the present invention have been shown and described above, it should be understood that the above-mentioned embodiments are exemplary and should not be construed as limiting the present invention. Embodiments are subject to variations, modifications, substitutions and alterations.

Claims (15)

1. A control method of auxiliary composition is used for controlling an electronic device, and is characterized in that the electronic device comprises an imaging device, an orientation sensor and a memory, wherein the imaging device is used for collecting scene data, the scene data comprises a buffered main image, and the orientation sensor is used for sensing the orientation of the imaging device; when the imaging device faces downwards, the imaging device is used for shooting scenes on the ground, and the storage stores a plurality of three-dimensional space structure types and corresponding composition suggestions; the control method comprises the following steps:

processing the scene data to acquire depth information of the cached main image;

acquiring a foreground part of the cached main image according to the depth information;

determining a current three-dimensional space structure type according to the foreground part and the orientation: reversely deducing the current orientation of the main cache image from the orientation, wherein when the imaging device faces forwards, the electronic device is perpendicular to the ground, reversely deducing that objects in the main cache image are distributed front and back, analyzing the image content of the foreground part, and determining that the current three-dimensional space structure type is a Chinese character jing when two objects with different colors from the background area exist in the foreground part; and

and searching the current composition suggestion corresponding to the current three-dimensional space structure type in the memory.

2. The control method according to claim 1, wherein the scene data includes a depth image corresponding to the buffered main image, and the step of processing the scene data to obtain the depth information of the buffered main image includes the steps of:

processing the depth image to obtain depth data of the cached main image; and

processing the depth data to obtain the depth information.

3. The control method according to claim 1, wherein the scene data includes a buffer secondary image corresponding to the buffer primary image, and the step of processing the scene data to acquire the depth information of the buffer primary image includes the steps of:

processing the main cache image and the auxiliary cache image to obtain depth data of the main cache image; and

processing the depth data to obtain the depth information.

4. The control method according to claim 1, wherein the step of obtaining the foreground portion of the cached main image based on the depth information comprises the steps of:

obtaining the foremost point of the cache main image according to the depth information; and

and finding a region which is continuously connected with the most front point and continuously changes in depth as the foreground part.

5. The control method according to claim 1, wherein the electronic device includes a display, the control method comprising the steps of:

controlling the display to display the current composition suggestion.

6. A control device for composition assistance, for controlling an electronic device, wherein the electronic device comprises an imaging device, an orientation sensor and a memory, wherein the imaging device is configured to acquire scene data, wherein the scene data comprises a buffered main image, and the orientation sensor is configured to sense an orientation of the imaging device; when the imaging device faces downwards, the imaging device is used for shooting scenes on the ground, and the storage stores a plurality of three-dimensional space structure types and corresponding composition suggestions; the control device includes:

a processing module for processing the scene data to obtain depth information of the cached main image;

the acquisition module is used for acquiring a foreground part of the cached main image according to the depth information;

a determination module for determining a current three-dimensional spatial structure type from the foreground portion and the orientation: reversely deducing the current orientation of the main cache image from the orientation, wherein when the imaging device faces forwards, the electronic device is perpendicular to the ground, reversely deducing that objects in the main cache image are distributed front and back, analyzing the image content of the foreground part, and determining that the current three-dimensional space structure type is a Chinese character jing when two objects with different colors from the background area exist in the foreground part; and

a finding module to find a current composition suggestion in the memory corresponding to the current three-dimensional spatial structure type.

7. The control apparatus of claim 6, wherein the scene data comprises a depth image corresponding to the cached primary image, the processing module comprising:

a first processing unit for processing the depth image to obtain depth data of the cached main image; and

a second processing unit for processing the depth data to obtain the depth information.

8. The control apparatus according to claim 6, wherein the scene data includes a buffer sub-image corresponding to the buffer main image, the processing module includes:

a third processing unit, configured to process the main cache image and the secondary cache image to obtain depth data of the main cache image; and

a fourth processing unit, configured to process the depth data to obtain the depth information.

9. The control apparatus of claim 6, wherein the obtaining module comprises:

a fifth processing unit, configured to obtain a forefront point of the cached main image according to the depth information; and

a finding unit for finding a region continuously connected with the forefront point and continuously changing in depth as the foreground portion.

10. The control device of claim 6, wherein the electronic device includes a display, the control device comprising:

a control module to control the display to display the current composition suggestion.

11. An electronic device, comprising:

an imaging device for acquiring a scene image, the scene image comprising a cached primary image;

a direction sensor for sensing an orientation of the imaging device;

a memory storing a plurality of three-dimensional spatial structure types and corresponding composition suggestions; and

a control device as claimed in any one of claims 6 to 10.

12. The electronic device of claim 11, wherein the electronic device comprises a cell phone or a tablet computer.

13. The electronic device of claim 11, wherein the imaging device comprises a primary camera and a secondary camera.

14. The electronic device of claim 11, wherein the imaging device comprises a camera and a projector.

15. The electronic device of claim 11, wherein the imaging device comprises a TOF depth camera.

Images