TWI662355B - Image background removing system, image background changing apparatus, image background removing method, and computer program product thereof - Google Patents

Abstract

An embodiment of the present invention provides an image background removal method. The method includes the following steps: shooting a target object to obtain an object image; determining whether a target object image of the target object can be obtained from the object image; if yes, Remove the background of the target object from the object image and obtain a target object image corresponding to the target object; and if not, switch the background of the target object, and then remove the background of the target object from the object image to obtain a The target object image of the target object.

Description

Image background removal system, image background replacement device, image background removal method, and computer program product thereof

One embodiment of the present invention relates to image processing, and in particular, to an image background removal system, an image background replacement device, an image background removal method, and a computer program product thereof.

With the advancement of technology, there are many applications that need to use background-free object images, such as e-commerce websites, presentation production, and so on. For example, a typical user will use his mobile device (such as a smartphone or tablet computer) to capture an object, and the obtained object image usually includes a foreground portion and a background portion. However, if the object image contains a complex background part, it is difficult for a conventional background image removal program to completely remove the background part and retain only the objects in the foreground part. In addition, users need to manually operate similar programs to remove unwanted background parts, which will waste a lot of time.

An embodiment of the present invention provides an image background changing device, including: a cabinet, a background screen, a stepping motor, and a microcontroller. The background curtain includes a plurality of curtains. The microcontroller is configured to switch based on The control signal controls the rotation of the stepping motor to switch between the plurality of curtains.

An embodiment of the present invention further provides an image background removal system, which includes an image background replacement device and a mobile device. The image background changing device includes a cabinet, a background curtain, a stepping motor, and a microcontroller. The background curtain includes a plurality of curtains. The mobile device is communicatively coupled to the image background replacement device, and the mobile device includes: an image capture device and a processor. The image capturing device shoots a target object in the box of the image background changing device through a shooting window of the box with the background curtain as a background to obtain an object image. The processor executes an image background removal program to remove a background portion of the object image and obtain a target object image corresponding to the target object. The microcontroller controls the image background changing device to switch the color of the background screen according to a switching control signal from the mobile device.

An embodiment of the present invention further provides an image background removal method. The method includes the following steps: shooting a target object to obtain an object image; judging whether a target object image of the target object can be obtained from the object image; if yes , Remove the background of the target object from the object image and obtain a target object image corresponding to the target object; and if not, switch the background of the target object, and then remove the background of the target object from the object image to obtain a corresponding The target object image of the target object.

An embodiment of the present invention further provides a computer program product. The computer program product loads the program through a processor to execute the image background removal method in the above embodiment.

100‧‧‧Image background removal system

110‧‧‧Image background changing device

111‧‧‧Microcontroller

112‧‧‧Communication Module

113‧‧‧Stepping motor

114‧‧‧Background

115‧‧‧light-emitting device

116‧‧‧light sensor

117‧‧‧Stepper motor controller

118‧‧‧light control board

119‧‧‧printed circuit board

120‧‧‧Box

121‧‧‧ right cover

122‧‧‧Left cover

123‧‧‧ Upper cover

124‧‧‧ Object Platform

1301-1305‧‧‧Roller

131‧‧‧Synchronous Belt

1321-1322‧‧‧pulley

140‧‧‧ mobile device

141‧‧‧Processor

142‧‧‧Communication Module

143‧‧‧Memory Unit

144‧‧‧Storage device

145‧‧‧display

146‧‧‧Image background removal program

147‧‧‧Image capture device

150‧‧‧ Cloud Server

151‧‧‧Database

S310-S370‧‧‧step

410‧‧‧ Object image

420‧‧‧ grayscale object image

430‧‧‧Partial image area

431, 432‧‧‧ pixels

433‧‧‧closed contour

440‧‧‧Target object image area

451, 452, 453‧‧‧‧some object outlines

4201‧‧‧The first grayscale object image

4202‧‧‧Second grayscale object image

4203‧‧‧ Third grayscale object image

460‧‧‧closed contour

470‧‧‧ synthetic grayscale image

S510-S565‧‧‧step

FIG. 1 is a functional block diagram of an image background removal system according to an embodiment of the present invention.

FIG. 2A is a perspective view showing an image background removal system according to an embodiment of the present invention.

FIG. 2B is another oblique view of the image background removal system in the embodiment according to FIG. 2A of the present invention.

FIG. 2C is an exploded view showing an image background removal system in the embodiment according to FIG. 2A of the present invention.

FIG. 3 is a flowchart showing a pre-processing of an image background removal method according to an embodiment of the present invention.

FIG. 4A is a schematic diagram showing the shooting of a target object using an image background removal system according to an embodiment of the present invention.

FIG. 4B is a schematic diagram showing a part of the grayscale object image in the embodiment according to FIG. 4A of the present invention.

FIG. 4C is a schematic diagram showing the outline of the object image in the embodiment according to FIG. 4A of the present invention.

FIG. 4D is a schematic diagram showing the outline of the grayscale object image according to the embodiment of FIG. 4A of the present invention.

FIG. 4E is a schematic diagram showing a user interface of an image background removal program in the embodiment according to FIG. 4A of the present invention.

FIG. 4F is a schematic diagram showing a first gray-scale object image according to an embodiment of the present invention.

FIG. 4G is a schematic diagram showing a second grayscale object image according to an embodiment of the present invention.

FIG. 4H is a schematic diagram showing a third grayscale object image according to an embodiment of the present invention.

FIG. 4I is a schematic diagram showing a synthetic gray-scale object image according to an embodiment of the present invention.

5A-5B are flowcharts illustrating a method for removing background of an image according to an embodiment of the present invention.

In order to make the foregoing objects, features, and advantages of the embodiments of the present invention more comprehensible, the following detailed description is given in conjunction with the accompanying drawings.

FIG. 1 is a functional block diagram of an image background removal system according to an embodiment of the present invention.

As shown in FIG. 1, the image background removal system 100 includes an image background replacement device 110 and a mobile device 140. The image background changing device 110 is coupled to the mobile device 140, and the image background changing device 110 and the mobile device 140 may be communicatively coupled through a wireless communication protocol (such as Bluetooth, near field communication, etc.). The image background changing device 110 includes a microcontroller 111, a communication module 112, a stepper motor 113, a background curtain 114, a light emitting device 115, and a light detector 116, And a stepping motor controller 117. The microcontroller 111 and the communication module 112 can be placed on a printed circuit board 119, for example.

The communication module 112 includes, for example, a transceiver, which can support one or more wireless communication protocols, such as Bluetooth, low-power Bluetooth Bluetooth (Bluetooth Low Energy, BLE), wireless fidelity (Wifi), and / or near-field communication, etc., but the embodiments of the present invention are not limited thereto.

The background curtain 114 includes a plurality of monochrome curtains (for example, matte curtains), such as a white curtain, a black curtain, a blue curtain, a green curtain, and the like. In some embodiments, the plurality of monochrome screens are sequentially connected to form the background screen 114. It should be noted that the monochrome screens of the above colors are for illustration only, and the embodiments of the present invention are not limited thereto. The stepping motor controller 117 is used to control the rotation of the stepping motor 113. The micro-controller 111 transmits the switching control signal from the mobile device 140 to the stepping motor controller 117, and the stepping motor controller 117 is used to control the stepping motor 113 to rotate forward or backward to switch between different colors. The color curtain, its details will be described in the embodiment of FIGS. 2A-2C. In some embodiments, the stepping motor controller 117 can be integrated into the microcontroller 111, which means that the microcontroller 111 can be used as the stepping motor controller of the stepping motor 113.

The light-emitting device 115 includes one or more light-emitting sources, such as a white light-emitting diode (LED), a light bulb, or a lamp tube, for projecting light onto a target object placed in front of the background curtain 114. . It should be noted that each light source has the same specifications, such as the same color temperature, power, color rendering, etc., but the embodiments of the present invention are not limited thereto. In one embodiment, the microcontroller 111 can adjust the light intensity of the light emitting device 115 according to a light control signal from the mobile device 140. In another embodiment, the light sensor 116 is used to detect the ambient light strength inside the box 120 (shown in FIG. 2A) in the image background changing device 110, and detects the ambient light strength. The ambient light intensity is reported to the microcontroller 111. Microcontroller 111 is based on light sensing The intensity of the ambient light detected by the device 116 is used to control the light intensity of the light projected by the light emitting device 115 onto the target object. In some embodiments, the light sensor 116 and the light emitting device 115 may be integrated into a light control board 118.

In one embodiment, the mobile device 140 includes a processor 141, a communication module 142, a memory unit 143, a storage device 144, a display screen 145, and an image capture device 147.

The processor 141 is, for example, a central processing unit (CPU) or a digital signal processor (DSP), but the embodiment of the present invention is not limited thereto. The communication module 142 includes, for example, a transceiver that can support one or more wireless communication protocols, such as Bluetooth, Bluetooth Low Energy (BLE), Wifi, and near-field communication (near- field communication), Code Division Multiple Access (CDMA), Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), 3G, 4G, etc. However, the embodiments of the present invention are not limited thereto. For example, the processor 141 is connected to the communication module 112 in the image background changing device 110 through the communication module 142 to communicate with the microcontroller 111, such as transmitting a switching control signal and / or a light control signal, or It receives sensing data from the light sensor 116, but the embodiment of the present invention is not limited thereto.

The memory unit 143 is a volatile memory, such as a dynamic random access memory (DRAM), and is used to store image data during background removal processing. The storage device 144 is a non-volatile memory, such as a hard disk drive, a solid-state disk, or a flash memory. Invention Implementation Examples are not limited to this. The image capturing device 147 may be, for example, a camera, which may be composed of a plurality of image sensors, a color filter array, and a lens (not shown). The image sensor may be, for example, a photosensitive coupling element ( Charge coupled device (CCD) sensors, or complementary metal-oxide semiconductor (CMOS) sensors, but embodiments of the present invention are not limited thereto. The display screen 145 is, for example, a touch screen.

In one embodiment, the storage device 144 records an image background removal program 146. When the image background removal program 146 is executed by the processor 141, it may send a switching control signal and / or a light control signal to the microcontroller 111 to switch the background curtain 114 or adjust the light intensity emitted by the light emitting device 115. In addition, the image background removal program 146 and the image capture device 147 are used to capture the target object to obtain an object image (for example, a color image), and the background of the object image is processed to obtain the object image related to the target object. One of the target object images (foreground image).

For example, the processor 141 reads the image background removal program 146 from the storage device 144 to the memory unit 143 and executes the image background removal program 146. The details of the image background removal program 146 and its details and the image background replacement device 110 are used. The interactive operation will be detailed later.

In one embodiment, the image background removal system 100 further includes a cloud server 150 which is coupled to the mobile device 140 through a wired or wireless communication protocol. The cloud server 150 includes a database 151. The target object image (foreground image) obtained by the mobile device 140 after executing the image background removal program 146 on the background of the object image can be transmitted to the wired or wireless network to The cloud server 150 is stored in the database 151. The user can use the image background removal system 100 to shoot different target objects and obtain corresponding target object images, and store them in the database 151 of the cloud server 150. When necessary, the user can access the previously stored target object image from the database 151 of the cloud server 150.

FIG. 2A is a perspective view showing an image background removal system according to an embodiment of the present invention. FIG. 2B is another oblique view of the image background removal system in the embodiment according to FIG. 2A of the present invention. FIG. 2C is an exploded view showing an image background removal system in the embodiment according to FIG. 2A of the present invention.

As shown in FIG. 2A, the image background changing device 110 further includes a box 120, and the components 111 to 116 in the image background changing device 110 are placed in the box 120, and details thereof will be described later. A photographing window 126 is provided on the front surface 125 of the box 120, and a fixing clip 127 is attached to the front surface 125 to fix the mobile device 140. Therefore, the user can use the fixing clip 127 to fix the mobile device 140 on the front surface 125 of the image background changing device 110, and the front lens or main lens (not shown) of the mobile device 140 can be viewed through the shooting window 126 and the background curtain 114 as The background is photographed toward a target object placed inside the box 120 (for example, on the object platform 124 (shown in FIG. 2B)). FIG. 2B is an oblique view obtained by removing the left cover 122 and the upper cover 123 in FIG. 2A.

As shown in FIGS. 2B and 2C, the image background changing device 110 further includes a right cover 121, a left cover 122, an upper cover 123, and an object platform 124. For example, the object platform 124 can be fixed in the box 120 and placed horizontally, and the target object can be placed on the object platform 124 for shooting by the mobile device 140, and its background is one of the background curtains 114. Monochrome curtain. Right cover 121, left cover 122, The top cover 123 and the top cover 123 can be respectively embedded or fixed on the right, left, and top of the box 120, and the user can lift the right cover 121, the left cover 122, or the top cover 123 to conveniently place the target object in the box 120 Object platform 124. In one embodiment, the box 120, the right cover 121, the left cover 122, and the upper cover 123 are all made of opaque materials. When the mobile device 140 shoots a target object placed on the object platform 124, The right cover 121, the left cover 122, and the upper cover 123 are placed at corresponding positions of the box 120, so that the inside of the box 120 is not easily interfered by the external ambient light of the box 120.

In addition, the image background changing device 110 further includes rollers 1301 to 1305, a timing belt 131, and timing pulleys 1321 and 1322. These components can be combined into the structure shown in FIG. 2B and combined with The background curtain 114 and the stepping motor 113 operate in combination with each other. For example, the timing belt 131 and the pulleys 1321 to 1322 can be regarded as a driving assembly coupled to one of the stepping motors 113. The rollers 1301 to 1305 can be regarded as a roller assembly, which is linked with the driving assembly. The roller assembly can be divided into, for example, a first roller group (including rollers 1301 and 1302), a second roller group (including rollers 1304 and 1305), and a first roller (such as roller 1303). For example, please refer to FIG. 2B. The timing belt 131 is provided on the pulleys 1321 and 1322 (for example, it can be sleeved on the pulleys 1321 and 1322), and the stepping motor 113 is used to control the pulley 1321 (for example, the first pulley). Turn. When the pulley 1321 rotates, it drives the pulley 1322 (for example, the second pulley) through the timing belt 131 to rotate. The pulley 3122 can, for example, drive the roller assembly to rotate. For example, the pulley 1322 is coupled to the first roller. For example, the pulley 1322 is connected and linked with the roller 1301 in the first roller group. Therefore, when the pulley 1322 is rotated, the roller 1301 is rotated. Since the rollers 1301 and 1302 are paired roller groups, the rollers 1302 will be linked as the rollers 1302 rotate. In addition, The background curtain 114 is arranged on the first roller group (including rollers 1301 and 1302), the second roller group (including rollers 1304 and 1305), and a first roller (such as roller 1303). Therefore, the first roller group can drive the second roller group and the first roller to rotate through the background curtain 114. In some embodiments, the plane formed by the roller 1302 and the roller 1304 is perpendicular to the plane formed by the roller 1304 and the roller 1303.

For the rollers 1301 to 1305, the roller 1301 is driven by the pulley 1322, so it can be regarded as a driving shaft. The rollers 1302 ~ 1305 can be regarded as driven shafts. If looking from the left side of the box 120 to the box 120, when the stepper motor 113 controls the pulley 1321 to rotate clockwise, it will drive the pulley 1322 and the roller 1301 to rotate clockwise, so the background curtain 114 will move down at this time. To switch between different color curtains. When the stepper motor 113 controls the pulley 1321 to rotate counterclockwise, it will drive the pulley 1322 and the roller 1301 to rotate counterclockwise, so the background curtain 114 will move upward at this time to switch the curtains of different colors.

Therefore, the microcontroller 111 can receive the switching control signal from the mobile device 140, and control the stepping motor 113 to rotate forward or backward through the stepping motor controller 117, thereby switching between different color sheets in the background curtain 114. Color curtain. In addition, the light control board 118 having the light emitting device 115 thereon can be mounted on the inside of the upper cover 123 or the left cover 122 and the right cover 121, for example, and can project light toward a target object placed on the object platform 124.

FIG. 3 is a flowchart showing a pre-processing of an image background removal method according to an embodiment of the present invention.

In step S310, the power of the image background changing device 110 is turned on. For example, the user can use a power switch (not shown) to turn on the power of the image background replacement device 110.

In step S320, the image background changing device 110 is connected to the mobile device 140. Taking the Bluetooth low energy communication protocol as an example, the image background replacement device 110 and the mobile device 140 need to be paired before performing the image background removal method, and the image background replacement device 110 can be connected to the mobile device 140 after the pairing is completed.

In step S330, the target object is placed on the object platform 124 in the image background changing device 110. For example, the user may first remove the upper cover 123, the left cover 122, or the right cover 121 of the image background changing device 110 from the box 120 to conveniently place the target object on the object platform 124.

In step S340, the mobile device 140 is fixed to the shooting window 126 of the image background changing device 110. For example, the user can use the fixing clip 127 to fix the mobile device 140 to the shooting window 126 on the front surface 125 of the image background changing device 110, so that the mobile device 140 can focus on the target object placed on the object platform 124.

In step S350, the image background removal program 146 is executed by the mobile device 140. For example, the image background removal program 146 displays a user interface on the display screen 145 of the mobile device 140, such as a preview screen including a camera button and a target object. The user can use the camera button on the user interface or use the physical buttons on the mobile device 140 to shoot the target object.

In step S360, the light sensor 116 of the image background changing device 110 is used to detect the ambient light and adjust the light intensity of the light emitting device 115. Before the mobile device 140 shoots the target object, the microcontroller 111 determines whether the sensing data from the light sensor 116 (such as the ambient light intensity around the target object) meets the shooting conditions. For example, the ambient light intensity needs to be within a certain range. Within range. That is, when the ambient light intensity around the target object is too high or too low, before shooting the target object, the microcontroller 111 will control the light emitting device 115 to adjust the emitted light intensity so that the ambient light intensity can meet the shooting conditions.

In step S370, the image capturing device 147 of the mobile device 140 is used to shoot the target object located on the object platform 124 to obtain an object image.

FIG. 4A is a schematic diagram showing the shooting of a target object using an image background removal system according to an embodiment of the present invention. FIG. 4B is a schematic diagram showing a part of the grayscale object image in the embodiment according to FIG. 4A of the present invention. FIG. 4C is a schematic diagram showing the outline of the object image in the embodiment according to FIG. 4A of the present invention. FIG. 4D is a schematic diagram showing the outline of the grayscale object image according to the embodiment of FIG. 4A of the present invention. FIG. 4E is a schematic diagram showing a user interface of an image background removal program in the embodiment according to FIG. 4A of the present invention.

In an embodiment, if the background screen 114 is switched to a white screen, after the mobile device 140 finishes shooting the target object to obtain the object image 410 (for example, an RGB color image), the image background removal program 146 will The image 410 is subjected to image processing to obtain a corresponding gray-scale object image 420, as shown in FIG. 4A.

Next, the image background removal program 146 uses the gray-scale object image 420 to detect the image edge of the target object. For example, because a white screen is used, the brightness value of the background portion in the grayscale object image 420 is equal to or close to 255. As shown in FIG. 4B, in a part of the image area 430 in the grayscale object image 420, the brightness value of a plurality of pixels 431 is 0, and the brightness value of the pixel 432 to the right of the pixel 431 is 255. Therefore, the image background removal program 146 can be determined in pixels There are image edges between 431 and pixels 432. In detail, the image background removal program 146 can calculate the difference between any two adjacent pixels in the grayscale object image 420 and determine whether the difference is greater than a predetermined threshold. If so, it can be determined that there is an image edge between the selected two adjacent pixels, and the selected two adjacent pixels can be referred to as edge pixels. In this way, the image background removal program 146 can obtain the edge pixels in the grayscale object image 420.

Next, the image background removal program 146 connects the obtained edge pixels, and determines whether the connected edge pixels can form a closed contour of the target object. If the closed contour 433 of the target object can be formed, the image background removal program 146 marks the closed contour 433 in the gray-scale object image 420, as shown in FIG. 4C.

The image background removal program 146 applies the closed contour 433 obtained in the grayscale object image to the object image 410, and sets the image area within the closed contour 433 in the object image 410 as the target object image area 440, and A corresponding message is presented on the user interface to allow the user to select the target object image area to be retrieved. The message is, for example, "Please select an object to be retrieved", as shown in FIG. 4D. In this embodiment, a target object image area is used for description, so the user can click the target object image area 440 on the display screen 145 to select the target object to be taken out. If multiple closed contours are obtained from the gray-level object image, the user can click an image area in one of the closed contours on the display screen 145 to select a target object to be retrieved.

After the user selects an object on the user interface of the image background removal program 146, the image background removal program 146 will display corresponding options on the user interface, such as: "Remove" and "Cancel", as shown in Figure 4E. Show. When the user clicks the “Remove” option on the display screen 145 of the mobile device 140, the image background removal program 146 takes out the object image area 440 within the closed outline from the object image 410 and removes the background portion 450 (that is, the target object An image area other than the image area 440), and save the background-free object image as an image file, such as a portable network graphics (Portable Network Graphics; PNG) format image file. It should be noted that the image area outside the target object image area 440 in the image file is recorded in the form of transparent pixels.

FIG. 4F is a schematic diagram showing a first gray-scale object image according to an embodiment of the present invention. FIG. 4G is a schematic diagram showing a second grayscale object image according to an embodiment of the present invention. FIG. 4H is a schematic diagram showing a third grayscale object image according to an embodiment of the present invention.

The image background removal program 146 may not be able to find the complete closed contour in the gray-level object image through the single-color background curtain 114, but obtain a part of the object contour. In one embodiment, the background screen 114 includes a white screen, a black screen, and a gray screen. As shown in FIG. 4F, when the image background removal program 146 uses the white curtain in the background curtain 114 to take a picture of the target object (for example, it can be called the first shooting cycle), the first gray level can be generated from the obtained object image Object image 4201. In addition, because the grayscale values of some pixels of the target object are similar to the white background, the image background removal program 146 can only obtain a partial object outline 451 from the first grayscale object image 4201. It should be noted that the first gray-level object image 4201 and part of the object contour 451 are both stored in the memory unit 113. Next, the image background removal program 146 judges that the closed contour of the target object cannot be obtained, and sends a switching control signal to the microcontroller 111, so as to control the stepping motor 113 to rotate to switch to another color curtain in the background curtain 114. E.g. black screen.

As shown in FIG. 4G, the image background removal program 146 uses the black screen in the background screen 114 to take a picture of the target object (for example, it can be called a second shooting cycle), and generates a second gray from the obtained object image Step object image 4202. Because the grayscale values of some pixels of the target object are similar to the black background, the image background removal program 146 can only obtain a partial object outline 452 from the second grayscale object image 4202. It should be noted that the second gray-level object image 4202 and some object contours 452 are all stored in the memory unit 113. Next, the image background removal program 146 judges that the closed contour of the target object cannot be obtained, and sends a switching control signal to the microcontroller 111, so as to control the stepping motor 113 to rotate to switch to another color curtain in the background curtain 114. For example, a gray curtain.

As shown in FIG. 4H, the image background removal program 146 uses the gray screen in the background screen 114 to take a picture of the target object (for example, it can be called a third shooting cycle), and generates a third gray from the obtained object image. Step object image 4203. Because the grayscale values of some pixels of the target object are similar to the gray background, the image background removal program 146 can only obtain part of the object outline 453 from the third grayscale object image 4203. It should be noted that the third grayscale object image 4203 and part of the object outline 453 are all stored in the memory unit 113. Then, the image background removal program 146 judges that the closed outline of the target object cannot be obtained. However, at this time, the curtains of different colors in the background curtain 114 have been used to shoot the target object.

FIG. 4I is a schematic diagram showing a synthetic gray-scale object image according to an embodiment of the present invention. As shown in FIG. 4I, the image background removal program 146 performs an image synthesis process on the first grayscale object image 4201, the second grayscale object image 4202, and the third grayscale object image 4203 to generate a synthetic grayscale image. 470, and some object outlines 451 ~ 453 are shown on the synthetic grayscale image 470. Therefore, the image background removal program 146 can obtain the closed contour 460 of the target object based on the contours 451 to 453 of some objects. Then, the image background removal program 146 can segment the target object image area from one of the object images in the above process according to the closed contour 460, for example, an object image captured using a white curtain as a reference.

In some embodiments, the background curtain 114 may include curtains of more than three colors, and the image background removal program 146 may use a curtain of different colors to repeatedly shoot the target object for a predetermined number of times, and then start image synthesis processing to generate a composite Grayscale image 440. In some embodiments, if the background curtain 114 of a different color is replaced, the image background removal program 146 can obtain the closed outline of the target object from the grayscale object image, and the image background removal program 146 can obtain the closed outline from the obtained closed outline. Take out the target object image area from the object image and remove the background, and store the background-removed object image. For example, it can be saved as an image file in PNG format, but the embodiment of the present invention is not limited to this.

5A-5B are flowcharts illustrating a method for removing background of an image according to an embodiment of the present invention. In step S510, a target object placed in the image background changing device 110 is photographed by using the mobile device 140 to obtain an object image. For example, after the pre-processing of FIG. 3, the user can press the camera button in the user interface of the image background removal program 146 on the display screen 145 of the mobile device 140 to start taking pictures of the target object. . When the target object is shot for the first time, the image background removal program 146 may first notify the microcontroller 111 to switch the background screen 114 to a predetermined color screen, such as a white screen, but the embodiment of the present invention does not This is the limit. It should be noted that the target The first shooting cycle of the target object is called the first shooting cycle; the second shooting of the target object is called the second shooting cycle, and so on.

In step S515, image processing is performed on the object image to obtain a grayscale object image corresponding to the object image. For example, the object image is, for example, an RGB image, and each pixel in the object image may be subjected to a matrix operation to obtain the brightness value of each pixel, which is also referred to as a grayscale value. A grayscale object image is an image composed of the grayscale values of each pixel in the object image.

In step S520, one or more image edges are detected from the grayscale object image. For the technique of detecting the edge of an image from a gray-scale object image, for example, refer to the embodiments shown in FIGS. 4A to 4E, or other edge processing techniques in image processing can be used. Those skilled in the art of the embodiments of the present invention can understand Different detection image edge detection technology, so its details will not be repeated here.

In step S525, the one or more image edges are marked in the grayscale object image. For example, the image background removal program 146 can display the grayscale object image and the edge or edges of the image on the display screen 145.

In step S530, it is determined whether the one or more image edges form a closed contour. If yes, go to step S555; if not, go to step S535. In some embodiments, steps S515 to S530 can be simplified, for example, to determine whether a closed contour corresponding to the target object can be obtained based on the object image. If yes, go to step S555; if not, go to step S535.

In step S535, it is determined whether the target object has been photographed a predetermined number of times. If yes, go to step S550; if no, go to step S540.

In step S540, the image background changing device 110 is controlled to switch the color of the background curtain 114. For example, the background curtain 114 may include a white curtain, Black, gray, and other colors. When the image background removal program 146 determines that it is necessary to change the background of another color to shoot the target object (for example, no closed contour is found), the processor 141 sends a switching control signal to the microcontroller 111 to control the stepping motor 113 to rotate to Switch to a background curtain of another color, and return to step S510.

In step S550, an image synthesis process is performed on the edge of the one or more images in the corresponding grayscale object images in different shooting cycles to obtain the closed contour. In some embodiments, the corresponding grayscale object image in each shooting cycle will have one or more image edges, such as shown in Figures 4F, 4G, and 4H, and may not form a closed contour, so it is necessary to Image synthesis processing is performed on one or more image edges of gray-level object images in different shooting cycles to obtain a closed contour.

In step S555, the closed contour is marked in the object image. For example, the image background removal program 146 can display the object image and the closed outline on the display screen 145, so that the user can know the target object obtained by the image background removal program 146, as shown in FIG. 4C or 4I. . In some embodiments, the user may click the user interface of the image background removal program 146 to select the target object and perform the background removal process.

In step S560, an image area within the closed contour of the object image is set as a target object image area, and a background area outside the target object image area is removed from the object image to obtain a target object image. . In some embodiments, the target object image is shown in FIG. 4E.

In step S565, the target object image is uploaded to a cloud server. For example, the cloud server 150 includes a database 151. The image background removal system 100 is used to shoot different target objects and obtain corresponding target object images, and store them in the database 151 of the cloud server 150. When necessary, the user can access the previously stored target object image from the database 151 of the cloud server 150. In some embodiments, step S565 may be omitted. For example, the target object image obtained by the user using his mobile device may be stored in his mobile device.

In summary, the embodiments of the present invention provide an image background removal system, an image background replacement device, an image background removal method, and a computer program product, which allow users to easily use the image background replacement device and mobile device in different Shoot different target objects under the simple background, and remove the background part from the object image to get the target object image. In addition, the obtained images of different target objects can be uploaded to a cloud server to facilitate user management and utilization.

Although the present invention is disclosed by the embodiments as above, it is not intended to limit the scope of the embodiments of the present invention. Any person with ordinary knowledge in the technical field can do a little without departing from the spirit and scope of the embodiments of the present invention. Changes and retouching, therefore, the protection scope of the embodiments of the present invention shall be determined by the scope of the attached patent application.

Claims (20)

An image background changing device includes: a cabinet; a background curtain placed in the cabinet and including a plurality of curtains; a stepping motor; and a microcontroller coupled to the stepping motor, and It is configured to control the rotation of the stepping motor to switch between the plurality of curtains according to a switching control signal. The image background changing device as described in the first item of the patent application scope, wherein each of the background screens has a different color. The image background changing device described in item 1 of the scope of the patent application, wherein the switching control signal is from a mobile device that is communicatively coupled with the image background changing device. The image background replacement device described in item 1 of the patent application scope further includes: a right cover, a left cover, and an upper cover, which are respectively embedded or fixed on the right, left, and top of the box; and an object The platform is fixed in the box and placed horizontally. The image background replacement device described in item 1 of the scope of patent application, further includes: a light emitting device disposed in the box and configured to project light on a target object placed on an object platform in the box And a light sensor placed in the box and configured to detect an ambient light intensity in the box; wherein the microcontroller is based on the ambient light intensity detected by the light sensor, A light intensity of the light projected by the light emitting device to the target object is controlled. According to the image background replacement device described in item 1 of the scope of patent application, one of the front surfaces of the box is provided with a shooting window and a fixing clip, and the fixing clip is configured to fix a mobile device to the box. The shooting window on the front surface. The image background replacement device described in item 1 of the scope of the patent application, further includes: a driving assembly coupled to the stepping motor; and a roller assembly interlocking with the driving assembly; wherein the background screen Is arranged on the roller assembly, thereby being driven by the roller assembly to switch between the plurality of curtains. The image background changing device according to item 7 of the scope of patent application, wherein the driving assembly includes: a first pulley, coupled to the stepper motor, and the stepper motor controls the rotation of the first pulley; A second pulley; and a timing belt disposed on the first pulley and the second pulley, and driving the rotation of the second pulley through the rotation of the first pulley; wherein the second pulley drives the roller The assembly rotates. The image background replacement device according to item 8 of the scope of patent application, wherein the roller assembly includes a first roller group coupled to the second pulley, and the second roller drives the first roller Rotation of the group; a second roller group; and a first roller; wherein the background curtain is disposed on the first roller group, the second roller group, and the first roller, and the The first roller group drives the second roller group and the first roller to rotate through the background curtain. An image background removal system includes: an image background replacement device, including: a cabinet; a background curtain placed in the cabinet and including a plurality of curtains; a microcontroller; and a mobile device, a communication coupling Connected to the image background replacement device, and comprising: an image capture device; and a processor; wherein the image capture device is placed against the image background through a shooting window of the box against the background curtain A target object in the box of the replacement device is photographed to obtain an object image; wherein the processor executes an image background removal program to remove a background portion of the object image and obtain a target object corresponding to the target object Image; wherein the microcontroller switches the color of the background backdrop according to a switching control signal from the mobile device to control the image background changing device; wherein the object image is a color image and the processor is to the object The image is subjected to image processing to obtain one or more image edges. The image background removing system as described in item 10 of the scope of patent application, wherein each of the background screens has a different color. According to the image background removal system described in item 10 of the patent application scope, wherein the processor further determines whether the edge of the one or more images constitutes a closed contour; if so, the processor applies the closed contour to the object image , And obtain a target object image area within the closed contour in the object image, and remove a background area outside the target object image area from the object image to obtain a target object image; if not, the The processor determines whether the target object has been photographed for a predetermined number of times. The image background removal system described in item 12 of the scope of patent application, wherein, if the target object has been shot for the predetermined number of times, the processor performs an image of the one or more image edges corresponding to different shooting cycles. Synthesis processing to obtain the closed outline; if the target object is not shot for the predetermined number of times, the processor sends the switching control signal to the processor to control the image background changing device to switch the color of the background curtain and use the The image capturing device shoots the target object with the background screen after switching colors as the background. The image background removal system described in item 10 of the patent application scope further includes a cloud server, and the processor further uploads the target object image to a database of the cloud server. An image background removal method includes: shooting a target object to obtain an object image; determining whether a target object image of the target object can be obtained from the object image; and if so, removing the background of the object image from the object image and Obtain the target object image corresponding to the target object; and if not, switch the background of the target object, then re-shoot the target object to obtain the object image, and remove the background of the target object from the object image to obtain a corresponding The target object image of the target object. The image background removal method described in item 15 of the scope of patent application, wherein the object image is a color image, and determining whether the target object image corresponding to the target object can be obtained from the object image includes: the object image is performed An image is processed to obtain one or more image edges. The image background removal method described in item 16 of the scope of patent application, wherein determining whether the target object image corresponding to the target object can be obtained based on the object image further includes: determining whether the edge of the one or more images constitutes a seal Outline; if so, apply the closed outline to the object image, and obtain a target object image area within the closed outline in the object image, and remove the background area outside the target object image area from the object image To obtain the target object image; and if not, determine whether the target object has been shot a predetermined number of times. The image background removal method described in item 17 of the scope of patent application, wherein determining whether the target object image corresponding to the target object can be obtained from the object image further includes: if the target object has been shot for the predetermined number of times, the Perform an image synthesis process on the one or more image edges corresponding to different shooting cycles to obtain the closed contour; and if the target object is not shot for the predetermined number of times, switch the background of the target object and use the switched background Shoot the target object. The image background removing method described in item 15 of the patent application scope further includes uploading the target object image to a database of a cloud server. A computer program product, the computer program product is loaded into the program through a processor to execute the image background removal method as in item 15 of the scope of patent application.