CN111432123A - Image processing method and device - Google Patents

Abstract

Embodiments of the present invention provide an image processing method and device. The method includes: acquiring a first image; determining a reference line on the first image; and obtaining a mirror image according to a first sub-image located on a first side of the reference line in the first image an image; replacing the second sub-image on the second side of the reference line in the first image with a mirror image to obtain a second image; displaying the second image. In the embodiment of the present invention, the reflection image can be automatically generated, the simulated generation of the reflection image can be realized, the dependence on the environment or props and the shooting skills during the shooting process is reduced, the shooting difficulty is reduced, and the user experience is improved.

Description

Image processing method and device

technical field

The present invention relates to the field of image technology, and in particular, to an image processing method and device.

Background technique

With the development and progress of information technology, various electronic devices provide a wealth of shooting modes in photography programs, such as food mode, architecture mode, portrait mode, etc.

These existing shooting modes usually use artificial intelligence algorithms to automatically identify the subject in the image, and enhance and attenuate the parameters of the photo image elements, so as to achieve the optimal effect. However, the existing shooting modes are all optimized for a certain image. When the user needs to present an image with a reflection effect, the existing shooting modes cannot meet the needs of use. Either they need to shoot in the water environment, or they need to use the mirror tool. shoot. Moreover, users are required to have certain shooting skills to ensure a good reflection effect.

Therefore, at present, when shooting to form a reflection image, the user usually relies on the environment or props and shooting skills to achieve a good reflection effect, and the operation is complicated and difficult.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide an image processing method, apparatus, electronic device, and computer-readable storage medium, which can solve the problems that the current shooting of reflected images is heavily dependent on the environment, props, and shooting skills, and the operation is complicated and difficult.

In order to solve the above-mentioned technical problems, the present invention is achieved in this way:

In a first aspect, an embodiment of the present invention provides an image processing method, which is applied to an electronic device, and the method includes:

get the first image;

determining a reference line on the first image;

obtaining a mirror image according to the first sub-image located on the first side of the reference line in the first image;

replacing the second sub-image on the second side of the reference line in the first image with the mirror image to obtain a second image;

Display the second image.

In a second aspect, an embodiment of the present invention further provides an image processing apparatus, the apparatus comprising:

an acquisition module for acquiring the first image;

a determining module for determining a reference line on the first image;

a mirroring module, configured to obtain a mirror image according to the first sub-image located on the first side of the reference line in the first image;

a replacement module, configured to replace the second sub-image on the second side of the reference line in the first image with the mirror image to obtain a second image;

A display module, used for displaying the second image.

In a third aspect, an embodiment of the present invention further provides an electronic device, including a processor, a memory, and a computer program stored on the memory and executable on the processor, the computer program being executed by the processor When executed, the steps of the image processing method described in the first aspect are realized.

In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the image processing described in the first aspect is implemented steps of the method.

In this embodiment of the present invention, by determining the reference line on the first image, a mirror image is obtained according to the first sub-image located on the first side of the reference line in the first image, and the second sub-image on the second side of the reference line is The image is replaced with a mirror image of the first sub-image to obtain a second image, that is, a second image including the first sub-image and its mirror image can be displayed. Therefore, the reflection image can be automatically generated, the simulated generation of the reflection image can be realized, the dependence on the environment or props and the shooting skills during the shooting process is reduced, the shooting difficulty is reduced, and the user experience is improved.

Description of drawings

FIG. 1 shows a flowchart of an image processing method provided by an embodiment of the present invention;

FIG. 2 shows a schematic diagram of a reference line according to an embodiment of the present invention;

FIG. 3 shows a schematic diagram of a mirror image according to an embodiment of the present invention;

FIG. 4 shows a flowchart of another image processing method provided by an embodiment of the present invention;

5 is a schematic diagram of another reference line according to an embodiment of the present invention;

6 is a schematic diagram showing various water surface types according to an embodiment of the present invention;

FIG. 7-1 shows an effect diagram of a ambiguity in an embodiment of the present invention;

Fig. 7-2 shows an effect diagram of another ambiguity in an embodiment of the present invention;

FIG. 8 shows a structural block diagram of an image processing apparatus provided by an embodiment of the present invention;

FIG. 9 shows a structural block diagram of another image processing apparatus provided by an embodiment of the present invention;

FIG. 10 shows a structural block diagram of an electronic device provided by an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

It is to be understood that reference throughout the specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic associated with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily necessarily referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments.

In various embodiments of the present invention, it should be understood that the size of the sequence numbers of the following processes does not mean the sequence of execution, and the execution sequence of each process should be determined by its functions and internal logic, rather than the implementation of the present invention The implementation of the examples constitutes no limitation.

Example 1

Referring to FIG. 1, a flowchart of an image processing method provided by an embodiment of the present invention is shown. The steps of the method are as follows:

Step 101, acquiring a first image.

For image processing, it is first necessary to have an image that is provided to the user for preview. The image is the first image obtained by the electronic device.

It can be understood that such a first image may be captured by the user through other devices, transmitted from other devices to the device currently performing image processing through a memory card or wirelessly, or may be captured by the electronic device currently performing image processing. of.

Specifically, the acquisition of the first image in step 101 may be implemented by the following methods in the first mode or the second mode.

Method 1: Obtain when the electronic device performs a photographing operation.

When the user is using the electronic device, he can click the photo application icon on the screen to start the photo application, and the electronic device displays the real-time preview screen to the user through the display screen. When the shooting orientation, angle and displayed screen elements of the preview screen meet psychological expectations During the effect, the electronic device saves the image by receiving the user's shutter triggering operation. Therefore, the user can acquire the first image when performing the photographing operation.

It should be noted that, in the prior art, various electronic devices with shooting functions usually provide users with special categories of shooting modes such as gourmet mode, architectural mode, and portrait mode. The category of the subject object, and the corresponding image optimization is performed. Similarly, when this solution is implemented, the function for generating a reflection image can be built in as a reflection mode that is juxtaposed with the gourmet mode, the building mode, and the portrait mode. One way to enter the reflection mode is: you can set the reflection mode as the default shooting mode in the photo program, that is, after the user opens the photo application, the first screen will display the reflection mode by default, no additional steps are required, and it is extremely simple. Another method for entering the reflection mode is: after the user opens the camera application, the user selects to switch to the reflection mode on the display interface. In the second method, in order to improve the switching efficiency, the modes can also be sorted according to conditions such as the frequency of use of various shooting modes, the length of the cumulative use time, and the distance of the most recent use time. For example, a shooting mode that is frequently used is displayed at a position that can be directly selected without the user's sliding operation, and a shooting mode that is used less frequently is displayed at a position that requires a user's sliding operation to be called out. Therefore, based on the user's usage habits, the user's operational convenience can be improved.

Method 2: Obtain from other electronic devices.

When implementing the image processing method provided by this application, in addition to processing the images captured by the current device in real time, it is also possible to access other mobile storage media such as memory cards, U disks, or other wireless means such as Bluetooth, WiFi, and mobile communication networks. target device. For example, other mobile phones, computers, servers, etc. By reading images pre-stored in the memory of the target device, images of other devices other than the current device can be processed to generate a reflection image.

Step 102, determining a reference line on the first image.

After acquiring the first image, the electronic device displays the screen content of the first image to the user in a visual manner through the display screen. As shown in FIG. 2 , a reference line m needs to be determined on the first image, and the reference line is a virtual reference line visible to the naked eye, which is used to simulate the boundary of the water surface. It can be understood that one side of the reference line is used to present the real picture, and the other side is used to present the reflected image. Specifically, in actual implementation, the reference line may be a dotted line or a solid line. Of course, the reference line may also flash on the first image at a certain frequency to prompt the user where the reference line is located. As an implementation manner, the reference line can be generated in the middle of the screen by default and presented as a horizontal line. It should be noted that the user can also adjust the shape and position of the reference line.

Step 103: Obtain a mirror image according to the first sub-image located on the first side of the reference line in the first image.

Based on the determined reference lines, the first image is divided into different regions. As shown in Figure 3, taking the reference line m as an example, the reference line m divides the first image into two parts, the upper and lower parts, the first side above the reference line m is the first sub-image, and the second side below the reference line m is the first sub-image. for the second sub-image. Using the image flipping algorithm, the first sub-image is flipped to obtain a mirror image of the first sub-image. For example, in the two-dimensional image plane, the reference line is used as the coordinate axis x in the horizontal direction, and the area above the reference line is defined as the coordinate In the positive direction of the axis y, all the pixels in the positive direction of the coordinate axis y can be symmetrically copied with the coordinate axis x as the symmetry axis. That is, the newly generated mirror image and the first sub-image are mirror-symmetrical about the axis of the reference line. It should be noted that, if the reference line is a curve, the above method can still be referred to, and the point on the curve is used as the midpoint to calculate the mirror image point mirrored with the pixel point in the first sub-image, which will not be repeated here.

Step 104: Replace the second sub-image on the second side of the reference line in the first image with the mirror image to obtain a second image.

The original first image includes a first sub-image and a second sub-image, the first sub-image and the second sub-image are different picture elements, and the mirror image obtained based on the reference line has the same picture as the first sub-image The image of the element, and the mirror image is mirror-symmetrical to the first sub-image with respect to the reference line. In order to obtain a composite image with a reflection effect, the reference line can be used as a replacement boundary, and the second sub-image can be replaced with a mirror image. Specifically, for example, an image recognition algorithm can be used to identify the area of the second sub-image segmented by the reference line, cut out and delete the area of the second sub-image, and fill the mirror image in the deleted area. Of course, The reference line can also be used as a composite boundary, and the mirror image can be directly superimposed and covered on the upper layer of the second sub-image, so as to block the picture elements of the second sub-image. Thus, one side of the reference line is a real scene image, and the other side is a second image of a virtual reflection obtained by digital processing.

Step 105, displaying the second image.

The obtained second image with reflection effect can be displayed on the display screen in thumbnail mode or full-screen mode, and during display, the user can also zoom in on the display screen to view the image at the reference line position or other positions details to confirm the composite quality of the second image.

In this embodiment of the present invention, by determining the reference line on the first image, a mirror image is obtained according to the first sub-image located on the first side of the reference line in the first image, and the second sub-image on the second side of the reference line is The image is replaced with a mirror image of the first sub-image to obtain a second image, that is, a second image including the first sub-image and its mirror image can be displayed. Therefore, the reflection image can be automatically generated, the simulated generation of the reflection image can be realized, the dependence on the environment or props and the shooting skills during the shooting process is reduced, the shooting difficulty is reduced, and the user experience is improved.

Embodiment 2

Referring to FIG. 4 , a flowchart of another image processing method provided by an embodiment of the present invention is shown. The steps of the method are as follows:

Step 201, acquiring a first image.

For the acquisition method of the first image in step 201, reference may be made to the description of step 101 in the first embodiment, and details are not repeated here.

Step 202, receiving a first input from the user.

After acquiring the first image, the electronic device needs to receive an operation request from the user, where the operation request is the user's first input. The first input can be an operation request received by the electronic device through physical keys, an operation request received by the electronic device through virtual keys or gesture operations on the touch screen, or an operation request received by the electronic device through an optical sensor. Operation requests related to eye control technology.

Specifically, the following methods can be used to receive the first input:

In sub-step a1, an acquisition control is provided on the first image.

A transparent layer can be generated on the first image, and collection controls such as an input box, a slider or a selection menu can be provided on the layer. The user can input data into the input box, slide the position of the slider, and select different menu items. options.

Sub-step a2, receiving the user's first input through the collection control.

Through the above acquisition controls, the user can input requirements for the position and/or shape of the reference line in the acquisition controls. Taking the input box as an example, the user can determine the position of the reference line and whether its shape is a straight line or a curve by inputting coordinate points and curvature. Taking the slider as an example, the user can determine the position of the reference line by sliding the distance of the slider and adjust whether its shape is a straight line or a curve.

Another way to receive the first input is as follows:

The user's sliding track or anchor point on the first image is received as the first input.

As the touch technology becomes more and more accurate, it is possible to directly receive the user's sliding track on the first image or the anchor points that are clicked one by one. Adjusted reference lines are formed from track or anchor point information. Since the first image is intuitively displayed to the user on the display screen, when the user draws the reference line based on the visual interface or clicks the anchor point to draw the reference line, the position of the reference line can be accurately located, and the shape of the formed reference line can be more accurately located. It can also better meet the needs of reflection images. It can be understood that, whether it is a reference line formed by a sliding trajectory or a reference line connected by anchor points, after receiving the first input from the user, the electronic device can further optimize the reference line by smoothing and fitting the lines. shape to make it more realistic to simulate the water boundary.

Step 203, in response to the first input, determine the position and/or shape of the reference line on the first image.

After receiving the first input from the user, the electronic device performs graphic visualization processing on the data in the first input based on the information input by the user, and visualizes the coordinates of each point on the reference line included in the first input, the curvature of the line, etc. It is displayed on the first image, thereby determining the relative positional relationship between the lower reference line and the picture element on the first image and its shape, so as to facilitate mirroring. For example, when the user's first input indicates that the reference line is presented as a horizontal straight line in the middle position of the first image, after responding to the first input, the position of the reference line can be displayed in the middle position of the first image.

Optionally, when the reference line is displayed, if the user feels that at least one of the position or the shape is inappropriate, the user can return to the interface for receiving the first input and re-enter the reference line to adjust the reference line. The specific adjustment operation and electronic The device receives the first input, and the steps for responding to the first input are the same, which will not be repeated here. As shown in FIG. 5 , a schematic diagram of an adjusted reference line m is shown. The adjustment of the position and shape of the reference line is helpful to simulate different water boundaries and water areas, thereby enhancing the realistic effect of the reflection image.

Of course, optionally, the foregoing steps 202 and 203 may also be replaced by directly determining the reference line on the first image, which is not specifically limited in this embodiment of the present invention. For example, the reference line is directly determined according to the position and/or shape of the reference line selected by the user by default.

Step 204, receiving a second input from the user.

Similar to the electronic device receiving the user's first input, the difference is that the first input is related to the reference line, and the second input is used to select a target water surface type from at least two preset water surface type materials.

Step 205, in response to the second input, determine the target water surface type.

In the method provided by the embodiment of the present invention, picture materials of various water surface types may be stored in advance. After receiving the second input from the user, the electronic device may determine the target water surface type from at least two types of water surface material in response to the second input. For example, as shown in Figure 6, three different types of water surface image materials A, B, and C are displayed on the display screen of the electronic device, representing the lake surface, the sea surface and the river surface respectively. After the electronic device receives the user's selection information for the C type water surface image , the water surface texture of the C-type water surface image can be applied to the first sub-image, which can simulate and restore the reflection effect under different water types more realistically, and improve the fidelity of the reflection image.

Step 206: Obtain the mirror image according to the first sub-image and the target water surface type.

After obtaining the first sub-image and the target water surface type in the preceding steps, one method of obtaining the mirror image is to first copy and separate the first sub-image from the first image to obtain a copy of the first sub-image, and then copy the first sub-image The copy of the image is fused with the image material corresponding to the target water surface type, for example, superimposed to adjust the transparency, etc. Then the fused image is mirrored with the reference line as the axis to obtain a mirror image. Another method for obtaining the mirror image may be to first copy and separate the first sub-image from the first image to obtain a copy of the first sub-image, and then mirror the copy of the first sub-image with the reference line as the axis to obtain the to-be-processed copy. The mirror image to be processed is merged with the picture material corresponding to the target water surface type, for example, superimposed to adjust the transparency, etc. After the fusion, the final mirror image can be obtained. It should be noted that the mirror image obtained based on the target water surface type and the first sub-image has a more realistic effect than the directly obtained mirror image due to the introduction of water surface material.

Optionally, in addition to obtaining the mirror image by the methods from steps 204 to 206, steps 204 to 206 can also be replaced by the following steps, or steps 204 to 206 can be taken at the same time to obtain the mirror image:

a. Receive a third input from the user.

Similar to the electronic device receiving the user's first input, the difference is that the first input is related to the reference line, and the third input is used to set the blurriness of the mirror image.

b. In response to the third input, determining the blurriness of the mirror image.

After receiving the third input from the user, in response to the third input, the electronic device may provide the user with a blurriness setting control, such as a blurriness input box, a blurriness setting wheel or a scroll bar, and the like. The user can determine a blur degree value through the blur degree setting control. The blur degree value can be between 0-100%, indicating the degree of blurring of the picture, 0 means completely clear, 100% means completely blurred, and the picture elements are indistinguishable. For example, the user can input a 50% blur degree through the blur degree input box to determine the blur degree of the mirror image as 50%. The 50% blur degree can be used to generate a more realistic mirror image, which can be more realistically simulated and restored under different water types. The reflection effect can improve the fidelity of the reflection image.

c. Obtain the mirror image according to the first sub-image and the blur degree.

After obtaining the first sub-image and the blur degree in the preceding steps, one method of obtaining a mirror image is to first copy and separate the first sub-image from the first image to obtain a copy of the first sub-image, and then copy the first sub-image The duplicates are processed according to the determined ambiguity by a blurring algorithm such as Gaussian blurring. Then, the processed image is mirrored with the reference line as the axis to obtain a mirror image. Another method for obtaining the mirror image may be to first copy and separate the first sub-image from the first image to obtain a copy of the first sub-image, and then mirror the copy of the first sub-image with the reference line as the axis to obtain the to-be-processed copy. The mirror image to be processed is processed by a blurring algorithm such as Gaussian blur according to the determined blur degree, and the final mirror image can be obtained after processing. It should be noted that, in the mirror image obtained based on the blur degree and the first sub-image, since the mirror image presents a blurring effect, the effect of the mirror image is more realistic compared to the directly obtained mirror image.

Step 207: Replace the second sub-image on the second side of the reference line in the first image with the mirror image to obtain a second image.

Step 207 is similar to step 104, and reference may be made to the description of step 104, which will not be repeated here.

Step 208, displaying the second image.

The obtained second image with reflection effect can be displayed on the display screen in thumbnail mode or full-screen mode, and during display, the user can also zoom in on the display screen to view the image at the reference line position or other positions details to confirm the composite quality of the second image.

In addition, optionally, after displaying the second image, the method may further include the following steps:

Step 209: Receive a fourth input from the user.

Similar to the electronic device receiving the user's first input, the difference is that the first input is related to the reference line, and the fourth input is used to modify and adjust the water surface type.

Step 210: In response to the fourth input, determine a second water surface type, and adjust the mirror image in the second image to correspond to the second water surface type.

It can be understood that, in the foregoing steps, the electronic device determines the target water surface type based on the user's second input. The user can also modify the water surface type after the second image is displayed, if the visual effect of the second image does not meet psychological expectations. After receiving the user's fourth input, the electronic device may provide the user with a water surface type selection interface, and the user may reselect and determine a second water surface type different from the target water surface type. In response to such determination information, the electronic device may adjust the mirror image to correspond to the second water surface type. The specific process is similar to the description of step 206 .

In addition to re-adjusting the mirror image according to the methods of steps 209 and 210 , steps 211 and 212 may also be taken to continue to adjust or replace steps 209 and 210 .

Step 211: Receive a fifth input from the user.

Similar to the electronic device receiving the user's first input, the difference is that the first input is related to the reference line, and the fifth input is used to modify and adjust the blurriness of the mirror image.

Step 212: In response to the fifth input, adjust the blurriness of the mirror image in the second image.

It can be understood that, in the foregoing steps, the electronic device determines the blurriness of the mirror image based on the user's third input. The user may also modify the blurriness of the mirror image after displaying the second image, if the visual effect of the second image does not meet psychological expectations. After receiving the user's fifth input, the electronic device may provide the user with a blurring degree adjustment interface, and the user may reselect and determine another value different from the aforementioned blurring degree value. As shown in Figure 7-1, it shows the schematic effect of adjusting the blurriness to 20% through the slider, and as shown in Figure 7-2, it shows the schematic effect of adjusting the blurriness to 75% through the slider. Therefore, the blur degree of the mirror image can be adjusted according to the actual blur degree requirements, so as to restore the real reflection scene as much as possible.

In addition, optionally, when there are sundries in the image, the method may further include the following steps:

Step 213, receiving a sixth input.

The electronic device can also receive the user's touch selection information through the display screen, receive voice control instructions through the microphone, and can track the eye trajectory through the front camera.

On the display interface, sundry elements that affect the beauty of the screen may be selected based on the user's aesthetic feeling, and the selection method may also not be limited to touch operations. The sixth input is the user's selection information for the sundry elements in the image, and the user's sixth input information is received in one or more different ways, and is used to determine the sundry elements in the first image.

Step 214, in response to the sixth input, determine the clutter element in the first image.

After receiving the sixth input from the user, the electronic device may determine, in response to the sixth input, some elements in the first image as sundry elements. For example, according to the user's touch and slide track on the first image, some of the circled elements are determined as sundry elements, and marked as objects that the user wants to remove. It can be understood that, in this embodiment, an artificial intelligence algorithm can also be used to automatically identify and outline the boundaries of each subject in the screen, and the user selects one or more of the subjects as sundry elements.

Step 215, eliminating the sundry elements.

The matting technology has matured day by day, and the natural image matting algorithm based on the perceptual color space can be used to retain the image with the sundry elements removed. Based on the existing image processing methods, the pixels around the sundry elements can be identified, and the image picture can be fitted with a linear or non-linear algorithm, so as to repair the image, eliminate the sundry elements in the image, and avoid the Clutter elements appear in the reflected image to avoid interfering with the visual effect.

In this embodiment of the present invention, by determining the reference line on the first image, a mirror image is obtained according to the first sub-image located on the first side of the reference line in the first image, and the second sub-image on the second side of the reference line is The image is replaced with a mirror image of the first sub-image to obtain a second image, that is, a second image including the first sub-image and its mirror image can be displayed. Therefore, the reflection image can be automatically generated, the simulated generation of the reflection image can be realized, the dependence on the environment or props and the shooting skills during the shooting process is reduced, the shooting difficulty is reduced, and the user experience is improved. And the above process also introduces the type of water surface or blurring. In addition, by receiving user input, the target water surface type and blur degree can be adjusted, the blur degree of the mirror image can be modified, and the sundries in the image can be eliminated. , thereby further improving the fidelity of the reflection image.

Embodiment 3

Referring to FIG. 8, a block diagram of an image processing apparatus is shown, and the apparatus includes:

The acquiring module 301 is used for acquiring a first image.

A determination module 302, configured to determine a reference line on the first image.

The mirroring module 303 is configured to obtain a mirror image according to the first sub-image located on the first side of the reference line in the first image.

The replacement module 304 is configured to replace the second sub-image located on the second side of the reference line in the first image with the mirror image to obtain a second image.

The display module 305 is configured to display the second image.

In this embodiment of the present invention, by determining the reference line on the first image, a mirror image is obtained according to the first sub-image located on the first side of the reference line in the first image, and the second sub-image on the second side of the reference line is The image is replaced with a mirror image of the first sub-image to obtain a second image, that is, a second image including the first sub-image and its mirror image can be displayed. Therefore, the reflection image can be automatically generated, the simulated generation of the reflection image can be realized, the dependence on the environment or props and the shooting skills during the shooting process is reduced, the shooting difficulty is reduced, and the user experience is improved.

Embodiment 4

Referring to FIG. 9, a block diagram of another image processing apparatus is shown, and the apparatus includes:

The acquiring module 401 is used for acquiring a first image.

A determination module 402, configured to determine a reference line on the first image.

Optionally, the determining module 402 may include:

The first receiving module 4021 is used to receive the first input.

A first response module 4022, configured to determine the position and/or shape of the reference line on the first image in response to the first input.

The mirroring module 403 is configured to obtain a mirror image according to the first sub-image located on the first side of the reference line in the first image.

The replacement module 404 is configured to replace the second sub-image located on the second side of the reference line in the first image with the mirror image to obtain a second image.

The display module 405 is configured to display the second image.

Optionally, the mirroring module 403 may include:

The second receiving sub-module 4031 is configured to receive the second input of the user.

The second response sub-module 4032 is configured to determine the target water surface type in response to the second input.

A mirror image sub-module, configured to obtain the mirror image according to the first sub image and the target water surface type.

Optionally, in another image processing apparatus, the mirroring module 403 may include:

The third receiving sub-module is configured to receive the third input from the user.

A third response sub-module, configured to determine the blurriness of the mirror image in response to the third input.

A mirror image sub-module, configured to obtain the mirror image according to the first sub image and the blur degree.

Optionally, the image processing apparatus may further include:

The fourth receiving module 406 is configured to receive a fourth input from the user.

The fourth response module 407 is configured to determine a second water surface type in response to the fourth input, and adjust the mirror image in the second image to correspond to the second water surface type.

and / or,

The fifth receiving module is used for receiving the fifth input of the user.

A fifth response module, configured to adjust the blur degree of the mirror image in the second image in response to the fifth input.

Optionally, the image processing apparatus may further include:

a sixth receiving module, configured to receive the sixth input of the user;

a sixth response module, configured to determine debris elements in the first image in response to the sixth input;

An elimination module for eliminating the sundry elements.

In this embodiment of the present invention, by determining the reference line on the first image, a mirror image is obtained according to the first sub-image located on the first side of the reference line in the first image, and the second sub-image on the second side of the reference line is The image is replaced with a mirror image of the first sub-image to obtain a second image, that is, a second image including the first sub-image and its mirror image can be displayed. Therefore, the reflection image can be automatically generated, the simulated generation of the reflection image can be realized, the dependence on the environment or props and the shooting skills during the shooting process is reduced, the shooting difficulty is reduced, and the user experience is improved. And the above process also introduces the type of water surface or blurring. In addition, by receiving user input, the target water surface type and blur degree can be adjusted, the blur degree of the mirror image can be modified, and the sundries in the image can be eliminated. , thereby further improving the fidelity of the reflection image.

As for the embodiment of the image processing apparatus, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts and beneficial effects can be referred to the partial description of the method embodiment.

The embodiment of the present invention also provides an electronic device, including:

It includes a processor, a memory, and a computer program stored on the memory and executable on the processor, and when the computer program is executed by the processor, implements the steps of the image processing method provided by the foregoing embodiments. The electronic device provided in the embodiment of the present invention can implement each process implemented by the electronic device in the method embodiments of FIG. 1 to FIG. 7-2 . To avoid repetition, details are not repeated here.

10 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present invention;

The electronic device 500 includes but is not limited to: a radio frequency unit 501, a network module 502, an audio output unit 503, an input unit 504, a sensor 505, a display unit 506, a user input unit 507, an interface unit 508, a memory 509, a processor 510, and Power 511 and other components. Those skilled in the art can understand that the structure of the electronic device shown in FIG. 10 does not constitute a limitation on the electronic device, and the electronic device may include more or less components than the one shown, or combine some components, or different components layout. In this embodiment of the present invention, the electronic device includes but is not limited to a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

Wherein, the processor 510 is configured to acquire the first image;

determining a reference line on the first image;

obtaining a mirror image according to the first sub-image located on the first side of the reference line in the first image;

replacing the second sub-image on the second side of the reference line in the first image with the mirror image to obtain a second image;

The second image is displayed by the display unit 506 .

In this embodiment of the present invention, by determining the reference line on the first image, a mirror image is obtained according to the first sub-image located on the first side of the reference line in the first image, and the second sub-image on the second side of the reference line is The image is replaced with a mirror image of the first sub-image to obtain a second image, that is, a second image including the first sub-image and its mirror image can be displayed. Therefore, the reflection image can be automatically generated, the simulated generation of the reflection image can be realized, the dependence on the environment or props and the shooting skills during the shooting process is reduced, the shooting difficulty is reduced, and the user experience is improved.

It should be understood that, in this embodiment of the present invention, the radio frequency unit 501 can be used for receiving and sending signals during sending and receiving of information or during a call. Specifically, after receiving the downlink data from the base station, it is processed by the processor 510; The uplink data is sent to the base station. Generally, the radio frequency unit 501 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 501 can also communicate with the network and other devices through a wireless communication system.

The electronic device provides the user with wireless broadband Internet access through the network module 502, such as helping the user to send and receive emails, browse web pages, access streaming media, and the like.

The audio output unit 503 may convert audio data received by the radio frequency unit 501 or the network module 502 or stored in the memory 509 into audio signals and output as sound. Also, the audio output unit 503 may also provide audio output related to a specific function performed by the electronic device 500 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 503 includes a speaker, a buzzer, a receiver, and the like.

The input unit 504 is used to receive audio or video signals. The input unit 504 may include a graphics processor (Graphics Processing Unit, GPU) 5041 and a microphone 5042, and the graphics processor 5041 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed. The processed image frames may be displayed on the display unit 506 . The image frames processed by the graphics processor 5041 may be stored in the memory 509 (or other storage medium) or transmitted via the radio frequency unit 501 or the network module 502 . The microphone 5042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 501 for output in the case of a telephone call mode.

The electronic device 500 also includes at least one sensor 505, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 5061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 5061 and the display panel 5061 when the electronic device 500 is moved to the ear. / or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of electronic devices (such as horizontal and vertical screen switching, related games , magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 505 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, Infrared sensors, etc., are not repeated here.

The display unit 506 is used to display information input by the user or information provided to the user. The display unit 506 may include a display panel 5061, and the display panel 5061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 507 may be used to receive input numerical or character information, and generate key signal input related to user setting and function control of the electronic device. Specifically, the user input unit 507 includes a touch panel 5071 and other input devices 5072 . The touch panel 5071, also referred to as a touch screen, can collect the user's touch operations on or near it (such as the user's finger, stylus, etc., any suitable object or accessory on or near the touch panel 5071). operate). The touch panel 5071 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 510, the command sent by the processor 510 is received and executed. In addition, the touch panel 5071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 5071 , the user input unit 507 may also include other input devices 5072 . Specifically, other input devices 5072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.

Further, the touch panel 5071 can be covered on the display panel 5061. When the touch panel 6071 detects a touch operation on or near it, it transmits it to the processor 510 to determine the type of the touch event, and then the processor 510 determines the type of the touch event according to the touch The type of event provides a corresponding visual output on display panel 5061. Although in FIG. 10 , the touch panel 5071 and the display panel 5061 are used as two independent components to realize the input and output functions of the electronic device, but in some embodiments, the touch panel 5071 and the display panel 5061 can be integrated The implementation of the input and output functions of the electronic device is not specifically limited here.

The interface unit 508 is an interface for connecting an external device to the electronic device 500 . For example, external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 508 may be used to receive input (eg, data information, power, etc.) from external devices and transmit the received input to one or more elements within the electronic device 500 or may be used between the electronic device 500 and external Transfer data between devices.

The memory 509 may be used to store software programs as well as various data. The memory 509 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required for at least one function, and the like; Data created by the use of the mobile phone (such as audio data, phone book, etc.), etc. Additionally, memory 509 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 510 is the control center of the electronic device, using various interfaces and lines to connect various parts of the entire electronic device, by running or executing the software programs and/or modules stored in the memory 509, and calling the data stored in the memory 509. , perform various functions of electronic equipment and process data, so as to monitor electronic equipment as a whole. The processor 510 may include one or more processing units; preferably, the processor 510 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem The processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 510.

The electronic device 500 may also include a power supply 511 (such as a battery) for supplying power to various components. Preferably, the power supply 511 may be logically connected to the processor 510 through a power management system, so as to manage charging, discharging, and power consumption management through the power management system and other functions.

In addition, the electronic device 500 includes some functional modules not shown, which will not be repeated here.

Embodiments of the present invention further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the above image processing method embodiments can be implemented, and the same technology can be achieved. The effect, in order to avoid repetition, is not repeated here. The computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk, or an optical disk.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present invention.

The embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of the present invention, without departing from the spirit of the present invention and the scope protected by the claims, many forms can be made, which all belong to the protection of the present invention.

Claims (10)

1. An image processing method applied to an electronic device, the method comprising:

acquiring a first image;

determining a reference line on the first image;

obtaining a mirror image according to a first sub-image which is positioned on the first side of the reference line in the first image;

replacing a second sub-image positioned on a second side of the reference line in the first image with the mirror image to obtain a second image;

and displaying the second image.

2. The method according to claim 1, wherein the determining a reference line on the first image specifically comprises:

receiving a first input of a user;

in response to the first input, a position and/or a shape of the reference line on the first image is determined.

3. The method according to claim 1, wherein obtaining a mirror image from a first sub-image of the first image on a first side of the reference line comprises:

receiving a second input of the user;

determining a target water surface type in response to the second input;

and obtaining the mirror image according to the first sub-image and the type of the target water surface.

4. The method according to claim 1, wherein obtaining a mirror image from a first sub-image of the first image on a first side of the reference line comprises:

receiving a third input of the user;

determining a degree of blur of the mirror image in response to the third input;

and obtaining the mirror image according to the first sub-image and the ambiguity.

5. The method of claim 1, wherein after the displaying the second image, the method further comprises:

receiving a fourth input from the user;

in response to the fourth input, determining a second water surface type and adjusting the mirror image in the second image to correspond to the second water surface type;

and/or the presence of a gas in the gas,

receiving a fifth input of the user;

adjusting a degree of blur of the mirrored image in the second image in response to the fifth input.

6. An image processing apparatus characterized by comprising:

the acquisition module is used for acquiring a first image;

a determining module for determining a reference line on the first image;

the mirror image module is used for obtaining a mirror image according to a first sub-image which is positioned on the first side of the reference line in the first image;

the replacing module is used for replacing a second sub-image which is positioned on the second side of the reference line in the first image with the mirror image to obtain a second image;

and the display module is used for displaying the second image.

7. The apparatus of claim 6, wherein the determining module comprises:

a first receiving submodule for receiving a first input;

a first response submodule for determining a position and/or a shape of the reference line on the first image in response to the first input.

8. The apparatus of claim 6, wherein the mirroring module comprises:

the second receiving submodule is used for receiving a second input of the user;

a second response submodule for determining a target water surface type in response to the second input;

and the mirror image submodule is used for obtaining the mirror image according to the first sub image and the type of the target water surface.

9. The apparatus of claim 6, wherein the mirroring module comprises:

the third receiving submodule is used for receiving a third input of the user;

a third response submodule for determining a degree of blur of the mirrored image in response to the third input;

and the mirror image submodule is used for obtaining the mirror image according to the first sub-image and the ambiguity.

10. The apparatus of claim 6, further comprising:

the fourth receiving module is used for receiving a fourth input of the user;

a fourth response module, configured to determine a second water surface type in response to the fourth input, and adjust the mirror image in the second image to correspond to the second water surface type;

and/or the presence of a gas in the gas,

the fifth receiving module is used for receiving fifth input of the user;

a fifth response module to adjust a blur level of the mirrored image in the second image in response to the fifth input.

Images