[go: up one dir, main page]

WO2015161561A1 - Method and device for terminal to achieve image synthesis based on multiple cameras - Google Patents

Method and device for terminal to achieve image synthesis based on multiple cameras Download PDF

Info

Publication number
WO2015161561A1
WO2015161561A1 PCT/CN2014/080346 CN2014080346W WO2015161561A1 WO 2015161561 A1 WO2015161561 A1 WO 2015161561A1 CN 2014080346 W CN2014080346 W CN 2014080346W WO 2015161561 A1 WO2015161561 A1 WO 2015161561A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
objects
preview
camera
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2014/080346
Other languages
French (fr)
Chinese (zh)
Inventor
罗义军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Publication of WO2015161561A1 publication Critical patent/WO2015161561A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Definitions

  • the present invention relates to, but is not limited to, the field of Internet mobile terminal products, computers, tablet computers, mobile phones, and the like, and more particularly to a method and apparatus for implementing a photographing using multiple cameras. .
  • BACKGROUND With the development of science and technology, mobile phones and camera devices have been widely popularized, and the quality of photographs and user experience have been continuously improved. With the rapid improvement of the performance of mobile phone processors, photography has become an important selling point for smartphones to attract users. From the initial 100,000, 300,000 pixels, to the current 5 million, 8 million, or even 41 million pixels.
  • the camera application is also constantly enriched, such as the best group photo, face preference, skin beauty, removal of mobile background, dynamic picture shooting, panoramic shooting, etc., excellent photo application and
  • the function has also become the main goal of product upgrades such as mobile phones.
  • mobile phone shooting is enough, but users expect the image quality of the mobile phone camera to be more outstanding, and the camera before and after the mobile phone has more rich operations.
  • the mobile phone camera configuration is constantly upgraded, and the pixels are constantly improving. From a single camera to a front and rear dual camera to a 3D camera, the flash is built from scratch and constantly upgraded. Hardware configuration and performance are constantly improving, which also promotes application development and improvement.
  • An object of the present invention is to provide a method and apparatus for realizing a photographing of a terminal based on a multi-camera, which can solve the problem that a plurality of cameras cannot acquire a combined photographed picture by simultaneous shooting while the existing terminal is photographing.
  • a method for implementing a photographing of a plurality of cameras based on a multi-camera comprising: capturing, by the terminal, a plurality of objects by using a plurality of camera components to obtain a preview image of the plurality of objects; Navigating a preview image of the plurality of objects, causing a preview image of the plurality of objects to be displayed on the display; and synthesizing the preview images of the plurality of objects stacked on the display to obtain a synthesized image Multi-camera photo.
  • the plurality of camera assemblies include a front camera assembly and a rear camera assembly.
  • the step of layering the preview images of the plurality of objects on the display by tiling the preview images of the plurality of objects on the display comprises: capturing the rear camera components a preview image is tiled on the bottom layer of the display; a preview image captured by the front camera component is tiled over the preview image captured by the rear camera component, and the preview captured by the front camera component
  • the display area of the image is smaller than the display area of the preview image captured by the rear camera assembly.
  • the step of synthesizing the preview images of the plurality of objects stacked on the display to obtain the synthesized multi-camera photographs comprises: displaying, by the terminal processor, the plurality of stacks on the display
  • the preview image of the object performs an object separation operation to obtain mutually independent object images and background images; and at least a part of the object images or/and the background images are combined to obtain a combined multi-camera photographed image.
  • the step of combining the at least part of the object image or/and the background image comprises: performing brightness adjustment on at least a part of the object image or/and the background image, so that the at least part of the object image or/and the background image
  • the brightness is uniform; white balance adjustment is performed on at least a part of the object image data or/and the background image to make the white balance of the at least part of the object image data or/and the background image coincide.
  • the step of performing brightness adjustment on at least a part of the object image or/and the background image comprises: calculating a difference value of the pixel brightness average value by reading an average value of pixel brightness of the preview image of the plurality of objects; Comparing the pixel brightness average difference value with a preset first threshold value; if the pixel brightness average value difference is greater than a preset first threshold value, performing brightness on the at least one part of the object image or/and the background image Adjustment.
  • the step of performing white balance adjustment on at least a part of the object image or/and the background image comprises: obtaining a gray point of the preview image of the plurality of objects by calculating a number of gray point pixels of the preview image of the plurality of objects a pixel number difference value; comparing the gray point pixel number difference value with a preset second threshold value, and adjusting a white balance of the at least one part of the object image or/and the background image according to the obtained comparison result.
  • the step of adjusting the white balance of the at least part of the object image or/and the background image according to the obtained comparison result comprises: if the difference of the gray point pixel number of the preview image of the plurality of objects is greater than a preset number a second threshold, the optimal white balance parameter is calculated according to the maximum gray point pixel number value, and the white balance of the at least part of the object image or/and the background image is adjusted by using; if the preview image of the plurality of objects Calculating an average value of the gray point pixels of the preview image of the plurality of objects, and using the same for the at least part of the object image or/and the background image White balance is adjusted.
  • an apparatus for implementing a photographing of a plurality of cameras based on a multi-camera comprising: a photographing module configured to respectively capture a plurality of objects by using a plurality of camera components to obtain a preview of the plurality of objects An image; a tile module, configured to tile a preview image of the plurality of objects on the display, And displaying a preview image of the plurality of objects on the display; and a synthesizing module configured to synthesize a preview image of the plurality of objects stacked on the display to obtain a synthesized multi-camera photographed picture.
  • the synthesizing module further includes: a brightness sub-module, configured to perform brightness adjustment on at least a part of the object image or/and the background image to make the brightness of the at least part of the object image or/and the background image consistent; white balancer And a module configured to perform white balance adjustment on at least a portion of the object image or/and the background image to make the white balance of the at least a portion of the object image or/and the background image coincide.
  • the embodiment of the present invention can simultaneously capture multiple objects by using multiple cameras to obtain a combined picture, thereby improving the user experience in the process of taking pictures, and realizing more diversification of the camera function.
  • FIG. 1 is a flow chart of a method for implementing a photographing of a terminal based on a multi-camera according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a device for realizing a photographing of a terminal based on a multi-camera according to an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of a mobile phone camera device for implementing a camera based on a multi-camera according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram of a terminal based on a multi-camera according to an embodiment of the present invention
  • FIG. 6 is a schematic diagram of a pre-synthesis preview picture of a terminal based on a multi-camera according to an embodiment of the present invention
  • FIG. 1 is a flow chart of a method for implementing a photographing of a terminal based on a multi-camera according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of a device for realizing
  • FIG. 7 is a schematic diagram of a composite preview picture of a terminal based on a multi-camera according to an embodiment of the present invention
  • FIG. It is a schematic diagram of a white balance gray point selection area in which a terminal implements a photographing based on a multi-camera according to an embodiment of the present invention.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The preferred embodiments of the present invention are described in detail below with reference to the accompanying drawings.
  • FIG. 1 is a flowchart of a method for implementing a photographing of a terminal based on a multi-camera according to an embodiment of the present invention. As shown in FIG. 1 , the method mainly includes the following steps S1 to S3.
  • Step S1 The terminal respectively captures a plurality of objects by using a plurality of camera components to obtain a preview image of the plurality of objects.
  • the plurality of camera assemblies include a front camera assembly and a rear camera assembly.
  • Step S2 The preview images of the plurality of objects are layered and displayed on the display by tiling the preview images of the plurality of objects on the display.
  • the preview image captured by the rear camera assembly may be tiled on the bottom layer of the display; then the preview image captured by the front camera assembly is tiled on the rear camera assembly.
  • the display area of the preview image captured by the front camera component is smaller than the display area of the preview image captured by the rear camera component.
  • Step S3 synthesizing a preview image of a plurality of objects stacked on the display to obtain a synthesized multi-camera photograph.
  • the terminal processor may perform object separation operation on the preview image of the plurality of objects displayed on the display by using the terminal processor to obtain mutually independent object images and background images; and at least a part of the object images or/and The background image is combined to obtain a composite multi-camera photograph.
  • the step of combining at least a portion of the object image or/and the background image may include: performing brightness adjustment on at least a portion of the object image or/and the background image to cause brightness of the at least a portion of the object image or/and the background image Consistent; white balance adjustment is performed on at least a part of the object image data or/and the background image to make the white balance of the at least part of the object image data or/and the background image coincide.
  • the step of performing brightness adjustment on at least a part of the object image or/and the background image comprises: calculating a difference value of the pixel brightness average value by reading an average value of pixel brightness of the preview image of the plurality of objects; The pixel brightness average difference value is compared with a preset first threshold value; if the pixel brightness average value difference is greater than a preset first threshold value, brightness of the at least part of the object image or/and the background image Make adjustments.
  • the step of performing white balance adjustment on at least a part of the object image or/and the background image may include: obtaining a preview image of the plurality of objects by calculating a number of gray point pixels of the preview image of the plurality of objects Gray point pixel number difference; comparing the gray point pixel number difference with a preset second threshold value, and adjusting white balance of the at least part of the object image or/and the background image according to the obtained comparison result.
  • the step of adjusting the white balance of the at least part of the object image or/and the background image according to the obtained comparison result may include: if the difference of the gray point pixel number of the preview image of the plurality of objects is greater than a preset a second threshold, the optimal white balance parameter is calculated according to the maximum gray point pixel number value, and the white balance of the at least part of the object image or/and the background image is adjusted by using; if the plurality of objects are Calculating an average value of the gray point pixels of the preview image of the plurality of objects, and using the pair of object images and/or the background of the preview image of the plurality of objects, the difference of the gray point pixel number of the preview image is less than a preset second threshold.
  • FIG. 2 is a schematic structural diagram of a device for taking a picture of a multi-camera according to an embodiment of the present invention.
  • the device mainly includes: a shooting module, a tiling module, and a synthesizing module.
  • the shooting module is configured to capture, by the terminal, a plurality of objects by using a plurality of camera components to obtain a preview image of the plurality of objects.
  • the tile module is configured to display a preview image of the plurality of objects on the display by tiling a preview image of the plurality of objects on a display.
  • the synthesis module is configured to perform a synthesis process on a preview image of a plurality of objects stacked on the display to obtain a composite multi-camera picture.
  • the brightness sub-module of the synthesis module is configured to perform brightness adjustment on at least a part of the object image or/and the background image to make the brightness of the at least part of the object image or/and the background image coincide.
  • the white balance sub-module of the synthesis module is configured to perform white balance adjustment on at least a portion of the object image or/and the background image to make the white balance of the at least a portion of the object image or/and the background image coincide.
  • 3 is a schematic structural diagram of a device for taking a picture of a multi-camera according to an embodiment of the present invention. As shown in FIG.
  • the device includes two or more camera components, and the camera and system are programmable (ISP: In-System Programming). Connected, each set of cameras is connected to the processor via an ISP, and the processor is connected to one or more displays and controllers.
  • the controller can be a touchpad, and the display and the controller can be integrated touch screens, and the ISP can also be embedded in the processor or in the camera assembly.
  • the corresponding preview content is obtained by two or more cameras, and the preview content is processed by the ISP and the processor, and then displayed on the display. Different objects in the preview content of each group of cameras are segmented with the background by an object segmentation algorithm in the processor.
  • FIG. 4 is a schematic structural diagram of a mobile phone camera device with a multi-camera picture taken according to an embodiment of the present invention.
  • a mobile phone taking a mobile phone as an example, a front camera and a rear camera are respectively connected to a processor through an ISP, and the touch screen is used as a display and The controller is connected to the processor. Get the corresponding preview content through the front and rear cameras. The preview content is processed by the ISP and the processor and then displayed on the display.
  • FIG. 5 is a flowchart of a method for multi-camera picture comparison according to an embodiment of the present invention. As shown in FIG. 5, specific steps include: starting, starting front and rear cameras, camera initialization, synthesizing preview image and displaying, object segmentation processing , Photo object confirmation, focus adjustment, brightness consistency adjustment, white balance consistency adjustment, photo completion and picture saving.
  • FIG. 6 is a schematic diagram of a pre-synthesis preview image of a multi-camera photographed image according to an embodiment of the present invention.
  • the present invention is not limited thereto, and the present invention may be based on the present invention.
  • the principles of the invention are subject to various modifications.
  • portrait B and background B are rear camera preview images, which can be placed in the bottom layer in the form of windows or layers; portrait A and background A are front camera preview images, and can also be windows or layers.
  • the form is placed on the upper layer; the upper front camera preview picture area is smaller than the bottom back camera preview picture area.
  • the portrait may also be replaced with a scene.
  • the object segmentation processing By using the pixel contrast to confirm the boundary of different objects, or the object segmentation method such as moving object capture, the object is separated from the preview image of the front and rear cameras, and the object data after the operation is separately packaged, and the user is selected to select the object. As shown in Figure 6, portrait A, portrait B, background A, and background B all support the user's choice. Among them, the object segmentation method may have a segmentation error or inaccuracy, and the user can correct the result of the object segmentation through the touch screen.
  • FIG. 7 is a schematic diagram of a composite preview picture of a multi-camera picture taken according to an embodiment of the present invention. As shown in FIG. 7, the user combines the selected portrait A, scene B, and background B to form a composite preview picture, thereby realizing a scene effect of the user and the scene.
  • portrait A is a front camera preview area object
  • portrait B is a rear camera preview area object
  • the background may be a front camera preview area background or a rear camera preview area background.
  • the resolution of the entire photo storage can be adjusted according to the object with the lowest resolution in the photo.
  • the user can also select an object or background from the pre-stored data to be added to the composite preview image.
  • Focus adjustment The front and rear cameras can perform autofocus separately according to their respective viewing contents. Through the controller, the user can select or change the focus area of one or more cameras. Usually, the object selected by the user defaults to the focus object. In addition, the user can adjust the position, size or deformation of the object in the synthesized preview picture through the controller. In order to make the front and rear camera images and background images more consistent, it is necessary to adjust the brightness consistency and white balance consistency of the preview images of the two cameras before completing the shooting.
  • Brightness consistency adjustment Comparing the preview images of the front and rear cameras, if the average value of the pixel brightness average of the preview image exceeds a predetermined threshold, the brightness of the camera shooting content is adjusted to make different objects in the synthesized preview image, The background effect is consistent to some extent.
  • the details are as follows: Read the average brightness of the pixels of the preview images of the front camera and the rear camera, and compare the average brightness Y of the pixels of similar objects or a certain area or the entire picture in the preview images of the two cameras.
  • the brightness of the preview picture of the front camera or the preview picture of the rear camera is brightnessed. Modulation, so that the brightness of the preview image is consistent.
  • the user can also adjust the brightness of the preview image of the front or rear camera through the touch screen.
  • some subjects may be too dark or too bright to affect the overall brightness, resulting in inaccurate adjustment of brightness consistency. Therefore, it is necessary to increase the area where the camera shooting area is too dark or too bright. If there is a black or over-lighted area in the shooting area, the effect of the area should be considered when calculating the average pixel brightness of the picture.
  • the pixel of the area can be not calculated when calculating the average pixel brightness of the picture.
  • user manual brightness adjustment is added, including adjustment of individual object brightness and background brightness in the composite preview picture.
  • the user can also manually adjust the different objects and background brightness in the synthesized preview picture through the controller.
  • the white balance discrimination condition is the gray point in the framing image.
  • the white balance determination result of the camera with the better discrimination condition is selected and applied to the synthesized preview picture. If the white balance discrimination conditions of the two sets of camera framing are not significantly different, and the preset threshold is not exceeded, the white balance discrimination conditions of the two groups of cameras are averaged, and the average white balance discrimination condition is used as the processing result, and is applied to the composite preview.
  • FIG. 8 is a schematic diagram of a white balance gray point selection area of a multi-camera picture taken according to an embodiment of the present invention. As shown in FIG.
  • a pixel area of a gray object in a shooting area is calculated, and the number of gray point pixels satisfying the condition in the front camera framing image is calculated.
  • the gray point condition is (YCbCr color model), m3Cr+c3 ((Cb((mlCr+cl, m2Cb+c2((Cr((m4Cb+c4), the number of pixels is X (sum of gray pixels) o
  • the brightness in X (sum of gray pixels) satisfies Ymin "Y”
  • the number of gray pixels of the gray balance is satisfied.
  • the number of gray dots satisfying the condition in the rear camera framing image is calculated. M2.
  • the calculation method and conditions are the same as those of the front camera.
  • the white balance discrimination condition of the front camera is used as the judgment result, according to Ml Calculate the optimal white balance parameter and apply it to the synthesized preview image white balance processing; otherwise, the white balance discrimination condition of the subsequent camera is used as the determination result, and the optimal white balance parameter is calculated according to M2, and The preview image applied to the composition is white balance processing. If
  • multiple cameras can be used to simultaneously capture multiple objects, and a composite photo is obtained, thereby improving the user's photographing process.
  • the use experience and the realization of the photographing function are more diversified.
  • Industrial Applicability The embodiments of the present invention can simultaneously capture a plurality of objects using a plurality of cameras to obtain a composite picture, thereby enhancing the user's
  • the experience in the process of taking pictures and the realization of the camera function are more diversified. Therefore, it has industrial applicability.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)

Abstract

Disclosed are a method and a device for a terminal to achieve image synthesis based on multiple cameras, which relates to (but is not limited to) the fields of Internet mobile terminal products, computers, tablet personal computers, cellphones, etc. The method comprises: a terminal shooting a plurality of objects respectively using a plurality of camera assemblies, so as to obtain preview images of the plurality of objects; tiling the preview images of the plurality of objects on a display, so that the preview images of the plurality of objects are displayed on the display in a stacked manner; and conducting synthesis processing on the preview images of the plurality of objects stacked on the display, so as to obtain a synthetized multi-camera image synthesis picture. By means of the present invention, a plurality of objects can be shot at the same time using a plurality of cameras, so as to acquire a synthetized multi-camera image synthesis picture, thereby improving the usage experience of a user in the process of shooting, and achieving a more diversified shooting function.

Description

一种终端基于多摄像头实现合照的方法及装置 技术领域 本发明涉及(但不限于)互联网移动终端产品、 计算机、 平板电脑、 手机等领域, 特别涉及一种运用多个摄像头实现合照的方法及装置。 背景技术 随着科技发展, 手机、 拍照摄像设备得到了广泛的普及, 拍照质量、 用户体验方 面不断提升。 伴随手机处理器性能的快速提升, 拍照已经成为智能手机吸引用户的重 要卖点。 从最初的 10万、 30万像素, 到现在的 500万、 800万, 甚至是 4100万像素。 为了提升拍照体验的竞争力, 除了升级摄像头硬件外, 拍照应用也不断丰富, 如最佳 群组拍照、 面部优选、 美肤、 去除移动背景、 动态图片拍摄、 全景拍摄等, 优秀的拍 照应用及功能也成为了手机等产品提升的主要目标。 目前手机拍摄已经足够使用, 但用户期待手机摄像头的画质表现更加出众, 以及 手机前后摄像头有更多丰富化的操作。 在硬件配置方面, 手机摄像头配置不断升级, 像素不断提升, 从单摄像头到前后 双摄像头再到 3D摄像头, 闪光灯从无到有, 并且不断升级。 硬件配置、 性能不断提 升, 对应用开发与提升也起到推动作用。 但是, 相关技术中, 并没有涉及如何进行多 个摄像头合照, 从而使得多个摄像头无法通过同时拍摄获取合成的合照图片。 发明内容 本发明的目的在于提供一种终端基于多摄像头实现合照的方法及装置, 能够解决 现有终端在进行拍摄时, 多个摄像头无法通过同时拍摄获取合成的合照图片的问题。 根据本发明的一个方面, 提供了一种终端基于多摄像头实现合照的方法, 包括: 终端利用多个摄像头组件分别对多个对象进行拍摄, 获得所述多个对象的预览图像; 通过在显示器上平铺所述多个对象的预览图像, 使所述多个对象的预览图像层叠显示 在所述显示器上; 对层叠显示在所述显示器上的多个对象的预览图像进行合成处理, 获得合成的多摄像头合照图片。 优选地, 所述多个摄像头组件包括前置摄像头组件和后置摄像头组件。 优选地, 所述通过在显示器上平铺所述多个对象的预览图像, 使所述多个对象的 预览图像层叠显示在所述显示器上的步骤包括: 将所述后置摄像头组件拍摄到的预览 图像平铺在所述显示器的底层; 将所述前置摄像头组件拍摄到的预览图像平铺在所述 后置摄像头组件拍摄到的预览图像之上, 所述前置摄像头组件拍摄到的预览图像的显 示区域小于所述后置摄像头组件拍摄到的预览图像的显示区域。 优选地, 对层叠显示在所述显示器上的多个对象的预览图像进行合成处理, 获得 合成的多摄像头合照图片的步骤包括: 利用终端处理器对所述层叠显示在所述显示器 上的多个对象的预览图像进行对象分离运算, 得到相互独立的对象图像和背景图像; 对至少一部分对象图像或 /和背景图像进行组合处理, 得到合成的多摄像头合照图片。 优选地, 所述的对至少一部分对象图像或 /和背景图像进行组合处理的步骤包括: 对至少一部分对象图像或 /和背景图像进行亮度调整, 使所述至少一部分对象图像或 / 和背景图像的亮度一致; 对至少一部分对象图像数据或 /和背景图像进行白平衡调整, 使所述至少一部分对象图像数据或 /和背景图像的白平衡一致。 优选地, 对至少一部分对象图像或 /和背景图像进行亮度调整的步骤包括: 通过读 取所述多个对象的预览图像的像素亮度平均值, 计算出所述像素亮度平均值差值; 将 所述像素亮度平均值差值与预置的第一阈值进行比较; 若所述像素亮度平均值差值大 于预置的第一阈值, 则对所述至少一部分对象图像或 /和背景图像的亮度进行调整。 优选地, 对至少一部分对象图像或 /和背景图像进行白平衡调整的步骤包括: 通过 计算出所述多个对象的预览图像的灰点像素数, 得到所述多个对象的预览图像的灰点 像素数差值; 将所述灰点像素数差值与预置的第二阈值进行比较, 并根据得到的比较 结果对所述至少一部分对象图像或 /和背景图像的白平衡进行调整。 优选地,根据得到的比较结果对所述至少一部分对象图像或 /和背景图像的白平衡 进行调整的步骤包括: 若所述多个对象的预览图像的灰点像素数差值大于预置的第二 阈值, 则根据最大灰点像素数数值计算出最优的白平衡参数, 并利用其对所述至少一 部分对象图像或 /和背景图像的白平衡进行调整; 若所述多个对象的预览图像的灰点像 素数差值小于预置的第二阈值, 则计算出所述多个对象的预览图像的灰点像素数平均 值, 并利用其对所述至少一部分对象图像或 /和背景图像的白平衡进行调整。 根据本发明的另一方面, 提供了一种终端基于多摄像头实现合照的装置, 包括: 拍摄模块, 设置为终端利用多个摄像头组件分别对多个对象进行拍摄, 获得所述多个 对象的预览图像; 平铺模块, 设置为通过在显示器上平铺所述多个对象的预览图像, 使所述多个对象的预览图像层叠显示在所述显示器上; 合成模块, 设置为对层叠在所 述显示器上的多个对象的预览图像进行合成处理, 获得合成的多摄像头合照图片。 优选地, 所述的合成模块进一步包括: 亮度子模块, 设置为对至少一部分对象图 像或 /和背景图像进行亮度调整, 使所述至少一部分对象图像或 /和背景图像的亮度一 致; 白平衡子模块, 设置为对至少一部分对象图像或 /和背景图像进行白平衡调整, 使 所述至少一部分对象图像或 /和背景图像的白平衡一致。 与现有技术相比较,本发明实施例能够同时使用多个摄像头对多个对象进行拍摄, 获取合成的合照图片, 从而提升用户在拍照过程中的使用体验, 以及实现拍照功能更 加的多元化。 附图说明 图 1是本发明实施例提供的终端基于多摄像头实现合照的方法流程图; 图 2是本发明实施例提供的终端基于多摄像头实现合照的装置结构示意图; 图 3是本发明实施例提供的终端基于多摄像头实现合照的装置结构示意图; 图 4是本发明实施例提供的终端基于多摄像头实现合照的手机摄像装置结构示意 图; 图 5是本发明实施例提供的终端基于多摄像头实现合照的方法流程图; 图 6 是本发明实施例提供的终端基于多摄像头实现合照的合成前预览图片示意 图; 图 7是本发明实施例提供的终端基于多摄像头实现合照的合成预览图片示意图; 图 8 是本发明实施例提供的终端基于多摄像头实现合照的白平衡灰点选区示意 图。 具体实施方式 以下结合附图对本发明的优选实施例进行详细说明, 应当理解, 以下所说明的优 选实施例仅用于说明和解释本发明, 并不用于限定本发明。 图 1是本发明实施例提供的终端基于多摄像头实现合照的方法流程图, 如图 1所 示, 主要包括步骤如下步骤 S1-步骤 S3。 步骤 S1 : 终端利用多个摄像头组件分别对多个对象进行拍摄, 获得所述多个对象 的预览图像。 在步骤 S1中, 所述多个摄像头组件包括前置摄像头组件和后置摄像头组件。 步骤 S2: 通过在显示器上平铺所述多个对象的预览图像, 使所述多个对象的预览 图像层叠显示在所述显示器上。 在步骤 S2中,可以将所述后置摄像头组件拍摄到的预览图像平铺在所述显示器的 底层; 然后将所述前置摄像头组件拍摄到的预览图像平铺在所述后置摄像头组件拍摄 到的预览图像之上, 所述前置摄像头组件拍摄到的预览图像的显示区域小于所述后置 摄像头组件拍摄到的预览图像的显示区域。 步骤 S3 : 对层叠显示在所述显示器上的多个对象的预览图像进行合成处理, 获得 合成的多摄像头合照图片。 在步骤 S3中,可以利用终端处理器对所述层叠显示在所述显示器上的多个对象的 预览图像进行对象分离运算, 得到相互独立的对象图像和背景图像; 对至少一部分对 象图像或 /和背景图像进行组合处理, 得到合成的多摄像头合照图片。 可选地,对至少一部分对象图像或 /和背景图像进行组合处理的步骤可以包括:对 至少一部分对象图像或 /和背景图像进行亮度调整, 使所述至少一部分对象图像或 /和 背景图像的亮度一致; 对至少一部分对象图像数据或 /和背景图像进行白平衡调整,使 所述至少一部分对象图像数据或 /和背景图像的白平衡一致。 可选地,对至少一部分对象图像或 /和背景图像进行亮度调整的步骤包括:通过读 取所述多个对象的预览图像的像素亮度平均值, 计算出所述像素亮度平均值差值; 将 所述像素亮度平均值差值与预置的第一阈值进行比较; 若所述像素亮度平均值差值大 于预置的第一阈值, 则对所述至少一部分对象图像或 /和背景图像的亮度进行调整。 可选地, 对至少一部分对象图像或 /和背景图像进行白平衡调整的步骤可以包括: 通过计算出所述多个对象的预览图像的灰点像素数, 得到所述多个对象的预览图像的 灰点像素数差值; 将所述灰点像素数差值与预置的第二阈值进行比较, 并根据得到的 比较结果对所述至少一部分对象图像或 /和背景图像的白平衡进行调整。 可选地,根据得到的比较结果对所述至少一部分对象图像或 /和背景图像的白平衡 进行调整的步骤可以包括: 若所述多个对象的预览图像的灰点像素数差值大于预置的 第二阈值, 则根据最大灰点像素数数值计算出最优的白平衡参数, 并利用其对所述至 少一部分对象图像或 /和背景图像的白平衡进行调整;若所述多个对象的预览图像的灰 点像素数差值小于预置的第二阈值, 则计算出所述多个对象的预览图像的灰点像素数 平均值, 并利用其对所述至少一部分对象图像或 /和背景图像的白平衡进行调整。 图 2是本发明实施例提供的多摄像头合照图片的装置结构示意图, 如图 2所示, 该装置主要包括: 拍摄模块、 平铺模块和合成模块。 其中, 所述拍摄模块设置为终端利用多个摄像头组件分别对多个对象进行拍摄, 获得所述多个对象的预览图像。 所述平铺模块设置为通过在显示器上平铺所述多个对象的预览图像, 使所述多个 对象的预览图像层叠显示在所述显示器上。 所述合成模块设置为对层叠显示在所述显示器上的多个对象的预览图像进行合成 处理, 获得合成的多摄像头合照图片。 其中, 所述合成模块的亮度子模块设置为对至 少一部分对象图像或 /和背景图像进行亮度调整, 使所述至少一部分对象图像或 /和背 景图像的亮度一致。 所述合成模块的白平衡子模块设置为对至少一部分对象图像或 / 和背景图像进行白平衡调整, 使所述至少一部分对象图像或 /和背景图像的白平衡一 致。 图 3是本发明实施例提供的多摄像头合照图片的装置结构示意图, 如图 3所示, 该装置包括两个或两个以上的摄像头组件, 摄像头与系统可编程 (ISP: In-System Programming)相连, 每组摄像头经由 ISP与处理器相连, 处理器连接一个或多个显示 器和控制器。其中, 控制器可以是触摸板, 显示器和控制器可以是合为一体的触摸屏, ISP 也可以内嵌于处理器中或摄像头组件中。 通过两个或两个以上的摄像头获取对应 的预览内容, 通过 ISP和处理器对预览内容进行处理, 然后在显示器上显示。 通过处 理器中的对象分割算法, 将每组摄像头的预览内容中的不同对象与背景进行分割。 用 户通过控制器可以选择每组摄像头预览内容中的一个或多个任一对象和背景来组合成 新的拍摄预览图片, 用户也可以从预存的数据中选择对象或背景加入到合成的预览图 片中, 最后用户通过控制器完成拍照。 图 4是本发明实施例提供的多摄像头合照图片的手机摄像装置结构示意图, 如图 4所示, 以手机为例, 前置摄像头和后置摄像头分别通过 ISP与处理器连接, 触摸屏 作为显示器和控制器与处理器相连。 通过前置和后置摄像头获取对应的预览内容, 通 过 ISP和处理器对预览内容进行处理, 然后在显示器上显示。 通过处理器中的对象分 割算法, 将每组摄像头的预览内容中的不同对象与背景进行分割。 用户通过控制器可 以选择每组摄像头预览内容中的一个或多个任一对象和背景来组合成新的拍摄预览图 片, 用户也可以从预存的数据中选择对象或背景加入到合成的摄预览图片中, 最后用 户通过控制器完成拍照。 图 5是本发明实施例提供的多摄像头合照图片的方法流程图, 如图 5所示, 具体 步骤包括: 开始、 启动前置和后置摄像头、 摄像头初始化、 合成预览图像并显示、 对 象分割处理、 合照对象确认、 对焦调整、 亮度一致性调整、 白平衡一致性调整、 完成 拍照和图片保存。 具体步骤如以下 (1 ) - (6) 所描述。 ( 1 )合成预览图像并显示。 在初始化后, 将前置摄像头、 后置摄像头预览图像进 行处理, 在显示屏上同时显示出来。 图 6是本发明实施例提供的多摄像头合照图片的 合成前预览图片示意图, 为本发明实施例提供的一种常用的合照对象确认应用场景, 本发明不限于此, 本技术领域技术人员可以根据本发明的原理进行各种修改。 如图 6 所示, 人像 B和背景 B为后置摄像头预览图片, 可以以窗口或图层的形式置于底层; 人像 A和背景 A为前置摄像头预览图片, 也可以以窗口或图层的形式置于上层; 上层 前置摄像头预览图片区域小于底层后置摄像头预览图片区域。 其中, 所述人像亦可以 替换为景物。 FIELD OF THE INVENTION The present invention relates to, but is not limited to, the field of Internet mobile terminal products, computers, tablet computers, mobile phones, and the like, and more particularly to a method and apparatus for implementing a photographing using multiple cameras. . BACKGROUND With the development of science and technology, mobile phones and camera devices have been widely popularized, and the quality of photographs and user experience have been continuously improved. With the rapid improvement of the performance of mobile phone processors, photography has become an important selling point for smartphones to attract users. From the initial 100,000, 300,000 pixels, to the current 5 million, 8 million, or even 41 million pixels. In order to enhance the competitiveness of the camera experience, in addition to upgrading the camera hardware, the camera application is also constantly enriched, such as the best group photo, face preference, skin beauty, removal of mobile background, dynamic picture shooting, panoramic shooting, etc., excellent photo application and The function has also become the main goal of product upgrades such as mobile phones. At present, mobile phone shooting is enough, but users expect the image quality of the mobile phone camera to be more outstanding, and the camera before and after the mobile phone has more rich operations. In terms of hardware configuration, the mobile phone camera configuration is constantly upgraded, and the pixels are constantly improving. From a single camera to a front and rear dual camera to a 3D camera, the flash is built from scratch and constantly upgraded. Hardware configuration and performance are constantly improving, which also promotes application development and improvement. However, in the related art, how to perform a plurality of camera photographings is not involved, so that a plurality of cameras cannot acquire a combined photographed picture by simultaneous photographing. SUMMARY OF THE INVENTION An object of the present invention is to provide a method and apparatus for realizing a photographing of a terminal based on a multi-camera, which can solve the problem that a plurality of cameras cannot acquire a combined photographed picture by simultaneous shooting while the existing terminal is photographing. According to an aspect of the present invention, a method for implementing a photographing of a plurality of cameras based on a multi-camera is provided, the method comprising: capturing, by the terminal, a plurality of objects by using a plurality of camera components to obtain a preview image of the plurality of objects; Navigating a preview image of the plurality of objects, causing a preview image of the plurality of objects to be displayed on the display; and synthesizing the preview images of the plurality of objects stacked on the display to obtain a synthesized image Multi-camera photo. Preferably, the plurality of camera assemblies include a front camera assembly and a rear camera assembly. Preferably, the step of layering the preview images of the plurality of objects on the display by tiling the preview images of the plurality of objects on the display comprises: capturing the rear camera components a preview image is tiled on the bottom layer of the display; a preview image captured by the front camera component is tiled over the preview image captured by the rear camera component, and the preview captured by the front camera component The display area of the image is smaller than the display area of the preview image captured by the rear camera assembly. Preferably, the step of synthesizing the preview images of the plurality of objects stacked on the display to obtain the synthesized multi-camera photographs comprises: displaying, by the terminal processor, the plurality of stacks on the display The preview image of the object performs an object separation operation to obtain mutually independent object images and background images; and at least a part of the object images or/and the background images are combined to obtain a combined multi-camera photographed image. Preferably, the step of combining the at least part of the object image or/and the background image comprises: performing brightness adjustment on at least a part of the object image or/and the background image, so that the at least part of the object image or/and the background image The brightness is uniform; white balance adjustment is performed on at least a part of the object image data or/and the background image to make the white balance of the at least part of the object image data or/and the background image coincide. Preferably, the step of performing brightness adjustment on at least a part of the object image or/and the background image comprises: calculating a difference value of the pixel brightness average value by reading an average value of pixel brightness of the preview image of the plurality of objects; Comparing the pixel brightness average difference value with a preset first threshold value; if the pixel brightness average value difference is greater than a preset first threshold value, performing brightness on the at least one part of the object image or/and the background image Adjustment. Preferably, the step of performing white balance adjustment on at least a part of the object image or/and the background image comprises: obtaining a gray point of the preview image of the plurality of objects by calculating a number of gray point pixels of the preview image of the plurality of objects a pixel number difference value; comparing the gray point pixel number difference value with a preset second threshold value, and adjusting a white balance of the at least one part of the object image or/and the background image according to the obtained comparison result. Preferably, the step of adjusting the white balance of the at least part of the object image or/and the background image according to the obtained comparison result comprises: if the difference of the gray point pixel number of the preview image of the plurality of objects is greater than a preset number a second threshold, the optimal white balance parameter is calculated according to the maximum gray point pixel number value, and the white balance of the at least part of the object image or/and the background image is adjusted by using; if the preview image of the plurality of objects Calculating an average value of the gray point pixels of the preview image of the plurality of objects, and using the same for the at least part of the object image or/and the background image White balance is adjusted. According to another aspect of the present invention, an apparatus for implementing a photographing of a plurality of cameras based on a multi-camera is provided, comprising: a photographing module configured to respectively capture a plurality of objects by using a plurality of camera components to obtain a preview of the plurality of objects An image; a tile module, configured to tile a preview image of the plurality of objects on the display, And displaying a preview image of the plurality of objects on the display; and a synthesizing module configured to synthesize a preview image of the plurality of objects stacked on the display to obtain a synthesized multi-camera photographed picture. Preferably, the synthesizing module further includes: a brightness sub-module, configured to perform brightness adjustment on at least a part of the object image or/and the background image to make the brightness of the at least part of the object image or/and the background image consistent; white balancer And a module configured to perform white balance adjustment on at least a portion of the object image or/and the background image to make the white balance of the at least a portion of the object image or/and the background image coincide. Compared with the prior art, the embodiment of the present invention can simultaneously capture multiple objects by using multiple cameras to obtain a combined picture, thereby improving the user experience in the process of taking pictures, and realizing more diversification of the camera function. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a flow chart of a method for implementing a photographing of a terminal based on a multi-camera according to an embodiment of the present invention; FIG. 2 is a schematic structural diagram of a device for realizing a photographing of a terminal based on a multi-camera according to an embodiment of the present invention; FIG. 4 is a schematic structural diagram of a mobile phone camera device for implementing a camera based on a multi-camera according to an embodiment of the present invention; FIG. 5 is a schematic diagram of a terminal based on a multi-camera according to an embodiment of the present invention; FIG. 6 is a schematic diagram of a pre-synthesis preview picture of a terminal based on a multi-camera according to an embodiment of the present invention; FIG. 7 is a schematic diagram of a composite preview picture of a terminal based on a multi-camera according to an embodiment of the present invention; FIG. It is a schematic diagram of a white balance gray point selection area in which a terminal implements a photographing based on a multi-camera according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The preferred embodiments of the present invention are described in detail below with reference to the accompanying drawings. FIG. 1 is a flowchart of a method for implementing a photographing of a terminal based on a multi-camera according to an embodiment of the present invention. As shown in FIG. 1 , the method mainly includes the following steps S1 to S3. Step S1: The terminal respectively captures a plurality of objects by using a plurality of camera components to obtain a preview image of the plurality of objects. In step S1, the plurality of camera assemblies include a front camera assembly and a rear camera assembly. Step S2: The preview images of the plurality of objects are layered and displayed on the display by tiling the preview images of the plurality of objects on the display. In step S2, the preview image captured by the rear camera assembly may be tiled on the bottom layer of the display; then the preview image captured by the front camera assembly is tiled on the rear camera assembly. Above the preview image, the display area of the preview image captured by the front camera component is smaller than the display area of the preview image captured by the rear camera component. Step S3: synthesizing a preview image of a plurality of objects stacked on the display to obtain a synthesized multi-camera photograph. In step S3, the terminal processor may perform object separation operation on the preview image of the plurality of objects displayed on the display by using the terminal processor to obtain mutually independent object images and background images; and at least a part of the object images or/and The background image is combined to obtain a composite multi-camera photograph. Optionally, the step of combining at least a portion of the object image or/and the background image may include: performing brightness adjustment on at least a portion of the object image or/and the background image to cause brightness of the at least a portion of the object image or/and the background image Consistent; white balance adjustment is performed on at least a part of the object image data or/and the background image to make the white balance of the at least part of the object image data or/and the background image coincide. Optionally, the step of performing brightness adjustment on at least a part of the object image or/and the background image comprises: calculating a difference value of the pixel brightness average value by reading an average value of pixel brightness of the preview image of the plurality of objects; The pixel brightness average difference value is compared with a preset first threshold value; if the pixel brightness average value difference is greater than a preset first threshold value, brightness of the at least part of the object image or/and the background image Make adjustments. Optionally, the step of performing white balance adjustment on at least a part of the object image or/and the background image may include: obtaining a preview image of the plurality of objects by calculating a number of gray point pixels of the preview image of the plurality of objects Gray point pixel number difference; comparing the gray point pixel number difference with a preset second threshold value, and adjusting white balance of the at least part of the object image or/and the background image according to the obtained comparison result. Optionally, the step of adjusting the white balance of the at least part of the object image or/and the background image according to the obtained comparison result may include: if the difference of the gray point pixel number of the preview image of the plurality of objects is greater than a preset a second threshold, the optimal white balance parameter is calculated according to the maximum gray point pixel number value, and the white balance of the at least part of the object image or/and the background image is adjusted by using; if the plurality of objects are Calculating an average value of the gray point pixels of the preview image of the plurality of objects, and using the pair of object images and/or the background of the preview image of the plurality of objects, the difference of the gray point pixel number of the preview image is less than a preset second threshold. The white balance of the image is adjusted. 2 is a schematic structural diagram of a device for taking a picture of a multi-camera according to an embodiment of the present invention. As shown in FIG. 2, the device mainly includes: a shooting module, a tiling module, and a synthesizing module. The shooting module is configured to capture, by the terminal, a plurality of objects by using a plurality of camera components to obtain a preview image of the plurality of objects. The tile module is configured to display a preview image of the plurality of objects on the display by tiling a preview image of the plurality of objects on a display. The synthesis module is configured to perform a synthesis process on a preview image of a plurality of objects stacked on the display to obtain a composite multi-camera picture. The brightness sub-module of the synthesis module is configured to perform brightness adjustment on at least a part of the object image or/and the background image to make the brightness of the at least part of the object image or/and the background image coincide. The white balance sub-module of the synthesis module is configured to perform white balance adjustment on at least a portion of the object image or/and the background image to make the white balance of the at least a portion of the object image or/and the background image coincide. 3 is a schematic structural diagram of a device for taking a picture of a multi-camera according to an embodiment of the present invention. As shown in FIG. 3, the device includes two or more camera components, and the camera and system are programmable (ISP: In-System Programming). Connected, each set of cameras is connected to the processor via an ISP, and the processor is connected to one or more displays and controllers. The controller can be a touchpad, and the display and the controller can be integrated touch screens, and the ISP can also be embedded in the processor or in the camera assembly. The corresponding preview content is obtained by two or more cameras, and the preview content is processed by the ISP and the processor, and then displayed on the display. Different objects in the preview content of each group of cameras are segmented with the background by an object segmentation algorithm in the processor. The user can select one or more objects and backgrounds in each group of camera preview contents to be combined into a new shooting preview picture by the controller, and the user can also select an object or background from the pre-stored data to be added to the synthesized preview picture. Finally, the user completes the photo through the controller. 4 is a schematic structural diagram of a mobile phone camera device with a multi-camera picture taken according to an embodiment of the present invention. As shown in FIG. 4, taking a mobile phone as an example, a front camera and a rear camera are respectively connected to a processor through an ISP, and the touch screen is used as a display and The controller is connected to the processor. Get the corresponding preview content through the front and rear cameras. The preview content is processed by the ISP and the processor and then displayed on the display. Different objects in the preview content of each group of cameras are segmented with the background by an object segmentation algorithm in the processor. The controller can select one or more objects and backgrounds in each group of camera preview contents to be combined into a new shooting preview picture by the controller, and the user can also select an object or background from the pre-stored data to be added to the synthesized preview picture. In the middle, the last user completes the photo through the controller. FIG. 5 is a flowchart of a method for multi-camera picture comparison according to an embodiment of the present invention. As shown in FIG. 5, specific steps include: starting, starting front and rear cameras, camera initialization, synthesizing preview image and displaying, object segmentation processing , Photo object confirmation, focus adjustment, brightness consistency adjustment, white balance consistency adjustment, photo completion and picture saving. The specific steps are as described in (1) - (6) below. (1) Combine the preview image and display it. After initialization, the front camera and rear camera preview images are processed and displayed on the display simultaneously. FIG. 6 is a schematic diagram of a pre-synthesis preview image of a multi-camera photographed image according to an embodiment of the present invention. The present invention is not limited thereto, and the present invention may be based on the present invention. The principles of the invention are subject to various modifications. As shown in Figure 6, portrait B and background B are rear camera preview images, which can be placed in the bottom layer in the form of windows or layers; portrait A and background A are front camera preview images, and can also be windows or layers. The form is placed on the upper layer; the upper front camera preview picture area is smaller than the bottom back camera preview picture area. The portrait may also be replaced with a scene.

(2)对象分割处理。通过使用像素对比确认不同对象的边界, 或运动对象捕捉等 对象分割方法, 对前置和后置摄像头的预览图片进行对象分离运算, 将运算后的对象 数据单独封装, 支持用户选择其中的对象。 如图 6所示, 人像 A、 人像 B、 背景 A、 背景 B都支持用户单独选择。 其中, 对象分割方法可能会出现分割错误或不准确的情 况, 用户可以通过触摸屏来修正对象分割的结果。 (2) Object segmentation processing. By using the pixel contrast to confirm the boundary of different objects, or the object segmentation method such as moving object capture, the object is separated from the preview image of the front and rear cameras, and the object data after the operation is separately packaged, and the user is selected to select the object. As shown in Figure 6, portrait A, portrait B, background A, and background B all support the user's choice. Among them, the object segmentation method may have a segmentation error or inaccuracy, and the user can correct the result of the object segmentation through the touch screen.

(3 ) 合照对象确认。 通过触摸屏, 用户可以调整人像 A、 人像 B的大小与位置, 也可从预存的图库中选取作为对象或者背景的图片。 图 7是本发明实施例提供的多摄 像头合照图片的合成预览图片示意图, 如图 7所示, 用户将选择的人像 A、 景物 B和 背景 B组成合成预览图片, 实现用户与景物合照的场景效果。 其中, 人像 A为前置摄 像头预览区域对象, 人像 B为后置摄像头预览区域对象, 背景可以是前置摄像头预览 区域背景或后置摄像头预览区域背景。 另外, 为保证整个合照质量, 可根据合照中分 辨率最低的对象调整整个合照图片存储的分辨率。 此外, 用户也可以从预存的数据中 选择对象或背景加入到合成的摄预览图片中。 (4) 对焦调整。 前置、 后置摄像头可以根据各自的取景内容分别进行自动对焦。 通过控制器, 用户可以选择或更改一个或多个摄像头的对焦区域, 通常设置为用户所 选对象默认为对焦对象。 除此之外, 用户还可以通过控制器对合成的预览图片中对象的位置、 大小或变形 等进行调整。 为了使前置、 后置摄像头所拍对象、 背景图片更一致, 在完成拍摄前还 需要对两个摄像头的预览图片进行亮度一致性和白平衡一致性进行调节。 (3) Confirmation of the subject. Through the touch screen, the user can adjust the size and position of portrait A, portrait B, and also select an image as an object or background from the pre-stored gallery. FIG. 7 is a schematic diagram of a composite preview picture of a multi-camera picture taken according to an embodiment of the present invention. As shown in FIG. 7, the user combines the selected portrait A, scene B, and background B to form a composite preview picture, thereby realizing a scene effect of the user and the scene. . Wherein, portrait A is a front camera preview area object, portrait B is a rear camera preview area object, and the background may be a front camera preview area background or a rear camera preview area background. In addition, to ensure the quality of the entire photo, the resolution of the entire photo storage can be adjusted according to the object with the lowest resolution in the photo. In addition, the user can also select an object or background from the pre-stored data to be added to the composite preview image. (4) Focus adjustment. The front and rear cameras can perform autofocus separately according to their respective viewing contents. Through the controller, the user can select or change the focus area of one or more cameras. Usually, the object selected by the user defaults to the focus object. In addition, the user can adjust the position, size or deformation of the object in the synthesized preview picture through the controller. In order to make the front and rear camera images and background images more consistent, it is necessary to adjust the brightness consistency and white balance consistency of the preview images of the two cameras before completing the shooting.

( 5 )亮度一致性调节。对前置、 后置摄像头的预览图片进行比较, 如果预览图片 的像素亮度平均值差值超过预定阀值, 则对某组摄像头拍摄内容进行亮度调节, 使所 合成的预览图片中不同的对象、 背景效果在一定程度上保持一致。 具体如下: 读取前置摄像头和后置摄像头预览图片的像素亮度平均值, 对比两摄像头预览图 片中类似对象或某一区域或整个画面的像素亮度平均值 Y。 如果前置摄像头预览图片 亮度 Y1和后置摄像头预览图片亮度 Υ2相差大于预定阀值 Dl, 即 |Y1-Y2|>D1, 则对 前置摄像头的预览图片或后置摄像头的预览图片亮度进行亮度调制, 使预览图片亮度 效果一致。此外,用户也可以通过触摸屏选择调整前置或后置摄像头预览图片的亮度。 此外, 摄像头拍摄区域可能还会出现某些对象过黑或过亮, 影响整体亮度, 导致 亮度一致性自动调整不准确的情况。 所以需增加检查摄像头拍摄区域是否有过黑或过 亮的区域。 如果拍摄区域存在过黑或过亮的区域, 在计算画面的像素亮度平均值时, 要考虑该区域的影响, 比如, 可以在计算画面的像素亮度平均值时不计算该区域的像 素。 另外, 增加用户手动亮度调节, 包括对合成预览图片中的单个对象亮度、 背景亮 度的调节。 此外,用户也可以通过控制器手动调节合成的预览图片中不同的对象、背景亮度。 (5) Brightness consistency adjustment. Comparing the preview images of the front and rear cameras, if the average value of the pixel brightness average of the preview image exceeds a predetermined threshold, the brightness of the camera shooting content is adjusted to make different objects in the synthesized preview image, The background effect is consistent to some extent. The details are as follows: Read the average brightness of the pixels of the preview images of the front camera and the rear camera, and compare the average brightness Y of the pixels of similar objects or a certain area or the entire picture in the preview images of the two cameras. If the front camera preview picture brightness Y1 and the rear camera preview picture brightness Υ 2 are greater than the predetermined threshold Dl, ie |Y1-Y2|>D1, the brightness of the preview picture of the front camera or the preview picture of the rear camera is brightnessed. Modulation, so that the brightness of the preview image is consistent. In addition, the user can also adjust the brightness of the preview image of the front or rear camera through the touch screen. In addition, some subjects may be too dark or too bright to affect the overall brightness, resulting in inaccurate adjustment of brightness consistency. Therefore, it is necessary to increase the area where the camera shooting area is too dark or too bright. If there is a black or over-lighted area in the shooting area, the effect of the area should be considered when calculating the average pixel brightness of the picture. For example, the pixel of the area can be not calculated when calculating the average pixel brightness of the picture. In addition, user manual brightness adjustment is added, including adjustment of individual object brightness and background brightness in the composite preview picture. In addition, the user can also manually adjust the different objects and background brightness in the synthesized preview picture through the controller.

(6) 白平衡一致性。 采用先进灰世界算法, 白平衡判别条件为取景图像中灰点。 通过对前置、 后置摄像头取景的白平衡判别条件进行比较, 选择其中判别条件较优的 摄像头的白平衡判定结果应用于合成的预览图片中。 如果两组摄像头取景的白平衡判 别条件无明显差异, 不超过预设阀值, 则平均两组摄像头的白平衡判别条件, 并将平 均后的白平衡判别条件作为处理结果, 应用于合成的预览图片中。 图 8是本发明实施例提供的多摄像头合照图片的白平衡灰点选区示意图, 如图 8 所示, 为拍摄区域灰色物体的像素区域, 计算前置摄像头取景图像中满足条件的灰点 像素数 Ml。 以 Cr为横坐标, Cb为纵坐标, 建立坐标系, 则四条直线 Cb=mlCr+cl, Cr=m4Cb+c4, Cb=m3Cr+c3 , Cr=m2Cb+c2 围成的区域为灰色对象像素区域。 即, 满 足灰点条件为( YCbCr颜色模型表示), m3Cr+c3((Cb((mlCr+cl, m2Cb+c2((Cr((m4Cb+c4 的像素区域, 像素数为 X ( sum of gray pixels ) o 而 X ( sum of gray pixels) 中亮度满足 Ymin《Y《Yman的, 则为满足白平衡判定条件的灰点像素数 M。 同理, 计算出后置摄像头取景图像中满足条件的灰点像素数 M2。 与前置摄像头 的计算方式和条件相同。 若 |M1-M2|>D2 (D2为预设阀值), 且 M1>M2, 则以前置摄像头的白平衡判别条 件作为判定结果, 根据 Ml计算出最优白平衡参数, 并将其应用于合成的预览图片白 平衡处理中; 反之, 则以后置摄像头的白平衡判别条件作为判定结果, 根据 M2计算 出最优白平衡参数, 并将其应用于合成的预览图片白平衡处理中。 若 |M1-M2| 《D2, 则平均两组摄像头的白平衡判别条件, 并将平均后的白平衡判 别条件作为处理结果, 应用于合成的预览图片中。 完成拍照表现为, 用户通过触摸屏操作, 完成拍照。 综上所述, 通过本发明实施例提供的技术方案, 能够同时使用多个摄像头对多个 对象进行拍摄, 获取合成的合照图片, 从而提升用户在拍照过程中的使用体验, 以及 实现拍照功能更加的多元化。 尽管上文对本发明进行了详细说明, 但是本发明不限于此, 本技术领域技术人员 可以根据本发明的原理进行各种修改。 因此, 凡按照本发明原理所作的修改, 都应当 理解为落入本发明的保护范围。 工业实用性 本发明实施例能够同时使用多个摄像头对多个对象进行拍摄, 获取合成的合照图 片, 从而提升用户在拍照过程中的使用体验, 以及实现拍照功能更加的多元化。 因此, 具有工业实用性。 (6) White balance consistency. Using the advanced gray world algorithm, the white balance discrimination condition is the gray point in the framing image. By comparing the white balance discrimination conditions of the front and rear camera framing, the white balance determination result of the camera with the better discrimination condition is selected and applied to the synthesized preview picture. If the white balance discrimination conditions of the two sets of camera framing are not significantly different, and the preset threshold is not exceeded, the white balance discrimination conditions of the two groups of cameras are averaged, and the average white balance discrimination condition is used as the processing result, and is applied to the composite preview. In the picture. FIG. 8 is a schematic diagram of a white balance gray point selection area of a multi-camera picture taken according to an embodiment of the present invention. As shown in FIG. 8 , a pixel area of a gray object in a shooting area is calculated, and the number of gray point pixels satisfying the condition in the front camera framing image is calculated. Ml. Taking Cr as the abscissa and Cb as the ordinate, and establishing the coordinate system, the four straight lines Cb=mlCr+cl, Cr=m4Cb+c4, Cb=m3Cr+c3, Cr=m2Cb+c2 The area enclosed by the gray object pixel area . That is, full The gray point condition is (YCbCr color model), m3Cr+c3 ((Cb((mlCr+cl, m2Cb+c2((Cr((m4Cb+c4), the number of pixels is X (sum of gray pixels) o On the other hand, if the brightness in X (sum of gray pixels) satisfies Ymin "Y", the number of gray pixels of the gray balance is satisfied. For the same reason, the number of gray dots satisfying the condition in the rear camera framing image is calculated. M2. The calculation method and conditions are the same as those of the front camera. If |M1-M2|>D2 (D2 is the preset threshold), and M1>M2, the white balance discrimination condition of the front camera is used as the judgment result, according to Ml Calculate the optimal white balance parameter and apply it to the synthesized preview image white balance processing; otherwise, the white balance discrimination condition of the subsequent camera is used as the determination result, and the optimal white balance parameter is calculated according to M2, and The preview image applied to the composition is white balance processing. If |M1-M2| "D2, the white balance discrimination conditions of the two groups of cameras are averaged, and the average white balance discrimination condition is used as the processing result, and is applied to the synthesized preview picture. Complete the photo table The user can complete the photographing through the touch screen operation. In summary, according to the technical solution provided by the embodiment of the present invention, multiple cameras can be used to simultaneously capture multiple objects, and a composite photo is obtained, thereby improving the user's photographing process. The use experience and the realization of the photographing function are more diversified. Although the invention has been described in detail above, the invention is not limited thereto, and those skilled in the art can make various modifications in accordance with the principles of the invention. The modifications made in accordance with the principles of the present invention should be understood as falling within the scope of the present invention. Industrial Applicability The embodiments of the present invention can simultaneously capture a plurality of objects using a plurality of cameras to obtain a composite picture, thereby enhancing the user's The experience in the process of taking pictures and the realization of the camera function are more diversified. Therefore, it has industrial applicability.

Claims

权 利 要 求 书 、 一种终端基于多摄像头实现合照的方法, 包括: 终端利用多个摄像头组件分别对多个对象进行拍摄, 获得所述多个对象的 预览图像;  The method for obtaining a photograph based on a multi-camera, the method comprising: the terminal respectively capturing a plurality of objects by using a plurality of camera components to obtain a preview image of the plurality of objects; 通过在显示器上平铺所述多个对象的预览图像, 使所述多个对象的预览图 像层叠显示在所述显示器上;  Displaying a preview image of the plurality of objects on the display by tiling a preview image of the plurality of objects on a display; 对层叠显示在所述显示器上的多个对象的预览图像进行合成处理, 获得合 成的多摄像头合照图片。 、 根据权利要求 1所述的方法, 其中, 所述多个摄像头组件包括前置摄像头组件 和后置摄像头组件。 、 根据权利要求 1或 2所述的方法, 其中, 所述通过在显示器上平铺所述多个对 象的预览图像, 使所述多个对象的预览图像层叠显示在所述显示器上的步骤包 括:  A preview image of a plurality of objects stacked on the display is subjected to synthesis processing to obtain a composite multi-camera photograph. The method of claim 1, wherein the plurality of camera assemblies comprise a front camera assembly and a rear camera assembly. The method according to claim 1 or 2, wherein the step of layering the preview images of the plurality of objects on the display by tiling the preview images of the plurality of objects on the display comprises : 将所述后置摄像头组件拍摄到的预览图像平铺在所述显示器的底层; 将所述前置摄像头组件拍摄到的预览图像平铺在所述后置摄像头组件拍摄 到的预览图像之上, 所述前置摄像头组件拍摄到的预览图像的显示区域小于所 述后置摄像头组件拍摄到的预览图像的显示区域。 、 根据权利要求 1所述的方法, 其中, 所述的对层叠显示在所述显示器上的多个 对象的预览图像进行合成处理, 获得合成的多摄像头合照图片的步骤包括: 利用终端处理器对所述层叠显示在所述显示器上的多个对象的预览图像进 行对象分离运算, 得到相互独立的对象图像和背景图像;  And scanning a preview image captured by the rear camera assembly on a bottom layer of the display; and tiling a preview image captured by the front camera component on a preview image captured by the rear camera component, The display area of the preview image captured by the front camera assembly is smaller than the display area of the preview image captured by the rear camera assembly. The method according to claim 1, wherein the step of synthesizing the preview images of the plurality of objects stacked on the display to obtain the synthesized multi-camera photographs comprises: using a terminal processor pair The preview image of the plurality of objects displayed on the display layer is subjected to an object separation operation to obtain mutually independent object images and background images; 对至少一部分对象图像或 /和背景图像进行组合处理,得到合成的多摄像头 合照图片。 、 根据权利要求 4所述的方法, 其中, 所述的对至少一部分对象图像或 /和背景图 像进行组合处理的步骤包括:  At least a part of the object image or/and the background image are combined to obtain a composite multi-camera picture. The method according to claim 4, wherein the step of combining the at least part of the object image or/and the background image comprises: 对至少一部分对象图像或 /和背景图像进行亮度调整,使所述至少一部分对 象图像或 /和背景图像的亮度一致; 对至少一部分对象图像数据或 /和背景图像进行白平衡调整,使所述至少一 部分对象图像数据或 /和背景图像的白平衡一致。 、 根据权利要求 5所述的方法, 其中, 所述的对至少一部分对象图像或 /和背景图 像进行亮度调整的步骤包括: Performing brightness adjustment on at least a part of the object image or/and the background image to make the brightness of the at least part of the object image or/and the background image consistent; Performing white balance adjustment on at least a portion of the object image data or/and the background image to match the white balance of the at least a portion of the object image data or/and the background image. The method according to claim 5, wherein the step of performing brightness adjustment on at least a part of the object image or/and the background image comprises: 通过读取所述多个对象的预览图像的像素亮度平均值, 计算出所述像素亮 度平均值差值;  Calculating the pixel brightness average difference value by reading an average value of pixel brightness of the preview image of the plurality of objects; 将所述像素亮度平均值差值与预置的第一阈值进行比较;  Comparing the pixel brightness average difference value with a preset first threshold value; 若所述像素亮度平均值差值大于预置的第一阈值, 则对所述至少一部分对 象图像或 /和背景图像的亮度进行调整。 、 根据权利要求 5所述的方法, 其中, 所述的对至少一部分对象图像或 /和背景图 像进行白平衡调整的步骤包括:  If the pixel luminance average difference is greater than a preset first threshold, the brightness of the at least a portion of the image or/and the background image is adjusted. The method according to claim 5, wherein the step of performing white balance adjustment on at least a part of the object image or/and the background image comprises: 通过计算出所述多个对象的预览图像的灰点像素数, 得到所述多个对象的 预览图像的灰点像素数差值;  Obtaining a gray point pixel number difference value of the preview image of the plurality of objects by calculating a gray point pixel number of the preview image of the plurality of objects; 将所述灰点像素数差值与预置的第二阈值进行比较, 并根据得到的比较结 果对所述至少一部分对象图像或 /和背景图像的白平衡进行调整。 、 根据权利要求 7所述的方法, 其中, 所述的根据得到的比较结果对所述至少一 部分对象图像或 /和背景图像的白平衡进行调整的步骤包括:  The gray point pixel number difference is compared with a preset second threshold, and the white balance of the at least a part of the object image or/and the background image is adjusted according to the obtained comparison result. The method according to claim 7, wherein the step of adjusting the white balance of the at least one part of the object image or/and the background image according to the obtained comparison result comprises: 若所述多个对象的预览图像的灰点像素数差值大于预置的第二阈值, 则根 据最大灰点像素数数值计算出最优的白平衡参数, 并利用其对所述至少一部分 对象图像或 /和背景图像的白平衡进行调整;  If the gray pixel pixel difference value of the preview image of the plurality of objects is greater than a preset second threshold, calculating an optimal white balance parameter according to the maximum gray point pixel number value, and using the pair of the at least part of the object Adjust the white balance of the image or / and background image; 若所述多个对象的预览图像的灰点像素数差值小于预置的第二阈值, 则计 算出所述多个对象的预览图像的灰点像素数平均值, 并利用其对所述至少一部 分对象图像或 /和背景图像的白平衡进行调整。 、 一种终端基于多摄像头实现合照的装置, 包括: 拍摄模块, 设置为终端利用多个摄像头组件分别对多个对象进行拍摄, 获 得所述多个对象的预览图像;  If the gray pixel pixel difference value of the preview image of the plurality of objects is less than a preset second threshold, calculating an average value of the gray dot pixels of the preview image of the plurality of objects, and using the pair of the at least The white balance of a part of the object image or/and the background image is adjusted. And a device for implementing a photographing based on a multi-camera, comprising: a photographing module, configured to respectively capture a plurality of objects by using a plurality of camera components to obtain a preview image of the plurality of objects; 平铺模块, 设置为通过在显示器上平铺所述多个对象的预览图像, 使所述 多个对象的预览图像层叠显示在所述显示器上; 合成模块, 设置为对层叠显示在所述显示器上的多个对象的预览图像进行 合成处理, 获得合成的多摄像头合照图片。 根据权利要求 9所述的装置, 其中, 所述的合成模块进一步包括: 亮度子模块, 设置为对至少一部分对象图像或 /和背景图像进行亮度调整, 使所述至少一部分对象图像或 /和背景图像的亮度一致; 白平衡子模块,设置为对至少一部分对象图像或 /和背景图像进行白平衡调 整, 使所述至少一部分对象图像或 /和背景图像的白平衡一致。 a tiling module, configured to display a preview image of the plurality of objects on the display by tiling a preview image of the plurality of objects on a display; The synthesis module is configured to perform a synthesis process on the preview images of the plurality of objects stacked on the display to obtain a composite multi-camera picture. The apparatus according to claim 9, wherein the synthesizing module further comprises: a brightness sub-module, configured to perform brightness adjustment on at least a part of the object image or/and the background image, so that the at least part of the object image or/and the background The brightness of the image is uniform; the white balance sub-module is configured to perform white balance adjustment on at least a portion of the object image or/and the background image to match the white balance of the at least a portion of the object image or/and the background image.
PCT/CN2014/080346 2014-04-23 2014-06-19 Method and device for terminal to achieve image synthesis based on multiple cameras Ceased WO2015161561A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410164148.9A CN105025215B (en) 2014-04-23 2014-04-23 A kind of terminal realizes the method and device of group photo based on multi-cam
CN201410164148.9 2014-04-23

Publications (1)

Publication Number Publication Date
WO2015161561A1 true WO2015161561A1 (en) 2015-10-29

Family

ID=54331670

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/080346 Ceased WO2015161561A1 (en) 2014-04-23 2014-06-19 Method and device for terminal to achieve image synthesis based on multiple cameras

Country Status (2)

Country Link
CN (1) CN105025215B (en)
WO (1) WO2015161561A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105391866A (en) * 2015-11-30 2016-03-09 东莞酷派软件技术有限公司 A photographing method, device and terminal
CN107807772A (en) * 2017-10-17 2018-03-16 广东欧珀移动通信有限公司 Image processing method, device and mobile terminal

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979163A (en) * 2015-11-06 2016-09-28 乐视移动智能信息技术(北京)有限公司 Shooting method and device
CN106210542A (en) * 2016-08-16 2016-12-07 深圳市金立通信设备有限公司 The method of a kind of photo synthesis and terminal
CN106528855A (en) * 2016-11-28 2017-03-22 深圳市金立通信设备有限公司 Photo display method and terminal
CN106657788A (en) * 2016-12-28 2017-05-10 深圳众思科技有限公司 Image processing method for electronic device and electronic device
CN106973227A (en) * 2017-03-31 2017-07-21 努比亚技术有限公司 Intelligent photographing method and device based on dual camera
CN107197144A (en) * 2017-05-24 2017-09-22 珠海市魅族科技有限公司 Filming control method and device, computer installation and readable storage medium storing program for executing
CN107222677A (en) * 2017-05-27 2017-09-29 成都通甲优博科技有限责任公司 The method and device that multi-cam is opened simultaneously
CN108986770B (en) * 2017-06-02 2020-11-10 广东夏野日用电器有限公司 Information terminal
CN108986768B (en) 2017-06-02 2020-09-22 广东夏野日用电器有限公司 Control method
CN108600611A (en) * 2018-03-28 2018-09-28 努比亚技术有限公司 A kind of image pickup method, mobile terminal and computer readable storage medium
CN108234891B (en) * 2018-04-04 2019-11-05 维沃移动通信有限公司 A kind of photographic method and mobile terminal
CN109302511A (en) * 2018-09-26 2019-02-01 努比亚技术有限公司 A kind of image capturing method, device and computer readable storage medium
CN111225180B (en) * 2018-11-26 2021-07-20 浙江宇视科技有限公司 Screen processing method and device
CN109600547B (en) * 2018-11-30 2021-01-12 Oppo广东移动通信有限公司 Photographing method and device, electronic equipment and storage medium
CN110933300B (en) * 2019-11-18 2021-06-22 深圳传音控股股份有限公司 An image processing method and electronic terminal device
CN112333386A (en) * 2020-10-29 2021-02-05 维沃移动通信(杭州)有限公司 Shooting method and device and electronic equipment
CN112929566B (en) * 2021-01-22 2022-09-13 维沃移动通信(杭州)有限公司 Display control method, display control device, electronic apparatus, and medium
CN112950635A (en) * 2021-04-26 2021-06-11 Oppo广东移动通信有限公司 Gray dot detection method, gray dot detection device, electronic device, and storage medium
CN116471429B (en) * 2023-06-20 2023-08-25 上海云梯信息科技有限公司 Image information pushing method based on behavior feedback and real-time video transmission system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102055834A (en) * 2009-10-30 2011-05-11 Tcl集团股份有限公司 Double-camera photographing method of mobile terminal
CN202488611U (en) * 2012-03-31 2012-10-10 北京三星通信技术研究有限公司 Signal processing circuit of mobile equipment and mobile equipment
CN102938825A (en) * 2012-11-12 2013-02-20 北京小米科技有限责任公司 Method and device for shooting pictures and recording videos
CN103716537A (en) * 2013-12-18 2014-04-09 宇龙计算机通信科技(深圳)有限公司 Photograph synthesizing method and terminal

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003189168A (en) * 2001-12-21 2003-07-04 Nec Corp Camera for mobile phone
JP6114495B2 (en) * 2012-02-20 2017-04-12 キヤノン株式会社 Image display device, image display method, and imaging system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102055834A (en) * 2009-10-30 2011-05-11 Tcl集团股份有限公司 Double-camera photographing method of mobile terminal
CN202488611U (en) * 2012-03-31 2012-10-10 北京三星通信技术研究有限公司 Signal processing circuit of mobile equipment and mobile equipment
CN102938825A (en) * 2012-11-12 2013-02-20 北京小米科技有限责任公司 Method and device for shooting pictures and recording videos
CN103716537A (en) * 2013-12-18 2014-04-09 宇龙计算机通信科技(深圳)有限公司 Photograph synthesizing method and terminal

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105391866A (en) * 2015-11-30 2016-03-09 东莞酷派软件技术有限公司 A photographing method, device and terminal
CN107807772A (en) * 2017-10-17 2018-03-16 广东欧珀移动通信有限公司 Image processing method, device and mobile terminal

Also Published As

Publication number Publication date
CN105025215B (en) 2019-09-24
CN105025215A (en) 2015-11-04

Similar Documents

Publication Publication Date Title
WO2015161561A1 (en) Method and device for terminal to achieve image synthesis based on multiple cameras
US9196071B2 (en) Image splicing method and apparatus
CN105635579B (en) A kind of method for displaying image and device
CN106412458A (en) Image processing method and apparatus
WO2013155804A1 (en) Photograph shooting method and electronic device
CN105049728A (en) Method and device for acquiring shot image
CN105049695A (en) Video recording method and device
EP2323102A1 (en) Image capturing aid
WO2022001897A1 (en) Image photographing method and electronic device
CN110177216B (en) Image processing method, device, mobile terminal and storage medium
TWI536829B (en) Electronic apparatus using image processing
JP2001169174A (en) Digital image pickup device, image processing-system provided therewith, image processor, digital image pickup method and recording medium
CN108810326B (en) Photographing method and device and mobile terminal
WO2022022633A1 (en) Image display method and apparatus, and electronic device
CN106791390B (en) Wide-angle self-timer real-time preview method and user terminal
CN112637515A (en) Shooting method and device and electronic equipment
CN106888333A (en) A kind of image pickup method and device
TWI520604B (en) Camera device, image preview system thereof and image preview method
CN105139340A (en) Method and device for splicing panoramic photos
CN105827934A (en) Image processing method of electronic device and electronic device
CN106162024A (en) Photo processing method and device
CN104735353B (en) A kind of method and device for the photo that pans
CN104539847B (en) A kind of panorama photographic method and mobile terminal
WO2016202073A1 (en) Image processing method and apparatus
TW201717190A (en) Display adjustment method electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14890389

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14890389

Country of ref document: EP

Kind code of ref document: A1