[go: up one dir, main page]

WO2016008359A1 - Procédé de synthèse d'images de suivi de mouvement d'objets, dispositif et support de stockage informatique - Google Patents

Procédé de synthèse d'images de suivi de mouvement d'objets, dispositif et support de stockage informatique Download PDF

Info

Publication number
WO2016008359A1
WO2016008359A1 PCT/CN2015/082641 CN2015082641W WO2016008359A1 WO 2016008359 A1 WO2016008359 A1 WO 2016008359A1 CN 2015082641 W CN2015082641 W CN 2015082641W WO 2016008359 A1 WO2016008359 A1 WO 2016008359A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
object motion
motion trajectory
synthesizing
trajectory image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2015/082641
Other languages
English (en)
Chinese (zh)
Inventor
邹明双
崔小辉
苗雷
里强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Publication of WO2016008359A1 publication Critical patent/WO2016008359A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio

Definitions

  • the invention relates to an imaging technology, in particular to a method, a device and a computer storage medium for synthesizing an object motion trajectory image.
  • the camera (such as a mobile phone, camera, etc.) captures the trajectory of the object (such as the motion trajectory of the star), and finally only gets an image showing the trajectory of the object, that is, the motion trajectory image of the object. After completing the trajectory of the photographed object and generating the motion trajectory image of the object, the user cannot return to view the image of the motion trajectory of the object generated within a certain period of time during the shooting.
  • the main purpose of the embodiment of the present invention is to solve the technical problem that the user cannot return to view the motion trajectory image of the object generated within a certain period of time after the trajectory of the object is completed and the motion trajectory image of the object is generated.
  • an embodiment of the present invention provides a method for synthesizing an object motion trajectory image, where the method for synthesizing the object motion trajectory image includes:
  • the first image is taken as the current image to be composited
  • the second image After taking the second image, take an image every preset exposure time, and at each When an image is captured, the currently captured image is combined with the current image to be composited to generate a new object motion trajectory image, and the new object motion trajectory image is taken as the current image to be composited;
  • the object motion trajectory image When the object motion trajectory image satisfies the first preset condition, the object motion trajectory image that satisfies the first preset condition is stored.
  • the synthesizing the currently captured image with the current image to be synthesized to generate a new object motion trajectory image includes:
  • the pixels in the current image to be combined are replaced with the pixels in the corresponding positions in the currently captured image, and a new object motion trajectory image is generated.
  • storing the object motion trajectory image that satisfies the first preset condition including:
  • the object motion trajectory image is a star track image.
  • an embodiment of the present invention further provides a method for synthesizing an object motion trajectory image, where the method for synthesizing the object motion trajectory image includes:
  • Selecting the first image as the current image to be composited selecting the second image; synthesizing the second image with the current image to be combined to generate an object motion trajectory image, and using the object motion trajectory image as the current image Image to be synthesized;
  • the object motion trajectory image When the object motion trajectory image satisfies the second preset condition, the object motion trajectory image that satisfies the second preset condition is stored.
  • storing the object motion trajectory image that satisfies the second preset condition including:
  • the object motion trajectory image is a star track image.
  • an embodiment of the present invention further provides an apparatus for synthesizing an object motion trajectory image, where the apparatus for synthesizing an object motion trajectory image includes:
  • An initialization module configured to: when the first image is captured, the first image is the current image to be composited; and when the second image is captured, the second image and the current image to be composited Performing synthesis to generate an object motion trajectory image, and using the object motion trajectory image as the current image to be synthesized;
  • the first synthesizing module is configured to take an image every preset exposure time after the second image is captured, and perform the current captured image and the current image to be synthesized when each image is captured Synthesizing to generate a new object motion trajectory image, and using the new object motion trajectory image as the current image to be composited;
  • the first storage module is configured to store an object motion trajectory image that satisfies the first preset condition when the object motion trajectory image satisfies the first preset condition.
  • the first synthesis module includes:
  • a determining unit configured to determine a brightness value of a pixel in an image currently captured at the same location Whether it is greater than the brightness value of the pixel of the current image to be composited
  • the generating unit is configured to replace the pixels in the current image to be combined with the pixels in the corresponding positions in the currently captured image to generate a new object motion trajectory image.
  • the first storage module is configured to:
  • the object motion trajectory image is a star track image.
  • an embodiment of the present invention further provides an apparatus for synthesizing an object motion trajectory image, where the apparatus for synthesizing an object motion trajectory image includes:
  • a sorting module configured to sort the photographed images in chronological order after the step of taking an image at the end of each preset exposure time
  • a second synthesizing module configured to select the first image as the current image to be combined, select the second image, and combine the second image with the current image to be synthesized to generate an object motion trajectory image, and The object motion trajectory image is used as the current image to be synthesized;
  • a third synthesizing module configured to synthesize the second image and the current image to be synthesized to generate an object motion trajectory image, and then select each image to combine the currently selected image with the current image to be synthesized Generating a new object motion trajectory image, and using the new object motion trajectory image as the current image to be composited;
  • the second storage module is configured to store an object motion trajectory image that satisfies the second preset condition when the object motion trajectory image satisfies the second preset condition.
  • the second storage module is configured to:
  • the object motion trajectory image is a star track image.
  • an embodiment of the present invention further provides a computer storage medium.
  • the computer storage medium provided by the embodiment of the present invention stores a computer program, and the computer program is used to execute the method for synthesizing the object motion trajectory image.
  • the first image when the first image is captured, the first image is taken as the current image to be composited; when the second image is captured, the second image is compared with the current image to be composited. Synthesizing to generate an object motion trajectory image, and using the object motion trajectory image as the current image to be composited; after capturing the second image, taking an image every preset exposure time, and shooting at each image At that time, the currently captured image is combined with the current image to be composited to generate a new object motion trajectory image, and the new object motion trajectory image is taken as the current image to be composited; When the condition is set, the object motion trajectory image that satisfies the first preset condition is stored.
  • the embodiment of the present invention stores an object motion trajectory image that satisfies the first preset condition, and is used by the user to complete the trajectory of the object and to generate an object motion trajectory image, and then return to view the motion trajectory image of the object within a certain period of time during the shooting process. Meet the user's personalized needs.
  • 1 is a schematic flow chart of a first embodiment of a method for synthesizing an image of an object motion trajectory
  • FIG. 2 is a schematic flow chart of a second embodiment of a method for synthesizing an object motion trajectory image according to the present invention
  • FIG. 3 is a schematic flow chart of an embodiment of a method for synthesizing an object motion trajectory image according to the present invention
  • FIG. 4 is a schematic diagram of functional modules of a first embodiment of a device for synthesizing an object motion trajectory image according to the present invention
  • FIG. 5 is a schematic diagram of functional modules of a second embodiment of a device for synthesizing an object motion trajectory image according to the present invention.
  • FIG. 6 is a schematic diagram of functional modules of an embodiment of a device for synthesizing an object motion trajectory according to the present invention.
  • Fig. 7 is a block diagram showing a main electrical configuration of a camera according to an embodiment of the present invention.
  • the implementation method of the method for synthesizing the motion trajectory image of the object of the embodiment of the present invention may be a mobile phone, a tablet computer, a camera, a video camera, etc.
  • the terminal may be any terminal or device that can implement the method for synthesizing the motion track image of the object in the embodiment of the present invention, which is not agreed in the embodiment of the present invention.
  • the mobile phone is used as an implementation theme of the method for synthesizing the object motion trajectory image according to the embodiment of the present invention.
  • the type of object motion includes: object motion, photographer Still; or, the object is stationary, the photographer is moving; or the object and the photographer are moving relative to each other.
  • Embodiments of the present invention provide a method for synthesizing an object motion trajectory image.
  • FIG. 1 is a schematic flow chart of a first embodiment of a method for synthesizing an object motion trajectory image according to the present invention.
  • the method includes:
  • Step S10 when the first image is captured, the first image is taken as the current image to be composited
  • the mobile phone presets the photographing parameters such as exposure time, ISO, resolution, exposure compensation, noise reduction, etc., and the photographing parameters may be preset or adjusted by the mobile phone or the user, and the mobile phone may also be different according to different regions.
  • the object motion scene presets different parameters for the user to select a suitable object motion scene for shooting, or the mobile phone automatically selects according to the current environment. Shoot the appropriate object motion scene.
  • the user sends a shooting instruction
  • the method for the user to send the shooting instruction may be: pressing the shooting button, triggering the virtual shooting button, voice and gesture, and the like.
  • the mobile phone responds to the user's shooting instruction and starts to take an image.
  • the mobile phone can immediately start capturing an image when receiving the user's shooting instruction, or can start capturing the image by delaying the preset time length, wherein delaying the preset time length to start capturing the image is beneficial to avoid
  • the image is taken when the user shakes the phone by pressing the shooting button or triggering the virtual shooting button.
  • Step S20 when the second image is captured, synthesizing the second image with the current image to be synthesized to generate an object motion trajectory image, and using the object motion trajectory image as the current image to be composited;
  • the second image is captured, and the second image is combined with the current image to be synthesized to generate an object motion trajectory image, which may be: the first image pixel and the current image to be composited
  • the pixels are superimposed to generate an object motion trajectory image; or, the object motion trajectory image is generated according to the luminance value information of the pixels in the first image and the luminance value information of the pixels in the current image to be combined.
  • Step S30 after capturing the second image, taking an image every preset exposure time, and synthesizing the currently captured image with the current image to be combined to generate a new image when each image is captured.
  • An object motion trajectory image, and the new object motion trajectory image is taken as an image to be synthesized;
  • the mobile phone takes an image every preset exposure time, and the time interval between the first image taken by the mobile phone and the second image is also the preset exposure time.
  • the preset exposure time can be preset by the mobile phone, or can be preset by the user according to the requirements.
  • the exposure time cannot be too large due to hardware limitations.
  • the method for synthesizing the currently captured image with the current image to be combined to generate a new object motion trajectory image, and combining the second image with the current image to be synthesized in step S20 The method for generating the motion trajectory image of the object is the same, and may be: superimposing the pixel of the currently captured image and the pixel of the current image to be combined to generate a new object motion trajectory image; or, according to the pixel in the currently captured image
  • the brightness value information and the brightness value information of the pixels in the current image to be combined generate a new object motion track image.
  • Step S40 when the object motion trajectory image satisfies the first preset condition, storing the object motion trajectory image that satisfies the first preset condition.
  • the first preset condition may be preset by the mobile phone or the user, and the first preset condition may be: the shooting time point of the image corresponding to the object motion trajectory image matches the first preset time point; or the shooting environment parameter of the captured image (such as brightness, visibility, etc.) meet the preset environmental parameters.
  • the object motion trajectory image that satisfies the first preset condition is stored, and the user can return to view the motion trajectory image of the object within a certain period of time after completing the trajectory of the photographic path of the object, and then satisfy the image of the trajectory of the object within a certain period of time during the shooting process.
  • the user's personalized needs are stored, and the user can return to view the motion trajectory image of the object within a certain period of time after completing the trajectory of the photographic path of the object, and then satisfy the image of the trajectory of the object within a certain period of time during the shooting process.
  • FIG. 2 is a schematic flow chart of a second embodiment of a method for synthesizing an object motion trajectory image according to the present invention.
  • the present embodiment is based on the first embodiment, and the step S30 includes:
  • Step S31 determining whether the brightness value of the pixel in the image currently captured by the same location is greater than the brightness value of the pixel of the current image to be combined;
  • Step S32 when it is determined that the brightness value of the pixel in the image currently captured at the same position is greater than the brightness value of the pixel of the current image to be combined, the pixel in the current image to be combined is replaced with the corresponding position in the currently captured image. Pixels, generating new object motion trajectory images.
  • the method for determining, by the mobile phone, whether the brightness value of the pixel in the image currently captured at the same position is greater than the brightness value of the pixel of the current image to be combined, and comparing the brightness value of the pixel in the same position as the current image to be combined may be: The number of pixels, which is the brightness value of the pixel with the same number.
  • the pixel of the position in the currently captured image is extracted to replace the corresponding position in the current image to be combined. Pixels, generating new object motion trajectory images.
  • the new object motion trajectory image generated by the present embodiment is clearer than the method of superimposing the captured image with the current image to be combined.
  • the generated new object motion trajectory image is subjected to noise reduction processing.
  • the step S40 includes:
  • a plurality of first preset time points are preset in the first preset condition, when the shooting time point of the image corresponding to the object motion trajectory image is the same as the first preset time point preset in the first preset condition, Determining that the object motion trajectory image satisfies the first preset condition; or, in the first preset condition, preset one or more first preset time ranges, when the shooting time point of the image corresponding to the object motion trajectory image is at the first preset
  • the first preset time range is preset in the condition, it is determined that the object motion trajectory image satisfies the first preset condition.
  • the shooting time point of the image corresponding to the object motion trajectory image does not match the first preset time point, it is determined that the object motion trajectory image does not satisfy the first preset condition, and the object motion trajectory image is not stored.
  • the first preset condition may be that the number of the object motion trajectory image is a number selected by the user. That is, the user can select the number of the motion trajectory image of the object to be stored. If the number of the motion trajectory image of the object is the number of the motion trajectory image of the object selected by the user, it is determined that the motion trajectory image of the object satisfies the first preset condition.
  • the object motion trajectory image is a star track image.
  • the embodiment of the invention further provides a method for synthesizing an object motion trajectory image.
  • FIG. 3 is a schematic flow chart of an embodiment of a method for synthesizing an object motion trajectory image according to the present invention.
  • the method includes:
  • Step S01 after the step of taking an image for every preset exposure time, sorting the captured images in chronological order;
  • the mobile phone presets camera parameters such as exposure time, ISO, resolution, exposure compensation, noise reduction, etc.
  • the camera parameters may be preset or adjusted by the mobile phone or the user, and the mobile phone may also be different according to different regions.
  • the object motion scene presets different parameters for the user to select a suitable object motion scene for shooting, or the mobile phone automatically selects a suitable object motion scene according to the current environment for shooting.
  • the user sends a shooting instruction
  • the method for the user to send the shooting instruction may be: pressing the shooting button, triggering the virtual shooting button, voice and gesture, and the like.
  • the mobile phone responds to the user's shooting instruction and starts to take an image.
  • the mobile phone can immediately start capturing an image when receiving the user's shooting instruction, or can start capturing the image by delaying the preset time length, wherein delaying the preset time length to start capturing the image is beneficial to avoid
  • the image is taken when the user shakes the phone by pressing the shooting button or triggering the virtual shooting button.
  • the exposure time can be preset by the mobile phone, or can be preset by the user according to the demand, and the exposure time cannot be too large due to hardware limitations.
  • the images are sorted in chronological order, and the mobile phone can sequentially sequence the images that have been sorted.
  • Step S02 selecting the first image as the current image to be combined, selecting the second image; synthesizing the second image with the current image to be combined to generate an object motion trajectory image, and moving the object motion trajectory The image is used as the current image to be composited;
  • the method for synthesizing the second image and the current image to be combined to generate an object motion trajectory image may be: superimposing the second image pixel and the pixel of the current image to be combined to generate an object motion trajectory image; or, according to the The luminance value information of the pixels in the two images and the luminance value information of the pixels in the current image to be synthesized generate an object motion trajectory image.
  • Step S03 after synthesizing the second image and the current image to be synthesized to generate an object motion trajectory image, each time an image is selected, the currently selected image is combined with the current image to be synthesized to generate a new object. Moving the trajectory image and using the new object motion trajectory image as the current image to be composited;
  • the method for synthesizing the currently selected image with the current image to be synthesized to generate a new object motion trajectory image is the same as the method for synthesizing the second image with the current image to be synthesized to generate an object motion trajectory image in step S02, Yes: superimposing the pixels of the currently selected image and the pixels of the current image to be combined to generate a new object motion track image; or, according to the brightness value information of the pixel in the currently selected image and the brightness value of the pixel in the current image to be combined Information, generating a new object motion trajectory image.
  • Step S04 when the object motion trajectory image satisfies the second preset condition, the object motion trajectory image that satisfies the second preset condition is stored.
  • the second preset condition may be preset by the mobile phone or the user, and the second preset condition may be: the shooting time point of the image corresponding to the object motion trajectory image matches the second preset time point; or The shooting environment parameters (such as brightness, visibility, etc.) of the captured image meet the preset environmental parameters.
  • the object motion trajectory image that satisfies the second preset condition is stored, and the user can return to view the motion trajectory image of the object within a certain period of time after completing the trajectory of the photographic path of the object, and then satisfy the image of the trajectory of the object within a certain period of time.
  • the user's personalized needs are stored, and the user can return to view the motion trajectory image of the object within a certain period of time after completing the trajectory of the photographic path of the object, and then satisfy the image of the trajectory of the object within a certain period of time.
  • the step S03 includes:
  • the pixel in the current image to be composited is replaced with the pixel in the corresponding position in the currently selected image, and generated. New object motion trajectory image.
  • the mobile phone determines whether the brightness value of the pixel in the currently selected image at the same location is greater than the brightness value of the pixel of the current image to be combined, and the method for comparing the brightness value of the pixel in the same position as the current image to be combined may be: The number of the brightness of the pixel that is the same as the number.
  • the pixel at the position in the currently selected image is extracted to replace the pixel corresponding to the current position in the image to be combined. Generate a new object motion trajectory image.
  • the pixels in the current image to be combined are replaced with the pixels in the corresponding position in the currently selected image to generate a new object motion track image.
  • the new object motion trajectory image generated by the embodiment is clearer than the method of superimposing the selected image with the current image to be combined.
  • the generated new object motion trajectory image is subjected to noise reduction processing.
  • step S04 includes:
  • a plurality of second preset time points are preset in the second preset condition, when the shooting time point of the image corresponding to the object motion track image is the same as the second preset time point preset in the second preset condition, Determining that the motion trajectory image of the object satisfies the second preset condition; or, preset two or more second preset time ranges in the second preset condition, when the shooting time point of the image corresponding to the motion trajectory image of the object is in the second pre-predetermined
  • the second preset time range preset in the condition it is determined that the object motion trajectory image satisfies the second preset condition.
  • the setting method of the second preset time point or the second preset time range may be: receiving a setting instruction that is sent by the user to carry the second preset time point or the second preset time range, and setting the second preset time a second preset time range; or a second preset time point or a second preset time range according to a shooting process selected by the user, for example, when the user selects one quarter and three quarters of the shooting process
  • the shooting time point of the image corresponding to the object motion trajectory image does not match the second preset time point, it is determined that the object motion trajectory image does not satisfy the second preset condition, and the object motion trajectory image is not stored.
  • the second preset condition may be that the number of the object motion trajectory image is a number selected by the user. That is, the user can select the number of the motion trajectory image of the object to be stored. If the number of the motion trajectory image of the object is the number of the motion trajectory image of the object selected by the user, it is determined that the motion trajectory image of the object satisfies the second preset condition.
  • the present embodiment is in the above Based on the embodiment, the object motion trajectory image is a star track image.
  • the embodiment of the invention further provides a synthesizing device for an object motion trajectory image.
  • FIG. 4 is a schematic diagram of functional modules of a first embodiment of a device for synthesizing an object motion trajectory image according to the present invention.
  • the apparatus includes:
  • the initialization module 10 is configured to, when the first image is captured, the first image as the current image to be composited; and when the second image is captured, the second image and the current to be synthesized
  • the image is synthesized to generate an object motion trajectory image, and the object motion trajectory image is taken as an image to be synthesized;
  • the first synthesizing module 20 is configured to: after the second image is captured, take an image every preset exposure time, and when each image is captured, the current captured image and the current image to be combined Performing synthesis to generate a new object motion trajectory image, and using the new object motion trajectory image as the current image to be composited;
  • the first storage module 30 is configured to store an object motion trajectory image that satisfies the first preset condition when the object motion trajectory image satisfies the first preset condition.
  • the synthesizing device of the object motion trajectory image presets the photographing parameters such as exposure time, ISO, resolution, exposure compensation, noise reduction, etc., and the photographing parameter may be a synthesizing device of the object motion trajectory image or preset or adjusted by the user, and the object motion
  • the trajectory image synthesizing device can also preset different parameters according to different object motion scenes over different regions, for the user to select a suitable object motion scene for shooting, or the object motion trajectory image synthesizing device automatically selects an appropriate one according to the current environment. The subject moves the scene to shoot.
  • the user sends a shooting instruction
  • the method for the user to send the shooting instruction may be: pressing the shooting button, triggering the virtual shooting button, voice and gesture, and the like.
  • the initialization module 10 starts to capture an image in response to the user's shooting instruction, and the initialization module 10 can immediately start capturing an image when receiving the user's shooting instruction, or can start capturing the image by delaying the preset time length, wherein the delay preset time starts. Taking an image is advantageous in avoiding taking an image when the user shakes the synthesizing device of the object motion trajectory image by pressing the shooting button or triggering the virtual shooting button.
  • the initialization module 10 captures the second image, and combines the second image with the current image to be synthesized to generate an object motion trajectory image, which may be: the first image pixel and the current image
  • the pixels of the composite image are superimposed to generate an object motion trajectory image; or, the object motion trajectory image is generated according to the luminance value information of the pixels in the first image and the luminance value information of the pixels in the current image to be combined.
  • the first synthesis module 20 captures an image every preset exposure time, and the time interval between the first image being captured by the initialization module 10 and the second image being captured may also be Is the preset exposure time.
  • the preset exposure time may be preset by the first synthesis module 20, or may be preset by the user according to requirements, and the exposure time may not be too large due to hardware limitations.
  • the first synthesizing module 20 synthesizes the currently captured image with the current image to be synthesized to generate a new object motion trajectory image
  • the initialization module 10 synthesizes the second image with the current image to be synthesized to generate an object motion trajectory image.
  • the method is the same, which may be: superimposing the pixels of the currently captured image and the pixels of the current image to be combined to generate a new object motion trajectory image; or, according to the brightness value information of the pixel in the currently captured image and the current waiting The luminance value information of the pixels in the image is synthesized to generate a new object motion trajectory image.
  • the first preset condition may be preset by the first storage module 30 or the user, and the first preset condition may be: the shooting time point of the image corresponding to the object motion trajectory image matches the first preset time point; or, the captured image
  • the shooting environment parameters (such as brightness, visibility, etc.) meet the preset environmental parameters.
  • the object motion trajectory image that satisfies the first preset condition is stored, and the user can return to view the motion trajectory image of the object within a certain period of time after completing the trajectory of the photographic path of the object, and then satisfy the image of the trajectory of the object within a certain period of time during the shooting process.
  • the user's personalized needs are stored, and the user can return to view the motion trajectory image of the object within a certain period of time after completing the trajectory of the photographic path of the object, and then satisfy the image of the trajectory of the object within a certain period of time during the shooting process.
  • the specific functions of the above modules may be implemented by a central processing unit (CPU, Central Processing Unit), or a digital signal processor (DSP), or a programmable gate array located in a synthesizing device of an object motion trajectory image.
  • CPU Central Processing Unit
  • DSP digital signal processor
  • FPGA Field-Programmable Gate Array
  • FIG. 5 is a schematic diagram of functional modules of a second embodiment of a device for synthesizing an object motion trajectory image according to the present invention.
  • the first synthesis module 20 includes:
  • the determining unit 21 is configured to determine whether the brightness value of the pixel in the image currently captured by the same location is greater than the brightness value of the pixel of the current image to be combined;
  • the generating unit 22 is configured to: when determining that the brightness value of the pixel in the image currently captured at the same position is greater than the brightness value of the pixel of the current image to be combined, replacing the pixel in the current image to be combined with the currently captured image A new object motion trajectory image is generated corresponding to the pixel of the position.
  • the determining unit 21 determines whether the brightness value of the pixel in the image currently captured by the same position is greater than the brightness value of the pixel of the current image to be combined, and the method for comparing the brightness value of the pixel in the same position as the current image to be combined may be: The number of pixels in advance is compared with the brightness value of the pixel with the same number.
  • the determining unit 21 determines that the brightness value of the pixel in the image currently captured by the same position is greater than the brightness value of the pixel of the current image to be combined
  • the generating unit 22 extracts the pixel of the position in the currently captured image to replace the current waiting A pixel corresponding to the position in the image is synthesized, and a new object motion trajectory image is generated.
  • the determining unit 21 determines whether the brightness value of the pixel in the image currently captured at the same position is greater than the brightness value of the pixel of the current image to be combined; the generating unit 22 determines the brightness value of the pixel in the image currently captured at the same position.
  • the brightness value of the pixel larger than the current image to be composited Then, the pixels in the current image to be combined are replaced with the pixels in the corresponding positions in the currently captured image to generate a new object motion trajectory image.
  • the new object motion trajectory image generated by the present embodiment is clearer than the method of superimposing the captured image with the current image to be combined.
  • the generated new object motion trajectory image is subjected to noise reduction processing.
  • the first storage module 30 is configured as:
  • a plurality of first preset time points are preset in the first preset condition, when the shooting time point of the image corresponding to the object motion trajectory image is the same as the first preset time point preset in the first preset condition,
  • the first storage module 30 determines that the object motion trajectory image satisfies the first preset condition; or, presets one or more first preset time ranges in the first preset condition, and when the image of the object motion trajectory image corresponds to the shooting time point
  • the first storage module 30 determines that the object motion trajectory image satisfies the first preset condition.
  • the first storage module 30 determines that the object motion trajectory image does not satisfy the first preset condition, and does not store the object motion trajectory image.
  • the first preset condition may be that the number of the object motion trajectory image is a number selected by the user. That is, the user can select the number of the motion track image of the object to be stored. If the number of the motion track image of the object is the number of the motion track image selected by the user, the first storage module 30 determines that the motion track image of the object satisfies the first preset condition. .
  • the present embodiment is in the first Based on the embodiment, the second embodiment, and the third embodiment, the object motion trajectory image is a star track image.
  • the specific functions of the above various modules may be implemented by a CPU, or a DSP, or an FPGA located in a synthesizing device of an object motion trajectory image.
  • the embodiment of the invention further provides a synthesizing device for an object motion trajectory image.
  • FIG. 6 is a schematic diagram of functional modules of an apparatus for synthesizing an object motion trajectory image according to an embodiment of the present invention.
  • the apparatus includes:
  • the sorting module 01 is configured to sort the photographed images in chronological order after the step of taking an image for every preset exposure time is completed;
  • the second synthesizing module 02 is configured to select the first image as the current image to be combined, select the second image, and combine the second image with the current image to be synthesized to generate an object motion trajectory image, and
  • the object motion trajectory image is used as an image to be synthesized
  • the third synthesizing module 03 is configured to synthesize the second image and the current image to be synthesized to generate an object motion trajectory image, and then select an image to synthesize the currently selected image with the current image to be synthesized. Generating a new object motion trajectory image and using the new object motion trajectory image as the current image to be composited;
  • the second storage module 04 is configured to store an object motion trajectory image that satisfies the second preset condition when the object motion trajectory image satisfies the second preset condition.
  • the synthesizing device of the object motion trajectory image presets the photographing parameters such as exposure time, ISO, resolution, exposure compensation, noise reduction, etc., and the photographing parameter may be a synthesizing device of the object motion trajectory image or preset or adjusted by the user, and the object motion
  • the trajectory image synthesizing device can also preset different parameters according to different object motion scenes over different regions, for the user to select a suitable object motion scene for shooting, or the object motion trajectory image synthesizing device automatically selects an appropriate one according to the current environment. The subject moves the scene to shoot.
  • the user sends a shooting instruction
  • the method for the user to send the shooting instruction may be: pressing the shooting button, triggering the virtual shooting button, voice and gesture, and the like.
  • the synthesizing device of the object motion trajectory image starts to capture the image in response to the user's shooting instruction, and the synthesizing device of the object motion trajectory image can immediately start capturing the image when receiving the user's shooting instruction, or can start capturing the image by delaying the preset time length, wherein Delaying the preset duration to start capturing an image is advantageous in avoiding capturing an image when the user shakes the synthesizing device of the object motion trajectory image by pressing the shooting button or triggering the virtual shooting button.
  • the synthesizing device of the object motion trajectory image takes an image every preset exposure time when starting to take an image.
  • the preset exposure time may be preset by a synthesizing device of the object motion trajectory image, or may be preset by the user according to requirements, and the exposure time may not be too large due to hardware limitations.
  • the sorting module 01 sorts the captured images in chronological order after the step of taking an image for every preset exposure time, and the sorting module 01 can sequentially sequence the images that have been sorted.
  • the method for the second synthesis module to combine the second image with the current image to be combined to generate the object motion trajectory image may be: superimposing the second image pixel and the pixel of the current image to be combined to generate an object motion trajectory image; Or generating an object motion trajectory image according to the brightness value information of the pixel in the second image and the brightness value information of the pixel in the current image to be combined.
  • the third synthesizing module 03 synthesizes the currently selected image with the current image to be synthesized to generate a new object motion trajectory image
  • the second compositing module 02 synthesizes the second image with the current image to be synthesized to generate an object motion trajectory.
  • the method of the image is the same, which may be: superimposing the pixels of the currently selected image and the pixels of the current image to be combined to generate a new object motion trajectory image; or, according to the brightness value information of the pixel in the currently selected image and the current to be synthesized The luminance value information of the pixels in the image generates a new motion trajectory image of the object.
  • the second preset condition may be the second storage module 04 or the user presets, the second preset The condition may be that the shooting time point of the image corresponding to the object motion trajectory image matches the second preset time point; or the shooting environment parameters (such as brightness, visibility, etc.) of the captured image satisfy the preset environmental parameter.
  • the object motion trajectory image that satisfies the second preset condition is stored, and the user can return to view the motion trajectory image of the object within a certain period of time after completing the trajectory of the photographic path of the object, and then satisfy the image of the trajectory of the object within a certain period of time.
  • the user's personalized needs are stored, and the user can return to view the motion trajectory image of the object within a certain period of time after completing the trajectory of the photographic path of the object, and then satisfy the image of the trajectory of the object within a certain period of time.
  • the third synthesizing module 03 is configured to:
  • the pixel in the current image to be composited is replaced with the pixel in the corresponding position in the currently selected image, and generated. New object motion trajectory image.
  • the third combining module 03 determines whether the brightness value of the pixel in the image currently selected at the same position is greater than the brightness value of the pixel of the current image to be combined, and the method for comparing the brightness value of the pixel in the same position as the current image to be combined may be: The brightness values of the pixels of the same number are compared according to the number of pixels in advance.
  • the pixel at the position in the currently selected image is extracted to replace the pixel corresponding to the current position in the image to be combined. Generate a new object motion trajectory image.
  • the third combining module 03 determines whether the brightness value of the pixel in the image currently selected at the same position is greater than the brightness value of the pixel of the current image to be combined; determining that the brightness value of the pixel in the currently selected image in the same position is greater than the current waiting value
  • the pixel in the current image to be combined is replaced with the pixel in the corresponding position in the currently selected image to generate a new object motion track image.
  • the new object motion trajectory image generated by the embodiment is clearer than the method of superimposing the selected image with the current image to be combined.
  • the generated new object motion trajectory image is subjected to noise reduction processing.
  • the second storage module 04 is configured as:
  • a plurality of second preset time points are preset in the second preset condition, when the shooting time point of the image corresponding to the object motion track image is the same as the second preset time point preset in the second preset condition, Determining that the motion trajectory image of the object satisfies the second preset condition; or, preset two or more second preset time ranges in the second preset condition, when the shooting time point of the image corresponding to the motion trajectory image of the object is in the second pre-predetermined
  • the second preset time range preset in the condition it is determined that the object motion trajectory image satisfies the second preset condition.
  • the setting method of the second preset time point or the second preset time range may be: receiving a setting instruction that is sent by the user to carry the second preset time point or the second preset time range, and setting the second preset time a second preset time range; or a second preset time point or a second preset time range according to a shooting process selected by the user, for example, when the user selects one quarter and three quarters of the shooting process
  • the shooting time point of the image corresponding to the object motion trajectory image does not match the second preset time point, it is determined that the object motion trajectory image does not satisfy the second preset condition, and the object motion trajectory image is not stored.
  • the second preset condition may be that the number of the object motion trajectory image is a number selected by the user. That is, the user can select the number of the motion trajectory image of the object to be stored, and if the number of the motion trajectory image of the object is the number of the motion trajectory image of the object selected by the user, it is determined. The object motion trajectory image satisfies the second preset condition.
  • the object motion trajectory image is a star track image.
  • the specific functions of the above various modules may be implemented by a CPU, or a DSP, or an FPGA located in a synthesizing device of an object motion trajectory image.
  • the apparatus for synthesizing the object motion trajectory image according to the embodiment of the present invention may be provided in a camera, and Fig. 7 is a block diagram showing the main electrical configuration of the camera of one embodiment of the present invention.
  • the photographic lens 101 is composed of a plurality of optical lenses for forming a subject image, and is a single focus lens or a zoom lens.
  • the photographic lens 101 can be moved in the optical axis direction by the lens driving unit 111, and controls the focus position of the taking lens 101 based on the control signal from the lens driving control unit 112, and also controls the focus distance in the case of the zoom lens.
  • the lens drive control circuit 112 performs drive control of the lens drive unit 111 in accordance with a control command from the microcomputer 107.
  • An imaging element 102 is disposed in the vicinity of a position where the subject image is formed by the photographing lens 101 on the optical axis of the photographing lens 101.
  • the imaging element 102 functions as an imaging unit that captures a subject image and acquires captured image data.
  • Photodiodes constituting each pixel are two-dimensionally arranged in a matrix on the imaging element 102. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, and the photoelectric conversion current is charged by a capacitor connected to each photodiode.
  • the front surface of each pixel is provided with a Bayer array of RGB color filters.
  • the imaging element 102 is connected to an imaging circuit 103 that performs charge accumulation control and image signal readout control in the imaging element 102, and performs waveform shaping after reducing the reset noise of the read image signal (analog image signal). Further, gain improvement or the like is performed to obtain an appropriate signal level.
  • the imaging circuit 103 is connected to the A/D conversion unit 104, which performs analog-to-digital conversion on the analog image signal, and outputs a digital image signal (hereinafter referred to as image data) to the bus 199.
  • image data a digital image signal
  • the bus 199 is a transmission path for transmitting various data read or generated inside the camera.
  • the A/D conversion unit 104 is connected to the bus 199, and an image processor 105, a JPEG processor 106, a microcomputer 107, a SDRAM (Synchronous DRAM) 108, and a memory interface (hereinafter referred to as a memory I/F) are connected. 109. LCD (Liquid Crystal Display) driver 110.
  • the image processor 105 performs various kinds of images such as OB subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, simultaneous processing, edge processing, and the like on the image data based on the output of the imaging element 102. deal with.
  • the JPEG processor 106 compresses the image data read out from the SDRAM 108 in accordance with the JPEG compression method. Further, the JPEG processor 106 performs decompression of JPEG image data for image reproduction display. At the time of decompression, the file recorded on the recording medium 115 is read, and after the compression processing is performed in the JPEG processor 106, the decompressed image data is temporarily stored in the SDRAM 108 and displayed on the LCD 116. Further, in the present embodiment, the JPEG method is adopted as the image compression/decompression method. However, the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be used.
  • the microcomputer 107 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera.
  • the microcomputer 107 is connected to the operation unit 113 and the flash memory 114.
  • the operation unit 113 includes but not limited to a physical button or a virtual button, and the entity or virtual button can be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, and a zoom in An operation member such as various input buttons and various input keys such as buttons is used to detect the operation state of these operation members.
  • the detection result is output to the microcomputer 107.
  • a touch panel is provided on the front surface of the LCD 116 as a display portion, and the touch position of the user is detected, and the touch position is output to the microcomputer 107.
  • the microcomputer 107 executes various processing sequences corresponding to the operation of the user based on the detection result of the operation member from the operation unit 113. (Again, you can change this place).
  • the computer 107 executes various processing sequences corresponding to the user's operation based on the detection result of the touch panel in front of the LCD 116. )
  • the flash memory 114 stores programs for executing various processing sequences of the microcomputer 107.
  • the microcomputer 107 performs overall control of the camera in accordance with the program. Further, the flash memory 114 stores various adjustment values of the camera, and the microcomputer 107 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.
  • the SDRAM 108 is an electrically rewritable volatile memory for temporarily storing image data or the like.
  • the SDRAM 108 temporarily stores image data output from the A/D conversion unit 104 and image data processed in the image processor 105, the JPEG processor 106, and the like.
  • the memory interface 109 is connected to the recording medium 115, and performs control for writing image data and a file header attached to the image data to the recording medium 115 and reading from the recording medium 115.
  • the recording medium 115 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body.
  • the recording medium 115 is not limited thereto, and may be a hard disk or the like built in the camera body.
  • the LCD driver 110 is connected to the LCD 116, and stores image data processed by the image processor 105 in the SDRAM.
  • the image data stored in the SDRAM is read and displayed on the LCD 116, or the image data stored in the JPEG processor 106 is compressed.
  • the JPEG processor 106 reads the compressed image data of the SDRAM, decompresses it, and displays the decompressed image data on the LCD 116.
  • the LCD 116 is disposed on the back surface of the camera body or the like to perform image display.
  • the LCD 116 is provided with a touch panel that detects a user's touch operation.
  • the liquid crystal display panel (LCD 116) is disposed as the display portion.
  • the present invention is not limited thereto, and various display panels such as an organic EL may be employed.
  • the apparatus for tracking the service signaling may also be stored in a computer readable storage medium if it is implemented in the form of a software function module and sold or used as a separate product. Based on such understanding, the technical solution of the embodiments of the present invention may be embodied in the form of a software product in essence or in the form of a software product. Stored in a storage medium, including instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the methods described in various embodiments of the present invention.
  • a computer device which may be a personal computer, server, or network device, etc.
  • the foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read only memory (ROM), a magnetic disk, or an optical disk.
  • program codes such as a USB flash drive, a mobile hard disk, a read only memory (ROM), a magnetic disk, or an optical disk.
  • an embodiment of the present invention further provides a computer storage medium, wherein a computer program for executing a method for synthesizing an object motion trajectory image according to an embodiment of the present invention is stored.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)

Abstract

La présente invention concerne un procédé de synthèse d'images de suivi de mouvement d'objets. Le procédé comporte les étapes consistant à: capturer des images à intervalles d'un temps d'exposition prédéfini, et lorsque chaque image est capturée, synthétiser l'image de prise de vue actuelle et une image actuelle à synthétiser de façon à générer une nouvelle image de suivi de mouvement d'objets, et prendre la nouvelle image de suivi de mouvement d'objets comme image actuelle à synthétiser; lorsqu'une certaine image de suivi de mouvement d'objets satisfait une première condition prédéfinie, stocker l'image de suivi de mouvement d'objets satisfaisant la première condition prédéfinie. La présente invention concerne également un dispositif de synthèse d'images de suivi de mouvement d'objets et un support de stockage informatique sont.
PCT/CN2015/082641 2014-07-16 2015-06-29 Procédé de synthèse d'images de suivi de mouvement d'objets, dispositif et support de stockage informatique Ceased WO2016008359A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410340088.1 2014-07-16
CN201410340088.1A CN104104872B (zh) 2014-07-16 2014-07-16 物体运动轨迹图像的合成方法及装置

Publications (1)

Publication Number Publication Date
WO2016008359A1 true WO2016008359A1 (fr) 2016-01-21

Family

ID=51672641

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/082641 Ceased WO2016008359A1 (fr) 2014-07-16 2015-06-29 Procédé de synthèse d'images de suivi de mouvement d'objets, dispositif et support de stockage informatique

Country Status (2)

Country Link
CN (1) CN104104872B (fr)
WO (1) WO2016008359A1 (fr)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104104872B (zh) * 2014-07-16 2016-07-06 努比亚技术有限公司 物体运动轨迹图像的合成方法及装置
CN106331462A (zh) * 2015-06-25 2017-01-11 宇龙计算机通信科技(深圳)有限公司 一种轨迹照片的拍摄方法、装置及移动终端
KR20170014556A (ko) * 2015-07-30 2017-02-08 삼성전자주식회사 이동체를 촬영하는 방법 및 촬영 장치.
CN105872394A (zh) * 2015-12-08 2016-08-17 乐视移动智能信息技术（北京）有限公司 照片的处理方法及装置
CN105827991B (zh) * 2016-01-22 2019-05-17 维沃移动通信有限公司 一种运动对象的拍照方法及移动终端
CN106357979A (zh) * 2016-09-19 2017-01-25 宇龙计算机通信科技(深圳)有限公司 一种摄影方法、装置和终端
CN109413437A (zh) 2017-08-15 2019-03-01 深圳富泰宏精密工业有限公司 电子设备及传送视频流的方法
TWI626846B (zh) * 2017-08-15 2018-06-11 群邁通訊股份有限公司 電子設備及傳送視頻流的方法
CN108076293A (zh) * 2018-01-02 2018-05-25 努比亚技术有限公司 光绘拍摄方法、移动终端和计算机可读介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070177048A1 (en) * 2006-01-31 2007-08-02 Phil Van Dyke Long exposure images using electronic or rolling shutter
CN103517037A (zh) * 2012-06-14 2014-01-15 Ls产电株式会社 用于提供图像的装置和方法
CN103595914A (zh) * 2013-11-04 2014-02-19 华为终端有限公司 一种拍照方法和移动终端
CN103905730A (zh) * 2014-03-24 2014-07-02 深圳市中兴移动通信有限公司 移动终端的拍摄方法和移动终端
CN104104872A (zh) * 2014-07-16 2014-10-15 深圳市中兴移动通信有限公司 物体运动轨迹图像的合成方法及装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101630290B1 (ko) * 2009-12-24 2016-06-16 한화테크윈 주식회사 추적 경로 이미지 생성을 위한 촬영 방법 및 이를 이용한 촬영 장치
JP5327211B2 (ja) * 2010-12-28 2013-10-30 カシオ計算機株式会社 撮像装置、撮像制御方法及びプログラム
JP5821625B2 (ja) * 2011-08-29 2015-11-24 カシオ計算機株式会社 画像編集装置およびプログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070177048A1 (en) * 2006-01-31 2007-08-02 Phil Van Dyke Long exposure images using electronic or rolling shutter
CN103517037A (zh) * 2012-06-14 2014-01-15 Ls产电株式会社 用于提供图像的装置和方法
CN103595914A (zh) * 2013-11-04 2014-02-19 华为终端有限公司 一种拍照方法和移动终端
CN103905730A (zh) * 2014-03-24 2014-07-02 深圳市中兴移动通信有限公司 移动终端的拍摄方法和移动终端
CN104104872A (zh) * 2014-07-16 2014-10-15 深圳市中兴移动通信有限公司 物体运动轨迹图像的合成方法及装置

Also Published As

Publication number Publication date
CN104104872B (zh) 2016-07-06
CN104104872A (zh) 2014-10-15

Similar Documents

Publication Publication Date Title
WO2016008359A1 (fr) Procédé de synthèse d'images de suivi de mouvement d'objets, dispositif et support de stockage informatique
US10419661B2 (en) Shooting method and shooting device
WO2016023406A1 (fr) Procédé de prise de vue pour trace de déplacement d'objet, terminal mobile et support de stockage informatique
KR101948692B1 (ko) 촬영 장치 및 이미지 합성 방법
WO2016029746A1 (fr) Procédé de prise de vue, dispositif de prise de vue et support d'enregistrement informatique
JP6325841B2 (ja) 撮像装置、撮像方法、およびプログラム
CN105072315B (zh) 电子摄像机以及摄像控制方法
WO2016000515A1 (fr) Procédé et dispositif pour filmer une vidéo de traînée d'étoile, et support de stockage informatique
CN102469244B (zh) 用于对被摄体进行连续摄像的摄像装置
US20170302848A1 (en) Photographing method, device and computer storage medium
CN106878605A (zh) 一种基于电子设备的图像生成的方法和电子设备
KR101889932B1 (ko) 촬영 장치 및 이에 적용되는 촬영 방법
WO2016011859A1 (fr) Procédé pour filmer une vidéo en peinture de lumière, terminal mobile, et support d'enregistrement
US10762600B2 (en) Image processing apparatus, image processing method, and non-transitory computer-readable recording medium
WO2016004819A1 (fr) Procede de prise de vue, dispositif de prise de vue et support de stockage informatique
WO2016011872A1 (fr) Procédé et appareil de photographie d'une image et support de stockage informatique
WO2017080348A2 (fr) Dispositif et procédé de photographie basée sur une scène, et support d'informations pour ordinateur
WO2016000514A1 (fr) Procédé et dispositif servant à filmer une vidéo de nébuleuse et support informatique d'informations
US8189055B2 (en) Digital photographing apparatus and method of controlling the same
US11622175B2 (en) Electronic apparatus and control method thereof
WO2016019786A1 (fr) Procédé et système de photographie de la trajectoire de déplacement d'un objet, et support de stockage informatique
JP6450107B2 (ja) 画像処理装置及び画像処理方法、プログラム、記憶媒体
CN102082909A (zh) 数字拍摄设备以及控制该数字拍摄设备的方法
CN105357447B (zh) 图片处理方法及装置
JP5289354B2 (ja) 撮像装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15821302

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 12/06/2017)

122 Ep: pct application non-entry in european phase

Ref document number: 15821302

Country of ref document: EP

Kind code of ref document: A1