[go: up one dir, main page]

WO2022061660A1 - Procédé de découpage de vidéo, dispositif électronique, véhicule aérien sans pilote et support de stockage - Google Patents

Procédé de découpage de vidéo, dispositif électronique, véhicule aérien sans pilote et support de stockage Download PDF

Info

Publication number
WO2022061660A1
WO2022061660A1 PCT/CN2020/117488 CN2020117488W WO2022061660A1 WO 2022061660 A1 WO2022061660 A1 WO 2022061660A1 CN 2020117488 W CN2020117488 W CN 2020117488W WO 2022061660 A1 WO2022061660 A1 WO 2022061660A1
Authority
WO
WIPO (PCT)
Prior art keywords
unmanned aerial
aerial vehicle
data
video data
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2020/117488
Other languages
English (en)
Chinese (zh)
Inventor
李和和
梁季光
潘晖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Technology Co Ltd
Original Assignee
SZ DJI Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Technology Co Ltd filed Critical SZ DJI Technology Co Ltd
Priority to CN202080040151.3A priority Critical patent/CN113940087A/zh
Priority to PCT/CN2020/117488 priority patent/WO2022061660A1/fr
Publication of WO2022061660A1 publication Critical patent/WO2022061660A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41422—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance located in transportation means, e.g. personal vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U20/00—Constructional aspects of UAVs
    • B64U20/80—Arrangement of on-board electronics, e.g. avionics systems or wiring
    • B64U20/87—Mounting of imaging devices, e.g. mounting of gimbals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4524—Management of client data or end-user data involving the geographical location of the client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8547—Content authoring involving timestamps for synchronizing content
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2101/00—UAVs specially adapted for particular uses or applications
    • B64U2101/30—UAVs specially adapted for particular uses or applications for imaging, photography or videography
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64U—UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
    • B64U2201/00—UAVs characterised by their flight controls
    • B64U2201/20—Remote controls

Definitions

  • the present application relates to the field of video editing, and in particular, to a video editing method, an electronic device, an unmanned aerial vehicle, and a storage medium.
  • aerial images are often captured and recorded by the on-board camera. Then, the captured video data can be edited to obtain a video composed of highlights.
  • video data is automatically edited through automatic video editing technology, and wonderful pictures are extracted and edited mainly through image recognition technology.
  • the present application provides a video editing method, an electronic device, an unmanned aerial vehicle and a storage medium, which can automatically edit video data shot by the unmanned aerial vehicle and retain the wonderful pictures that the user wishes to leave.
  • a video editing method which is applied to an electronic device, the electronic device is communicatively connected to an unmanned aerial vehicle, the unmanned aerial vehicle is equipped with a shooting device and is used for shooting video data, and the electronic equipment is used for for processing the video data; the method includes:
  • the video data is clipped based on the flight attitude data and the time stamp data.
  • a video editing method applied to an unmanned aerial vehicle, the unmanned aerial vehicle is equipped with a photographing device, and the method includes:
  • the shooting device Acquiring the video data shot by the shooting device, and recording the flight attitude data of the unmanned aerial vehicle, and correspondingly generating time stamp data; wherein, the time stamp data is used to synchronize the video data and the flight attitude data;
  • the video data is clipped based on the flight attitude data and the time stamp data.
  • an electronic device which is connected in communication with an unmanned aerial vehicle and used to control the movement of the unmanned aerial vehicle, and the unmanned aerial vehicle is equipped with a photographing device, including:
  • memory for storing processor-executable instructions
  • processor is configured to:
  • the video data is clipped based on the flight attitude data and the time stamp data.
  • an unmanned aerial vehicle which is equipped with a photographing device, including:
  • memory for storing processor-executable instructions
  • processor is configured to:
  • the shooting device Obtain the video data shot by the shooting device, record the flight attitude data of the unmanned aerial vehicle in the memory, and generate time stamp data correspondingly; wherein, the time stamp data is used to synchronize the video data and the flight attitude data;
  • the video data is clipped based on the flight attitude data and the time stamp data.
  • a computer storage medium is provided on which a computer program is stored, and when the computer program is executed, any one of the above methods is implemented.
  • the video editing method provided by the present application utilizes the time stamp data to synchronize the video data with the flight attitude data of the aircraft, and automatically edits the recorded video based on the flight attitude data and the time stamp data, and can make the aircraft fly in a specific attitude.
  • the video data captured at the time is automatically edited out, and the wonderful picture that the user wants to leave is preserved.
  • FIG. 1 is an application scenario of the video editing method provided by the present application.
  • FIG. 2 shows a video editing method according to an embodiment of the present application.
  • FIG. 3 is an electronic device shown in the present application according to an exemplary embodiment.
  • FIG. 4 shows a video editing method according to another embodiment of the present application.
  • Fig. 5 shows a video editing method according to another embodiment of the present application.
  • FIG. 6 is a schematic structural diagram of an electronic device provided by the present application.
  • FIG. 7 is a schematic structural diagram of the unmanned aerial vehicle provided by the present application.
  • the unmanned aerial vehicle is equipped with a photographing device, so that the unmanned aerial vehicle can take aerial pictures when flying and hovering.
  • the communication connection between the remote controller and the unmanned aerial vehicle enables the user to control the flight of the unmanned aerial vehicle through the remote controller.
  • the flight speed, altitude, and return of the unmanned aerial vehicle can be controlled through the joystick, pulley and other controls on the remote controller.
  • the unmanned aerial vehicle may be an unmanned aerial photography machine, a time-travelling machine, etc.
  • the photographing device may be a device with an image acquisition function, such as a camera and a camera.
  • the method may be performed by an electronic device in communication with the unmanned aerial vehicle.
  • the electronic device communicates with an unmanned aerial vehicle equipped with a photographing device, and can be used to process video data.
  • the electronic device may be a remote controller equipped with a display screen, and the remote controller has a processor or a processing chip.
  • the user can view the video data returned by the aircraft on the display screen, and the processor or processing chip in the remote control can process the video data.
  • the electronic device may also be a mobile terminal capable of running a virtual interface with a remote control function, such as a mobile phone, a tablet, an ipad, etc. (not shown in FIG.
  • the mobile terminal can control the flight of the UAV through virtual controls (such as virtual joysticks, virtual pulleys, etc.) in the virtual interface, and view and process the video data returned by the aircraft.
  • virtual controls such as virtual joysticks, virtual pulleys, etc.
  • the mobile terminal and the remote control can also be combined through electrical connection (as shown in the figure) or wireless connection (not shown in the figure).
  • the flight of the UAV can be controlled by the remote controller, and on the other hand, the video data returned by the aircraft can be viewed and processed on the mobile terminal.
  • the electronic devices of the present application include but are not limited to the above categories, which are not limited herein.
  • the steps shown in FIG. 2 can also be performed by an unmanned aerial vehicle.
  • the image processing module on the processing chip provided in the unmanned aerial vehicle can take pictures of the photographing device. Video execution.
  • the method includes the following steps:
  • Step 110 Acquire video data, flight attitude data and time stamp data of the unmanned aerial vehicle captured by the photographing device.
  • Step 120 Edit the video data based on the flight attitude data and the time stamp data.
  • the video data captured by the camera of the UAV and the flight attitude data of the UAV can be obtained by the electronic device.
  • time stamp data wherein the time stamp data is used to synchronize flight attitude data and video data.
  • the electronic device can obtain the above three kinds of data from the UAV in real time during the flight of the UAV and edit it.
  • the video data captured by the shooting device can also be saved in real time by the UAV during the flight.
  • the flight attitude data of the unmanned aerial vehicle and the time stamp data are recorded and saved, and after the shooting of the unmanned aerial vehicle is completed, the above three kinds of data are read from the memory of the unmanned aerial vehicle for editing.
  • the clipped video data can be used for playback or sharing.
  • the unmanned aerial vehicle when the above steps are performed by the unmanned aerial vehicle, can generate time stamp data based on the flight attitude data of the unmanned aerial vehicle in real time during the flight, and thus based on the flight attitude data and the time stamp The data clips the video data captured by the camera in real time, and sends the clipped video to the electronic device connected in communication for playback or sharing.
  • the unmanned aerial vehicle can also save the video data captured by the shooting device in real time during the flight, record and save the flight attitude data of the unmanned aerial vehicle and generate time stamp data, and edit the video data after the shooting is completed. , and then send the edited video to a communicatively connected electronic device for playback or sharing.
  • the flight attitude data of the UAV at different times and the video data captured at that time can be synchronized through the time stamp data, when the UAV is to be edited to show that the UAV is flying at a specific time.
  • the electronic device can find out the time stamp data corresponding to the specific flight attitude data for the video data captured when flying in the attitude, and edit the video data according to the corresponding time stamp data.
  • the video editing method provided by the above embodiment utilizes the time stamp data to synchronize the video data with the flight attitude data of the aircraft, and automatically cuts the recorded video based on the flight attitude data and the time stamp data, so that the unmanned aerial vehicle can be automatically edited.
  • the video data shot when flying in a specific attitude is automatically edited, and the beautiful pictures that the user wants to leave are preserved.
  • the electronic device executes step 110 to acquire video data captured by the camera, flight attitude data of the UAV, and timestamp data from the UAV.
  • the video data is the video frame data recorded by the photographing device when the UAV is flying or hovering.
  • the flight attitude data can describe the flight attitude of the UAV at various time points. These data can be the flight gear, flight speed, rotation angle, flight height, obstacle distance, and the attitude of the gimbal. one or more data.
  • the rotation angle of the UAV may be a pitch angle (Pitch angle), a yaw angle (yaw angle), a roll angle (roll angle), and so on.
  • the timestamp data is used to identify the generation time of other data. In this application, the timestamp data can identify the generation time of the video data and the flight attitude data, and is used to synchronize the video data and the flight attitude data.
  • the electronic device communicates with the UAV and can obtain video data, flight attitude data and time stamp data from the UAV.
  • the electronic device can obtain video data, flight attitude data and time stamp data in real time when the UAV is flying; it can also obtain the video data and flight attitude data stored in the aircraft after the shooting device completes the shooting and the UAV returns home. and timestamp data.
  • the electronic device may perform denoising processing on the acquired flight attitude data.
  • the method of denoising processing can be selected according to the needs of those skilled in the art. For example, low-pass filtering can be performed on the flight attitude data, so as to remove sudden changes in the flight attitude data, such as when the flight speed jumps instantaneously. data, so that the editing result is smoother and smoother.
  • the de-noising processing of the flight attitude data can also be performed by the processor of the UAV. The UAV can send the processed flight attitude data to the electronic device after de-noising processing.
  • step 120 the electronic device performs step 120, and the process of editing the video data based on the flight attitude data and the time stamp data can be seen in FIG. 4, which includes the following steps:
  • Step 121 determine whether the flight attitude data satisfies the preset editing conditions
  • Step 122 Splicing the video data corresponding to the moment of the flight attitude data satisfying the preset editing conditions to obtain a edited video.
  • the editing conditions may be set by those skilled in the art according to actual needs, and several possible editing conditions are listed here, which may specifically be a combination of any one or more of the following conditions:
  • the flight gear of the unmanned aerial vehicle is the preset gear: the unmanned aerial vehicle has various flight gears, such as ordinary gear, power gear, sports gear, manual gear, rolling gear, etc. Depending on the flight position, the user’s operating instructions, the flight actions that the aircraft can perform (yaw, pitch, and roll motions), the maximum flight speed, and the maximum flight altitude will be different. Users can choose the flight position according to their needs.
  • the preset gear can be a gear that allows the UAV to perform high-degree-of-freedom actions, or a gear that allows the UAV to fly at a higher speed, such as a sports gear, a manual gear, or a roll gear. This does not limit.
  • the rotation angle of the unmanned aerial vehicle is greater than the preset angle threshold: as mentioned above, the rotation angle of the unmanned aerial vehicle may include the pitch angle, the yaw angle and the roll angle, etc. Therefore, correspondingly, the preset angle threshold may include the pitch angle Threshold, yaw angle threshold and roll angle threshold, etc. The user can set it by himself. When the specified rotation angle of a certain angle is greater than the corresponding angle threshold, it is considered that the rotation angle of the UAV is greater than the preset angle threshold.
  • the UAV's rotation angle is considered to be greater than the preset angle threshold, and the other two rotation angles are ignored; it is also possible to set more than one rotation angle to be greater than the corresponding angle threshold, then the UAV is considered to be unmanned aerial vehicle.
  • the rotation angle is greater than the preset angle threshold, which is not limited here.
  • the flight altitude of the UAV is greater than the preset altitude threshold.
  • the distance between the UAV and the obstacle is less than the preset distance threshold.
  • the attitude change of the gimbal on the unmanned aerial vehicle is greater than the preset attitude change threshold: the fuselage of the unmanned aerial vehicle will inevitably shake due to air resistance during flight. In order to prevent the shaking of the fuselage from affecting the shooting stability of the shooting device The gimbal will shake in the same frequency and amplitude as the body shake, but in the opposite direction to the shake, so as to stabilize the shooting device. In order to distinguish whether the gimbal attitude change is caused by the stable camera or the drone has a large flight attitude change, the jitter frequency of the gimbal can be smaller than the preset frequency threshold and the rotation amplitude of the gimbal is greater than the preset frequency. Set the rotation amplitude threshold as the clipping condition. Wherein, the change of the gimbal attitude can also be determined according to the angle changes of the gimbal in the pitch angle, the yaw angle and the roll angle, and the preset attitude change threshold can also be set according to the above three angles.
  • the variation range of the controls on the electronic device used to operate the drone flight is greater than the preset variation range threshold.
  • the controls can be physical controls such as joysticks and dials; and can also be virtual controls such as virtual joysticks and virtual dials. As an example, this condition may be set such that the stick volume change on the remote control is greater than 30%.
  • the above-mentioned preset gears, speed thresholds, height thresholds, distance thresholds, frequency thresholds, and rotation amplitude thresholds can be modified by the user, or can be set by default in the program, which is not limited here.
  • a variety of selectable editing conditions are listed above, and the user can select more than one editing condition as the preset editing condition.
  • the user can select only "The flight speed of the UAV is greater than the preset speed threshold" as the preset editing condition, or can select "The flight speed of the UAV is greater than the preset speed threshold", and/or "The flight speed of the UAV is greater than the preset speed threshold", and/or "The flight speed of the UAV is greater than the preset speed threshold”.
  • the rotation angle is greater than the preset angle threshold", and/or "The distance between the UAV and the obstacle is less than the preset distance threshold" as the preset clipping conditions.
  • the clipping video data may be marking the video data, and extracting the marked video data in the video data for splicing.
  • the flight attitude data records the flight attitude of the unmanned aerial vehicle at various time points.
  • the timestamp data corresponding to the flight attitude can be marked in the timestamp data. If the flight attitude data from the 2nd minute to 2 minutes 20 seconds and the flight attitude data from the 3rd minute to 3 minutes and 30 seconds when the UAV is flying, meet the preset editing conditions, the first time stamp data will be marked. 2 minutes to 2 minutes and 20 seconds, and data from the 3rd minute to 3 minutes and 30 seconds.
  • the corresponding video data is searched, and the video data is extracted for splicing.
  • the marked video data from the 2nd minute to 2 minutes 20 seconds and the 3rd minute to 3 minutes 30 seconds can be found.
  • the above two pieces of video data are extracted, and the two pieces of video data are spliced together to obtain an automatically edited video.
  • the above-mentioned automatic editing method based on flight attitude data can also be combined with an existing automatic editing method based on video content, that is, the automatic editing method refers to both the flight attitude and the video content.
  • the automatic editing method based on video content may be to use such as biometric identification and scene recognition technology to identify whether the video data contains a human scene, and to edit the video data containing the human scene; it may also be to use image recognition technology to identify the scene. Similarity between adjacent frames, marking a moment in the video data when the similarity between adjacent frames is greater than a preset similarity threshold, and extracting video data within a specified time period including the moment for splicing.
  • Those skilled in the art can use conventional technologies for automatic editing based on video content, which is not limited in this application.
  • the combination of the two editing methods may include firstly editing the corresponding video data with reference to the flight attitude, and then performing secondary editing on the video data after the one-time editing with reference to the video content.
  • First refer to the flight attitude or the video content for editing, which is not limited here.
  • the combination of the two editing methods can edit the video data corresponding to the flight attitude that meets the preset editing conditions, and the video data identified based on the video content, which can make up for the possible missing highlights caused by a single editing method. The problem greatly enriches the content of the clip video.
  • the electronic device may further edit the video data for a second time.
  • the unmanned aerial vehicle only saves the video data captured when the flight height is greater than 50 meters, and executes the above-mentioned video editing method to edit the video data recorded by the shooting device to obtain the video data whose flight height is greater than 50 meters.
  • the UAV can send the flight attitude data, time stamp data, and video data after one clip to the electronic device.
  • the user can further execute the above-mentioned video editing method on the electronic device as required, and then edit the video data captured when the flight speed is greater than 20km/h, or the distance from the obstacle is less than 2m.
  • the played back video can be edited video data, or it can be video data marked but not edited based on flight attitude data and time stamp data. If you use the above method to mark the video data from the second minute to 2 minutes and 20 seconds during the flight, you can directly jump to the moment of 1 minute and 57 seconds during playback, and start playing from this moment to 2 minutes and 23 seconds later. Then skip to the next marked time for playback.
  • the video editing method provided by the present application automatically edits the recorded video based on the flight attitude data and the time stamp data, which can make the aircraft perform high-speed flight, tumbling, rotation and other difficult actions.
  • the captured video data is automatically edited, and the wonderful pictures that the user wants to leave are preserved.
  • the time-travel aircraft different from the aerial photography aircraft, the time-travel aircraft can perform high-speed, large maneuvering scene flight and other difficult flight actions, which often brings about large changes in the shooting picture, which makes it difficult to capture some momentary pictures. It can be accurately identified by image recognition, especially for the pictures taken by the traversing aircraft during high-speed flight and flipping, and these pictures are often the wonderful pictures that the user wants to extract and retain.
  • Using the video editing method provided by this application based on The flight attitude of the aircraft is automatically edited, which can avoid the problem of easy-to-miss wonderful moments due to inaccurate picture recognition.
  • Step 210 Acquire video data, timestamp data, and flight attitude data.
  • the video data is the video frame data recorded by the unmanned aerial vehicle using its photographing device when it is flying or hovering.
  • the flight attitude data can describe the flight attitude of the UAV at various time points. These data can be the flight gear, flight speed, rotation angle, flight height, obstacle distance, and the attitude of the gimbal. one or more types of data.
  • the timestamp data can identify the generation time of the video data and the flight attitude data, and is used to synchronize the video data and the flight attitude data.
  • the electronic device can obtain the above three kinds of data in real time; it can also obtain the above three kinds of data after the shooting device completes the shooting and the unmanned aerial vehicle returns home.
  • Step 220 Read the flight attitude data at a certain moment.
  • the flight attitude data includes the UAV's flight gear, flight speed, rotation angle, flight altitude, obstacle distance, and the attitude of the mounted gimbal.
  • the flight gear, flight speed, and rotation angle are used as examples of the editing conditions.
  • the user may select other data or a combination thereof as the editing conditions, which is not limited in this application.
  • Step 230 Perform low-pass filtering.
  • the flight attitude data can be de-noised.
  • the commonly used processing method is low-pass filtering, which can remove the data with sudden changes in the data, such as the data generated when the flight speed jumps instantaneously.
  • Step 240 Determine whether the flight data meets preset editing conditions, including:
  • Step 240a determine whether the flight gear is a preset gear
  • Step 240b determine whether the flight speed is greater than the speed threshold
  • Step 240c determine whether the rotation angle is greater than the angle threshold
  • preset gears, speed thresholds, and angle thresholds can be set and modified by the user, or can be set by default in the program, which is not limited here.
  • Step 250 Determine whether more than one editing condition is satisfied.
  • Step 250 may also be: judging whether two or more editing conditions are satisfied. If so, go to step 260; otherwise, go to step 220 to read the flight attitude data at the next moment.
  • Step 260 Mark the corresponding timestamp data.
  • the flight attitude data at a certain moment satisfies the above judgment condition, the corresponding moment is marked from the timestamp data.
  • Step 270 Extract video data segments corresponding to the marked timestamp data.
  • Step 280 Splicing the extracted video data segments.
  • All the extracted video data segments are spliced together to obtain an automatically edited video.
  • the video editing method provided by the above embodiments of the present application realizes the automatic editing of the recorded video based on the flight attitude data and the time stamp data.
  • the video data is automatically edited, and the wonderful pictures that the user wants to leave are preserved.
  • the present application also provides a schematic structural diagram of the electronic device shown in FIG. 6 .
  • the electronic device includes a processor, an internal bus, a network interface, a memory, and a non-volatile memory, and of course, may also include hardware required by other services.
  • the processor reads the corresponding computer program from the non-volatile memory into the memory and runs it, so as to implement the video editing method described in FIG. 2 above.
  • the present application also provides a schematic structural diagram of the unmanned aerial vehicle as shown in FIG. 7 .
  • the UAV includes a processor, an internal bus, a network interface, a memory, and a non-volatile memory, and of course, may also include hardware required by other services.
  • the processor reads the corresponding computer program from the non-volatile memory into the memory and runs it, so as to implement the video editing method described in FIG. 2 above.
  • the present application also provides a computer storage medium, where the storage medium stores a computer program, and when the computer program is executed by the processor, can be used to execute the video editing method provided in FIG. 2 above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Microelectronics & Electronic Packaging (AREA)
  • Mechanical Engineering (AREA)
  • Remote Sensing (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Studio Devices (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

La présente demande concerne un procédé de découpage de vidéo qui est appliqué à un dispositif électronique. Le dispositif électronique est en connexion de communication avec un véhicule aérien sans pilote ; le véhicule aérien sans pilote est équipé d'un appareil de prises de vues et est utilisé pour filmer des données vidéo ; et le dispositif électronique est utilisé pour traiter les données vidéo. Le procédé comprend : l'acquisition de données vidéo, filmées par un appareil de prises de vues, ainsi que de données d'attitude de vol et de données d'estampille temporelle d'un véhicule aérien sans pilote, les données d'estampille temporelle étant utilisées pour synchroniser les données vidéo avec les données d'attitude de vol ; et le découpage des données vidéo sur la base des données d'attitude de vol et des données d'estampille temporelle. La présente demande permet de réaliser un découpage vidéo sur la base des données d'attitude de vol d'un véhicule aérien sans pilote. La présente demande concerne en outre un dispositif électronique, un véhicule aérien sans pilote et un support de stockage informatique.
PCT/CN2020/117488 2020-09-24 2020-09-24 Procédé de découpage de vidéo, dispositif électronique, véhicule aérien sans pilote et support de stockage Ceased WO2022061660A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202080040151.3A CN113940087A (zh) 2020-09-24 2020-09-24 一种视频剪辑方法、电子设备、无人飞行器及存储介质
PCT/CN2020/117488 WO2022061660A1 (fr) 2020-09-24 2020-09-24 Procédé de découpage de vidéo, dispositif électronique, véhicule aérien sans pilote et support de stockage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/117488 WO2022061660A1 (fr) 2020-09-24 2020-09-24 Procédé de découpage de vidéo, dispositif électronique, véhicule aérien sans pilote et support de stockage

Publications (1)

Publication Number Publication Date
WO2022061660A1 true WO2022061660A1 (fr) 2022-03-31

Family

ID=79275151

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/117488 Ceased WO2022061660A1 (fr) 2020-09-24 2020-09-24 Procédé de découpage de vidéo, dispositif électronique, véhicule aérien sans pilote et support de stockage

Country Status (2)

Country Link
CN (1) CN113940087A (fr)
WO (1) WO2022061660A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107197136A (zh) * 2016-06-20 2017-09-22 普宙飞行器科技（深圳）有限公司 实现无人机机载相机图像美化、视频剪辑的控制方法
US20180103197A1 (en) * 2016-10-06 2018-04-12 Gopro, Inc. Automatic Generation of Video Using Location-Based Metadata Generated from Wireless Beacons
CN108320304A (zh) * 2017-12-18 2018-07-24 广州亿航智能技术有限公司 一种无人机航拍视频媒体的自动编辑方法与系统
CN108702464A (zh) * 2017-10-16 2018-10-23 深圳市大疆创新科技有限公司 一种视频处理方法、控制终端及可移动设备
CN109076263A (zh) * 2017-12-29 2018-12-21 深圳市大疆创新科技有限公司 视频数据处理方法、设备、系统及存储介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN205017419U (zh) * 2015-09-22 2016-02-03 杨珊珊 航拍装置
CN108886579A (zh) * 2017-12-26 2018-11-23 深圳市大疆创新科技有限公司 无人机拍摄视频的处理方法、拍摄相机和遥控器
WO2020019193A1 (fr) * 2018-07-25 2020-01-30 深圳市大疆创新科技有限公司 Procédé et système de commande de véhicule aérien sans pilote, et véhicule aérien sans pilote
CN109036479A (zh) * 2018-08-01 2018-12-18 曹清 剪辑点判断系统及剪辑点判断方法
CN112166599A (zh) * 2019-09-26 2021-01-01 深圳市大疆创新科技有限公司 视频剪辑方法及终端设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107197136A (zh) * 2016-06-20 2017-09-22 普宙飞行器科技（深圳）有限公司 实现无人机机载相机图像美化、视频剪辑的控制方法
US20180103197A1 (en) * 2016-10-06 2018-04-12 Gopro, Inc. Automatic Generation of Video Using Location-Based Metadata Generated from Wireless Beacons
CN108702464A (zh) * 2017-10-16 2018-10-23 深圳市大疆创新科技有限公司 一种视频处理方法、控制终端及可移动设备
CN108320304A (zh) * 2017-12-18 2018-07-24 广州亿航智能技术有限公司 一种无人机航拍视频媒体的自动编辑方法与系统
CN109076263A (zh) * 2017-12-29 2018-12-21 深圳市大疆创新科技有限公司 视频数据处理方法、设备、系统及存储介质

Also Published As

Publication number Publication date
CN113940087A (zh) 2022-01-14

Similar Documents

Publication Publication Date Title
JP7506492B2 (ja) 画像を取り込むシステムおよびカメラ機器
CN103491331B (zh) 显示控制设备、显示控制方法
US10395338B2 (en) Virtual lens simulation for video and photo cropping
US10447929B2 (en) Video processing method, device and image system
US20160156847A1 (en) Enriched digital photographs
CN108702464B (zh) 一种视频处理方法、控制终端及可移动设备
CN107071389A (zh) 航拍方法、装置和无人机
CN109076263B (zh) 视频数据处理方法、设备、系统及存储介质
CN110771175A (zh) 视频播放速度的控制方法、装置及运动相机
CN114520877A (zh) 视频录制方法、装置和电子设备
CN108521866A (zh) 一种视频获取方法、控制终端、飞行器及系统
CN111917979B (zh) 多媒体文件输出方法、装置、电子设备及可读存储介质
Braverman Video Shooter: Storytelling with DV, HD, and HDV Cameras
CN108419052A (zh) 一种多台无人机全景成像方法
WO2022021438A1 (fr) Procédé de traitement d'images, procédé de commande d'images et dispositif associé
WO2022061660A1 (fr) Procédé de découpage de vidéo, dispositif électronique, véhicule aérien sans pilote et support de stockage
CN106488128B (zh) 一种自动拍照的方法及装置
CN108475410B (zh) 三维立体水印添加方法、装置及终端
WO2022016334A1 (fr) Procédé et appareil de traitement d'image, drone de course, système d'optimisation d'image et support de stockage
CN105765969B (zh) 影像处理方法、装置和设备及影像拍摄系统
WO2025055296A1 (fr) Procédé, système et dispositif de suppression du bruit de terminaux de vol, et support
CN108521823A (zh) 一种图像处理方法、装置及电子设备
WO2022082439A1 (fr) Procédé et appareil de photographie accélérée de trajectoire, et caméra à cardan, véhicule aérien sans pilote et cardan portatif
CN117950552B (zh) 一种无人机仿真数据的回放、标注与采集方法
JP6146108B2 (ja) 情報処理装置、画像表示システム、画像表示方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20954512

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20954512

Country of ref document: EP

Kind code of ref document: A1