WO2019165723A1 - Method and system for processing audio/video, and device and storage medium - Google Patents

Abstract

Disclosed are a method and system for processing an audio/video, and a device and a storage medium. The method comprises the steps of: generating a positioning information tag, an environmental meteorological information tag, and a time information tag of a location where an audio/video is recorded; matching to obtain a historical audio/video having information tags identical to the information tags above from a database; and processing and generating a target audio/video according to the recorded audio/video and the historical audio/video. By means of the method and system for processing the audio/video, and the device and the storage medium, the positioning information tag, the environmental meteorological information tag, and the time information tag of the location where the audio/video is recorded are added, so that the historical audio/video having identical information tags can be used as a reference of the recorded audio/video when the audio/video is processed, the audio/video can be edited and processed more accurately, the operation difficulty and the operation time of a user are reduced, and the authenticity of the target audio/video after processing is improved.

Description

 Method, system, device and storage medium for processing audio and video

Technical field

The present application relates to the field of wireless communications, and in particular, to a method, system, device, and storage medium for processing audio and video.

Background technique

With the continuous development of camera technology, more and more users can shoot audio and video by themselves. In order to ensure the quality of audio and video, after the audio and video shooting is completed, it is usually necessary to edit the recorded audio and video, such as the sound. Some of the clips in the video are extracted, deleted, merged, and so on.

In the prior art, when a user needs to edit audio and video, the user usually needs to download and install professional audio and video editing software through a personal computer, such as Adobe After. Effects or Adobe Premiere, etc.

The existing audio and video editing software generally performs intelligent calculation on the audio and video editing part and nearby content according to the embedded algorithm to obtain the edited audio and video content. This method has strong dependence on the software embedded algorithm, and the audio and video editing is strong. The low authenticity depends mainly on the accuracy of the algorithm and the level of personal ability of the user. The requirements on the user and the editing machine are high, which greatly affects the user experience.

Summary of the invention

The main purpose of the present application is to provide a method, system, device, and storage medium for processing audio and video, which improves the authenticity of a scene in a modified audio and video.

To achieve the above object, the present application provides a method for processing audio and video, including the steps of:

Generating a positioning information label, an environmental weather information label, and a time information label at a position where the recorded audio and video are located;

Matching historical audio and video that is the same as or similar to the positioning information label, the environmental weather information label, and the time information label from the database;

The target audio and video is generated according to the above-mentioned recorded audio and video and historical audio and video processing.

To achieve the above object, the present application proposes a system for processing audio and video, comprising:

The generating module is configured to generate a positioning information label, an environmental weather information label, and a time information label at a position where the recorded audio and video are located;

The matching module is configured to match the historical audio and video of the same information label from the database;

The processing module is configured to generate a target audio and video according to the above-mentioned recorded audio and video and historical audio and video processing.

To achieve the above object, the present application provides a computer device including a memory, a processor, and a computer program stored on the memory and operable on the processor, and the processor performs the following steps when executing the program:

Generating a positioning information label, an environmental weather information label, and a time information label at a position where the recorded audio and video are located;

Matching historical audio and video that is the same as or similar to the positioning information label, the environmental weather information label, and the time information label from the database;

The target audio and video is generated according to the recorded audio and video and historical audio and video processing.

To achieve the above object, the present application provides a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the following steps:

Generating a positioning information label, an environmental weather information label, and a time information label at a position where the recorded audio and video are located;

Matching historical audio and video that is the same as or similar to the positioning information label, the environmental weather information label, and the time information label from the database;

The target audio and video is generated according to the recorded audio and video and historical audio and video processing.

The beneficial effects of the method, system, device and storage medium for processing audio and video of the present application are as follows: by adding a positioning information label, an environmental weather information label and a time information label of a location for recording audio and video, so that the audio and video can be processed when the audio and video are processed. The historical audio and video with the same information label is used as a reference for the recorded audio and video, so that the audio and video can be edited and processed more accurately, the operation difficulty and operation time of the user are reduced, and the authenticity of the target audio and video after processing is improved.

DRAWINGS

1 is a schematic flow chart of a method for processing audio and video according to an embodiment of the present application;

2 is a schematic flowchart of a method for processing audio and video according to an embodiment of the present application;

FIG. 3 is a schematic flowchart diagram of a method for processing audio and video according to an embodiment of the present application; FIG.

FIG. 4 is a schematic flowchart diagram of a method for processing audio and video according to an embodiment of the present application; FIG.

FIG. 5 is a schematic flowchart diagram of a method for processing audio and video according to an embodiment of the present application;

6 is a schematic flowchart of a method for processing audio and video according to an embodiment of the present application;

FIG. 7 is a schematic flowchart diagram of a method for processing audio and video according to an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a module for processing an audio and video according to an embodiment of the present application; FIG.

FIG. 9 is a schematic structural diagram of a module for processing an audio and video according to an embodiment of the present application; FIG.

FIG. 10 is a schematic structural diagram of a module for processing an audio and video according to an embodiment of the present application; FIG.

FIG. 11 is a schematic structural diagram of a module for processing an audio and video according to an embodiment of the present application; FIG.

FIG. 12 is a schematic structural diagram of a module for processing an audio and video according to an embodiment of the present application; FIG.

FIG. 13 is a schematic structural diagram of a module for processing an audio and video according to an embodiment of the present application; FIG.

FIG. 14 is a schematic structural diagram of a module for processing an audio and video according to an embodiment of the present application; FIG.

FIG. 15 is a schematic structural diagram of a computer device according to an embodiment of the present application.

The object of the present application, the features and advantages of the present application will be further described with reference to the accompanying drawings.

Detailed ways

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

In addition, the descriptions of "first", "second", and the like in this application are used for the purpose of description only, and are not to be construed as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" or "second" may include at least one of the features, either explicitly or implicitly. In addition, the technical solutions between the various embodiments may be combined with each other, but must be based on the realization of those skilled in the art, and when the combination of the technical solutions is contradictory or impossible to implement, it should be considered that the combination of the technical solutions does not exist. Nor is it within the scope of protection required by this application.

Referring to FIG. 1, in the embodiment of the present application, the application provides a method for processing audio and video, including the steps of:

S101. Generate a positioning information label, an environmental weather information label, and a time information label at a location where the recorded audio and video are located;

S102. Matching, from the database, a historical audio and video that is the same as or similar to the positioning information label, the environmental weather information label, and the time information label;

S103. Generate target audio and video according to the foregoing recording audio and video and historical audio and video processing.

In the above step S101, the positioning information label, the environmental meteorological information label, and the time information label of the location where the recorded audio and video are located are generated. After the recording of the recorded audio and video is completed, the positioning information of the location of the recording device is obtained, and the information is obtained. The positioning information is integrated into the data of the recorded audio and video to form a positioning information label of the recorded audio and video. The positioning information label generally uses latitude and longitude as the performance value. After confirming the positioning information label, according to the positioning information of the positioning information label. Query the environmental meteorological parameters and real-time time of the area, which generally includes – but is not limited to – temperature, pressure, humidity, wind direction, wind speed, light intensity, UV intensity and weather, and integrates the above environmental meteorological parameters and real-time time In the data of the above recorded audio and video, the environmental weather information label and the time information label are obtained.

In the above step S102, the historical audio and video that is the same as or similar to the positioning information label, the environmental weather information label, and the time information label is matched from the database, and the positioning information label, the environmental weather information label, and the time information label are performed in the database. Matching the search to obtain a historical audio and video with the same positioning information label, environmental weather information label, and time information label as the above recorded audio and video mark,

The target audio and video is generated according to the above-mentioned recorded audio and video and historical audio and video processing, and the recorded audio and video is edited after the sufficient historical audio and video is obtained in the above step S102 to obtain the processed target audio and video. Wherein, the above target audio and video generally includes, but is not limited to, 3D audio and video or specific scene audio and video, etc., and the above processing generally includes, but is not limited to, trimming and deleting of video or adding a specified image in the video, wherein After the sufficient historical audio and video is obtained through the foregoing step S102, the recorded audio and video may be authentically detected. The detection process only needs to compare the difference between the historical audio and video and the recorded audio and video. Whether the video is modified or not, this detection process is easier and less time consuming than checking whether the video data has a modified trace.

Referring to FIG. 2, in the embodiment, in the method for processing audio and video, the foregoing step of generating a target audio and video includes the following steps:

S131. Select a target area in the recorded audio and video.

S132. Acquire image data of a corresponding target area in the historical audio and video.

S133. The image data is replaced by the image data of the target area to generate the target audio and video.

In the above step S131, the target area in the recorded audio and video is selected, and the selected target area is generally selected from the recorded audio and video as a selection basis, wherein the target area is generally a non-fixed area, and is selected by the user. After the target area is selected, the target image in the target area is selected, and after the target image is selected, the target image is identified on the remaining number of frames in the recorded audio and video to obtain an image that is the same as or similar to the target image. And re-defining the position of the image as the above target area, thereby obtaining the motion track of the target area.

Obtaining the image data of the corresponding target area in the historical audio and video as described above, after the step S131 is performed, setting the motion track of the target area in the historical audio and video, and acquiring the motion track coverage of the target area. Image data,

In step S133 described above, the image data is replaced with the image data of the target area to generate the target audio and video.

Referring to FIG. 3, in the foregoing method, in the method for processing audio and video, the foregoing step of generating a target audio and video includes the following steps:

S134. Select the recorded audio and video and the target image in the historical audio and video;

S135. Integrate the target image to obtain three-dimensional data of the target image.

S136. Generate the target audio and video according to the three-dimensional data of the target image.

In step S134, the target audio image and the target image in the historical audio and video are selected, and the user selects a corresponding target image from the recorded audio and video and the historical audio and video, respectively, each of the recorded audio and video or the historical sound. The target image selected in the video is generally - but not limited to - specifying an image of the object or scene at the perspective of the audio and video, wherein the image generally includes - but is not limited to - a front view of the specified object or scene, Multiple sheets in the rear view, left view, right view, top view, and bottom view. It is also possible to increase the image of other views or reduce the corresponding image according to the actual number of the above-mentioned historical audio and video and the difference of the recorded viewing angle or the complexity of the specified object or scene. An image of a perspective;

In step S135, the target image is integrated to obtain the three-dimensional data of the target image, and the target image obtained by the above step S134 is subjected to corresponding three-dimensional merging, and the three-dimensional data of the target image is integrated to obtain a specified object or scene. Three-dimensional image,

The step S136 is configured to generate the target audio and video according to the three-dimensional data of the target image, and generate the target audio and video according to the three-dimensional data of the target image, that is, the three-dimensional image of the specified object or the scene, with the specified audio or video image.

Referring to FIG. 4, in the foregoing method, in the method for processing audio and video, the step of generating a corresponding positioning information label, an environmental weather information label, and a time information label for recording audio and video includes the following steps:

S111. Obtain positioning information of a location where the video recording device is located.

S112. Acquire real-time environmental weather information and current time information of the location corresponding to the positioning information according to the foregoing positioning information.

S113. The positioning information label, the environmental weather information label, and the time information label are generated according to the positioning information, the real-time environmental weather information, and the current time information, and are added to the recorded audio and video.

If the location information of the location of the video recording device is obtained, the location information obtained when acquiring the location information of the location of the video recording device is generally - but not limited to - latitude and longitude, and includes altitude, but when the altitude is The content of audio and video has little or no effect. Users can manually cancel the acquisition of altitude and save only the latitude and longitude.

Obtaining the real-time environmental meteorological information and the current time information of the location corresponding to the location information according to the foregoing location information, and obtaining the corresponding location information by using the local weather information sharing platform or the weather website connected to the region after obtaining the location information in step S111. The environmental meteorological information of the location is obtained by synchronizing the real-time time while obtaining the environmental meteorological information of the corresponding location through the local meteorological information sharing platform or the meteorological website in the area, to obtain the current time information of the corresponding location, and the current time information is generally For the time zone real time corresponding to the location, obtaining the current time information may also obtain the recording start time or the recording end time of the recorded audio and video, and then perform the frame time of the recorded audio and video according to the timing module in the recording device. Conversion,

In the above step S113, the positioning information label, the environmental weather information label and the time information label are generated according to the positioning information, the real-time environmental weather information and the current time information, and are added to the recorded audio and video.

Referring to FIG. 5, in the foregoing method, in the foregoing method for processing audio and video, after the step of generating the target audio and video according to the foregoing recording audio and video and historical audio and video processing, the method further includes the following steps:

S401. Store the recorded audio and video into the audio and video list corresponding to the database.

In the above step S401, the recorded audio and video is stored in the audio and video list corresponding to the database, and after the step S103 is performed, the recorded audio and video is stored in the corresponding audio and video list to achieve the purpose of updating the audio and video list. , optimized synchronization and update of changes in location.

Referring to FIG. 5, in the foregoing method, in the foregoing method for processing audio and video, before the step of generating the positioning information label, the environmental weather information label, and the time information label at the position where the recorded audio and video is located, the method further includes the following steps:

S501. Generate an audio and video list corresponding to a combination of different positioning information labels, environmental weather information labels, and time information labels.

S601. Acquire a historical audio and video corresponding to the audio and video list, and store the historical audio and video into the corresponding audio and video list.

S701. Collect the audio and video list and the content to form the database.

Step S501, generating an audio and video list corresponding to the content combination of the different positioning information label, the environmental weather information label, and the time information label, and generating different according to different content combinations of the positioning information label, the environmental weather information label, and the time information label. The audio and video list, and the content combinations of the positioning information label, the environmental weather information label, and the time information label in the different audio and video lists are different from each other.

Obtaining the historical audio and video corresponding to the audio and video list, and storing the historical audio and video into the corresponding audio and video list, and performing the above-mentioned audio and video list according to the generated audio and video list after the step S501 is performed. The historical audio and video is stored in the above audio and video list, wherein the method for obtaining the historical audio and video generally includes, but is not limited to, performing pre-recording or acquiring from a cloud sharing database.

In step S701, the audio and video list and the content are collected to form the database. After the step S601 is performed, the generated audio and video list and the historical audio and video stored in the list are integrated into the database.

Referring to FIG. 6, in the foregoing method, in the method for processing audio and video, the step of acquiring the historical audio and video corresponding to the audio and video list includes the following steps:

S610. The historical audio and video is generated by performing positioning information calculation, environment meteorological information query, and recording corresponding time determination in the existing audio and video in the cloud sharing database.

As described above, in step S610, the historical audio and video is generated by performing positioning information calculation, environmental weather information query, and recording corresponding time determination in the existing audio and video in the cloud sharing database.

Referring to FIG. 6 , in a specific embodiment, in the foregoing method for processing audio and video, the step of acquiring the historical audio and video corresponding to the audio and video list may further replace the foregoing step S610 by using the following steps. include:

S620: Perform pre-recording of audio and video and add a corresponding positioning information label, an environmental weather information label, and a time information label to form the historical audio and video.

As in the above step S620, the pre-recording of the audio and video is performed, and the corresponding positioning information label, the environmental weather information label and the time information label are added to form the historical audio and video, and a plurality of audio and video are pre-recorded and the corresponding positioning information label is The environmental weather information tag and the time information tag are attached to the audio and video to form the above-mentioned historical audio and video.

Referring to FIG. 7, in the embodiment, in the foregoing method for processing audio and video, the foregoing positioning information calculation includes the following steps:

S611. Extract a picture of a specified number of frames in the audio and video.

S612, performing image recognition and searching on the iconic image in the above-mentioned screen to obtain a geographic location of the iconic image;

S613, calculating a recording distance of the audio and video according to a size ratio of two or more specified images in the above picture and a size ratio between the corresponding objects;

S614. Calculate the positioning information according to the content, the geographical location, and the recording distance of the iconic image.

In the above step S611, a picture of the specified number of frames in the audio and video is extracted, wherein the picture of the specified number of frames is generally a face change including a prominent recognition feature or a landmark, such as a landmark building, an item, a character, and the like.

In the above step S612, the iconic image in the above-mentioned screen is image-recognized and searched to obtain the geographic location of the iconic image, wherein the iconic image is generally selected by the user, and the user selects the image when the user gives up the selection. An area where the image color difference is large or a region with a large number of historical selections is defined as an iconic image, and the above-mentioned iconic image includes at least one, and generally preferably includes, but is not limited to, two.

In step S613, the recording distance of the audio and video is calculated according to the size ratio of the two or more specified images in the screen and the size ratio between the corresponding objects, and the size ratio of the plurality of specified images in the screen is obtained or The ratio of the distance between the two images to the actual scene, thereby obtaining the recording distance of the above-mentioned recording device and the actual scene in the specified image,

According to the above step S614, the positioning information is calculated according to the content, the geographical location and the recording distance of the iconic image.

Referring to FIG. 8, in the embodiment of the present application, the application provides a system for processing audio and video, including:

The generating module 101 is configured to generate a positioning information label, an environmental weather information label, and a time information label of the location where the recorded audio and video are located;

The matching module 102 is configured to match, from the database, historical audio and video that is the same as or similar to the positioning information label, the environmental weather information label, and the time information label;

The processing module 103 is configured to generate a target audio and video according to the recorded audio and video and historical audio and video processing.

The generating module 101 is generally configured to generate a positioning information label, an environmental weather information label, and a time information label at a position where the recorded audio and video is located, and obtain the positioning information of the location of the recording device after the recording of the recorded audio and video is completed, and The obtained positioning information is integrated into the data of the recorded audio and video to form a positioning information label of the recorded audio and video. The positioning information label generally has a latitude and longitude as a performance value, and after confirming the positioning information label, according to the positioning information label. The location information queries the environmental meteorological parameters and real-time time of the area, which generally includes, but is not limited to, temperature, air pressure, humidity, wind direction, wind speed, light intensity, ultraviolet intensity and weather, and the above-mentioned environmental meteorological parameters and real-time The time is integrated into the data of the recorded audio and video, and the environmental weather information label and the time information label are obtained.

The matching module 102 is generally configured to match historical audio and video that is the same as or similar to the positioning information label, the environmental weather information label, and the time information label from the database, and the positioning information label, the environmental meteorological information label, and the database in the database. The time information tag performs a matching search to obtain a historical audio and video with the same positioning information tag, environmental weather information tag, and time information tag as the above recorded audio and video tag.

The processing module 103 is generally configured to generate a target audio and video according to the recorded audio and video and the historical audio and video processing, and after the foregoing matching module 102 obtains sufficient historical audio and video, edit the recorded audio and video to obtain the processed audio and video. The above-mentioned target audio and video, wherein the above-mentioned target audio and video generally includes, but is not limited to, 3D audio and video or specific scene audio and video, etc., and the above processing generally includes, but is not limited to, trimming and deleting of video or adding video. An image is specified, wherein after the sufficient historical audio and video is obtained by the matching module 102, the recorded audio and video may be authentically detected, and the detection process only needs to compare the difference between the historical audio and video and the recorded audio and video. The ratio can be used to determine whether the video has been modified. This detection process is easier and less time-consuming than checking whether the video data has a modified trace.

Referring to FIG. 9, in the embodiment, in the above system for processing audio and video, the processing module 103 includes:

The first selecting module 131 is configured to select a target area in the recorded audio and video;

The image data module 132 is configured to acquire image data of a corresponding target area in the historical audio and video;

The replacement module 133 is configured to generate the target audio and video by replacing the image data with the image data of the target area.

The first selection module 131 is generally configured to select a target area in the recorded audio and video. In the selection of the target area, a frame frame is generally selected from the recorded audio and video as a selection basis, where the target area is generally a non-fixed area. After the user selects the target area, selecting a target image in the target area, and after selecting the target image, performing target image recognition on the remaining number of frames in the recorded audio and video to obtain the target image. The same or similar image and the position of the image is redefined as the above target area, thereby obtaining the motion track of the target area,

The image data module 132 is configured to acquire image data of a corresponding target area in the historical audio and video, and after the first selection module 131 is executed, set a motion track of the target area in the historical audio and video, and obtain the foregoing The trajectory of the target area says the image data covered,

The replacement module 133 is generally configured to generate the target audio and video by replacing the image data with the image data of the target area.

Referring to FIG. 10, in the embodiment, in the above system for processing audio and video, the processing module 103 includes:

The second selecting module 134 is configured to select the target audio image and the target image in the historical audio and video;

The integration module 135 is configured to integrate the target image to obtain three-dimensional data of the target image.

The audio and video generation module 136 is configured to generate the target audio and video according to the three-dimensional data of the target image.

The second selection module 134 is generally configured to select the target audio image and the target image in the historical audio and video, and the user selects a corresponding target image from the recorded audio and video and the historical audio and video, respectively. The target image selected in the video or the above-mentioned historical audio and video is generally - but not limited to - an image specifying the object or scene in the audio and video perspective, wherein the image generally includes - but is not limited to - the specified object or Multiple views in the front view, rear view, left view, right view, top view, and bottom view of the scene, and other views can be added according to the actual number of historical audio and video and the difference of the recorded viewing angle or the complexity of the specified object or scene. Image or reduce the image of the corresponding perspective;

The integration module 135 is generally configured to integrate the target image to obtain three-dimensional data of the target image, and perform corresponding three-dimensional merging of the target image obtained by the second selection module 134 to integrate three-dimensional data of the target image. To get a three-dimensional image of the specified object or scene,

The audio and video generating module 136 is configured to generate the target audio and video according to the three-dimensional data of the target image, and generate the target sound according to the three-dimensional data of the target image, that is, the three-dimensional image of the specified object or the scene and the specified audio or video image. video.

Referring to FIG. 11, in the embodiment, in the above system for processing audio and video, the generating module 101 includes:

The first obtaining sub-module 111 is configured to obtain positioning information of a location where the recording device is located;

The second obtaining sub-module 112 is configured to acquire real-time environmental meteorological information and current time information of the location corresponding to the positioning information according to the foregoing positioning information;

The additional sub-module 113 is configured to generate the positioning information label, the environmental weather information label and the time information label according to the positioning information, the real-time environmental weather information and the current time information, and add the sound information to the recorded audio and video.

The first obtaining sub-module 111 is generally configured to obtain positioning information of a location where the recording device is located, and the positioning information obtained when acquiring the positioning information of the location where the recording device is located is generally, but not limited to, latitude and longitude, and also includes an altitude. However, when the altitude has little or no influence on the content of the audio and video, the user can manually cancel the acquisition of the altitude and save only the latitude and longitude.

The second obtaining sub-module 112 is configured to obtain the real-time environmental weather information and the current time information of the location corresponding to the positioning information according to the positioning information, and obtain the positioning information by using the first acquiring sub-module 111 to connect the area. The local meteorological information sharing platform or the meteorological website obtains the environmental meteorological information of the corresponding location, and obtains the environmental meteorological information of the corresponding location through the local meteorological information sharing platform or the weather website of the area, and simultaneously synchronizes the real-time time to obtain the corresponding position. The current time information, the current time information is generally the time zone real time corresponding to the location, and the obtaining the current time information may also obtain the recording start time or the recording end time of the recorded audio and video, and then according to the timing module in the recording device. Convert each frame time of the above recorded audio and video,

The additional sub-module 113 is generally configured to generate the positioning information label, the environmental weather information label, and the time information label according to the positioning information, the real-time environmental weather information, and the current time information, and add the sound information to the recorded audio and video.

Referring to FIG. 12, in the embodiment, in the above system for processing audio and video, it is generally further included:

The storage module 401 is configured to store the recorded audio and video into the audio and video list corresponding to the database.

The storage module 401 is generally configured to store the recorded audio and video in the audio and video list corresponding to the database, and after the processing module 103 executes, store the recorded audio and video to the corresponding audio and video list to update the sound. The purpose of the video list has been to achieve optimal synchronization and update of changes in location.

Referring to FIG. 12, in the foregoing embodiment, in the system for processing audio and video, the method further includes:

The list generating module 501 is configured to generate an audio and video list corresponding to a combination of content of different positioning information labels, environmental weather information labels, and time information labels;

The list storage module 601 is configured to acquire a historical audio and video corresponding to the audio and video list, and store the historical audio and video into the corresponding audio and video list;

The list collection module 701 is configured to group the audio and video lists and contents to form the database.

The above-mentioned list generating module 501 is generally configured to generate an audio and video list corresponding to a combination of different positioning information tags, environmental weather information tags, and time information tags, according to different content of the positioning information tags, environmental weather information tags, and time information tags. Combining different audio and video lists, and the content combinations of the positioning information label, the environmental weather information label, and the time information label in the different audio and video lists are different from each other.

The above-mentioned list storage module 601 is generally configured to acquire a historical audio and video corresponding to the audio and video list, and store the historical audio and video in the corresponding audio and video list, after the list generating module 501 executes, according to the generated The audio and video list stores the corresponding historical audio and video to the audio and video list, wherein the method for obtaining the historical audio and video generally includes, but is not limited to, performing pre-recording or acquiring from a cloud sharing database.

The list aggregation module 701 is generally configured to collect the audio and video list and the content to form the database. After the list storage module 601 is executed, the generated audio and video list and the historical audio and video stored in the list are integrated into The above database.

Referring to FIG. 13, in the foregoing embodiment, in the system for processing audio and video, the list storage module 601 includes:

The history generation sub-module 610 is configured to generate the historical audio and video by performing positioning information calculation, environment meteorological information query, and recording corresponding time determination in the existing audio and video in the cloud sharing database.

The history generation sub-module 610 is generally configured to generate the historical audio and video by performing positioning information calculation, environmental meteorological information query, and recording corresponding time determination in the existing audio and video in the cloud sharing database.

Referring to FIG. 13, in a specific embodiment, in the foregoing system for processing audio and video, the history generation sub-module 610 can be replaced by the following modules, including:

The pre-recording sub-module 620 is configured to perform pre-recording of audio and video and add corresponding positioning information tags, environmental weather information tags and time information tags to form the historical audio and video.

The pre-recording sub-module 620 is generally configured to perform pre-recording of audio and video, and add a corresponding positioning information label, an environmental weather information label, and a time information label to form the historical audio and video, and pre-record a large number of audio and video and corresponding The positioning information label, the environmental weather information label, and the time information label are attached to the audio and video to form the historical audio and video.

Referring to FIG. 14, in the embodiment, in the above system for processing audio and video, the positioning information calculation includes the following steps:

The extraction submodule 611 is configured to extract a picture of the specified number of frames in the audio and video;

The identification sub-module 612 is configured to perform image recognition and search for the iconic image in the above-mentioned screen to obtain the geographic location of the iconic image;

The first calculation sub-module 613 is configured to calculate the recording distance of the audio and video according to the size ratio of two or more specified images in the above-mentioned picture and the size ratio between the corresponding objects;

The second calculating sub-module 614 is configured to calculate the positioning information according to the content, the geographical location, and the recording distance of the icon image.

The extraction sub-module 611 is generally configured to extract a picture of the specified number of frames in the audio and video, wherein the picture of the specified number of frames is generally a face-changing feature including a prominent recognition feature or a landmark, such as a landmark building, an item, a character, and the like.

The identification sub-module 612 is generally configured to perform image recognition and search for the landmark image in the image to obtain the geographic location of the icon image, wherein the icon image is generally selected by the user, and the user abandons the selection. The area in which the image color difference is large in the selection screen or the area in which the number of historical selections is large is defined as an iconic image, and the above-mentioned iconic image includes at least one, and generally includes, but is not limited to, two.

The first calculating sub-module 613 is generally configured to calculate a recording distance of the audio and video according to a size ratio of two or more specified images in the above-mentioned picture and a size ratio between the corresponding objects, and acquire multiples in the foregoing picture. Specifying the size ratio of the image or the ratio of the distance between the two images to the actual scene, thereby obtaining the recording distance of the above-mentioned recording device and the actual scene in the specified image,

The second calculating sub-module 614 is generally configured to calculate the positioning information according to the content, the geographical location, and the recording distance of the iconic image.

Referring to FIG. 11 , in the embodiment of the present application, the present application further provides a computer device. The computer device 12 is represented in the form of a general-purpose computing device. The components of the computer device 12 may include, but are not limited to: one or more processors or Processing unit 16, system memory 28, connects bus 18 of various system components, including system memory 28 and processing unit 16.

Bus 18 represents one or more of several types of bus 18 architectures, including memory bus 18 or memory controller, peripheral bus 18, graphics acceleration port, processor or office using any of the various bus 18 architectures. Domain bus 18. For example, these architectures include, but are not limited to, an Industry Standard Architecture (ISA) bus 18, a Micro Channel Architecture (MAC) bus 18, an Enhanced ISA Bus 18, a Video and Video Electronics Standards Association (VESA) local bus 18, and Peripheral Component Interconnect (PCI) bus 18.

Computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by computer device 12, including both volatile and nonvolatile media, removable and non-removable media.

System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and/or cache memory 32. Computer device 12 may further include other mobile/non-removable, volatile/non-volatile computer system storage media. By way of example only, storage system 34 may be used to read and write non-removable, non-volatile magnetic media (commonly referred to as "hard disk drives"). Although not shown in FIG. 11, a disk drive for reading and writing to a removable non-volatile disk such as a "floppy disk", and a removable non-volatile disk (for example, CD~ROM, DVD~ROM) may be provided. Or other optical media) read and write optical drive. In these cases, each drive can be coupled to bus 18 via one or more data medium interfaces. The memory can include at least one program product having a set (e.g., at least one) of program modules 42 that are configured to perform the functions of the various embodiments of the present application.

A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in a memory, such program modules 42 including, but not limited to, an operating system, one or more applications, other program modules 42 and program data, each of these examples or some combination may include an implementation of a network environment. Program module 42 typically performs the functions and/or methods of the embodiments described herein.

Computer device 12 may also be in communication with one or more external devices 14 (eg, a keyboard, pointing device, display 24, camera, etc.), and may also be in communication with one or more devices that enable a user to interact with the computer device 12, and/ Or communicating with any device (eg, a network card, modem, etc.) that enables the computer device 12 to communicate with one or more other computing devices. This communication can take place via an input/output (I/O) interface 22. Also, computer device 12 can communicate with one or more networks (e.g., a local area network (LAN)), a wide area network (WAN), and/or a public network (e.g., the Internet) via network adapter 20. As shown, network adapter 20 communicates with other modules of computer device 12 via bus 18. It should be understood that although not shown in FIG. 11, other hardware and/or software modules may be utilized in conjunction with computer device 12, including but not limited to: microcode, device drivers, redundant processing unit 16, external disk drive array, RAID system, A tape drive and a data backup storage system 34 and the like.

The processing unit 16 performs various function applications and data processing by running a program stored in the system memory 28, for example, a method for processing audio and video provided by the embodiments of the present application.

That is, when the processing unit 16 executes the foregoing procedure, the method provides: generating a positioning information label, an environmental weather information label, and a time information label at a position where the recorded audio and video is located; and matching the positioning information label, the environmental weather information label, and the time from the database. The historical audio and video with the same or similar information labels; the target audio and video is generated according to the above-mentioned recorded audio and video and historical audio and video processing.

In the embodiment of the present application, the present application further provides a computer readable storage medium, where a computer program is stored, and when the program is executed by the processor, the method for processing audio and video provided by all embodiments of the present application is implemented.

The method implemented on the processor can refer to various embodiments of the method for processing audio and video according to the present invention, and details are not described herein.

The method, system, device and storage medium for processing audio and video of the present invention have the beneficial effects of: by adding a positioning information label, an environmental weather information label and a time information label of a location for recording audio and video, so that the audio and video can be processed when the audio and video are processed. The historical audio and video with the same information label is used as a reference for the recorded audio and video, so that the audio and video can be edited and processed more accurately, the operation difficulty and operation time of the user are reduced, and the authenticity of the target audio and video after processing is improved.

The above description is only the preferred embodiment of the present application, and is not intended to limit the scope of the patent application, and the equivalent structure or equivalent process transformations made by the specification and the drawings of the present application, or directly or indirectly applied to other related The technical field is equally included in the scope of patent protection of the present application.

Claims (16)

 A method of processing audio and video, wherein the method comprises the steps of: Generating a positioning information label, an environmental weather information label, and a time information label at a position where the recorded audio and video are located; Matching historical audio and video that is the same as or similar to the positioning information label, the environmental weather information label, and the time information label from the database; The target audio and video is generated according to the recorded audio and video and historical audio and video processing. The method of processing audio and video according to claim 1, wherein said processing comprises the step of generating a target audio and video, comprising the steps of: Selecting a target area in the recorded audio and video; Obtaining image data of a corresponding target area in the historical audio and video; The image data is replaced with the image data of the target area to generate the target audio and video. The method of processing audio and video according to claim 1, wherein said processing comprises the step of generating a target audio and video, comprising the steps of: Selecting the recorded audio and video and the target image in the historical audio and video; Integrating the target image to obtain three-dimensional data of the target image; Generating the target audio and video according to the three-dimensional data of the target image. The method of processing audio and video according to claim 1, wherein the step of generating a corresponding positioning information label, an environmental weather information label, and a time information label for recording audio and video comprises the steps of: Obtaining location information of the location of the recording device; Acquiring real-time environmental meteorological information and current time information of the location corresponding to the positioning information according to the positioning information; The positioning information label, the environmental weather information label, and the time information label are generated according to the positioning information, the real-time environmental weather information, and the current time information, and are added to the recorded audio and video. The method of processing audio and video according to claim 1, wherein before the step of generating the positioning information label, the environmental weather information label and the time information label at the position where the recorded audio and video is located, the method further comprises the steps of: Generating an audio and video list corresponding to a combination of different positioning information tags, environmental weather information tags, and time information tags; Obtaining a historical audio and video corresponding to the audio and video list, and storing the historical audio and video into the corresponding audio and video list; The audio and video lists and content are grouped together to form the database. The method of processing audio and video according to claim 5, wherein the step of acquiring historical audio and video corresponding to the audio and video list comprises the steps of: The historical audio and video is generated by performing positioning information calculation, environmental meteorological information query, and recording corresponding time determination in the existing audio and video in the cloud sharing database. The method of processing audio and video according to claim 6, wherein said positioning information calculation comprises the steps of: Extracting a picture of a specified number of frames in the audio and video; Performing image recognition and searching on the iconic image in the picture to obtain a geographic location of the iconic image; Calculating a recording distance of the audio and video according to a size ratio of two or more specified images in the picture and a size ratio between the corresponding objects; The positioning information is calculated according to the content, the geographical location and the recording distance of the iconic image. A system for processing audio and video, wherein the system comprises: The generating module is configured to generate a positioning information label, an environmental weather information label, and a time information label at a position where the recorded audio and video are located; a matching module, configured to match the historical audio and video of the same information label from the database; The processing module is configured to generate a target audio and video according to the recorded audio and video and historical audio and video processing. A computer device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor performs the following steps when executing the program: Generating a positioning information label, an environmental weather information label, and a time information label at a position where the recorded audio and video are located; Matching historical audio and video that is the same as or similar to the positioning information label, the environmental weather information label, and the time information label from the database; The target audio and video is generated according to the recorded audio and video and historical audio and video processing. The computer apparatus according to claim 9, wherein said processor further implements the following steps when said program is executed: Selecting a target area in the recorded audio and video; Obtaining image data of a corresponding target area in the historical audio and video; The image data is replaced with the image data of the target area to generate the target audio and video. The computer apparatus according to claim 9, wherein said processor further implements the following steps when said program is executed: Selecting the recorded audio and video and the target image in the historical audio and video; Integrating the target image to obtain three-dimensional data of the target image; Generating the target audio and video according to the three-dimensional data of the target image. The computer apparatus according to claim 9, wherein said processor further implements the following steps when said program is executed: Obtaining location information of the location of the recording device; Acquiring real-time environmental meteorological information and current time information of the location corresponding to the positioning information according to the positioning information; The positioning information label, the environmental weather information label, and the time information label are generated according to the positioning information, the real-time environmental weather information, and the current time information, and are added to the recorded audio and video. A computer readable storage medium having stored thereon a computer program, wherein the program is executed by the processor to implement the following steps: Generating a positioning information label, an environmental weather information label, and a time information label at a position where the recorded audio and video are located; Matching historical audio and video that is the same as or similar to the positioning information label, the environmental weather information label, and the time information label from the database; The target audio and video is generated according to the recorded audio and video and historical audio and video processing. The computer readable storage medium of claim 13 wherein the program, when executed by the processor, further implements the following steps: Selecting a target area in the recorded audio and video; Obtaining image data of a corresponding target area in the historical audio and video; The image data is replaced with the image data of the target area to generate the target audio and video. The computer readable storage medium of claim 13 wherein the program, when executed by the processor, further implements the following steps: Selecting the recorded audio and video and the target image in the historical audio and video; Integrating the target image to obtain three-dimensional data of the target image; Generating the target audio and video according to the three-dimensional data of the target image. The computer readable storage medium of claim 13 wherein the program, when executed by the processor, further implements the following steps: Obtaining location information of the location of the recording device; Acquiring real-time environmental meteorological information and current time information of the location corresponding to the positioning information according to the positioning information; The positioning information label, the environmental weather information label, and the time information label are generated according to the positioning information, the real-time environmental weather information, and the current time information, and are added to the recorded audio and video.