CN111818295A - An image acquisition method and device - Google Patents

Abstract

The embodiment of the application provides an image acquisition method and device, comprising the following steps: the method comprises the steps of obtaining a data packet of a picture to be captured through a preset transmission channel, obtaining image data corresponding to code streams of all tracks, and storing the obtained image data of all tracks to cache regions corresponding to all tracks according to the corresponding relation between the tracks and the cache regions to obtain images of the picture to be captured. According to the scheme, the code streams of the preset frames of the camera equipment are transmitted in the same data packet through the preset transmission channel, and the image data corresponding to the code streams of the tracks are obtained in the preset transmission channel, so that the image of the picture to be captured is obtained. The process is completed in one transmission channel, and even if the number of the camera devices is increased, the transmission channel does not need to be increased, so that the transmission channel resource is saved. Image data are obtained in one transmission channel, image splicing processing is not needed, and image splicing resources are saved.

Description

An image acquisition method and device

technical field

The present application relates to the technical field of image processing, and in particular, to an image acquisition method and device.

Background technique

In the real-time code stream shot and transmitted by the camera or the stored video, when a target object, target object or preset event occurs, it is necessary to obtain one or more frames when the target object, target object or preset event occurs. frame images for subsequent processing of the acquired images.

At present, the way to obtain a frame of image from a real-time code stream or video is by capturing a picture, which is to capture a complete frame of image YUV data from the real-time code stream or video, where Y represents the brightness , U represents chromaticity, and V represents density. Then encode the captured YUV data into the required image format, such as JPEG format, RGB format, etc.

When multiple cameras collect video data at the same time, each camera corresponds to a transmission channel, and the captured video data can be transmitted in the form of a code stream through the transmission channel. Snapshots can only be captured in one transmission channel. Therefore, when there are multiple cameras shooting at the same time, it is necessary to capture images from the video captured by each camera, and then use the large-screen splicing technology to capture the captured images. Multiple images are stitched into one complete image.

Specifically, each transmission channel corresponds to a decoder, and each decoder corresponds to a display channel. Each camera transmits the captured video data to the decoder through the transmission channel, the decoder decodes the video data in the transmission channel, and transmits the decoded data to the large display screen through the display channel. The image represented by the data in the display channel is only a portion of the desired captured image. The large-screen display splices each part of the image through the large-screen splicing technology to obtain a spliced image, and takes a screenshot of the spliced image to obtain the image to be captured.

However, in the current solution for capturing images, each camera needs to have a corresponding transmission channel. When the number of cameras is increased, the transmission channel needs to be increased accordingly. The more cameras, the more transmission channel resources are required.

SUMMARY OF THE INVENTION

The purpose of the embodiments of the present application is to provide an image acquisition method and apparatus, so as to solve the problem of waste of transmission channel resources in the case of multiple camera devices. The specific technical solutions are as follows:

In a first aspect, an embodiment of the present application provides an image acquisition method, the method comprising:

Obtain a data packet of a picture to be captured through a preset transmission channel, wherein the data packet carries the code stream of preset frames of multiple tracks, each track corresponds to at least one camera device, and the preset frames are the same frame or a frame at the same moment;

Obtain the image data corresponding to the code stream of each track;

According to the corresponding relationship between the track and the buffer area, the acquired image data of each track is stored in the buffer area corresponding to each track to obtain the image of the to-be-captured picture.

Optionally, the data packet also carries track quantity information; after the step of acquiring the data packet of the to-be-captured picture, it also includes:

Based on the track quantity information, determine the number of buffer areas to be allocated;

A corresponding buffer area is allocated for each track, wherein the buffer area is used to store the image data in the track corresponding to the buffer area.

Optionally, allocating a corresponding buffer area for each track includes:

Allocate a total buffer area whose available storage space is not less than the target data volume, and whose width is not less than the preset width and the height is not less than the preset height, wherein the target data volume is the data volume of the image generated by the to-be-captured picture, The preset width and the preset height are respectively the width and height of the image generated for the to-be-captured picture;

Dividing the preset width of the total buffer area equally to obtain multiple sub-widths with the same length, wherein the number of the multiple sub-widths is the same as the number of the multiple tracks;

Determine the area formed by each sub-width and the preset height as a buffer area, wherein the determined buffer area and the track are in a one-to-one correspondence;

The storing of the acquired image data of each track in the buffer area corresponding to each track according to the corresponding relationship between the track and the buffer area includes:

Based on the obtained image data of each track, obtain image data whose image width is the sub-width and the image height is the preset height;

According to the one-to-one correspondence between the buffer area and the track, the obtained image data of each track is respectively stored in the buffer area corresponding to each track;

After the image data of each track is stored, the image data stored in each buffer area are combined to obtain the image of the to-be-captured picture.

Optionally, the method further includes:

After the image data of each track is stored, the stored image data is encoded to obtain an image in a preset format.

In a second aspect, an embodiment of the present application provides an image acquisition device, and the device includes:

The first acquisition module is configured to acquire data packets of the to-be-captured pictures through a preset transmission channel, wherein the data packets carry the code streams of preset frames of multiple tracks, each track corresponds to at least one camera device, and the The preset frame is the same frame or a frame at the same moment;

The second acquisition module is used to acquire the image data corresponding to the code stream of each track;

The storage module is configured to store the acquired image data of each track in the buffer area corresponding to each track according to the corresponding relationship between the track and the buffer area, so as to obtain the image of the to-be-captured picture.

Optionally, the device further includes:

a determining module for determining the number of buffer areas to be allocated based on the track quantity information;

The allocation module is configured to allocate a corresponding buffer area for each track, wherein the buffer area is used to store image data of the track corresponding to the buffer area.

Optionally, the allocation module is specifically used for:

Allocate a total buffer area whose available storage space is not less than the target data volume, and whose width is not less than the preset width and height is not less than the preset height, wherein the target data volume is the image generated by the to-be-captured screen The amount of data, the preset width and the preset height are respectively the width and height of the image generated for the to-be-captured picture;

Dividing the preset width of the total buffer area equally to obtain multiple sub-widths with the same length, wherein the number of the multiple sub-widths is the same as the number of the multiple tracks;

Determine the area formed by each sub-width and the preset height as a buffer area, wherein the determined buffer area and the track are in a one-to-one correspondence;

The storage module is specifically used for:

Based on the obtained image data of each track, obtain image data whose image width is the sub-width and the image height is the preset height;

According to the one-to-one correspondence between the buffer area and the track, the obtained image data of each track is respectively stored in the buffer area corresponding to each track;

After the image data of each track is stored, the image data stored in each buffer area are combined to obtain the image of the to-be-captured picture.

Optionally, the device further includes:

The encoding module is configured to perform encoding processing on the stored image data after the storage of the image data of each track is completed to obtain an image in a preset format.

In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;

memory for storing computer programs;

The processor is configured to implement any of the image acquisition method steps described above when executing the program stored in the memory.

In a fourth aspect, an embodiment of the present application provides a machine-readable storage medium, where a computer program is stored in the machine-readable storage medium, and when the computer program is executed by a processor, any one of the image acquisition methods described above is implemented step.

In the technical solution provided by the embodiment of the present application, a data packet of a to-be-captured picture is obtained through a preset transmission channel, wherein the data packet carries a code stream of preset frames of multiple tracks, and each track corresponds to at least one camera device, The image data corresponding to the code stream of each track is acquired, and according to the correspondence between the track and the buffer area, the acquired image data of each track is stored in the buffer area corresponding to each track to obtain the image of the to-be-captured picture. With the technical solutions provided in the embodiments of the present application, the code streams of the preset frames of each camera device are transmitted through the preset transmission channel in the same data packet, and the corresponding code streams of each track are obtained in the preset transmission channel. the image data, and then obtain the image of the picture to be captured. The above process is completed in one transmission channel. Even if the number of camera devices is increased, there is no need to increase the transmission channel, which saves transmission channel resources. Moreover, by obtaining image data in one transmission channel and correspondingly storing the image data in the buffer area, the image of the to-be-captured picture can be obtained in one display channel, eliminating the need for image splicing processing and saving image splicing resources.

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

FIG. 1 is a flowchart of an image acquisition method provided by an embodiment of the present application;

FIG. 2(a) is a schematic diagram of the determined buffer area;

Figure 2 (b) is an image of the picture to be captured based on the determined buffer area;

Fig. 2 (c) is a kind of schematic diagram of the picture to be captured based on the determined buffer area;

FIG. 3(a) is another schematic diagram of the determined buffer area;

Figure 3(b) is another schematic diagram of the determined buffer area;

FIG. 4 is a schematic structural diagram of an image acquisition apparatus provided by an embodiment of the present application;

FIG. 5 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this application.

In order to solve the problem of waste of transmission channel resources in the case of multiple camera devices, the embodiments of the present application provide an image acquisition method and apparatus, wherein the image acquisition method includes:

Obtain a data packet of a picture to be captured through a preset transmission channel, wherein the data packet carries the code stream of preset frames of multiple tracks, each track corresponds to at least one camera device, and the preset frames are the same frame or the same the frame of the moment;

Obtain the image data corresponding to the code stream of each track;

According to the corresponding relationship between the track and the buffer area, the acquired image data of each track is stored in the buffer area to obtain the image of the picture to be captured.

With the technical solutions provided in the embodiments of the present application, the code streams of the preset frames of each camera device are transmitted through the preset transmission channel in the same data packet, and the corresponding code streams of each track are obtained in the preset transmission channel. the image data, and then obtain the image of the picture to be captured. The above process is completed in one transmission channel. Even if the number of camera devices is increased, there is no need to increase the transmission channel, which saves transmission channel resources. Moreover, by obtaining image data in one transmission channel and correspondingly storing the image data in the buffer area, the image of the to-be-captured picture can be obtained in one display channel, eliminating the need for image splicing processing and saving image splicing resources.

The following first introduces the image acquisition method provided by the embodiment of the present application. An image acquisition method provided by an embodiment of the present application can be applied to a video processing device. The video processing device can be connected to one or more camera devices, and each camera device can send the captured video data to the video processing device for processing. deal with. In addition, when the video processing device receives the code stream sent by the imaging device, it can perform decoding processing on the received code stream to obtain a video image captured by the imaging device.

As shown in FIG. 1 , an image acquisition method provided by an embodiment of the present application includes the following steps.

S101: Acquire a data packet of a to-be-captured image through a preset transmission channel.

Wherein, the data packet carries the code streams of preset frames of multiple tracks, and each track corresponds to at least one camera device. For example, the track corresponding to the camera device 1 is the track 1, and the code stream output by the camera device 1 is the code stream of the track 1.

The preset frame is the same frame or a frame at the same moment.

When the preset frame is the same frame, the code stream included in one data packet is the code stream of the same frame of each imaging device. For example, the imaging device includes imaging device 1, imaging device 2, and imaging device 3. The code stream of the first frame of image of imaging device 1 is the same as the code stream of the first frame of image of imaging device 2, and the code stream of the first frame of image of imaging device 3. The stream is packaged into a data packet.

When the preset frame is the frame at the same time, the code stream included in one data packet is the code stream of the frame at the same time of each imaging device. For example, the code stream of the camera device 1 at 12:00, the code stream of the camera device 2 at 12:00, and the code stream of the camera device 3 at 12:00 are packaged into a data packet.

In an implementation manner, the code stream included in one data packet may only be the code stream of one frame of image, for example, the first data packet includes the code stream of the first frame of image of each camera, and the second data packet includes The code stream of the second frame image of each camera. Among them, the code streams of different cameras in a data packet can be distinguished by the preset start mark and end mark.

In another implementation manner, the code stream included in a data packet may also include a code stream of multiple frames of images. In this case, the data packet may include the start and end marks of each frame of code stream to use To distinguish the code stream of each frame.

The preset transmission channel may be a user-defined setting, and the preset transmission channel is used to transmit the code streams of the connected multiple camera devices, that is, the multiple camera devices pass through the preset transmission channel. transport stream.

In one implementation, a transmission protocol is pre-defined, and each camera device encodes the acquired image information into a code stream according to the transmission protocol, and packages the code stream obtained by encoding and the code stream of other camera devices into a code stream. A data packet, which is transmitted through a preset transmission channel.

Take the custom protocol as an example of a multi-track streaming protocol. The multi-track streaming protocol is a streaming protocol used for stream encoding and decoding, transmission, preview, video storage, etc. The code stream of multiple tracks encoded by the image information of the device can be spliced and combined into one image between the code stream images of different tracks, and the code streams of multiple tracks can be transmitted, previewed, Video storage, etc. The protocol header of the multi-track streaming protocol may include information such as the number of tracks, the start and end markers of the code stream of each track in the data packet, and the like.

In another implementation manner, each imaging device may be connected to one processing device, and each imaging device may send image information collected by itself to the processing device. After the processing device receives the image information sent by each camera device, it can encode the image information into a code stream, and package the code stream belonging to the same frame of image into a data packet, which is transmitted through the preset transmission channel in the form of a data packet. .

For example, the processing device is connected to the camera device 1, the camera device 2, and the camera device 3, respectively, and the camera device 1, the camera device 2, and the camera device 3 respectively send the first frame of image information collected to the processing device. The first frame image information is encoded into the code stream for the first frame image, and the code stream of the first frame image of the camera device 1, the code stream of the first frame image of the camera device 2, and the first frame image of the camera device 3 are encoded. The code stream of the image is packaged into a data packet, and the data packet is transmitted through the preset transmission channel. In this way, it is ensured that the first frame of images captured by the imaging device 1 , the imaging device 2 and the imaging device 3 are synchronized.

Through any of the above-mentioned implementation manners, the code streams belonging to the same frame of image can be transmitted in the same data packet, thereby ensuring the synchronization between the camera devices.

Wherein, the to-be-captured picture may be customized. For example, in a scenario of playing a video image captured by a camera device in real time, the currently displayed image may be used as the image to be captured. In the scenario of playing back the stored video, the currently displayed picture can be used as the picture to be captured during the playback. The picture of the first frame image of the currently playing video may also be determined as the picture to be captured.

In the scenario of replaying the stored video, any frame in the video can be determined as the to-be-captured image. Therefore, the to-be-captured image can be determined according to the user's instruction, and the to-be-captured image can be obtained from the replayed video. Take an image of the screen.

Wherein, the data packet may also include MFI (Multiple Frame Indicator, composite frame information byte) information, and the MFI information may include the number of tracks, the information of each code stream in the data packet, and the identification of the start and end of the code stream of each track Wait.

S102: Acquire image data corresponding to the code stream of each track.

Wherein, if the code stream transmitted in the track is the decoded image data, the image data can be directly obtained from each track. If the code stream transmitted in the track is encoded image data, the code stream of each track can be decoded to obtain the image data of the track.

After the data packet is acquired, the code stream carried by the data packet can be acquired, and the acquired code stream includes the code stream of each track, that is, the code stream output by each camera device. After the code stream of each track is acquired, the code stream of each track is decoded respectively.

Among them, in an embodiment of decoding the code stream of each track, each track corresponds to a decoder, the decoder can decode the code stream on the corresponding track, and the decoder corresponding to each track does not The codestreams of tracks other than this track will be decoded.

For example, camera device 1 corresponds to track 1, camera device 2 corresponds to track 2, and camera device 3 corresponds to track 3, wherein track 1 corresponds to decoder 1, track 2 corresponds to decoder 2, and track 3 corresponds to decoder 3. Then, decoder 1 decodes the code stream of track 1, decoder 2 decodes the code stream of track 2, and decoder 3 decodes the code stream of track 3.

The image data is data used to represent an image, and the image data may be YUV data, RGB data, or the like. In the embodiments of the present application, YUV data is used as an example for introduction. That is to say, if the acquired image data is YUV data, the YUV data can be used to represent an image. For example, when the YUV data comes from the imaging device 1 , the image represented by the YUV data is the image captured by the imaging device 1 .

S103, according to the corresponding relationship between the track and the buffer area, store the acquired image data of each track in the buffer area corresponding to each track, and obtain the image of the picture to be captured.

The corresponding relationship between the track and the buffer area may be preset or determined according to the code stream carried in the data packet, which is not limited herein. The correspondence between the track and the buffer area is used to determine the storage location of the image data of each track. After the image data of each track is stored in the corresponding buffer area, that is to say, after the corresponding image data has been stored in each buffer area, all the stored image data are combined to form an image, and the image is to be Capture an image of the screen.

For example, the camera equipment includes camera equipment 1, camera equipment 2 and camera equipment 3, and the buffer area includes buffer area 1, buffer area 2 and buffer area 3, as shown in Figure 2(a), wherein camera equipment 1 corresponds to buffer area 1 , the camera device 2 corresponds to the buffer area 2, and the camera device 3 corresponds to the buffer area 3. The YUV data obtained after the decoding process of the code stream output by the camera device 1 is stored in the buffer area 1, the YUV data obtained after the decoding process of the code stream output by the camera device 2 is stored in the buffer area 2, and the code output by the camera device 3 is stored in the buffer area 2. The YUV data obtained after the stream is decoded is stored in the buffer area 3 . After the above three buffer areas all store the YUV data of the corresponding camera equipment, the YUV data in the three buffer areas are combined to obtain a combined image, as shown in Figure 2(b), in the figure The two vertical lines of are added for the convenience of comparison with Figure 2(a), and finally an image is obtained, that is, the image of the picture to be captured, as shown in Figure 2(c).

In one embodiment, the buffer area is preset. The number of buffer areas is consistent with the number of tracks, and each track corresponds to a buffer area, which can be in a one-to-one correspondence. When the buffer area is determined, the corresponding relationship between each track and the buffer area is predetermined. In the subsequent image acquisition process, the corresponding relationship remains unchanged, that is, the image data transmitted in each track is fixedly stored in the corresponding buffer area.

For example, buffer area 1 and buffer area 2 are preset, and it is preset that track 1 corresponds to buffer area 1, and track 2 corresponds to buffer area 2. When image acquisition is performed, the image data transmitted in track 1 is stored in the buffer area. In 1, the image data transmitted in track 2 is stored in buffer 2.

In this embodiment, the buffer area can be adjusted, and the corresponding relationship between the track and the buffer area can be adjusted again.

In one embodiment, the buffer area corresponding to each track may be a self-defined buffer area, and the buffer area corresponding to each track may be continuous or non-consecutive. Based on the correspondence between the track and the buffer area, the image data in each track can be stored in the corresponding buffer area. When an image needs to be generated, the stored image data can be obtained from each buffer area, and the obtained image data can be combined according to a preset arrangement rule, that is, the image of the to-be-captured picture can be obtained. Wherein, after each image data is combined, format conversion, scaling processing, etc. can be performed, so as to obtain an image of the picture to be captured that meets the requirements.

The preset arrangement rules may be customized. For example, the image data in track 1 is captured by camera device 1, the image data in track 2 is captured by camera device 2, and the image data in track 3 is captured by camera device 3. The preset arrangement rules are: The image data in track 1 is located on the leftmost, the image data in track 2 is located in the middle, and the image data in track 3 is located on the far right, then the image captured by the camera device 1 in the obtained image to be captured is located at the On the leftmost side, the picture captured by the imaging device 2 is in the middle, and the picture captured by the imaging device 3 is in the far right.

In one embodiment, after the step (S101) of acquiring the data packet of the picture to be captured, the following steps may also be included: based on the track quantity information, determine the number of buffer areas to be allocated; The amount of data to stream, with buffers allocated for each track.

The data packet may carry track quantity information, where the track quantity information is used to indicate the number of tracks to which each code stream carried in the data packet belongs. Based on the track number information, the number of buffer areas can be determined, and the number of buffer areas is consistent with the number of tracks. For example, if the track quantity information carried in the data packet is 4, it means that the data packet carries code streams of 4 tracks, and it can be determined that the number of buffer areas is 4.

After the number of buffer areas is determined, the available storage space of each buffer area may be allocated, and the available storage space of each buffer area may be set by yourself. That is to say, the available storage space of each buffer area can be greater than or equal to the data amount of the image data in the track corresponding to the buffer area. In this case, the image data in the track can be directly stored in the corresponding buffer area. . The available storage space of each buffer area may be smaller than the data amount of the image data in the track corresponding to the buffer area. The amount is less than or equal to the available storage space of the corresponding buffer area.

In one implementation, in order to ensure that each buffer area has enough available storage space to store the image data of the corresponding track, when the buffer area is allocated, the available storage space allocated for each buffer area may be greater than or equal to the buffer area. The data amount of the image data of the track corresponding to the area, that is, it can be considered that the available storage space of each buffer area is greater than or equal to the data amount of the code stream of the track corresponding to the buffer area. In this way, even the image data of the track can be stored in the corresponding buffer area without scaling.

In one embodiment, the data packet may carry the target data amount of the image generated for the to-be-captured picture. The target data volume of the image can be customized, that is, the size of the generated image can be set. For example, if the target data volume is set to 5M, it means that the image generated by the image to be captured is 5M.

In addition, the data packet can also carry the width and height information of the image generated for the image to be captured, and the width and height information includes a preset width and a preset height, that is, the width of the image generated by the image to be captured is the preset width , the height is the preset height. Wherein, both the preset width and the preset height can be set by yourself. For example, if the preset width is 800 pixels and the preset height is 480 pixels, it means that the resolution width of the image generated by the image to be captured is 800 pixels. pixels, the resolution height is 480 pixels.

On the basis of the foregoing implementation manner, the step of allocating a buffer area for each track may specifically include the following steps.

A total buffer area may be allocated first, and the total buffer area is used to store the decoded image data of the code stream of each track in the data packet. The available storage space of the total buffer area can be allocated according to the target data volume of the images generated for the images to be captured, that is to say, the available storage space of the total buffer area should at least not be less than the target data volume. In addition, the width of the total buffer area is not less than the preset width, and the height is not less than the preset height. The preset width and preset height are the width and height of the image generated for the image to be captured, and the preset width and preset height may be set by yourself.

After allocating the total buffer area, the preset width of the total buffer area may be equally divided to obtain multiple sub-widths with the same length. The number of divided sub-widths is the same as the number of tracks. For example, if the number of camera devices is 4, the number of tracks is also 4. When the preset width of the total buffer area is 800 pixels, the preset width can be equally divided into 4 sub-widths, and each sub-width is 200 pixels.

An area formed by each sub-width and a preset height is determined as a buffer area, that is, the total buffer area includes a plurality of buffer areas of the same size. The width of each buffer is the sub-width and the height is the preset height. As shown in Figure 3(a), the preset width of the total buffer area is W, the preset height is H, and there are T1 tracks, then the preset width W is equally divided into T1 equal parts, and each sub-width is W/T1 . The area formed by each sub-width W/T1 and the preset height H is determined as a buffer area, such as the first buffer area, the second buffer area, and the T1-th buffer area in the figure.

The determined buffer areas and tracks may be in a one-to-one correspondence, that is, each buffer area corresponds to a track, and the image data of the track is stored in the buffer area corresponding to the track.

After the buffer area is determined, according to the corresponding relationship between the track and the buffer area, the step of storing the obtained image data of each track in the buffer area corresponding to each track ( S103 ) may include the following steps.

Based on the obtained image data of each track, image data with an image width of a sub-width and an image height of a preset height can be obtained. Wherein, when the width and height of the image data of each track are consistent with the width and height of the corresponding buffer area, the image data can be directly stored in the corresponding buffer area. When the sum and height are inconsistent with the width and height of the corresponding buffer area, the image data in the track can be scaled first, so that the width and height of the scaled image data are the same as the width and height of the corresponding buffer area. High is consistent. In an implementation manner, VGS (Video Graphics Sub-System, video graphics subsystem) can be used to compress the image data of each track, wherein the VGS can perform processing such as scaling, format conversion, and decoding on the image.

After the image data of each track is scaled into image data of sub-width and preset height, the scaled image data of each track can be stored in the corresponding cache area.

Taking Figure 3(a) as an example, there are T1 tracks, in which the first track corresponds to the first buffer area, the second track corresponds to the second buffer area... The T1th track corresponds to the T1th buffer area, then the first track corresponds to the T1th buffer area. The zoomed image data of one track is stored in the first buffer area, the zoomed image data of the second track is stored in the second buffer area, and the zoomed image data of the T1th track is stored in the T1 cache area.

Based on the image data after scaling processing and the buffer area having the same width and height, after the image data is stored in the buffer area, the entire buffer area will be filled with image data, then the image data in the buffer area can represent a image.

Wherein, when the scaled image data of each track is respectively stored in the buffer area corresponding to each track, the storage may be performed for multiple buffer areas at the same time, or may be sequentially stored in a custom order. For example, in Fig. 3(a), the identifiers are stored in the order from small to large, that is, the first buffer area is stored first, then the second buffer area is stored, and finally the T1-th buffer area is stored. After the storage of the buffer area is completed, the storage of the entire total buffer area is completed.

After the image data of each track is stored, the image data stored in each buffer area is combined to obtain the image of the to-be-captured picture. Wherein, the combination method may be to directly obtain an image from the image data stored in each buffer area, and the image is the image of the to-be-captured picture. For example, if the image of the picture to be captured is a YUV image, and the cache is divided into three parts, Y, U, and V for storage, then a YUV image can be directly obtained at this time, that is, the image of the picture to be captured. For another example, if the image of the picture to be captured is a bit image and the buffer area is continuous, the image of the picture to be captured can be directly obtained. In addition, the combination method can also perform data conversion processing on the image data in each buffer area to obtain image data that meets the requirements of the image format, etc. The image obtained from the image data after data conversion processing is the image of the screen to be captured. .

In one implementation, the total buffer area is evenly divided into T1 buffer areas, and the divided T1 buffer areas are shown in Figure 3(a). After each buffer area is determined, the first buffer area of each buffer area is determined. address, as shown in Figure 3(b). Two adjacent buffer areas are contiguous, that is, the first address of the buffer area and the last address of the previous buffer area adjacent to the buffer area are consecutive. For example, the first address of the second buffer area is the last address of the first buffer area.

For the buffer areas in Fig. 3(b), storage is performed in order of the identifiers from small to large, that is, the first buffer area is stored first, then the second buffer area is stored, and finally the T1th buffer area is stored. When it is detected that image data is stored in the T1-th buffer area, it means that the current T1 buffer areas have stored image data. At this time, the image data stored in each buffer area is combined to obtain the image of the picture to be captured. .

In one embodiment, the image format setting of the image to be captured may be performed. After the image data of each track is stored, the stored image data is encoded to obtain an image of a preset format.

Among them, it can be considered that the data processing of the image data is included in the process of the encoding process. In addition, the stored image data can also be scaled, so that the width and height of the obtained image are the preset width and height. .

The preset format may be user-defined, for example, the preset format may be a JPEG (Joint Photographic Experts Group, Joint Photographic Experts Group) format, a PNG (Portable Network Graphics, Portable Network Graphics) format, and the like.

The preset format may be set by yourself. In an implementation manner, the data packet may carry information in a preset format. After the data packet is acquired, the preset format information can be acquired, and an encoder for the preset format can be created according to the preset format information, and the encoder is used to convert the image input to the encoder into an image of the preset format . After the image data of each track is stored, the image data stored in the buffer area is input into the encoder, the encoder generates an image in a preset format, and the generated image in the preset format is stored and displayed.

For example, if the preset format is JPEG format, the data packet carries JPEG format information, and the JPEG format information indicates that the format of the image to be generated is JPEG format. The encoder created according to the JPEG format information is a JPEG encoder. After the image data of each track is stored, the image data stored in the buffer area is input to the JPEG encoder to generate a JPEG format image.

In an implementation manner, if the preset format is RGB format, TDE (Two Dimensional Engine, two-dimensional data processing tool) can be used to perform image processing on the image data stored in the buffer area to obtain an image in RGB format. Among them, the TDE device can provide graphics drawing functions in terms of OSD (On Screen Display, screen display overlay) and GUI (Graphical User Interface, graphical user interface).

With the technical solutions provided by the embodiments of the present application, the code streams of the preset frames of each camera device are transmitted through the preset transmission channel in the same data packet, and the corresponding code streams of each track are obtained in the preset transmission channel. the image data, and then obtain the image of the picture to be captured. The above process is completed in one transmission channel. Even if the number of camera devices is increased, there is no need to increase the transmission channel, which saves transmission channel resources. Moreover, by obtaining image data in one transmission channel and correspondingly storing the image data in the buffer area, the image of the to-be-captured picture can be obtained in one display channel, without the need for image splicing processing, which saves image splicing resources.

Corresponding to the above image acquisition method embodiments, the embodiments of the present application further provide an image acquisition apparatus, as shown in FIG. 4 , the image acquisition apparatus includes:

The first obtaining module 410 is configured to obtain a data packet of a to-be-captured picture through a preset transmission channel, wherein the data packet carries a code stream of preset frames of multiple tracks, each track corresponds to at least one camera device, and the preset The frame is the same frame or frame at the same moment;

The second acquisition module 420 is used to acquire the image data corresponding to the code stream of each track;

The storage module 430 is configured to store the acquired image data of each track in the buffer area corresponding to each track according to the corresponding relationship between the track and the buffer area, so as to obtain the image of the picture to be captured.

In one embodiment, the image acquisition device may further include:

A determination module for determining the number of buffer areas to be allocated based on the track quantity information;

The allocation module is used for allocating a corresponding buffer area for each track, wherein the buffer area is used to store the image data of the track corresponding to the buffer area.

In one embodiment, the allocation module is specifically used to:

Allocate a total buffer area whose available storage space is not less than the target data volume, and whose width is not less than the preset width and the height is not less than the preset height, wherein the target data volume is the data volume of the image generated by the screen to be captured, The preset width and preset height are the width and height of the image generated for the image to be captured;

The preset width of the total buffer area is evenly divided to obtain multiple sub-widths with the same length, wherein the number of multiple sub-widths is the same as the number of multiple tracks;

The area formed by each sub-width and the preset height is determined as a buffer area, wherein the determined buffer area and the track are in a one-to-one correspondence;

The storage module 430 is specifically used for:

Based on the obtained image data of each track, obtain image data whose image width is the sub-width and the image height is the preset height;

According to the one-to-one correspondence between the buffer area and the track, the obtained image data of each track is respectively stored in the buffer area corresponding to each track;

After the image data of each track is stored, the image data stored in each buffer area are combined to obtain the image of the image to be captured.

In one embodiment, the image acquisition device may further include:

The encoding module is configured to perform encoding processing on the stored image data after the storage of the image data of each track is completed to obtain an image in a preset format.

With the technical solutions provided in the embodiments of the present application, the code streams of the preset frames of each camera device are transmitted through the preset transmission channel in the same data packet, and the corresponding code streams of each track are obtained in the preset transmission channel. the image data, and then obtain the image of the picture to be captured. The above process is completed in one transmission channel. Even if the number of camera devices is increased, there is no need to increase the transmission channel, which saves transmission channel resources. Moreover, by obtaining image data in one transmission channel and correspondingly storing the image data in the buffer area, the image of the to-be-captured picture can be obtained in one display channel, eliminating the need for image splicing processing and saving image splicing resources.

Corresponding to the above image acquisition method embodiments, the embodiments of the present application further provide an electronic device, as shown in FIG. 5 , including a processor 510 , a communication interface 520 , a memory 530 and a communication bus 540 , wherein the processor 510 communicates with The interface 520, the memory 530 completes the mutual communication through the communication bus 540;

a memory 530 for storing computer programs;

When the processor 510 is used to execute the program stored in the memory 530, the following steps are implemented:

Obtain the data packet of the picture to be captured through the preset transmission channel, wherein the data packet carries the code stream of preset frames of multiple tracks, each track corresponds to at least one camera device, and the preset frame is the same frame or the same time. frame;

Obtain the image data corresponding to the code stream of each track;

According to the corresponding relationship between the track and the buffer area, the acquired image data of each track is stored in the buffer area corresponding to each track, and the image of the picture to be captured is obtained.

With the technical solutions provided in the embodiments of the present application, the code streams of the preset frames of each camera device are transmitted through the preset transmission channel in the same data packet, and the corresponding code streams of each track are obtained in the preset transmission channel. the image data, and then obtain the image of the picture to be captured. The above process is completed in one transmission channel. Even if the number of camera devices is increased, there is no need to increase the transmission channel, which saves transmission channel resources. Moreover, by obtaining image data in one transmission channel and correspondingly storing the image data in the buffer area, the image of the to-be-captured picture can be obtained in one display channel, eliminating the need for image splicing processing and saving image splicing resources.

The communication bus mentioned in the above electronic device may be a peripheral component interconnect standard (Peripheral Component Interconnect, PCI) bus or an Extended Industry Standard Architecture (Extended Industry Standard Architecture, EISA) bus or the like. The communication bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

The communication interface is used for communication between the above electronic device and other devices.

The memory may include random access memory (Random Access Memory, RAM), and may also include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

The above-mentioned processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; may also be a digital signal processor (Digital Signal Processing, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

Corresponding to the above image acquisition method embodiments, a machine-readable storage medium stores a computer program, and when the computer program is executed by a processor, any of the image acquisition method steps described above are implemented. .

It should be noted that, in this document, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any relationship between these entities or operations. any such actual relationship or sequence exists. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

Each embodiment in this specification is described in a related manner, and the same and similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the image acquisition apparatus, electronic device, and machine-readable storage medium embodiments, since they are basically similar to the image acquisition method embodiments, the description is relatively simple.

The above descriptions are only preferred embodiments of the present application, and are not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application are included in the protection scope of this application.

Claims (10)

1. An image acquisition method, characterized in that the method comprises:

acquiring a data packet of a picture to be captured through a preset transmission channel, wherein the data packet carries a code stream of preset frames of a plurality of tracks, each track corresponds to at least one camera device, and the preset frames are frames of the same frame or frames of the same time;

acquiring image data corresponding to the code stream of each track;

and storing the acquired image data of each track to the cache region corresponding to each track according to the corresponding relation between the tracks and the cache region to obtain the image of the picture to be captured.

2. The method of claim 1, wherein the data packet further carries track number information; after the step of obtaining the data packet of the picture to be grabbed, the method further comprises the following steps:

determining the number of cache regions required to be allocated based on the track number information;

and allocating a corresponding buffer area for each track, wherein the buffer area is used for storing the image data in the track corresponding to the buffer area.

3. The method of claim 2, wherein the allocating a corresponding buffer for each track comprises:

allocating a total cache region with an available storage space not smaller than a target data volume, a width not smaller than a preset width and a height not smaller than a preset height, wherein the target data volume is the data volume of an image generated by the picture to be captured, and the preset width and the preset height are respectively the width and the height of the image generated by the picture to be captured;

averagely dividing the preset width of the total cache area to obtain a plurality of sub-widths with the same length, wherein the number of the sub-widths is the same as that of the tracks;

determining an area formed by each sub-width and the preset height as a cache area, wherein the determined cache areas and the tracks are in one-to-one correspondence;

the storing the acquired image data of each track to the cache region corresponding to each track according to the corresponding relationship between the track and the cache region includes:

obtaining image data with the image width as the sub-width and the image height as the preset height based on the obtained image data of each track;

respectively storing the obtained image data of each track to the cache region corresponding to each track according to the one-to-one correspondence relationship between the cache regions and the tracks;

and after the image data of each track is stored, combining the image data stored in each cache region to obtain the image of the picture to be captured.

4. The method according to any one of claims 1-3, further comprising:

and after the image data of each track is stored, encoding the stored image data to obtain an image in a preset format.

5. An image acquisition apparatus, characterized in that the apparatus comprises:

the first acquisition module is used for acquiring a data packet of a picture to be captured through a preset transmission channel, wherein the data packet carries a code stream of preset frames of a plurality of tracks, each track corresponds to at least one camera device, and the preset frames are frames of the same frame or frames of the same time;

the second acquisition module is used for acquiring image data corresponding to the code stream of each track;

and the storage module is used for storing the acquired image data of each track to the cache region corresponding to each track according to the corresponding relation between the track and the cache region to obtain the image of the picture to be captured.

6. The apparatus of claim 5, further comprising:

the determining module is used for determining the number of the cache regions required to be allocated based on the track number information;

the allocation module is used for allocating a corresponding buffer area for each track, wherein the buffer area is used for storing the image data of the track corresponding to the buffer area.

7. The apparatus of claim 6, wherein the assignment module is specifically configured to:

allocating a total cache area with an available storage space not smaller than a target data volume, a width not smaller than the preset width and a height not smaller than the preset height, wherein the target data volume is the data volume of an image generated by the picture to be captured, and the preset width and the preset height are respectively the width and the height of the image generated by the picture to be captured;

averagely dividing the preset width of the total cache area to obtain a plurality of sub-widths with the same length, wherein the number of the sub-widths is the same as that of the tracks;

determining an area formed by each sub-width and the preset height as a cache area, wherein the determined cache areas and the tracks are in one-to-one correspondence;

the storage module is specifically configured to:

obtaining image data with the image width as the sub-width and the image height as the preset height based on the obtained image data of each track;

respectively storing the obtained image data of each track to the cache region corresponding to each track according to the one-to-one correspondence relationship between the cache regions and the tracks;

and after the image data of each track is stored, combining the image data stored in each cache region to obtain the image of the picture to be captured.

8. The apparatus of any one of claims 5-7, further comprising:

and the coding module is used for coding the stored image data after the image data of each track is stored, so as to obtain an image with a preset format.

9. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;

a memory for storing a computer program;

a processor for implementing the method steps of any of claims 1 to 4 when executing a program stored in the memory.

10. A machine readable storage medium, characterized in that a computer program is stored in the machine readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of claims 1 to 4.

Images