CN119031094A - Video processing method, device and related equipment - Google Patents

Abstract

The embodiment of the application discloses a video processing method, a video processing device and related equipment, which are used for solving the problem of privacy disclosure caused by shooting a privacy area when video of a camera is disclosed or shared. The method of the embodiment of the application comprises the following steps: obtaining a visible coordinate range of a visible area designated by terminal equipment; acquiring original data shot by a camera; processing the original data according to the visible coordinate range to generate video data shielding the area outside the visible area; and sending the video data to the terminal equipment.

Description

Video processing method, device and related equipment

Technical Field

The present application relates to the field of video processing technology, and in particular to a video processing method, apparatus and related equipment.

Background Art

Camera is a very important electronic device that can capture images and convert them into digital signals. With the continuous development of science and technology, cameras are also constantly upgraded and improved. The resolution of cameras has been greatly improved, from the initial hundreds of thousands of pixels to the current tens of millions of pixels. The resolution of cameras has achieved an order of magnitude leap. High-resolution cameras can capture more delicate image details, making the photos or videos taken clearer and more realistic. Cameras have become an indispensable part of our daily lives. However, the problem of camera privacy protection is becoming increasingly serious.

People's demand for privacy is getting higher and higher, so camera privacy protection is particularly important.

Summary of the invention

The embodiments of the present application provide a video processing method, apparatus and related equipment for solving the problem of privacy leakage caused by capturing a private area when a camera video is leaked or shared.

In a first aspect, the present application provides a video processing method, which can be executed by a computing device, which can be a server, such as a cloud server, a central server, an edge server, or a local server in a local data center, or mounted in an electronic device such as a camera device. The method includes:

Obtaining the visible coordinate range of the visible area specified by the terminal device. The user specifies the visible area to be watched on the terminal device, and the terminal device sends the visible coordinate range corresponding to the visible area specified by the user in the video screen to the computing device.

The raw data captured by the camera is obtained. The raw data may refer to the raw data obtained by converting the light source signal captured by the camera's image sensor into a digital signal.

According to the visible coordinate range, the original data is processed to generate video data of the area outside the visible area. After obtaining the visible coordinate range and the original data, while converting the original data into video data, the area outside the visible coordinate range in the video screen is shielded, so as to obtain the video data of the area outside the visible area, that is, in the video screen corresponding to the video data, only the visible area specified by the user can be included.

The video data is sent to the terminal device. The video data generated by the above steps is sent to the terminal device for playback, and the played video content shields the area outside the visible area, thereby achieving privacy protection for the area outside the visible area in the video.

The video processing method provided in the embodiment of the present application obtains the visible area specified by the user on the terminal device, and then processes the original data captured by the camera according to the coordinate range of the visible area, thereby obtaining video data that only displays the content of the visible area and returning it to the terminal device, thereby achieving accurate privacy masking of the video screen. When the video data is leaked or shared, the privacy of the masked area can be protected at the video data source, thereby solving the problem of privacy leakage caused by capturing the privacy area when the camera video is leaked or shared.

In a possible implementation method, the original data is processed according to the visible range to generate video data that masks areas outside the visible area, including:

Perform coordinate transformation on the visible coordinate range to obtain the shielded coordinate range;

Generate an electronic block covering the shielding coordinate range;

Electronic blocks are overlaid on the original data to generate video data that masks areas outside the visible area.

In this embodiment, after determining the visible coordinate range and the coordinate range covered by the video screen, the area between the edge of the visible coordinate range and the edge of the video screen is the shielded area, and an electronic block is generated on the shielded area. After covering the corresponding position in the original data, the shielded area (the area outside the visible area) is shielded by the electronic block, and the area outside the visible area is shielded in the generated video data, thereby achieving precise privacy shielding and protecting the content of the visible area.

In a possible implementation method, the visible area is an N-polygon, and the electronic block includes a plurality of sub-blocks, where N is an integer greater than 3;

The plurality of sub-blocks are used to cover the area between the N edges of the visible area and the edge of the video screen.

In a possible implementation method, the original data is processed according to the visible coordinate range to generate video data for masking the area outside the visible area, including:

Obtaining picture adjustment parameters according to the center coordinates and edge coordinates of the visible coordinate range;

The original data is moved and/or cropped according to the picture adjustment parameters to generate video data of the area outside the masked visible area.

In this embodiment, the visible area can be moved and cropped to achieve maximum coverage of the visible area in the video picture, thereby achieving accurate privacy shielding and protecting the content of the visible area.

In a possible implementation method, after sending the video data to the terminal device, the method further includes:

Perform edge recognition on the visible area in the video data to obtain the edge coordinate range;

Update the visible coordinate range according to the edge coordinate range;

The original data is processed according to the updated visible coordinate range.

In this embodiment, edge recognition technology in image recognition technology is used to identify the edge of the visible area in the video data of the demarcated visible area, and the visible coordinate range is re-updated according to the recognition result, so that the video screen can track the visible area.

In a second aspect, the present application provides a video processing device, including a transceiver module and a processing module;

The transceiver module is used to perform the transceiver operation of the video processing method of the first aspect, and the processing module is used to perform the processing operation of the video processing method of the first aspect.

For example, the video processing device is used to execute the following scheme:

A transceiver module, used to obtain the visible coordinate range of the visible area specified by the terminal device;

The transceiver module is also used to obtain the raw data captured by the camera;

A processing module, used for processing the original data according to the visible coordinate range to generate video data of the area outside the visible area;

The transceiver module is also used to send video data to the terminal device.

In a possible implementation, the processing module is specifically used to perform coordinate conversion on the visible coordinate range to obtain a shielded coordinate range; generate an electronic block covering the shielded coordinate range; cover the electronic block on the original data to generate video data of the area outside the shielded visible area.

In a possible implementation, the visible area is an N-gon, and the electronic block includes a plurality of sub-blocks, where N is an integer greater than 3;

The plurality of sub-blocks are used to cover the area between the N edges of the visible area and the edge of the video screen.

In one possible implementation, the visible area is a rectangle;

The processing module is specifically used to obtain picture adjustment parameters according to the center coordinates and edge coordinates of the visible coordinate range; according to the picture adjustment parameters, the original data is moved and/or cropped to generate video data that shields the area outside the visible area.

In a possible implementation, the processing module is further used to perform edge recognition on the visible area in the video data to obtain an edge coordinate range; update the visible coordinate range according to the edge coordinate range; and process the original data according to the updated visible coordinate range.

In a third aspect, the present application provides a video processing device, including a terminal device, a camera, and the video processing apparatus as described in the second aspect above;

The terminal device is used to obtain the visible coordinate range of the visible area and send the visible coordinate range to the video processing device; and is also used to obtain the video data processed by the video processing device;

The camera is used to convert the captured light signal into raw data of a digital signal through an image sensor, and send the raw data to a video processing device.

In a fourth aspect, the present application provides a computing device, the computing device comprising a processor;

The processor is used to execute the computer program or computer instructions in the memory to perform the video processing method of the first aspect as described above.

In a possible implementation, the computing device further includes a memory.

In a fifth aspect, the present application provides a computer-readable storage medium, characterized in that a computer program is stored thereon, and when the computer program is executed by a computing device, the computing device executes the video processing method of the first aspect as described above.

In a sixth aspect, the present application provides a computer program product, comprising a program, characterized in that when the program is executed by a processor, the video processing method of the first aspect described above is implemented.

The solutions provided in the second to sixth aspects are used to implement or cooperate with the method provided in the first aspect, and thus can achieve the same or corresponding beneficial effects as the first aspect, and will not be repeated here.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1A is an architecture diagram of a video processing device provided in an embodiment of the present application;

FIG1B is a flow chart of a video processing method provided by an embodiment of the present application;

FIG2 is a schematic diagram of selecting a visible area in a video screen provided by an embodiment of the present application;

FIG3 is a method flow chart of step 103;

FIG4 is a schematic diagram of shielding a sub-block provided in an embodiment of the present application;

FIG5 is a schematic diagram of shielding a sub-block provided in an embodiment of the present application;

FIG6 is another method flow chart of step 103;

7a and 7b are schematic diagrams of visible areas provided in embodiments of the present application;

FIG8 is a schematic diagram of the structure of a video processing device provided in an embodiment of the present application;

FIG. 9 is a transmission signaling diagram of a video processing device provided in an embodiment of the present application.

DETAILED DESCRIPTION

In order to make the purpose, technical solutions and advantages of the present application more clear, the embodiments of the present application are described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. It is known to those skilled in the art that with the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments described here can be implemented in an order other than that illustrated or described here. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or modules is not necessarily limited to those steps or modules clearly listed, but may include other steps or modules that are not clearly listed or inherent to these processes, methods, products or devices. The naming or numbering of steps in this application does not mean that the steps in the method flow must be executed in the time/logical sequence indicated by the naming or numbering. The process steps that have been named or numbered can change the execution order according to the technical purpose to be achieved, as long as the same or similar technical effects can be achieved. The division of units in this application is a logical division. There may be other division methods when it is implemented in actual applications. For example, multiple units can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection between units can be electrical or other similar forms, which are not limited in this application. In addition, the units or sub-units described as separate components may or may not be physically separated, may or may not be physical units, or may be distributed in multiple circuit units, and some or all of the units may be selected according to actual needs to achieve the purpose of the present application.

Camera is a very important electronic device that can capture images and convert them into digital signals. With the continuous development of science and technology, cameras are also constantly upgraded and improved. The resolution of cameras has been greatly improved, from the initial hundreds of thousands of pixels to the current tens of millions of pixels. The resolution of cameras has achieved an order of magnitude leap. High-resolution cameras can capture more delicate image details, making the photos or videos taken clearer and more realistic. With the advancement of technology, cameras have become popular in all aspects of our lives, from security cameras to smartphone cameras, and we are monitored by them all the time. However, this widespread application of cameras has also caused people to worry about privacy protection.

At the current stage, there are several related technologies that can be used for camera privacy protection. The following are some of the main technologies:

Encryption and secure transmission: The camera can use encryption technology to protect video data to ensure that the data is not stolen or tampered with during transmission. The use of secure transmission protocols and encryption algorithms, such as SSL/TLS, can ensure the confidentiality and integrity of the video stream.

Access control: Camera devices can use access control mechanisms to allow only authorized users or devices to access and operate the camera. This can be achieved through authentication, access tokens, or access control lists to ensure that only legitimate users can access the camera.

Privacy protection protocols and standards: Develop and adopt unified privacy protection protocols and standards to regulate the design, development and use of cameras to ensure compliance with privacy protection principles. For example, GDPR (General Data Protection Regulation) is an important regulation for personal data protection.

Physical blocking: This is a simple but effective method that physically blocks the camera lens, such as using a removable cover, sticker, or specially designed privacy protection device. This can effectively prevent unauthorized access and surveillance.

Anonymization and blurring: This technology is used to process video images captured by cameras to hide or blur personal identities or sensitive information. For example, faces are blurred, blocked or replaced to protect the privacy of the monitored person.

Smart algorithms and artificial intelligence: Using smart algorithms and artificial intelligence technology, cameras can be analyzed and identified to filter and remove unnecessary personal information, thereby protecting privacy. For example, using a face recognition algorithm can extract only facial features instead of a complete face image.

Among them, encryption and secure transmission, access permission control, privacy protection protocols and standards are aimed at protecting video content during video data transmission; physical occlusion, anonymization and blurring, intelligent algorithms and artificial intelligence protect video content by processing video data and hiding some privacy information.

It is understandable that with the continuous development of optical and hardware technologies, the current camera's field of view is getting wider and wider, covering a larger care area, while also capturing the user's private area in the picture, which may lead to the leakage of user privacy or inconvenience in sharing videos. A typical example is the baby care scenario: the crib is generally placed next to the parents' bed. The camera installed to watch the baby can easily capture the private area on the bed, bringing the risk of privacy leakage to the user. Since the baby's parents may share the video with other family members such as grandparents, the expansion of the care area also brings inconvenience to this scenario.

Based on the above problems, the present application provides a video processing method, apparatus and related equipment, whereby the user can directly define the visible area in the video interface, so that the area outside the visible area is shielded in the video screen corresponding to the final output video data.

The present application provides a video processing method, which can be applied to a video processing device, as shown in FIG1A, FIG1A is an architecture diagram of a video processing device provided in an embodiment of the present application, including a terminal device 1001, a video processing device 1002 and a camera 1003, wherein the terminal device is a device including a communication function, such as a handheld device, or a vehicle-mounted device, etc. At present, some examples of terminal devices are: mobile phones, computers, etc., which are used to obtain the visible area specified by the user for video care; the camera 1003 is used to shoot the video screen, specifically to convert the captured light source signal into the raw data of the digital signal. The video processing device 1002 is used to execute the following video processing method, and the video processing device 1002 can be a server, such as a cloud server, a central server, an edge server, or a local server in a local data center, or deployed on the above server, and the video processing device 1002 can also be mounted in electronic devices such as camera devices.

Please refer to FIG. 1B , which is a flow chart of a video processing method provided in an embodiment of the present application, including:

101. Obtain the visible coordinate range of the visible area specified by the terminal device.

Terminal equipment

First, a visible area designated by a user and requiring video monitoring is obtained through a terminal device. The coordinate range of the visible area in the video screen is the visible coordinate range.

It is understandable that the shape of the visible area is not limited. When the user needs to select a care area, the user can directly select the range using the brush tool box in the video screen, or determine the care range by selecting the corresponding drawing tool through the drawing box displayed to the user by the terminal device.

Please refer to FIG. 2 , which is a schematic diagram of selecting a visible area in a video screen provided in an embodiment of the present application.

In the video screen, the first area 204 where the crib 202 is located belongs to the care area, so the user can select the rectangle tool in the drawing toolbar 201 to frame the first area 204 where the crib 202 is located, and the first area 204 is a visible area, and the coordinate range of the first area 204 in the video screen is a visible coordinate range. In a possible case, there can be multiple visible areas, such as the table 203 in Figure 2, on which are placed items that may be used in the baby care process, such as milk bottles, thermometers, and medicines (not shown in the figure), so the user can use the arc tool and the straight line tool in the drawing toolbar 201 to frame the second area 205, and the second area 205 is also a visible area, and the coordinate range of the second area 205 in the video screen also belongs to the visible coordinate range.

102, obtaining the original data captured by the camera.

It is understandable that the raw data output by the camera's image sensor refers to the raw data that the sensor converts the captured light source signal into a digital signal. Raw data (RAW data) generally has RAW8, RAW10, RAW12, etc., which respectively indicate that a pixel has 8-bit data, 10-bit data, and 12-bit data.

After obtaining the visible coordinate range, the original data captured by the camera is obtained so that the original data can be directly processed later.

103 , processing the original data according to the visible coordinate range to generate video data of the area outside the masked visible area.

After obtaining the visible coordinate range, the original data is directly processed to obtain the video data. When the video data is leaked or shared, the privacy of the masked area can be protected in the video data source.

For example, in one possible case, processing the raw data to obtain the video data refers to converting the RAW data into YUV data, while shielding the area outside the guard area, to obtain the video encoding of the data in the format of H264/H265 or the like.

In a possible implementation method, please refer to FIG. 3 , which is a flow chart of a method of step 103 , specifically including:

301 , coordinate conversion is performed on the visible coordinate range to obtain a shielded coordinate range.

It can be understood that after the visible coordinate range and the coordinate range covered by the video screen are determined, the area between the edge of the visible coordinate range and the edge of the video screen is the shielding area, and the corresponding coordinate range is the shielding coordinate range.

302, generate an electronic block covering the shielding coordinate range.

After the shielding coordinate range is determined, an electronic block covering the range is generated. The electronic block can be a mosaic, a color block, a specified picture, etc.

303, overlay the original data with an electronic block to generate video data that shields areas outside the visible area.

It can be understood that after the shielding coordinate range is determined, the electronic block is covered at the corresponding position in the original data. At this time, the shielding area (the area outside the visible area) is shielded by the electronic block, and the area outside the visible area is shielded in the generated video data, thereby achieving the purpose of precise privacy shielding.

Further, the visible area is an N-gon, and correspondingly, the electronic block includes a plurality of sub-blocks, where N is an integer greater than 3;

The multiple sub-blocks are respectively used to cover the areas between the N edges of the visible area and the edge of the video screen.

For ease of understanding, please refer to FIG. 4 and FIG. 5 , which are schematic diagrams of shielding of sub-blocks provided in the embodiments of the present application.

As shown in FIG4 , the visible area is a quadrilateral, and the number of sub-blocks is also 4, which are respectively used to shield the occlusion area 1, the occlusion area 2, the occlusion area 3 and the occlusion area 4. Taking the sub-block (gray area) covering the occlusion area 1 as an example, the left edge, the upper edge and the lower edge of the sub-block are respectively the left edge, the upper edge and the lower edge of the video screen, and the straight line where the right edge of the sub-block is located is consistent with the straight line where the left edge of the visible area is located.

It is understandable that the visible area can also be other shapes. As shown in Figure 5, when the visible area is a triangle, the areas covered by the three sub-blocks (occlusion area 1', occlusion area 2' and occlusion area 3') also cover the area from the edge of the triangle to the edge of the video screen, which will not be repeated here.

In another possible implementation method, please refer to FIG. 6 , which is another method flow chart of step 103 , wherein the visible area is a rectangle, and step 103 specifically includes:

601 , obtaining picture adjustment parameters according to the center coordinates and edge coordinates of the visible coordinate range.

602 , moving and/or cropping the original data according to the picture adjustment parameters to generate video data of the area outside the masked visible area.

It can be understood that when the visible area is a rectangle, since the video screen is also a rectangle, after obtaining the visible coordinate range of the visible area, the center coordinates of the visible coordinate range and the center coordinates of the video screen, and the edge coordinates of the visible coordinate range and the edge of the video screen are compared to generate picture adjustment parameters. The picture adjustment parameters are used to move the video screen so that the visible area is located in the middle of the video screen, and at the same time, the shielded area is cropped to achieve the purpose of precise privacy shielding.

Please refer to FIG. 7a and FIG. 7b , which are schematic diagrams of the visible area provided in the embodiments of the present application.

Please refer to FIG. 2 , after the user selects only the first area 204 in the video screen shown in FIG. 2 as the visible area, since the first area 204 is a rectangle, the center coordinates of the first area 204 can be obtained according to the coordinate range of the first area 204. Combined with the center coordinates of the video screen, the first area 204 can be moved to the center of the video screen, as shown in FIG. 7a .

Then, the first area 204 is scaled so that at least one side of the first area 204 overlaps with the edge of the video screen, and the portion beyond the video screen is cropped, as shown in FIG7b, thereby generating video data that only displays the visible area (the first area). Further, when the aspect ratio of the visible area and the video screen is different, an electronic block (such as the gray area in FIG7) can be set at the same time for shielding.

104, sending the video data to the terminal device.

It is understandable that the video data generated through the above steps is sent to the terminal device for playback, and the areas outside the visible area are shielded in the played video content, thereby achieving privacy protection for the areas outside the visible area in the video. At the same time, since the video data is shielded during the encoding and conversion process of the original data, even if it is leaked during the video data transmission process, only the video images in the visible area can be seen, further protecting the user's privacy. Specifically, the video data can also be sent to the terminal device via a transmission medium such as a cloud server.

In a possible implementation method, the method further includes:

105, performing edge recognition on the visible area in the video data to obtain an edge coordinate range;

106, updating the visible coordinate range according to the edge coordinate range;

107, processing the original data according to the updated visible coordinate range.

It is understandable that the scenario considered in steps 105 to 107 is that when the camera moves due to human or other reasons, the video screen will also move accordingly, so that the visible area is also shifted. Then the area that can be guarded may be shifted to other locations that originally belonged to the privacy area. If it is not discovered in time, it will also cause unnecessary impact on the user. Therefore, the edge recognition technology in image recognition technology is used in the embodiment of the present application to identify the edge of the visible area in the video data with the demarcated visible area, and re-update the visible coordinate range according to the recognition result, so that the video screen can track the visible area. The details are as follows:

While sending the video data to the terminal device, edge recognition is performed on the visible area in the video data. For example, the visible area in FIG. 7b has an edge of a crib guardrail. Then, image recognition technology can be used to locate and lock the crib guardrail, and an edge coordinate range is constructed, i.e., a coordinate area within the edge of the crib guardrail. The visible coordinate range is updated according to the edge coordinate range, i.e., the original visible coordinate range is replaced with the edge coordinate range, and the process returns to step 103. The original data is processed according to the updated visible coordinate range, and the visible area in the generated video data, i.e., the area within the edge coordinate range, is the area where the crib is located as shown in FIG. 2.

It can be understood that the edge recognition technology in image recognition technology is: when detecting the edge of an object, first roughly detect its contour points, and then connect the originally detected contour points through linking rules, while also detecting and connecting missed boundary points and removing false boundaries. This technology already exists and has been applied in related fields, so this application will not go into details.

The video processing method provided in the embodiment of the present application obtains the visible area specified by the user on the terminal device, and then processes the original data captured by the camera according to the coordinate range of the visible area, thereby obtaining the video data of the area outside the shielded visible area and returning it to the terminal device, thereby realizing accurate privacy shielding of the video screen. When the video data is leaked or shared, the privacy of the shielded area can be protected at the video data source, thereby solving the problem of privacy leakage caused by capturing the privacy area when the camera video is leaked or shared.

The present application also provides a video processing device. Please refer to Figure 8, which is a schematic diagram of the structure of the video processing device provided in the embodiment of the present application. The video processing device can be used to execute the steps in the embodiment shown in Figure 1. For details, please refer to the relevant introduction in the above method embodiment. It can be understood that the video processing device provided in the embodiment of the present application can be mounted in a camera device, for example, integrated with a camera; it can also be deployed on a cloud server.

The video processing device 800 includes a transceiver module 801 and a processing module 802 .

The transceiver module 801 can implement corresponding communication functions, and the transceiver module 801 can also be called a communication interface or a communication unit. The processing module 802 is used to perform processing operations.

Optionally, the video processing device 800 may further include a storage module, which may be used to store instructions and/or data. The processing module 802 may read the instructions and/or data in the storage module so that the video processing device 800 implements the method embodiment shown in FIG. 1 .

The video processing device 800 can be used to perform the actions performed by the above method embodiment. The video processing device 800 can be a terminal device or a component that can be configured in a terminal device. The transceiver module 801 is used to perform the reception-related operations on the terminal device side in the above method embodiment, and the processing module 802 is used to perform the processing-related operations on the terminal device side in the above method embodiment.

Optionally, the transceiver module 801 may include a sending module and a receiving module. The sending module is used to perform the sending operation in the method embodiment shown in FIG1 . The receiving module is used to perform the receiving operation in the method embodiment shown in FIG1 .

For example, the video processing device 800 is used to execute the following scheme:

The transceiver module 801 is used to obtain the visible coordinate range of the visible area specified by the terminal device;

The transceiver module 801 is also used to obtain the original data captured by the camera;

A processing module 802 is used to process the original data according to the visible coordinate range to generate video data of the area outside the masked visible area;

The transceiver module 801 is also used to send the video data to the terminal device.

In one possible implementation, the processing module 802 is specifically used to perform coordinate conversion on the visible coordinate range to obtain a shielded coordinate range; generate an electronic block covering the shielded coordinate range; cover the electronic block on the original data to generate video data of the area outside the shielded visible area.

In a possible implementation, the visible area is an N-polygon, and the electronic block includes N sub-blocks, where N is an integer greater than 3;

The N sub-blocks are respectively used to cover the areas between the N edges of the visible area and the edge of the video screen.

In one possible implementation, the visible area is a rectangle;

The processing module 802 is specifically used to obtain picture adjustment parameters according to the center coordinates and edge coordinates of the visible coordinate range; and scale and/or crop the original data according to the picture adjustment parameters to generate video data that masks areas outside the visible area.

In a possible implementation, the processing module 802 is further used to perform edge recognition on the visible area in the video data to obtain an edge coordinate range; update the visible coordinate range according to the edge coordinate range; and process the original data according to the updated visible coordinate range.

The present application also provides a video processing device, please refer to Figure 9, which is a transmission signaling diagram of the video processing device provided in the embodiment of the present application, including a terminal device 901, a camera 902 and a video processing device 903 in the embodiment shown in Figure 8 above. It should be noted that the video processing device 903 can be mounted on a cloud server or integrated with the camera 902. The present application does not limit the deployment location of the video processing device 903. In short, the video processing device 903 is used to provide video processing functions.

The terminal device 901 is used to obtain the visible coordinate range of the visible area and send the visible coordinate range to the video processing device; and is also used to obtain the video data processed by the video processing device;

The camera 902 is used to convert the captured light signal into raw data of a digital signal through an image sensor, and send the raw data to the video processing device.

The video processing device 903 is used to obtain the visible coordinate range of the visible area specified by the terminal device; obtain the original data captured by the camera; process the original data according to the visible coordinate range to generate video data that shields the area outside the visible area; and send the video data to the terminal device.

In a possible implementation, the video processing device 903 is further used to perform edge recognition on the visible area in the video data to obtain an edge coordinate range; update the visible coordinate range according to the edge coordinate range; and process the original data according to the updated visible coordinate range.

The present application also provides a computing device, which may be a server, such as a cloud server, a central server, an edge server, or a local server in a local data center. In some embodiments, the computing device may also be a terminal device such as a desktop computer, a laptop computer, or a smart phone.

The computing device includes a processor, and the processor is used to execute a computer program or computer instructions in a memory to perform the video processing method in the embodiment shown in FIG. 1 above.

Furthermore, the computing device also includes a memory, and the memory may store instructions for executing the above-mentioned video processing method.

The present application also provides a computer program product including instructions. The computer program product may be a software or program product including instructions that can be run on a computing device or stored in any available medium. When the computer program product is run on at least one computing device, the at least one computing device executes the video processing method in the embodiment shown in FIG. 1 above.

The embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium can be any available medium that can be stored by a computing device or a data storage device such as a data center containing one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk). The computer-readable storage medium includes instructions that instruct the computing device to execute the video processing method in the embodiment shown in FIG. 1 above.

The steps of the method or algorithm described in conjunction with the disclosure of the present application can be implemented in a hardware manner, or can be implemented by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a RAM memory, a flash memory, a ROM memory, an EPROM memory, an EEPROM memory, a register, a hard disk, a mobile hard disk, a CD-ROM or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a terminal. Of course, the processor and the storage medium can also be present in the first communication device as discrete components.

Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk.

Claims (11)

1. A video processing method, comprising:

Obtaining a visible coordinate range of a visible area designated by terminal equipment;

acquiring original data shot by a camera;

Processing the original data according to the visible coordinate range to generate video data shielding the area outside the visible area;

and sending the video data to the terminal equipment.

2. The method of claim 1, wherein processing the raw data according to the visible range to generate video data masking regions outside the visible region comprises:

Performing coordinate conversion on the visible coordinate range to obtain a shielding coordinate range;

Generating an electronic stop covering the shielding coordinate range;

and overlaying the electronic stop on the original data to generate video data shielding the area outside the visible area.

3. The method of claim 2, wherein the visible region is an N-sided polygon, the electronic block comprising a plurality of sub-blocks, wherein N is an integer greater than 3;

The sub-stoppers are used for covering the area from N edges of the visible area to the edge of the video picture.

4. The method of claim 1, wherein said processing said raw data according to said visible coordinate range generates video data masking areas outside said visible area, comprising;

obtaining picture adjusting parameters according to the center coordinates and the edge coordinates of the visible coordinate range;

and moving and/or clipping the original data according to the picture adjusting parameters to generate video data shielding the area outside the visible area.

5. The method according to any one of claims 1 to 4, further comprising, after transmitting the video data to the terminal device:

performing edge recognition on the visible region in the video data to obtain an edge coordinate range;

updating the visible coordinate range according to the edge coordinate range;

And processing the original data according to the updated visible coordinate range.

6. The video processing device is characterized by comprising a transceiver module and a processing module;

The transceiver module is configured to perform the transceiver operations of any one of claims 1 to 5, and the processing module is configured to perform the processing operations of any one of claims 1 to 5.

7. A video processing apparatus comprising a terminal device, a camera, and the video processing device of claim 6;

the terminal equipment is used for acquiring a visible coordinate range of a visible area and sending the visible coordinate range to the video processing device; the video processing device is also used for obtaining the video data processed by the video processing device;

The camera is used for converting the captured optical signals into original data of digital signals through the image sensor and sending the original data to the video processing device.

8. A computing device, the computing device comprising a processor;

The processor is configured to execute a computer program or computer instructions in a memory to perform the method of any of claims 1 to 5.

9. The computing device of claim 8, wherein the computing device further comprises the memory.

10. A computer readable storage medium, having stored thereon a computer program which, when executed by a computing device, causes the computing device to perform the method of any of claims 1 to 5.

11. A computer program product comprising a program, characterized in that the method of any of claims 1 to 5 is implemented when the program is executed by a processor.