JP7608811B2 - Image capture device and method for controlling image capture device - Google Patents

Description

The present invention relates to an imaging device and a method for controlling the imaging device.

The imaging device may superimpose a watermark image onto image data captured by the imaging unit, and record the image data on a recording medium or distribute the image data over a network (see Patent Document 1).

JP 2004-328747 A

If an imaging device is stolen, there is a risk that the thief may distribute image data over a network. For example, if the imaging device distributes image data over a network with a company logo superimposed on it as a watermark image, the recipient of the network distribution will recognize that the image data is being distributed by a company. Therefore, when a third party other than the owner or administrator of the imaging device illegally obtains the imaging device and distributes image data over a network, it is desirable to take measures to inform the recipient that the image data is being distributed by a third party.

The present invention aims to provide an imaging device and a control method for the imaging device that can inform recipients that image data is being distributed by a third party when the third party illegally obtains the imaging device and distributes the image data over a network.

The present invention provides an imaging device that includes an imaging unit that captures an image of a subject and generates captured image data, a captured image processing unit that generates captured image data for distribution based on the captured image data, an image superimposition unit that superimposes a watermark image or a warning image on the captured image data for distribution, an output unit that outputs the captured image data for distribution on which the watermark image or the warning image is superimposed to a network so as to be distributed, and a control unit that requests permission for distribution from an authentication server when an operation is performed to distribute the captured image data for distribution over the network and determines whether or not permission for distribution has been notified from the authentication server, and the control unit controls the image superimposition unit to superimpose the watermark image on the captured image data for distribution when permission for distribution is notified from the authentication server, and controls the image superimposition unit to superimpose the warning image on the captured image data for distribution when permission for distribution is notified from the authentication server.

The present invention provides a method for controlling an imaging device, in which a photographed image processing unit for distribution generates photographed image data for distribution, and when an operation is performed to distribute the photographed image data for distribution over a network, a control unit requests permission for distribution from an authentication server and determines whether or not permission for distribution has been notified from the authentication server, and when permission for distribution has been notified from the authentication server, an image superimposition unit superimposes a watermark image on the photographed image data for distribution, and an output unit outputs the photographed image data for distribution with the watermark image superimposed thereon to a network, and when permission for distribution is notified from the authentication server, the image superimposition unit superimposes a warning image on the photographed image data for distribution, and the output unit outputs the photographed image data for distribution with the warning image superimposed thereon to a network.

The imaging device and imaging device control method of the present invention make it possible to inform the recipient that image data is being distributed by a third party when the third party illegally obtains the imaging device and distributes the image data over a network.

1 is a block diagram showing an imaging apparatus according to an embodiment; FIG. 13 is a diagram conceptually showing an alpha channel set for a watermark image Wm. 2 is a diagram showing one frame of distribution-purpose captured image data D31 generated by the distribution-purpose captured image processing unit 31 in FIG. 1. FIG. 2 is a diagram showing one frame of the photographed image data D32 for distribution on which a watermark image Wm has been superimposed by the image superimposing unit 32 in FIG. 1. [0023] FIG. 2 is a conceptual diagram showing a state in which permission for network distribution by the imaging device is set in an authentication server 80 appearing in FIG. 1 . FIG. 13 is a conceptual diagram showing a state in which network distribution by an imaging device is not permitted as set in an authentication server 80. FIG. 13 is a diagram conceptually showing an α channel set for a warning image Iwg. FIG. 13 is a diagram showing one frame of the distribution captured image data D32 on which a warning image Iwg is superimposed by the image superimposing unit 32. FIG. 4 is a flowchart showing the operation of the imaging apparatus according to an embodiment and a process according to a control method for the imaging apparatus according to an embodiment.

The imaging device and the control method for the imaging device according to one embodiment will be described below with reference to the attached drawings.

In FIG. 1, the imaging unit 11 includes an imaging element and multiple lenses, and captures an image of a subject with an angle of view of, for example, an aspect ratio of 16:9 to generate captured image data. The imaging element may be a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The image data storage unit 12 temporarily stores the captured image data output from the imaging unit 11. The image data storage unit 12 is a frame memory, and may be an SDRAM (Synchronous Dynamic Random Access Memory) or a DDR (Double-Data-Rate SDRAM).

The recording image processing unit 22 performs at least one of scaling and noise reduction processing on the captured image data D12 read from the image data storage unit 12 to prepare a recording image.

As an example of scaling processing, when the captured image data output from the imaging unit 11 has a horizontal pixel count x vertical pixel count of 3840 x 2160, called 4K, the recording captured image processing unit 22 reduces it to full HD pixel count of 1920 x 1080. When the capacity of the recording medium 24 is sufficiently large, the recording captured image processing unit 22 does not need to reduce the captured image data.

The recording processing unit 23 encodes the recording image data D22 and creates a file as necessary in order to record the recording image data D22 on the recording medium 24. The recording processing unit 23 records the encoded recording image data D22 on the recording medium 24. The recording medium 24 is any recording medium, and may be a memory card made up of a flash memory or a hard disk drive.

It is not essential that the imaging device includes the recording image processing section 22 to the recording medium 24. The imaging device may be configured without the recording medium 24 and the recording image processing section 22 and recording processing section 23 for recording the captured image data on the recording medium 24.

The distribution-purpose captured image processing unit 31 performs scaling processing on the captured image data D12 read out from the image data storage unit 12 to reduce the number of lines and pixels, and performs noise reduction processing as necessary to generate distribution-purpose captured image data D31. The number of lines and the number of pixels of the distribution-purpose captured image data D31 may be less than the number of lines and the number of pixels of the recording-purpose captured image data D22. The distribution-purpose captured image processing unit 31 may perform clipping processing to cut out a portion of each frame of the captured image data D12.

The watermark image storage unit 331 stores watermark image data to be superimposed on the captured image data for distribution D31. The watermark image storage unit 331 is composed of a non-volatile memory. The watermark image data is composed of image data in a format that includes auxiliary data called an alpha channel that sets the opacity of the image. As an example, the watermark image data is in PNG format.

Figure 2 conceptually shows the alpha channel set for the watermark image Wm indicated by the watermark image data. As an example, the background Wm00 within a rectangular area is set to an opacity of 0% (i.e., a transparency of 100%), and the mark Wm01 is set to an opacity of 100% (i.e., a transparency of 0%). In the example shown in Figure 2, the mark Wm01 is the letters "W.MK". The mark Wm01 may also be a company logo.

The image superimposition unit 32 superimposes watermark image data representing the watermark image Wm on the photographed image data for distribution D31 to generate photographed image data for distribution D32. The watermark image Wm is an image such as a logo that the owner or administrator of the imaging device has decided to superimpose when distributing the photographed image data for distribution D31 over a network.

Figure 3 shows one frame of the photographed image data for distribution D31 output from the photographed image processing unit for distribution 31. Figure 4 shows one frame of the photographed image data for distribution D32 on which the watermark image Wm has been superimposed by the image superimposition unit 32. Because the background Wm00 is set to an opacity of 0% by the alpha channel, only the mark Wm01 with an opacity of 100% appears to be superimposed on the photographed image data for distribution D32.

The output processing unit 34 encodes the photographed image data for distribution D32, performs packetization processing for a protocol and serialization processing for SDI (Serial Digital Interface) as necessary, and supplies the data to the output unit 35. The output unit 35 outputs the encoded photographed image data for distribution D32 supplied from the output processing unit 34 to a network 60 that is external to the imaging device. A recipient who receives the photographed image data for distribution D32 receives the photographed image data for distribution D32 on, for example, a mobile terminal 71 or a personal computer 72 connected to the network 60.

Next, we will explain the configuration for informing the recipient that image data has been distributed by a third party when the third party illegally obtains the imaging device shown in FIG. 1 and distributes the image data over a network. A unique imaging device name or serial number is stored in non-volatile memory 51 as identification information for uniquely identifying the imaging device. Here, the identification information is the serial number. The serial number of the imaging device shown in FIG. 1 is J001001234, and this serial number is stored in non-volatile memory 51.

When the control unit 50 is about to distribute the photographed image data for distribution D31 over the network, before starting the distribution, it notifies the authentication server 80 of the serial number via the output unit 35 and the network 60, and requests permission to distribute from the authentication server 80.

The GNSS receiver 52 receives radio waves from three or more satellites for the Global Navigation Satellite System (GNSS). One example of the GNSS is the Global Positioning System (GPS). The control unit 50 calculates position information based on the GNSS signals received by the GNSS receiver 52, which are radio waves from three or more satellites. The control unit 50 functions as a position information acquisition unit that acquires position information of the imaging device. The control unit 50 controls the position information of the imaging device to be transmitted to the authentication server 80. It is not essential to transmit the position information of the imaging device to the authentication server 80, but it is preferable to transmit it.

As shown in FIG. 5A, in the authentication server 80, permission is set as whether or not distribution is permitted in correspondence with the serial number J001001234. When the imaging device transmits location information to the authentication server 80, the location information of the imaging device is stored in correspondence with the serial number J001001234. The authentication server 80 notifies the control unit 50 of permission for distribution via the network 60 and the input unit 36. The control unit 50, which has been notified of permission for distribution, controls the image superimposition unit 32 to superimpose the watermark image Wm on the photographed image data for distribution D31. The output unit 35 outputs the photographed image data for distribution D32 on which the watermark image Wm has been superimposed to the network 60.

Next, a response will be described in the case where the imaging device is stolen by a third party. The user accesses the authentication server 80 using any device that can connect to the authentication server 80, such as a personal computer. As shown in FIG. 5B, the user sets the permission of distribution corresponding to serial number J001001234 to not permitted. Once distribution in the authentication server 80 has been set to not permitted, a password that the user has set in advance in the authentication server 80 is required to change the setting from not permitted to permitted. This prevents a third party from changing the setting from not permitted to permitted. A password may be required when setting the permission of distribution in the authentication server 80 to not permitted.

Let us assume that a third party operates the imaging device to attempt to distribute captured image data D31 for distribution. Before starting distribution, the control unit 50 notifies the authentication server 80 of the serial number via the output unit 35 and the network 60, and requests permission for distribution from the authentication server 80. The control unit 50 controls the transmission of location information of the imaging device to the authentication server 80. Then, since the authentication server 80 has a setting corresponding to the serial number J001001234 that disallows distribution, the control unit 50 is notified that distribution is disallowed.

In FIG. 5B, the location information of the imaging device corresponding to serial number J001001234 has been rewritten to the location information transmitted when a third party attempted to distribute the captured image data for distribution D31. If the location information of the imaging device is stored in the authentication server 80, it is possible to obtain the location information of a stolen imaging device. The user can receive the location information and search for the imaging device.

In FIG. 1, the warning image storage unit 332 stores warning image data that shows a predetermined warning image. The warning image storage unit 332 is configured from a non-volatile memory. The watermark image storage unit 331 and the warning image storage unit 332 may be a single non-volatile memory. The warning image data is also configured from image data in, for example, PNG format, having an alpha channel.

Figure 6 conceptually shows the alpha channel set for the warning image Iwg indicated by the warning image data. As an example, the background Iwg00 within a rectangular area is set to an opacity of 0%, and the mark Iwg01 and the end Iwg02 of the rectangular area are set to an opacity of 100%. In the example shown in Figure 62, the mark Iwg01 is the word "WARNING". The end Iwg02 may also be set to an opacity of 0%.

When notified that distribution is not permitted, the control unit 50 controls the image superimposition unit 32 to superimpose a warning image Iwg instead of a watermark image Wm on the photographed image data for distribution D31. The image superimposition unit 32 superimposes warning image data indicating the warning image Iwg on the photographed image data for distribution D31 to generate photographed image data for distribution D32. Figure 7 shows one frame of the photographed image data for distribution D32 on which the warning image Iwg has been superimposed by the image superimposition unit 32.

The output unit 35 outputs the photographed image data for distribution D32 on which the warning image Iwg is superimposed to the network 60. An image such as that shown in FIG. 7 is displayed on the mobile terminal 71 or personal computer 72 owned by the recipient who receives the photographed image data for distribution D32, so that the recipient can recognize that the distribution is by a third party. The control unit 50 preferably controls the output unit 35 to cut off distribution of the photographed image data for distribution D32 on which the warning image Iwg is superimposed after a predetermined time has passed.

With the above-described configuration and operation, the imaging device of this embodiment can inform the recipient that image data is being distributed by a third party when the third party illegally obtains the imaging device and distributes the image data over a network.

The operation of the imaging device of this embodiment and the processing by the control method of the imaging device of this embodiment will be explained again using the flowchart shown in FIG. 8. In FIG. 8, when the imaging device starts operating, the control unit 50 determines in step S1 whether or not an operation to distribute captured image data (captured image data for distribution D31) has been performed. If an operation to distribute captured image data has not been performed (NO), the control unit 50 repeats the processing of step S1.

If an operation to distribute captured image data is performed in step S1 (YES), the control unit 50 notifies the authentication server 80 of the identification information of the imaging device in step S2 and requests permission for distribution. Next, the control unit 50 determines in step S3 whether or not permission for distribution has been notified by the authentication server 80.

If permission for distribution is notified from the authentication server 80 in step S3 (YES), the control unit 50 controls the image superimposition unit 32 and the output unit 35 in step S4 to distribute the captured image data for distribution D32 with the watermark image Wm superimposed over the network. In step S5, the control unit 50 determines whether or not an operation to end the network distribution has been performed. If an operation to end the network distribution has not been performed (NO), the control unit 50 repeats the processing in steps S4 and S5.

If an operation to end network distribution is performed in step S5 (YES), the control unit 50 performs control to end network distribution in step S6, and determines whether or not a power-off operation has been performed in step S7. If a power-off operation has not been performed (NO), the control unit 50 returns the process to step S1. If a power-off operation has been performed (YES), the control unit 50 ends the process.

On the other hand, if permission for distribution is not notified from the authentication server 80 in step S3 (NO), the control unit 50 controls the image superimposition unit 32 and the output unit 35 in step S8 to distribute the captured image data for distribution D32 with the warning image Iwg superimposed over the network. In step S9, the control unit 50 determines whether or not a predetermined time has elapsed. If the predetermined time has not elapsed (NO), the control unit 50 repeats the processing of steps S8 and S9. If the predetermined time has elapsed (YES), the control unit 50 controls the output unit 35 in step S10 to block network distribution, and transitions the processing to step S7.

Although not shown in FIG. 8, if a third party performs an operation to end network distribution before the predetermined time has elapsed in step S9, the control unit 50 may control the network distribution to end.

The present invention is not limited to the embodiment described above, and various modifications are possible without departing from the spirit of the present invention.

REFERENCE SIGNS LIST 11 Imaging unit 12 Image data storage unit 22 Recording captured image processing unit 23 Recording processing unit 24 Recording medium 31 Distribution captured image processing unit 32 Image superimposition unit 34 Output processing unit 35 Output unit 36 Input unit 50 Control unit (position information acquisition unit)
51 Non-volatile memory 52 GNSS receiving unit 53 Operation unit 60 Network 71 Mobile terminal 72 Personal computer 80 Authentication server 222 Reproduction image processing unit 331 Watermark image storage unit 332 Warning image storage unit

Claims (3)

an imaging unit that captures an image of a subject and generates captured image data;
a distribution-purpose captured image processing unit that generates distribution-purpose captured image data based on the captured image data;
an image superimposing unit that superimposes a watermark image or a warning image on the captured image data for distribution;
an output unit that outputs the photographed image data for distribution on which the watermark image or the warning image is superimposed to a network for distribution;
a control unit that, when an operation for distributing the captured image data for distribution over a network is performed, requests an authentication server for permission to distribute the captured image data, and determines whether or not permission to distribute the captured image data has been notified by the authentication server;
Equipped with
The control unit is
when the authorization for distribution is notified from the authentication server, the image superimposing unit is controlled to superimpose the watermark image on the photographed image data for distribution;
When a notification of non-permission of distribution is received from the authentication server, the image superimposing unit is controlled to superimpose the warning image on the captured image data to be distributed. a position information acquisition unit that acquires position information of the imaging device,
The imaging device according to claim 1 , wherein the control unit transmits the location information of the imaging device acquired by the location information acquisition unit to the authentication server. A distribution-purpose captured image processing unit generates distribution-purpose captured image data,
when an operation for distributing the photographed image data to be distributed over a network is performed, a control unit requests an authentication server for permission to distribute the photographed image data to be distributed, and determines whether or not permission to distribute the photographed image data to be distributed has been notified from the authentication server;
When permission for distribution is notified from the authentication server, an image superimposing unit superimposes a watermark image on the photographed image data for distribution, and an output unit outputs the photographed image data for distribution on which the watermark image is superimposed to a network;
when notified of non-permission of distribution from the authentication server, the image superimposition unit superimposes a warning image on the captured image data for distribution, and an output unit outputs the captured image data for distribution on which the warning image is superimposed to a network.

Images