JP2008035271A - Imaging apparatus, control method thereof, and image communication system - Google Patents

Abstract

By recovering a loss incurred by an effective period of a control right for controlling an image pickup apparatus, a user can enjoy the given effective period more sufficiently than before.
An imaging apparatus transmits captured images to a plurality of image display apparatuses. The imaging device includes a control unit that controls the imaging mechanism in response to a control request received through a communication unit within an effective period of the right from the image display device to which the right to exclusively control the imaging device is granted. Furthermore, the imaging apparatus includes a recovery unit that recovers the time corresponding to the loss when a part of the effective period is lost due to occurrence of a predetermined situation.
[Selection] Figure 3

Description

  The present invention relates to an imaging apparatus that transmits a captured image, a control method thereof, and an image communication system.

  With the spread of the Internet, network cameras that allow viewing of images (still images, videos, etc.) at remote locations via the Internet have begun to spread. Each user can view images of a remote place through the PC at the same time.

  The network camera generally has functions such as pan (horizontal direction) rotation, tilt (vertical direction) rotation, and zoom (telephoto). However, it is not preferable that the network camera is remotely controlled by a plurality of people at the same time. Therefore, only a PC or a client having the right to exclusively control the network camera (hereinafter referred to as a control right) can remotely control these functions (Patent Documents 1, 2, and 3).

Furthermore, a camera server that permits camera control only to clients that have been successfully authenticated has also been proposed (Patent Document 4).
JP-A-10-136347 Japanese Patent Laid-Open No. 10-164559 JP 2004-194217 A JP-A-9-233453

  In general, the user wants to acquire an image by controlling the network camera by using the effective period of the given control right to the maximum.

  However, there is a possibility that the user cannot fully enjoy this effective period for the convenience of the network camera. For example, if the network camera wastes time for focusing, the network camera cannot be controlled even though it is within the effective period.

  Therefore, an object of the present invention is to provide an imaging apparatus, a control method thereof, and an image communication system capable of recovering a loss when the effective period of the control right is partially lost.

An imaging apparatus according to the present invention is, for example,
An imaging device that transmits captured images to a plurality of image display devices,
A communication unit for communicating with the image display device via a network;
Control for controlling an imaging mechanism included in the imaging device in response to a control request received from the image display device granted the right to exclusively control the imaging device exclusively through the communication unit within the effective period of the right And
And a recovery unit that recovers a time corresponding to the loss when a part of the effective period is lost due to occurrence of a predetermined situation.

  According to the present invention, when the effective period of the control right is partially lost, the loss can be recovered. Thereby, the user can enjoy the given effective period more sufficiently than before.

  An embodiment of the present invention is shown below. Of course, the individual embodiments described below will be helpful in understanding various concepts such as the superordinate concept, intermediate concept and subordinate concept of the present invention. Further, the technical scope of the present invention is determined by the scope of the claims, and is not limited by the following individual embodiments.

[First Embodiment]
FIG. 1 is a diagram illustrating an example of an image communication system according to the embodiment. Here, a network camera system 100 will be described as an example of an image communication system.

  The network camera 110 is an example of an imaging device. The network camera 110 includes an imaging unit 111, a control unit 112, a communication unit 113, a drive unit 114, and a storage unit 115.

  The imaging unit 111 includes an imaging element that captures an image and an image processing circuit. The control unit 112 is a control unit such as a CPU that comprehensively controls each unit of the network camera 110. For example, the control unit 112 assigns a control right for remotely controlling the network camera 110 to any image display device, or manages the effective period of the control right. In particular, the control unit 112 recovers the time corresponding to the loss when a part of the effective period is lost due to occurrence of a predetermined situation. Note that “when receiving a loss” includes a case where a loss is actually received and a case where a loss is expected to be received.

  The communication unit 113 is a communication unit that transmits an image to one or more image display devices and receives a control request from an image display device having a control right. Note that the communication unit 113 can transmit video to a plurality of image display devices in real time, and can simultaneously receive control requests from image display devices having a control right.

  The drive unit 114 drives an imaging function such as pan rotation, tilt rotation, and zoom according to the received control request. The storage unit 115 includes a storage device such as a RAM or a ROM. Note that the storage unit 115 stores data, tables, computer programs, and the like necessary for controlling the network camera 110.

  Viewers 120, 130, and 140 are examples of an image display device. Each viewer includes a communication unit 121, a display unit 122, a control unit 123, and an input unit 124, respectively. The communication unit 121 is a communication unit that receives an image from the network camera 110 via a network and transmits a control request for remotely controlling an imaging mechanism included in the network camera 110.

  The display unit 122 is a display unit that displays received images and user interfaces. The control unit 123 is a control unit including a CPU and the like that comprehensively control each unit included in the viewer. The control unit 123 may include a ROM, a RAM, a hard disk drive, and the like. The input unit 124 is a touch panel, a button, a switch, a key, and the like, and is operated when the user wants to control the network camera 110, for example.

  FIG. 2 is a diagram illustrating an example of a user interface of the viewer according to the embodiment. The user interface 201 has an image display area 202 for displaying an image received from the network camera 110 connected via a network.

  The user interface 201 includes a pan scroll bar 203, a zoom slider bar 204, a tilt scroll bar 205, a remaining time display area 206, a control right acquisition button 207, and the like for controlling the network camera. The pan scroll bar 203, the zoom slider bar 204, and the tilt scroll bar 205 operate in conjunction with an operation instruction from the input unit 124 such as a pointing device. The control unit 123 detects the operation amount of each bar, converts the detected operation amount into a corresponding control request, and transmits the control request to the network camera 110.

  The remaining time display area 206 is an area for displaying the remaining time in the effective period of the control right. When receiving a valid period countdown start signal from the network camera 110, the control unit 123 periodically subtracts a predetermined valid period and reflects the subtraction result in the remaining time display area 206.

  When the control right acquisition button 207 is pressed, the control unit 123 transmits a control right acquisition request regarding the network camera 110 via the communication unit 121. When the control right is given by the network camera 110, the control unit 123 can transmit a control request for controlling the imaging function of the network camera 110 using each bar.

  FIG. 3 is a block diagram illustrating an example of a control unit according to the embodiment. Here, functions provided in the control unit 112 of the network camera 110 will be described. Each function may be realized by hardware, may be realized by software, or may be realized by a combination of hardware and software.

  When receiving the control right request transmitted from the viewer, the control right granting unit 301 grants the control right to the viewer. The imaging mechanism control unit 302 sends a drive command corresponding to the drive unit 114 in response to a control request transmitted from the viewer having the control right.

  The recovery unit 303 recovers the time corresponding to the loss when the effective period of the control right and a part of the effective period are lost due to occurrence of a predetermined situation. The subtracting unit 304 periodically subtracts the effective period. Note that the remaining time (remaining time) of the effective period is transmitted to the viewer through the communication unit 113 and displayed in the remaining time display area 206.

  The temporary stop / extension unit 305 temporarily stops the subtraction of the effective period when a part of the effective period receives a loss, or extends the effective period by a time corresponding to the loss.

  FIG. 4 is a flowchart illustrating an example of a network camera control method according to the embodiment.

  In step S401, the control unit 112 instructs the imaging unit 111 to start imaging. In step S <b> 402, the control unit 112 starts transmitting the captured image to each viewer 120, 130, 140 via the communication unit 113. Thereafter, in parallel with the control of the imaging mechanism, an image is taken and transmitted to each viewer as needed.

  In step S403, the control right granting unit 301 of the control unit 112 determines whether a control right request has been received from any viewer. If the control right request has not been received, the image transmission is continued. On the other hand, if a control right request is received, the process proceeds to step S404.

  In step S404, the control right granting unit 301 grants the control right to the viewer that has transmitted the control right request. Specifically, the communication unit 113 transmits information indicating that the control right has been granted to the viewer. Thereby, the imaging mechanism control unit 302 shifts to a state in which a control request can be received from the viewer.

  In step S405, the control right granting unit 301 instructs the subtraction unit 304 of the recovery unit 303 to start subtracting the validity period. Thereby, the subtraction part 304 starts subtracting a predetermined effective period periodically. The initial value of the valid period may be different for each viewer or may be the same.

  In step S406, the imaging mechanism control unit 302 determines whether a control request has been received from the viewer to which the control right is given. If no control request has been received, the process proceeds to step S408. On the other hand, if a control request is received, the process proceeds to step S407, and the imaging mechanism control unit 302 sends a drive command corresponding to the received control request to the drive unit 114. Thereby, the drive part 114 drives a focusing mechanism, for example. Note that the imaging mechanism control unit 302 may change an invisible area such as a visible restriction area to a visible area in response to a control request.

  In step S408, the temporary stop / extension unit 305 of the recovery unit 303 determines whether or not a predetermined situation has occurred in which a part of the validity period is subject to loss. Thus, the temporary stop / extension unit 305 also functions as a determination unit or detection unit for a predetermined situation. If a predetermined situation has not occurred, the process proceeds to step S410. On the other hand, when a predetermined situation occurs, the process proceeds to step S409.

  Note that the predetermined situation may be only a situation that cannot be attributed to the user's blame, or may include a situation that can be attributed to the user's blame. In general, only a situation that occurs due to individual circumstances on the network camera 110 side that does not ask the user to take responsibility may be set as a predetermined situation.

  There are various specific examples of the predetermined situation. For example, while the focusing mechanism described above is being driven, a situation in which the viewer control request is temporarily limited may occur. In addition, when changing the visible area to the visible area, if authentication information (eg, user ID or password) is requested from the user, the user can continue until the change is completed after the authentication information is entered. Operations will be limited. Therefore, it is desirable to restore the effective period when such a situation occurs.

  In step S409, the temporary stop / extension unit 305 recovers the valid period according to the lost time. For example, the temporary stop / extension unit 305 temporarily stops the subtraction process of the subtraction unit 304 when a part of the valid period can be lost. In addition, the temporary stop / extension unit 305 may extend the valid period for a time corresponding to the loss when a part of the valid period is lost. In any case, the effective period is substantially restored.

  In step S410, the subtraction unit 304 or the control unit 112 determines whether or not the valid period has expired (the remaining time becomes 0). If the valid period has not expired, the process returns to step S406. On the other hand, if it has expired, the process returns to the main routine to continue image capturing and transmission (substantially the process of this flowchart is repeated).

  FIG. 5 is a flowchart illustrating an example of the effective period recovery process according to the embodiment. This flowchart is a subroutine of step S409 described above.

  In step S501, the temporary stop / extension unit 305 temporarily stops the effective period subtraction process. In step S502, the pause / extension unit 305 transmits a pause signal to the viewer via the communication unit 113.

  In step S503, the temporary stop / extension unit 305 determines whether or not a predetermined situation has been recovered. For example, when the operation regarding the focusing operation is completed and a clear image with focus is transmitted, it is determined that the situation has been recovered.

  If the situation has not recovered, the process returns to step S501. On the other hand, if the situation has been resolved, the process proceeds to step S504, and the temporary stop / extension unit 305 instructs the subtraction unit 304 to start subtraction.

  FIG. 6 is a diagram illustrating another example of the user interface according to the embodiment. Since the image display area 202 is in focus, a blurred image is displayed.

  When receiving the pause signal through the communication unit 121, the viewer control unit 123 stops the update of the remaining time and displays a mark 601 indicating that the subtraction is paused in the remaining time display area 206. This makes it easier for the user to recognize that the subtraction is paused.

  FIG. 7 is a flowchart illustrating an example of the effective period recovery process according to the embodiment. This flowchart is a subroutine of step S409 described above.

  In step S701, the temporary stop / extension unit 305 integrates the loss time associated with the occurrence of a predetermined situation. In step S702, the pause / extend unit 305 determines whether or not a predetermined situation has been recovered. If the situation has not recovered, the process returns to step S701. On the other hand, if the situation is resolved, the process proceeds to step S703, and the temporary stop / extension unit 305 instructs the subtraction unit 304 to extend the valid period by the accumulated loss time.

  In step S <b> 704, the temporary stop / extension unit 305 transmits an extension signal to the viewer via the communication unit 113. The extension signal includes information about the extension and the extended time.

  FIG. 8 is a diagram illustrating another example of the user interface according to the embodiment. In the image display area 202, an image that is temporarily blurred due to focusing is displayed.

  When receiving the extension signal through the communication unit 121, the control unit 123 displays a mark 801 indicating that the valid period is extended in the remaining time display area 206 in addition to the remaining time after the extension. This makes it easier for the user to recognize that the validity period has been extended.

  According to the present embodiment, when the effective period of the control right is partially lost, the loss can be recovered. Thereby, the user can enjoy the given effective period more sufficiently than before.

  For example, it is difficult for the user to view a suitable and clear image while the network camera performs the focusing operation. Therefore, the loss of the effective period is suppressed by temporarily stopping the subtraction of the effective period of the control right during the focusing operation.

  Of course, even if the loss time (loss time) during the focusing operation is accumulated and the effective period is extended according to the accumulated loss time, the same effect will be produced.

  Note that the recovery unit may transmit a signal (eg, a pause signal or an extension signal) that explicitly indicates that recovery of the effective period is executed to the viewer. In general, it is considered difficult for the user to recognize the fact that the effective period has been extended unless the remaining time display area 206 is watched. In particular, when a method that does not pause the effective period countdown (such as an extended method) is adopted, the effective period countdown progresses at any time, so the user feels that the effective period has been lost. It may be. Therefore, the user will be relieved if he explicitly outputs that the validity period is restored. Note that the restoration of the valid period may be output by voice or the like.

[Second Embodiment]
The present invention is not limited only to the embodiment described above. It goes without saying that various modifications and applications can be made without departing from the basic technical idea of the present invention.

  FIG. 9 is a block diagram illustrating an example of a control unit according to the embodiment. In addition, the description about the part already demonstrated is abbreviate | omitted.

  The upper limit value setting unit 901 sets the upper limit value of the recovery time in the valid period in the recovery time determination unit 902 in response to a request from the viewer. The recovery time determination unit 902 determines the recovery time within the range of the upper limit value set by the upper limit value setting unit 901.

  For example, the recovery time determination unit 902 monitors the suspension time in parallel with the occurrence of a situation that causes a loss of the effective period. When the recovery time determination unit 902 determines that the temporary stop time exceeds the upper limit value, the recovery time determination unit 902 restarts the subtraction. This determination step will be inserted between steps S502 and S503 in FIG. 5, for example.

  Alternatively, when the recovery time determination unit 902 determines that the integrated value of the loss time exceeds the upper limit value, the recovery time determination unit 902 replaces the integrated loss time with the upper limit value, and extends the valid period according to the upper limit value. Note that this replacement processing with the upper limit value may be inserted, for example, between steps S702 and S703 in FIG.

  According to this embodiment, there is an advantage that it is possible to suppress a situation in which a specific user monopolizes the control right of the network camera for a long time by limiting the effective period so as not to be longer than the upper limit value.

[Third Embodiment]
There are various situations in which the network camera 110 cannot sufficiently serve the viewer and the validity period is lost. For example, when a large number of viewers are connected to the network camera 110 at the same time, it becomes difficult for the network camera 110 to transfer data at a frame rate desired by the user. In this case, since frame dropping of the video occurs, it cannot be said that the network camera 110 has always been able to provide a suitable video to the user. Therefore, in the present embodiment, a technique for recovering the effective period of the control right when a frame drop or the like occurs will be described.

  FIG. 10 is a block diagram illustrating an example of a control unit according to the embodiment. In addition, the description about the part already demonstrated is abbreviate | omitted.

  The number assigning unit 1001 is a unit that assigns frame numbers to a plurality of images transmitted via the communication unit 113 in order. Note that the control unit 123 of each viewer monitors the received image (eg, one frame constituting the video) and its frame number. That is, the control unit 123 determines whether or not the frame number of the preceding image and the frame number of the currently received image are sequential numbers. If it is not a serial number, it is detected that a frame drop has occurred. When detecting a frame drop, the control unit 123 transmits a frame drop notification via the communication unit 121.

  The frame drop determination unit 1002 provided in the network camera 110 determines whether or not a frame drop notification has been received. This would indirectly detect the occurrence of frame dropping. When a frame drop is detected, the frame drop determination unit 1002 instructs the temporary stop / extension unit 305 to recover the valid period.

  According to the present embodiment, the effective period can be recovered even when a frame drop occurs due to network congestion or the like. It should be understood by those skilled in the art that the technical idea of this embodiment can be combined with the first and second embodiments.

[Fourth Embodiment]
Since the network camera 110 has a pan function and a tilt function, it can acquire images in various directions. However, there may be an image that should not be transmitted to some of the users. For example, objects and local images that should not be disclosed for security purposes should not be distributed. In this case, the network camera 110 provides an image after changing part or all of the captured image to an invisible state. The invisible state is realized by, for example, image processing such as filling processing or mosaic processing. Note that if the range of restriction differs for each viewer, the image processing is desirably executed on the viewer side.

  However, for the user, even when an image including such a visibility-restricted (invisible) region is provided, the effective period of the control right may be subtracted. For example, even if the viewer has a control right, if the displayed image is completely filled, it will be difficult to execute a productive control in the first place, and the effective period will be wasted. . Therefore, in the present embodiment, a technique for recovering the effective period while an image including a view restriction area is provided will be described.

  FIG. 11 is a block diagram illustrating an example of a control unit according to the embodiment. In addition, the description about the part already demonstrated is abbreviate | omitted.

  The visible restriction region management unit 1101 holds the coordinates of a region that should be invisible in the entire range (such as a plane defined by XY coordinates) that can be imaged by the imaging unit 111.

  The area determination unit 1102 determines whether or not a visible restricted area is included in the current imaging range. For example, the area determination unit 1102 performs the determination process based on the coordinate data of the current imaging range and the coordinate data of the area that should be invisible. Note that the current imaging range can be acquired by an encoder or the like provided in the drive unit 114 that controls the attitude of the network camera 110. The encoder determines how many times the optical axis of the network camera is tilted up, down, left, and right from the reference position, and further converts into coordinate data of the imaging range based on the determined angle and the viewing angle of the imaging unit 111. The coordinate data of the area that should be invisible can be acquired from the visibility limited area management unit 1101.

  Note that if the area determination unit 1102 determines that the current imaging range includes a visible restriction area, the area determination unit 1102 transmits a visibility restriction instruction to the corresponding viewer. When the viewer control instruction 123 receives an instruction to limit visibility along with the image, the viewer control section 123 changes a part of the image to be invisible based on the coordinate data of the visibility restriction area attached to the instruction and displays it on the display section 122.

  12A, 12B, and 12C are diagrams for explaining the relationship between the image capturing range and the visible restriction region. In particular, FIG. 12A shows an image 1201 displayed in the image display area 202 when the imaging range does not include the view restriction area. On the other hand, FIG. 12B shows an image 1202 displayed in the image display area 202 when the visible limited area is included in a part of the imaging range. Based on the coordinate data of the visibility limited area 1211 received from the network camera 110, the control unit 123 performs mask processing on the area.

  FIG. 12C shows an image 1203 displayed in the image display area 202 when the entire imaging range is the view restriction area. The control unit 123 performs a filling process on the entire area based on the coordinate data of the view restriction area received from the network camera 110.

  FIG. 13 is a diagram illustrating an example of a view restriction area management table held by the view restriction area management unit according to the embodiment. Each of the management data 1301, 1302, and 1303 includes data for specifying one view restriction area.

  The X coordinate range data 1311 is X coordinate data for defining a view restriction region. The Y coordinate range data 1312 is Y coordinate data for defining the visibility limited region. In addition, if the view restriction region is a rectangle, the region can be defined by coordinate data of at least two points located diagonally. The image processing type 1313 is type information representing image processing for realizing invisibility such as coloring processing or mosaic processing. The image processing type 1313 enables different image processing to be performed for each visible control region. The image processing type 1313 may be effective when it is desired to distinguish and display a plurality of restricted visibility areas for some reason. The viewer control unit 123 receives these pieces of information from the network camera 110 and performs image processing on the view restriction region.

  FIG. 14 is a flowchart illustrating an example of a situation determination process according to the embodiment. In this flowchart, step S408 in FIG. 4 is a subroutine.

  In step S1401, the area determination unit 1102 acquires coordinate data for specifying the current imaging range from the drive unit 114 or the like. In step S <b> 1401, the area determination unit 1102 reads the coordinate data of the visible restricted area from the visible restricted area management unit 1101.

  In step S1403, the region determination unit 1102 determines whether or not a visible limited region is included in the current imaging range based on the coordinate data for specifying the current imaging range and the coordinate data for specifying the current imaging range. Determine whether. If it is included, a predetermined situation has occurred, and the process proceeds to S409. On the other hand, if it is not included, since a predetermined situation has not occurred, the process proceeds to S410.

  After that, the recovery process for the effective period is executed according to the flowcharts shown in FIGS. Note that the situation elimination determination process (S503 and S702) is the same process as in FIG. That is, if the current imaging range does not include the view restriction region, it is determined that the situation has been resolved.

  According to the present embodiment, the effective period can be recovered even when a part of the captured image is subjected to display restrictions.

[Fifth Embodiment]
The visibility restriction area described above may be changed to a normal visibility area when authentication information (eg, user ID or password) transmitted from the viewer is valid. As a result, there is an advantage that a user who knows the authentication information can provide an unlimited image.

  However, the authentication information is generally manually input by the user through the input unit 124. If the validity period is subtracted while the authentication information is being input, the period during which the user can effectively use the control right will be substantially reduced.

  FIG. 15 is a block diagram illustrating an example of a control unit according to the embodiment. In addition, the description about the part already demonstrated is abbreviate | omitted.

  The authentication monitoring unit 1501 is a unit that monitors, for example, the time required from the input of authentication information for changing the view restriction area to the viewable area from the viewer having the control right until the view restriction area is changed to the viewable area. . A timer that is a part of the authentication monitoring unit 1501 starts timing when an authentication request is received, and measures the time until the authentication is successful and the visible area is changed or the authentication process is canceled.

  The authentication unit 1502 determines whether the authentication information received from the viewer is correct. It is assumed that correct authentication information is stored in the storage unit 115. The authentication unit 1502 transmits the authentication result to the viewer and sends a signal for stopping the time measurement to the authentication monitoring unit 1501.

  FIG. 16 is a diagram illustrating an example of an authentication information input screen according to the embodiment. When the control unit 123 detects that the view restriction region 1211 is clicked by the input unit 124, the control unit 123 displays the input screen 1601 on the display unit 122. In addition, the control unit 123 transmits an input start notification indicating that the input of authentication information has started to the network camera 110. When the authentication information is input from the input unit 124 to the authentication information input box 1602 and the OK button is clicked, the control unit 123 transmits the input authentication information to the network camera 110. When the cancel button is clicked, the control unit 123 transmits a notification indicating cancellation to the network camera 110.

  Note that there are various methods for displaying the input screen 1601. For example, the control unit 123 may display the input screen 1601 when it is detected that the view restriction region is included. In this case, the control unit 123 may transmit an input start notification to the network camera 110 when the authentication information input box 1602 on the input screen is clicked with a pointer and text can be input.

  FIG. 17 is a diagram illustrating an example of a visibility-restricted area management table held by the visibility-restricted area management unit according to the embodiment. The same parts as those in the management table shown in FIG.

  Compared to FIG. 13, the management table 1700 has a storage field 1701 for storing the identification information of the view restriction area, a user ID storage field 1702, and an authentication information storage field 1702. Here, the authentication information is described as only a password, but, of course, the user ID may be a part of the authentication information.

  18A, 18B, and 18C are exemplary sequence diagrams for the recovery processing according to the embodiment. In particular, FIG. 18A shows a recovery process when the authentication process is normally executed.

  In sequence S1801, the viewer 120 transmits a control right request. When receiving the control right request, in sequence S1802, the network camera 110 transmits a control right grant. Upon receiving the control right grant, the viewer 120 starts counting down the validity period.

  In sequence S1803, the viewer 120 transmits an authentication information input start notification. Upon receiving the input start notification, in sequence S1804, the network camera 110 stops subtracting the valid period and transmits a temporary stop signal. In addition, the authentication monitoring unit 1501 of the network camera 110 starts a timer.

  In sequence S1805, the viewer 120 transmits the input authentication information. The authentication unit 1502 of the network camera 110 performs authentication based on the received authentication information. In sequence S1806, the authentication unit 1502 transmits the authentication result.

  When receiving an authentication result indicating successful authentication, the control unit 123 of the viewer 120 releases the restriction. That is, the control unit 123 changes the view restriction region to the view region.

  In sequence S1807, the viewer 120 transmits a release notification indicating that the restriction has been released. When receiving the cancellation notification, in sequence S1808, the network camera 110 transmits a subtraction restart signal. Thereby, the loss of the effective period accompanying the input of authentication information is recovered.

  FIG. 18B shows a recovery process when cancellation is executed before the authentication process is completed. Description of the parts common to FIG. 18A is omitted.

  When the cancel button is clicked, in step S1810, the control unit 123 transmits a cancel notification. When the cancel notification is received, in sequence S1811, the network camera 110 transmits a subtraction restart signal and restarts subtraction of the valid period. As a result, the effective period is recovered even when the authentication process is canceled.

  FIG. 18C shows the recovery process when the authentication process times out. Description of the parts common to FIG. 18A is omitted.

  When the user takes time to input authentication information, the timer of the authentication monitoring unit 1501 times out. In this case, in sequence S1820, the network camera 110 transmits a subtraction restart signal and restarts subtraction of the valid period. As a result, the validity period is recovered even when the user takes time to input the authentication information.

  FIG. 19 is a flowchart illustrating an example of a situation determination process and a recovery process according to the embodiment. This flowchart is a subroutine of steps S408 and S409.

  In step S1901, the authentication monitoring unit 1501 determines whether authentication has started. For example, the authentication monitoring unit 1501 determines that the authentication is started when receiving the authentication information input start notification from the viewer. If the authentication has not started, the process returns to the main routine (S410).

  On the other hand, when the authentication is started, the process proceeds to step S1902, and the authentication monitoring unit 1501 starts a timer for measuring the input time. In step S1903, the temporary stop / extension unit 305 temporarily stops subtracting the valid period. In step S1904, the pause / extend unit 305 transmits a pause signal to the viewer.

  In step S1905, the authentication monitoring unit 1501 determines whether the authentication unit 1502 has succeeded in authentication based on the authentication information received from the viewer. If successful, the process advances to step S1910, and the authentication unit 1502 transmits the authentication result indicating the authentication success to the viewer, thereby executing the change process to the visible region.

  When receiving the authentication result indicating the authentication success, the viewer control unit 123 cancels the image processing applied to the view restriction region and changes the view to the view region. Further, the control unit 123 of the viewer transmits a restriction release notification indicating that the restriction is released to the network camera 110. The authentication monitoring unit 1501 waits until a restriction release notification is received. When the restriction release notification is received, the process proceeds to step S1907.

  On the other hand, if the authentication information has not been received or the authentication has failed, the process advances to step S1906, and the authentication monitoring unit 1501 determines whether the timer has timed out. Note that the authentication monitoring unit 1501 may determine whether a cancellation notification has been received from the viewer before timing out. When the cancel notification is received, the recovery process is executed in the same manner as when a timeout occurs.

  If not timed out, the process returns to step S1905, and the authentication unit 1502 executes authentication processing for the authentication information to be transmitted next. On the other hand, if timed out, the process proceeds to step S1907, where the temporary stop / extension unit 305 instructs the subtraction unit 304 to resume subtraction of the valid period and transmits a subtraction restart signal to the viewer.

  According to the present embodiment, the validity period can be suitably recovered even when the validity period is lost due to the authentication process for releasing the restriction imposed on the viewer.

  In FIG. 19, the effective period is recovered by temporarily stopping the subtraction of the effective period. However, the effective period may be extended according to the time lost by the authentication process.

  FIG. 20 is a flowchart illustrating an example of a situation determination process and a recovery process according to the embodiment. Portions common to those in FIG. 19 are denoted by the same reference numerals.

  As can be seen from comparison with FIG. 19, the subtraction pause process (S1903) and the pause signal transmission process (S1904) are omitted. Also, instead of the subtraction restart process (S1907), an effective period extension process (S2001) and an extension signal transmission process (S2002) are employed.

  In step S2001, the authentication monitoring unit 1501 sends the time (loss time) counted by the timer to the temporary stop / extension unit 305. The temporary stop / extension unit 305 extends the valid period according to the received loss time. In step S2002, the temporary stop / extension unit 305 transmits a valid period extension signal (including extension time) to the viewer. The details of the extension process are as described with reference to FIG.

According to the present embodiment, the effective period can be recovered according to the loss time even when the loss time occurs in association with the authentication process.
[Other Embodiments]
In each of the above-described embodiments, the effective period is subtracted until it becomes 0. Conversely, the effective period may be added from 0 until a predetermined threshold value is reached. That is, the subtraction unit 304 is replaced with an addition unit. In this case, the temporary stop / extension unit 305 recovers the effective period by temporarily stopping the addition or extending the effective period by increasing the threshold.

  The present invention supplies a software program that implements the functions of the above-described embodiments directly or remotely to a system or apparatus, and a computer included in the system reads and executes the supplied program code. Can also be achieved.

  Accordingly, since the functions and processes of the present invention are implemented by a computer, the program code itself installed in the computer also implements the present invention. That is, the computer program itself for realizing the functions and processes is also one aspect of the present invention.

  In this case, the program may be in any form as long as it has a program function, such as an object code, a program executed by an interpreter, or script data supplied to the OS.

  Examples of the recording medium for supplying the program include a flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. Examples of the recording medium include a magnetic tape, a non-volatile memory card, a ROM, a DVD (DVD-ROM, DVD-R), and the like.

  The program may be downloaded from a homepage on the Internet using a browser on a client computer. That is, the computer program itself of the present invention or a compressed file including an automatic installation function may be downloaded from the home page to a recording medium such as a hard disk. It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer may be a constituent requirement of the present invention.

  Further, the program of the present invention may be encrypted and stored in a storage medium such as a CD-ROM and distributed to users. In this case, only the user who cleared the predetermined condition is allowed to download the key information to be decrypted from the homepage via the Internet, decrypt the program encrypted with the key information, execute it, and install the program on the computer May be.

  Further, the functions of the above-described embodiments may be realized by the computer executing the read program. Note that an OS or the like running on the computer may perform part or all of the actual processing based on the instructions of the program. Of course, also in this case, the functions of the above-described embodiments can be realized.

  Furthermore, the program read from the recording medium may be written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Based on the instructions of the program, a CPU or the like provided in the function expansion board or function expansion unit may perform part or all of the actual processing. In this way, the functions of the above-described embodiments may be realized.

It is a figure which shows an example of the image communication system which concerns on embodiment. It is a figure which shows an example of the user interface of the viewer which concerns on embodiment. It is a block diagram which shows an example of the control part which concerns on embodiment. It is a flowchart which shows an example of the control method of the network camera which concerns on embodiment. It is a flowchart which shows an example of the effective period recovery process which concerns on embodiment. It is a figure which shows the other example of the user interface which concerns on embodiment. It is a flowchart which shows an example of the effective period recovery process which concerns on embodiment. It is a figure which shows the other example of the user interface which concerns on embodiment. It is a block diagram which shows an example of the control part which concerns on embodiment. It is a block diagram which shows an example of the control part which concerns on embodiment. It is a block diagram which shows an example of the control part which concerns on embodiment. It is a figure which shows the image displayed on an image display area when a visible restriction area | region is not included in an imaging range. It is a figure which shows the image displayed on an image display area when a visible restriction area | region is included in a part of imaging range. It is a figure which shows the image displayed on an image display area when the whole imaging range is a visibility restriction | limiting area | region. It is a figure which shows an example of the management table of the visibility restriction | limiting area | region which the visibility restriction | limiting area management part which concerns on embodiment hold | maintains. It is a flowchart which shows an example of the condition determination process which concerns on embodiment. It is a block diagram which shows an example of the control part which concerns on embodiment. It is a figure which shows an example of the input screen of the authentication information which concerns on embodiment. It is a figure which shows an example of the management table of the visibility restriction | limiting area | region which the visibility restriction | limiting area management part which concerns on embodiment hold | maintains. It is a sequence diagram which shows a recovery process when an authentication process is normally performed. It is a sequence diagram which shows a recovery process when cancellation is performed before an authentication process is complete | finished. FIG. 10 is a sequence diagram illustrating a recovery process when an authentication process times out. It is a flowchart which shows an example of the situation determination process and recovery process which concern on embodiment. It is a flowchart which shows an example of the situation determination process and recovery process which concern on embodiment.

Claims (11)

An imaging device that transmits captured images to a plurality of image display devices,
A communication unit for communicating with the image display device via a network;
Control for controlling an imaging mechanism included in the imaging apparatus in response to a control request received through the communication unit from an image display apparatus that is granted a right to exclusively control the imaging apparatus exclusively within the effective period of the right And
An image pickup apparatus comprising: a recovery unit that recovers a time corresponding to a loss when a part of the effective period is lost due to occurrence of a predetermined situation. The recovery unit is
A subtractor for periodically subtracting the effective period;
And a temporary stop unit that temporarily stops the subtraction processing of the subtraction unit when a part of the valid period is lost due to the occurrence of the predetermined situation. Item 2. The imaging device according to Item 1. The recovery unit is
A subtractor for periodically subtracting the effective period;
And an extension unit for extending the effective period by a time corresponding to the loss when a part of the effective period is lost due to the occurrence of the predetermined situation. The imaging apparatus according to 1. The recovery unit is
The imaging apparatus according to claim 1, wherein a signal explicitly indicating that the restoration of the effective period is executed is transmitted to the image display apparatus. The recovery unit is
An upper limit value setting unit for setting an upper limit value of the time to be recovered with respect to the effective period;
5. The imaging apparatus according to claim 1, further comprising: a determination unit that determines the time to be recovered within the set upper limit value range. A detection unit that detects that the control unit has performed a focusing operation within the effective period;
The imaging apparatus according to claim 1, wherein the recovery unit recovers the effective period when the execution of the focusing operation is detected. A numbering unit that sequentially assigns numbers to a plurality of images transmitted via the communication unit;
A determination unit that determines whether or not a notification transmitted to the imaging device is received when an image dropout is detected based on the number in the image display device;
Further including
The imaging apparatus according to claim 1, wherein the recovery unit recovers the effective period when the notification is received. A determination unit that determines whether or not a visible restriction region is included in at least a part of an imaging range of an image transmitted to the image display device;
The imaging device according to claim 1, wherein the recovery unit recovers the effective period when the visible restriction region is included. A monitoring unit for monitoring a time required from the input of the authentication information for changing the visible restricted area to the visible area until the visible area is changed to the visible area;
The imaging apparatus according to claim 8, wherein the recovery unit recovers the effective period according to the monitored time. A method of controlling an imaging apparatus that transmits captured images to a plurality of image display apparatuses,
A receiving step of receiving a control request from an image display device provided with a right to exclusively control the imaging device within a valid period of the right;
A control step of controlling an imaging mechanism included in the imaging device in response to the received control request;
And a recovery step of recovering a time corresponding to the loss when a part of the effective period is lost due to occurrence of a predetermined situation. An image communication system including an imaging device that captures and transmits an image, and a plurality of image display devices that receive and display the image,
The image display device includes:
An image receiving unit that receives an image from the imaging device via a network;
A display device for displaying the received image;
A command transmission unit that transmits a control request for remotely controlling an imaging mechanism included in the imaging device;
The imaging device
An image sensor for capturing an image;
An image transmission unit that transmits the captured images to the plurality of image display devices;
A command receiving unit that receives a control request from an image display device that is granted a right to exclusively control the imaging device;
A control unit that controls an imaging mechanism included in the imaging device in response to a control request received from the image display device to which the right is granted within the effective period of the right;
An image communication system comprising: a recovery unit that recovers a time corresponding to a loss when a part of the effective period is lost due to occurrence of a predetermined situation.

Images