JP2003111050A - Video distribution server and video reception client system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video distribution server with a small size and a light weight that provides an absolute minimum capacity for distributed data, warrants a transfer speed and the resolution in an excellent state even when a plurality of users exist, sufficiently satisfies requirement of each user and prevents the load imposed on the server from being increased. SOLUTION: A camera server 21 divides each frame of a consecutive images captured by an imaging apparatus 5 of an area division section 24a into a prescribed number of small areas of nearly rectangle. An degree of area interest arithmetic section 24b calculates areas with high degree of interest selected by a plurality of users and an area with low degree of interest selected by one user only according to areas desired by the users, outputs the result to an area priority decision section 24c, the area priority decision section 24c decides a high frame rate for the image of the areas with high degree of interest and a low frame rate for the image of the areas with low degree of interest, deletes areas to which no degree of interest is set, and distributes the result through a transfer rate selection data transmission section 24.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video distribution server and a video reception client system for receiving a video captured by an image pickup device such as a video camera through a network or the like and processing it in a predetermined manner.

[0002]

2. Description of the Related Art In recent years, a video camera such as a surveillance camera is provided with a camera server for processing and distributing substantially continuous images picked up by the video camera, a monitor for displaying an image from the camera server in a predetermined manner, and the like. Various systems have been proposed and some have been put into practical use by connecting them to clients on a general-purpose network.

For example, in the camera server disclosed in Japanese Unexamined Patent Application Publication No. 2000-197031, a number of shootable areas are set within a range in which the pan angle and tilt angle of one camera can be changed, and each set shooting can be performed. There is disclosed a system in which a virtual camera is assigned to an area and the like is shown to a client as if a plurality of cameras are connected to a camera server.

Further, in Japanese Patent Laid-Open No. 11-146295, an image is captured by using a lens having a wide field of view such as a fish-eye lens and transmitted to the television receiver side. Discloses a system for cutting out and displaying an arbitrary range.

[0005]

However, in the former case of the above-mentioned prior art, since the camera server has a movable part for physically changing the direction of the camera, there is a problem that the size and weight cannot be reduced. Further, although it is possible to satisfy a request in a desired direction with respect to one user, when a plurality of users have requests in different desired directions, it is not possible to sufficiently cope with the problem. is there.

In the latter of the above-mentioned prior arts,
Although a wide-angle image is captured, transmitted and received, and each user can cut out and display an arbitrary range desired by each user, the image sent to each user is the entire image. For this reason, there is a problem that the capacity of the image data for which the resolution is guaranteed becomes large for the user and the transfer speed becomes slow. On the contrary, if the capacity of the image data is limited in order to guarantee the transfer speed for the user, the resolution of the area desired by the user becomes coarse.

Further, if the camera server side cuts out and distributes only the area requested by the client each time, if the request of the client is slightly different, the cutout operation of the image data on the server must be performed again. There is also a problem that the load on the server becomes large, especially for multiple users.

The present invention has been made in view of the above circumstances, is small and lightweight, and minimizes the amount of data to be distributed, and has excellent transfer speed and resolution even if there are a plurality of users. It is an object of the present invention to provide a video distribution server and a video reception client system which can be guaranteed in a state and can sufficiently satisfy the requirements of each user, and which does not increase the load on the server.

[0009]

In order to achieve the above object, a video distribution server and a video reception client system according to the present invention according to claim 1 process and distribute substantially continuous videos captured by an imaging device. In a video distribution server and a video reception client system including a server and a video reception client that receives a video distributed by the video distribution server and displays the video on a display unit, the video distribution server determines the video from the imaging device in a predetermined manner. The image receiving client has a dividing / delivering unit that divides the image into a number of areas and independently handles each of the areas to deliver to the video receiving client. The image receiving client selects a desired image area and outputs information on the selected area. The divided distribution means has means for transmitting to the video distribution server, and the divided distribution means is based on the area requested by the video reception client. It is characterized by delivering a predetermined area among the divided regions.

That is, in the video distribution server and the video reception client system according to the first aspect, the video distribution server processes and distributes the substantially continuous video captured by the image pickup device, and the video reception client distributes it by the video distribution server. The image to be displayed is received and displayed on the display means. On this occasion,
In the image receiving client, select the desired image area,
The information of the selected area is transmitted to the video distribution server, and the video distribution server divides the video from the image pickup device into a predetermined number of areas by the split distribution means, and handles each of these areas independently and distributes them to the video reception client. . Specifically, the division distribution unit distributes a predetermined area among the areas divided based on the area requested by the video reception client. Therefore, the image pickup apparatus connected to the image distribution server according to the present invention is
Unlike the camera server disclosed in Japanese Unexamined Patent Publication No. 2000-197031, it is not necessary to have mechanical means for performing panning, tilting, etc., and it is possible to reduce the size and weight. In addition, by limiting the data to be distributed to the necessary area,
(I) Reducing the load on the server, and (ii) ensuring both the transfer rate and the resolution in an excellent state, and satisfying the user's requirements sufficiently, satisfying both (i) and (ii). To enable.

A video distribution server and a video reception client system according to a second aspect of the present invention are the video distribution server and the video reception client system according to the first aspect, wherein the video distribution server requests the video reception client. It is characterized in that a compression rate control means for changing the compression rate of the area to be distributed and other areas to be stored in the external storage means is provided. Therefore, the image data can be efficiently stored in the external storage means without the storage capacity becoming larger than necessary.

Further, the video distribution server and the video reception client system according to the third aspect of the present invention, the video distribution server for processing and distributing substantially continuous videos captured by the image pickup device, and the video distribution server for distribution. In a video distribution server and a video reception client system provided with a plurality of video reception clients for receiving the video and displaying it on the display means, the video distribution server divides the video from the imaging device into a predetermined number of areas, There is a division distribution unit that handles each area independently and distributes it to the video reception client, and the plurality of image reception clients each select a desired image area, and the information of the selected area is transmitted to the video distribution server. The dividing and delivering means has means for transmitting, and the dividing and delivering means performs the dividing operation based on the requests from the plurality of video receiving clients. It is characterized by executing with priority delivery of a predetermined region in the area.

That is, in the video distribution server and the video reception client system according to the third aspect, the video distribution server processes and distributes the substantially continuous videos captured by the image pickup device, and the video distribution servers include the video distribution server. The video distributed by is received and displayed on the display means. At this time, each of the plurality of image receiving clients selects a desired image area and sends the information of the selected area to the video distribution server. In the video distribution server, a predetermined number of videos from the imaging device are divided by the split distribution means. , And each of these areas is treated independently and delivered to the video receiving client. Specifically, the divided distribution unit preferentially executes distribution of a predetermined area among areas divided based on requests from a plurality of video reception clients. Therefore, the image pickup apparatus connected to the image distribution server according to the present invention is disclosed in Japanese Patent Laid-Open No. 2000-19.
Unlike the camera server of Japanese Patent No. 7031, it is not necessary to have mechanical means for performing panning, tilting, etc., and it is possible to make it compact and lightweight. In addition, by limiting the data to be distributed to the necessary area, (i) the load on the server is reduced, and (ii) the transfer speed and resolution are both ensured in an excellent state, and the user's requirements are fully satisfied. Of doing
It is possible to make both (i) and (ii) compatible.

A video distribution server and a video reception client system according to a fourth aspect of the present invention are the video distribution server and the video reception client system according to the third aspect, wherein the divided distribution means is the plurality of video reception clients. The priority distribution of a predetermined area based on the request of is set by the priority of the packet in the packet communication of the TCP / IP protocol, the flow control of the communication is performed according to the set priority of the packet communication, and the distribution of the predetermined area The feature is that it is executed with priority.

Further, the video distribution server and the video reception client system according to the present invention according to claim 5 are the video distribution server and the video reception client system according to claim 3 or 4, wherein the video distribution server is
It is characterized in that a compression rate control means for controlling the compression rate of the data to be stored in the external storage means based on the requests of the plurality of video receiving clients is provided. Therefore, the image data can be efficiently stored in the external storage means without the storage capacity becoming larger than necessary.

According to the sixth aspect of the present invention, there is provided a video distribution server and a video reception client system, wherein the video distribution server processes and distributes substantially continuous videos captured by an imaging device, and the video distribution server distributes. In a video distribution server and a video reception client system provided with a plurality of video reception clients for receiving the video and displaying it on the display means, the video distribution server divides the video from the imaging device into a predetermined number of areas, There is a division distribution unit that handles each area independently and distributes it to the video reception client, and the plurality of image reception clients each select a desired image area, and the information of the selected area is transmitted to the video distribution server. And a means for transmitting the divided distribution means for each of the plurality of video reception clients. And priority setting means for setting a Sakido,
Distribution priority selection means for preferentially executing distribution of a predetermined area among the divided areas according to requests from the plurality of video receiving clients and the priority set by the priority setting means Is characterized by.

That is, in the video distribution server and the video reception client system according to the sixth aspect, the video distribution server processes and distributes the substantially continuous video captured by the image pickup device, and the video distribution server has a plurality of video reception clients. The video distributed by is received and displayed on the display means. At this time, each of the plurality of image receiving clients selects a desired image area and sends the information of the selected area to the video distribution server. In the video distribution server, a predetermined number of videos from the imaging device are divided by the split distribution means. , And each of these areas is treated independently and delivered to the video receiving client. In the divided distribution means, specifically, the priority setting means sets the priority for each of the plurality of video reception clients, and the distribution priority selection means requests the plurality of video reception clients and the priority setting means. The distribution of a predetermined area among the areas divided according to the set priority is preferentially executed. Therefore, the image pickup apparatus connected to the image distribution server according to the present invention does not need to have any mechanical means for performing panning, tilting, etc., unlike the camera server disclosed in Japanese Patent Laid-Open No. 2000-197031. It can be lightweight. In addition, by limiting the data to be distributed to the necessary area, (i) the load on the server is reduced, and (ii) the transfer speed and resolution are both ensured in an excellent state, and the user's requirements are fully satisfied. Of doing (i),
It is possible to satisfy both (ii).

Furthermore, a video distribution server and a video reception client system according to the present invention according to claim 7 are the video distribution server and the video reception client system according to claim 6, wherein the division distribution means is the plurality of video reception clients. Of the priority and the priority set by the priority setting means, the priority defined in the predetermined area is T
The packet priority in the packet communication of the CP / IP protocol is set, the flow control of the communication is performed according to the set priority of the packet communication, and the distribution of the predetermined area is preferentially executed.

The video distribution server and the video reception client system according to the present invention according to claim 8 are the video distribution server and the video reception client system according to claim 6 or 7, wherein the video distribution server is
A compression rate control means for controlling the compression rate of the data to be stored in the external storage means is provided according to the requests of the plurality of video reception clients and the priority set by the priority setting means. Therefore, the image data can be efficiently stored in the external storage means without the storage capacity becoming larger than necessary.

Further, the video distribution server and the video reception client system according to the present invention according to claim 9 are the video distribution server and the video reception client system according to any one of claims 1 to 8. The receiving client includes means for selecting one of the resolution and the transfer rate of the video delivered from the video delivery server, and the video delivery server preferentially executes the delivery of the predetermined area. It is characterized in that either the selected resolution or transfer rate is changed and executed.

A video distribution server and a video reception client system according to the present invention according to claim 10 are the video distribution server and the video reception client system according to any one of claims 1 to 9. The receiving client is characterized by including trimming means for trimming a desired image area in the area received from the video distribution server. in this way,
By trimming the area of the desired image with the trimming means provided in the video receiving client, the load of the work until the area desired by the user is transmitted from the image distribution server and displayed is distributed between the server system and the client system. Therefore, it is possible to reduce the excessive load on the image distribution server side.

[0022]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. 1 to 7 show the first embodiment of the present invention.
FIG. 1 shows the overall configuration of a video distribution server and a video reception client system, FIG. 2 is a functional block diagram of the video distribution server, FIG. 3 is an explanatory diagram of image pickup area division, and FIG. 4 is transmission of divided areas. FIG. 5 is an explanatory diagram of a region selected by the user, FIG. 6 is an explanatory diagram of data distributed by the video distribution server, and FIG. 7 is an explanatory diagram of trimming in the video reception client.

In FIG. 1, reference numeral 1 denotes a video distribution server and a video reception client system. The video distribution server and the video reception client system 1 are one video distribution server (hereinafter referred to as a camera server) 2 and one video. The receiving client 3 is connected and configured by a network line 4.

The camera server 2 is composed of an image pickup device 5 such as a wide-angle or high-resolution digital video camera and a server 6, and the video reception client 3 is
It is composed of an electronic terminal such as a personal computer 8 having a monitor 7.

As shown in FIG. 2, the camera server 2 includes the image pickup device 5, the area dividing section 6a, and the area designating section 6 as shown in FIG.
b, the area selection unit 6c, and the data transmission unit 6d are mainly configured.

As shown in FIG. 3, the area dividing unit 6a has a predetermined number (for example, 10 (vertical) × 20 (horizontal) of each frame of continuous images captured by the image pickup device 5;
In order to simplify the explanation, it is divided into 4 (vertical) × 4 (horizontal) small rectangular areas.

Further, the area dividing section 6a captures the entire image captured by the image pickup apparatus 5 only in the initial state before the area designating section 6b sends a later-described area designating signal to the area selecting section 6c. The image is transmitted to the data transmission unit 6d with a predetermined resolution and distributed to the video reception client 3 through the network line 4.

That is, in the video receiving client 3,
Based on the entire image delivered in this initial state, the user selects his / her desired image area as shown in FIG. Specifically, the area displayed on the monitor 7 by the user is defined as a desired image area, and X- of each point P1, P2, P3, and P4 is set.
The Y coordinate values are set, and these coordinate values are set in the area designating section 6b.
Sent to.

The area designation section 6b receives the signal (coordinate value) of the desired image area from the video reception client 3 and outputs this signal, that is, the area designation signal to the area selection section 6c.

The area selecting section 6c selects a small area group from the area dividing section 6a including the specified area (FIG. 6) based on the area specifying signal from the area specifying section 6b. The selected small area group is output to the data transmission unit 6d.

In the data transmission section 6d, the area selection section 6
When the small area group is input from c, the small area group is distributed to the video receiving client 3 through the network line 4.

In the video reception client 3, as shown in FIG. 7, an image is formed by the distributed small area group,
Well-known trimming processing is performed by software by the trimming means 9 to display an area desired by the user on the monitor 7.

That is, in the first embodiment, the area distribution unit 6a, the area designation unit 6b, the area selection unit 6c, and the data transmission unit 6d constitute a division distribution means.

As described above, according to the first embodiment, only the data of the partial small area group including the area desired by the user in the entire image is distributed to the image receiving client 3, and therefore the distribution is performed. The amount of data is the minimum necessary,
It is possible to guarantee both the transfer speed and the resolution in an excellent state and sufficiently satisfy the user's request.

Further, the camera server 2 can be realized in a small size and a light weight without requiring a movable part or the like for physically changing the direction of the camera.

Further, since the trimming process of the image desired by the user is performed by the trimming means 9 of the video receiving client 3, the camera server 2 is not subject to any calculation load.

Next, FIGS. 8 and 9 show a second embodiment of the present invention.
FIG. 8 is a functional block diagram of the video distribution server,
FIG. 9 is an explanatory diagram of image data stored in the data storage unit. In addition, the second mode has a function of storing image data added to the first mode. The same components as those in the first mode are designated by the same reference numerals and the description thereof will be omitted.

That is, as shown in FIG. 8, the camera server 11 according to the second embodiment of the present invention includes an image pickup device 5, an area dividing section 6a, an area designating section 6b, a data transmitting section 6d, an area selecting section 12, and a data compressing section. The rate changing unit 13 and the data storage unit 14 are mainly configured.

In addition to the function of the area selecting section 6c of the first embodiment, the area selecting section 12 receives the area specifying signal from the area specifying section 6b together with each image data input from the area dividing section 6a. It is output to the compression rate changing unit 13.

In the data compression rate changing section 13, the image data selected by the area selecting section 12 and other image data (in the figure) are selected based on the image data and the area designation signal input from the area selecting section 12. , The data of the shaded area) is changed to form the compressed data of the entire image. For example, as shown in FIG. 9, the portion of the image data selected by the area selection unit 12 is compressed to 1/10 according to the JPEG standard, and the image data of the other area is compressed to 1/40 and compressed. Image data is formed. Then, the compressed image data is output to the data storage unit 14. That is,
The data compression rate changing unit 13 is provided as compression rate control means.

The data storage unit 14 is an external storage unit such as a hard disk, and stores image data compressed by the data compression rate changing unit 13.
This stored data can be transmitted upon request.

As described above, according to the second embodiment,
In addition to the effect of the first embodiment, the necessary video portion desired by the user is stored with high accuracy, and the other portion is stored with high compression, so that the image data is stored in the data storage unit 14. The storage capacity is efficiently stored without increasing the storage capacity more than necessary.

Next, FIGS. 10 to 12 show a third embodiment of the present invention, FIG. 10 is an overall configuration diagram of a video distribution server and a video reception client system, and FIG. 11 is a functional block diagram of the video distribution server. FIG. 12 is an explanatory diagram showing an example of a region of interest of each user. Note that the third embodiment is a case of a plurality of video receiving clients, whereas the first embodiment is one video receiving client, and the same configuration as the first embodiment The same reference numerals are given and the description is omitted.

That is, in FIG. 10, reference numeral 20 indicates a video distribution server and a video reception client system, and this video distribution server and video reception client system 20 includes one camera server 21 and a plurality of video reception clients (# 0, #). , ..., #N) 22 are connected by a network line 23.

The camera server 21 is composed of, for example, an image pickup device 5 such as a wide-angle or high-resolution digital video camera and a server 24, and the plurality of video reception clients 22 are personal computers each equipped with a monitor 7. 8 and other electronic terminals.

The camera server 21 shown in FIG.
As shown in, the image pickup device 5, the area dividing unit 24a, the area interest degree calculating unit 24b, the area priority determining unit 24c, and the transfer rate selection data transmitting unit 24d are mainly configured.

The area dividing section 24a is the same as the first embodiment.
Similar to the area dividing unit 6a in the embodiment, each frame of continuous images captured by the imaging device 5 is divided into a predetermined number of substantially rectangular small areas.

Further, the area dividing section 24a is only in the initial state before the area interest degree calculating section 24b sends the area interest degree signal, which will be described later, to the area priority determining section 24c. The entire image taken in is reduced in resolution to a predetermined value and transmitted to the transfer rate selection data transmission unit 24d and distributed to each video reception client 22 through the network line 23 provided exclusively for the video distribution server and the video reception client system. .

That is, in each video reception client 22, each user selects his / her desired image area (area of interest) based on the entire image delivered in this initial state, and the area interest degree of the camera server 21. It is transmitted to the calculation unit 24b. For example, in FIG. 12, the region of interest of user # 0 and the region of interest of user # 1 are divided into small region Nos.
It is included in 9, 10, 11, 13, 14, and 15. Also,
The region of interest of the user # 2 is No. of the divided small regions. 1
It is included in 1, 12, 15, and 16.

The area interest degree calculation unit 24b divides the area of high interest degree selected by a plurality of users and the area of low interest degree selected by only one user according to the input interest area. Calculation is performed, and the result is the area priority determination unit 2
Output to 4c. In the example of FIG. 12, the No. selected by a plurality of users. The small areas 9, 10, 11, 13, 14, and 15 are areas of high interest, and the No. selected by one user. Each of the small regions 12 and 16 is calculated as a region of low interest and output to the region priority determining unit 24c.

The area priority determining unit 24c receives a high interest rate from the area interest degree calculating unit 24b, and a high frame rate (for example, 1 second 1
Image rate), a low frame rate (for example, a rate of 1 second for 2 seconds) is determined for the image of the area of low interest, and the area of no interest is deleted to remove the transfer rate. The image data of each small area is output to the selection data transmission unit 24d.

The transfer rate selection data transmission section 24d
Distributes the input image data of each small area to the video receiving client 22 of the corresponding user according to the determined frame rate. The video delivered to each video receiving client 22 is subjected to a trimming process of a necessary area for each user's terminal.

Thus, in the case of the example of FIG. 12, the images distributed to the image reception client 22 are # 0 and #.
One user is delivered one fast frame rate video per second, and # 2 user is delivered one slow frame rate video every two seconds. Here, the video selected by the user # 2 is No. Although there are some images such as the small areas of 11 and 15 which are delivered at a high frame rate of 1 sheet per second, only the images synchronized with the slow frame rate are delivered and displayed on the monitor 7.

As described above, in the third embodiment, the area dividing section 24a, the area interest degree calculating section 24b, the area priority determining section 24c, and the transfer rate selection data transmitting section 24d.
The division distribution means is constituted by.

Then, according to the third embodiment, the degree of interest is set for the area selected by each user in the entire image by the number of users, and the frame rate is set according to the degree of interest. Since it is changed to deliver efficiently, the amount of delivered data is the minimum required even if the number of users increases, and both the transfer rate and the resolution are guaranteed in an excellent state to satisfy the user's request. It is possible to be satisfied with.

Further, the camera server 21 can be realized in a small size and light weight without the need for a movable part for physically changing the direction of the camera.

Furthermore, since the trimming processing of the image desired by each user is performed for each video receiving client 22, the camera server 21 is not subject to any computational load.

Next, FIG. 13 is a functional block diagram of a video distribution server according to the fourth embodiment of the present invention. still,
In the fourth mode, a function of storing image data is added to the third mode. The same components as those in the third mode are designated by the same reference numerals and the description thereof will be omitted.

That is, as shown in FIG. 13, the camera server 31 according to the fourth embodiment of the present invention includes an image pickup device 5, an area dividing section 24a, an area interest degree calculating section 24b, a transfer rate selection data transmitting section 24d, and an area priority. The degree determining unit 32, the data compression rate changing unit 33, and the data storage unit 34 are mainly configured.

In addition to the function of the area priority determining section 24c of the third embodiment, the area priority determining section 32 receives the area interest level signal from the area interest level calculating section 24b as the area dividing section 2.
The data is output to the data compression rate changing unit 33 together with each image data input from 4a.

In the data compression rate changing section 33, based on the image data and the area interest level signal input from the area priority determining section 32, the image data of the small area having a high area interest level and the low area interest level are obtained. The image data of the small area and the image data of the small area for which the degree of interest in the area is not set are changed to form compressed data. That is, the compression rate is low for small area image data with high area interest, high for small area image data with low area interest, and further high for small area image data with no area interest setting. The compression rate is increased to form compressed data. Then, the compressed image data is output to the data storage unit 34. That is, the data compression rate changing unit 33 is provided as compression rate control means.

The data storage unit 34 is an external storage means such as a hard disk, and stores the image data compressed by the data compression rate changing unit 33.
This stored data can be transmitted upon request.

As described above, according to the fourth embodiment,
In addition to the effect of the third embodiment, the necessary video portion desired by the user is stored with the compression degree changed according to the area interest degree at that time, so that the image data is stored in the data storage unit 34. Can be efficiently stored without increasing the storage capacity more than necessary.

Next, FIG. 14 is a functional block diagram of a video distribution server according to the fifth embodiment of the present invention. still,
In the fifth mode, when the plurality of video reception clients (# 0, # 1, ..., #N) 22 in the third mode have different priorities, the camera server is connected to the camera server through a network line containing other general data. This is an example of the case of distributing data, and the same components as those in the third embodiment are designated by the same reference numerals and the description thereof will be omitted.

That is, as shown in FIG. 14, the camera server 41 according to the fifth embodiment includes an image pickup device 5, an area dividing section 42a, an area designating section 42b, an area selecting section 42c, and an area selecting section 42c.
The flow controller 42d and the packet priority selection data transmitter 42e are mainly configured.

The area dividing section 42a is the same as the third embodiment.
Similar to the area dividing unit 24a in the embodiment, each frame of continuous images captured by the imaging device 5 is divided into a predetermined number of substantially rectangular small areas. Then, each of the divided small areas is treated as TCP / I as independent image data.
The packet is divided into packets in the P protocol packet communication and transmitted to the area selection unit 42c.

Further, the area dividing section 42a takes in the entire image captured by the image pickup apparatus 5 only in the initial state before the area priority section 42b sends a later-described area priority signal to the area selecting section 42c. The image is transmitted to the packet priority selection data transmission unit 42e with the resolution lowered to a predetermined level and distributed to each video reception client 22 through the network line 23.

That is, in each video reception client 22, each user selects his or her desired area based on the entire image distributed in this initial state, and sends it to the area designation unit 42b of the camera server 41. For example, in FIG.
2, the area desired by user # 0 and the area desired by user # 1 are divided into small area Nos. 9, 10,
It is included in 11, 13, 14, and 15. Also, user # 2
Is a divided small area No. 11, 1
2,15,16.

The area designating section 42b sets the priorities of the respective video receiving clients 22 in advance, and the priorities of the respective video receiving clients 22 and the input desired areas of the respective video receiving clients 22. To set the priority of each small area. For example, the video reception client 22
# 0 has a priority of 3 (the highest priority client),
The priority of the other video receiving clients 22 (# 1 to #N) is preset to 1 (normal priority). In this case, when the desired area is input from the user as described above, # 0 of the divided small area desired by # 0.
As the priority points of 9, 10, 11, 13, 14, and 15, 3 points are assigned to each small area, and No. 1 of the divided small areas desired by # 1. 9, 10, 11, 1
As the priority points of Nos. 3, 14 and 15, 1 point is assigned to each small area, and No. 2 of the divided small areas desired by # 2. As a priority point of 11, 12, 15, and 16, one point is assigned to each small area.
Then, the total of these priority points (that is, the priority points of the divided small areas No. 11 and 15 are 5 points, and the divided small areas No. 9, 10, 13, and 14 are
Has 4 priority points, N of the divided small area
o. The priority points of 12 and 16 are 1 point), and are set as the final priority of each small area.
It is output to c. As described above, in the area designating unit 42b, the higher the priority of the image receiving clients 22 that desires an area is, or the more image receiving clients 2 are provided.
The smaller the area from 2, the higher the priority of the small area is set. That is, the area designating unit 42b has a function as a priority setting unit.

The area selection unit 42c sets the priority order to the IP packet at the time of communication according to the final priority input from the area designation unit 42b, and the flow control unit 42c.
The packet data of the small area is transmitted to d.

Here, as an example of a method of prioritizing IP packet communication, there is a method of designating the number of packets that can be continuously transmitted using a window field on a TCP header field. Called the window size). In this method, the window size of the small area having a high priority is set larger than that of the area having a low priority, so that the priority can be set and the data transmission efficiency of the small area having a high priority can be improved.

The flow control unit 42d receives the data reception end signal from each video reception client 22, and controls the communication flow of the packet data from the area selection unit 42c based on the priority of each data. .
That is, since the priority order of the packet data is different, the time until the data is collected is different for each video reception client 22. As a result, the frequency at which the reception completion data reaches the camera server 41 is different, and the camera server 41
The data thinning (image reproduction rate) depends on the priority.

At this time, the flow control unit 42d waits until the transmission / reception of the data of the small area of the image having the same point is completed, and then transmits the next data. That is, T
In the protocol such as CP / IP that notifies the server of the completion of reception on the client side, all the notifications of the completion of reception from the plurality of clients are prepared for the plurality of clients requesting the area of the same point. By the way, the following data is transmitted.

Then, the packet priority selection data transmission unit 42e distributes each input packet data according to the priority of the designated packet. The video delivered to each video receiving client 22 is subjected to a trimming process of a necessary area for each user's terminal.

As described above, in the fifth embodiment, the area designating section 42b and the area selecting section 42c function as distribution priority selecting means, and the area dividing section 42a and the area designating section 4 are included.
2b, the area selection unit 42c, the flow control unit 42d, and the packet priority selection data transmission unit 42e constitute a division distribution unit.

Then, according to the fifth embodiment, the area selected by each user in the entire video is selectively and efficiently delivered according to the number of users and the priority of the users. As a result, even if the number of users increases, the amount of data to be delivered can be minimized, and it is possible to guarantee both the transfer rate and the resolution in an excellent state and sufficiently satisfy the user's requirements. ing.

Further, the fifth embodiment of the present invention can be easily realized at a low cost with a general network line, and has a wide versatility.

Further, the camera server 41 can be realized in a small size and light weight without the need for a movable part for physically changing the direction of the camera.

Further, since the trimming process of the image desired by each user is performed for each video receiving client 22, the camera server 41 is not subject to any calculation load.

Next, FIGS. 15 and 16 show a sixth embodiment of the present invention, FIG. 15 is a functional block diagram of a video distribution server, and FIG. 16 is a description of a frame rate-resolution selection unit in a video reception client. It is a figure. In the sixth embodiment, the user who is set to have a particularly low degree of interest in the third embodiment can determine either the image compression rate or the transfer rate by himself. ,
The same components as those in the third embodiment are designated by the same reference numerals, and the description thereof will be omitted.

That is, as shown in FIG. 15, a camera server 51 according to the sixth embodiment of the present invention includes an image pickup device 5, an area dividing section 24a, an area interest degree calculating section 24b, an area priority determining section 52, and a switch section 53. A compression rate selection unit 54, and
The transfer rate selection data transmission unit 55 is mainly configured.

The area priority determining unit 52 determines a high priority for an image of a region of high interest and selects an image of an area of low interest according to the input of the degree of interest from the region interest degree calculating unit 24b. Determines a low priority, deletes an area for which no interest is set, and outputs the image data of each small area to the compression rate selecting means 54.

The switch section 53 is inputted for each video receiving client 22 whether a video rate with a low compression rate and a high resolution is required, or a video with a smooth motion with a high frame rate is required. It Then, with respect to the video receiving client 22 having a low compression rate and requiring a high resolution, the compression rate selecting unit 54 performs processing at a normal compression rate for data in a small area having a particularly low priority. Then, the transfer rate selection data transmission unit 55 selects the frame rate stepwise based on the priority of the small area from the area priority determination unit 52 and distributes the video data. Further, for the video reception client 22 that needs a smooth moving image with a high frame rate, the compression rate selection unit 54 uses the area priority determination unit 52 from the area priority determination unit 52 for data in a small region with a low priority. The transfer rate selection data transmission unit 55 selects the normal frame rate and distributes the video data. still,
The selection of the frame rate and the resolution for each video receiving client 22 is executed by software by selecting the icon 56 displayed on the screen of the monitor 7 with a pointing device as shown in FIG. 16, for example.

As described above, the compression rate selecting section 54 sets the image data of each small area from the area priority determining section 52 for each small area based on the input signal from the switch section 53. The data is compressed stepwise according to the priority or is normally compressed and transmitted to the transfer rate selection data transmission unit 55.

The transfer rate selection data transmitting section 55 is
As described above, based on the input signal from the switch unit 53,
The image data of each small area from the area priority determining unit 52 is set and selected stepwise according to the priority set for each small area, or is set as a normal frame rate and transmitted. .

As described above, according to the sixth embodiment, since it is possible to select whether the emphasis is placed on the resolution or the frame rate for each video receiving client 22, the video desired by one user can be displayed to other users. Even if the priority is lower, you can still watch the video while making the most of the conditions that you emphasize.

Further, since the video data distributed from the camera server 51 is the data whose resolution is set to be lowered step by step according to the priority or the frame rate is changed stepwise, the video data of the user Even if the number is large, the amount of data to be delivered is the minimum necessary, and it is possible to guarantee both the transfer rate and the resolution in an excellent state and sufficiently satisfy the user's request.

In each of the above embodiments, the image pickup device 5 is used.
Describes one digital video camera having a wide angle or a high resolution as an example. However, as shown in FIG. 17, images captured by a plurality of digital video cameras 60 are combined by an image combining unit 61.
Alternatively, the data may be combined with each other and sent to each area dividing unit (for example, the area dividing unit 6a in the first embodiment).

[0089]

As described above, according to the present invention, it is small and lightweight, and the amount of data to be distributed is minimized, and even if there are a plurality of users, the transfer rate and the resolution are excellent. This has an excellent effect that it can be guaranteed in the state and the requirements of each user can be sufficiently satisfied, and the load on the server does not increase.

[Brief description of drawings]

FIG. 1 is an overall configuration diagram of a video distribution server and a video reception client system according to a first embodiment of the present invention.

FIG. 2 Same as above, functional block diagram of video distribution server

FIG. 3 is an explanatory diagram of image pickup area division of the same as above.

FIG. 4 is an explanatory diagram of transmission of divided areas in the same as above.

FIG. 5 is an explanatory diagram of an area selected by a user.

FIG. 6 is an explanatory diagram of data distributed by the video distribution server.

FIG. 7 is an explanatory diagram of trimming on the video receiving client.

FIG. 8 is a functional block diagram of a video distribution server according to the second embodiment of the present invention.

FIG. 9 is an explanatory diagram of image data stored in the data storage unit.

FIG. 10 is an overall configuration diagram of a video distribution server and a video reception client system according to a third embodiment of the present invention.

FIG. 11: Same as above, functional block diagram of video distribution server

FIG. 12 is an explanatory diagram showing an example of a region of interest of each user.

FIG. 13 is a functional block diagram of a video distribution server according to a fourth embodiment of the present invention.

FIG. 14 is a functional block diagram of a video distribution server according to a fifth embodiment of the present invention.

FIG. 15 is a functional block diagram of a video distribution server according to a sixth embodiment of the present invention.

FIG. 16: Same as above, speed in video reception client −
Explanatory drawing of resolution selection section

FIG. 17 is an explanatory diagram of an example in which the imaging unit of the video distribution server has a plurality of cameras.

[Explanation of symbols]

1 video distribution server and video reception client system 2 camera server (video distribution server) 3 video reception client 4 network line 5 imaging device 6 server 6a area division unit (divided distribution means) 6b area designation unit (divided distribution means) 6c area selection Section (divided delivery means) 6d data transmission section (divided delivery means) 7 monitor 8 personal computer 9 trimming means

Continued front page    F-term (reference) 5C022 AA13 AB61                 5C054 AA01 AA05 CA04 CC02 CH01                       DA06 EA03 EG09 FC11 FD07                       GA01 GB02 GD03 HA18                 5C064 BA01 BB07 BB10 BC06 BC18                       BC25 BC27 BD02 BD08                 5C087 AA08 AA24 BB11 BB73 DD03                       DD20 DD23 EE15 FF01 FF02                       FF19

Claims (10)

[Claims] 1. A video distribution comprising a video distribution server for processing and distributing substantially continuous videos captured by an imaging device, and a video reception client for receiving the video distributed by the video distribution server and displaying it on a display means. In the server and the video reception client system, the video distribution server has a division distribution unit that divides the video from the imaging device into a predetermined number of areas, handles each of these areas independently, and distributes to the video reception client. , The image receiving client selects a desired image area,
It has means for transmitting information on the selected area to the video distribution server, and the divided distribution means distributes a predetermined area among the divided areas based on the area requested by the video reception client. Video distribution server and video reception client system. 2. The video delivery server comprises a compression rate control means for changing the compression rate of an area to be delivered based on a request from the video receiving client and storing the area in an external storage means. The video distribution server and the video reception client system according to claim 1. 3. A video distribution server that processes and distributes substantially continuous video captured by an image pickup device, and a plurality of video reception clients that receive the video distributed by the video distribution server and display it on a display means. In the video distribution server and the video reception client system, the video distribution server divides the video from the imaging device into a predetermined number of areas, and divides and distributes each of these areas independently to the video reception client. The plurality of image receiving clients each have a means for selecting a desired image area and transmitting information of the selected area to the video delivery server. A video distribution server characterized by preferentially executing distribution of a predetermined area among the divided areas based on a request from a receiving client, and Image receiving client system. 4. The divided delivery means sets prioritized delivery of a predetermined area based on a request from the plurality of video receiving clients with a packet priority in packet communication of TCP / IP protocol, and the set packet communication. 4. The video distribution server and the video reception client system according to claim 3, wherein the flow control of communication is performed according to the priority of, and the distribution of the predetermined area is executed with priority. 5. The video distribution server comprises compression rate control means for controlling the compression rate of data to be stored in an external storage means based on requests from the plurality of video reception clients. The video distribution server and the video reception client system according to claim 4. 6. A video distribution server that processes and distributes substantially continuous video captured by an imaging device, and a plurality of video reception clients that receive the video distributed by the video distribution server and display it on display means. In the video distribution server and the video reception client system, the video distribution server divides the video from the imaging device into a predetermined number of areas, and divides and distributes each of these areas independently to the video reception client. The plurality of image receiving clients each have a means for selecting a desired image area and transmitting information of the selected area to the video delivery server. Priority setting means for setting a priority for each client to the receiving client, requests from the plurality of video receiving clients, and the priority A video distribution server and a video reception client system, comprising: a distribution priority selection unit that preferentially executes distribution of a predetermined region among the divided regions according to the priority set by the setting unit. . 7. The divided distribution means sets the priority defined in the predetermined area in accordance with the requests from the plurality of video reception clients and the priority set by the priority setting means,
7. The packet priority in the packet communication of the CP / IP protocol is set, the flow control of the communication is performed according to the set priority of the packet communication, and the distribution of the predetermined area is preferentially executed. Video distribution server and video reception client system. 8. The compression ratio control, wherein the video distribution server controls a compression ratio of data to be stored in an external storage unit according to a request from the plurality of video reception clients and a priority set by the priority setting unit. The video distribution server and the video reception client system according to claim 6 or 7, further comprising means. 9. The video receiving client includes means for selecting with emphasis on either the resolution or the transfer rate of the video delivered from the video delivery server, and the video delivery server delivers the predetermined area. 9. The video distribution server and the video reception according to claim 1, wherein one of the selected resolution and the transfer rate is changed and executed when priority is given to the video distribution server. Client system. 10. The video receiving client comprises trimming means for trimming a desired image area in the area received from the video distribution server. A video distribution server and a video reception client system described in one.