CN1320820C - Method for transmitting image frame - Google Patents
Method for transmitting image frame Download PDFInfo
- Publication number
- CN1320820C CN1320820C CNB2004100049512A CN200410004951A CN1320820C CN 1320820 C CN1320820 C CN 1320820C CN B2004100049512 A CNB2004100049512 A CN B2004100049512A CN 200410004951 A CN200410004951 A CN 200410004951A CN 1320820 C CN1320820 C CN 1320820C
- Authority
- CN
- China
- Prior art keywords
- image
- time
- frame
- image frame
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000005540 biological transmission Effects 0.000 claims abstract description 64
- 230000009471 action Effects 0.000 claims abstract description 15
- 230000008569 process Effects 0.000 claims abstract description 15
- 230000004044 response Effects 0.000 claims description 8
- 230000003068 static effect Effects 0.000 claims description 6
- 241001269238 Data Species 0.000 description 7
- 230000007704 transition Effects 0.000 description 6
- 230000008676 import Effects 0.000 description 3
- 230000011218 segmentation Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Landscapes
- Image Processing (AREA)
Abstract
The invention relates to a method for transmitting image frames, which comprises the following steps: inputting a portion of image data in an image frame into an image processor; wherein, the image frame is the image data which is generated and output by an image sensor after an exposure action is carried out on an entity object in an image frame processing time; responding to a transmission control signal generated and output by the image processor to be in a first state so as to enable the image sensor to pause outputting other subsequent image data in the image frame; and responding to the transmission control signal to be in a second state, so that the image sensor continuously outputs other subsequent image data in the image frame to the image processor. By the method, the phenomenon of data excess (overflow) can be avoided in the process of receiving and processing the image frame by the image processor.
Description
Technical field
The present invention relates to a kind of method of transmitting image frame, particularly a kind of method of avoiding in data transmission procedure, taking place the transmission image frame of data excess (overrun) phenomenon.
Background technology
Because at present network technology frequency range employed with it is more and more progressive and flourishing, so, transmit the application of image data by network, also universal day by day.Therefore, handle relevant technology with digitized video in network camera (web camera), network digital camera or the like networking products, promptly become focus of the present invention place.
In above-mentioned network Related product, usually use and shown in Fig. 1 (a), have real-time (real time) image transmission architecture that the image processor 12 of Digital Signal Processing (DSP) function is constituted by an image sensor 11 and to I haven't seen you for ages.In addition, image processor 12 also includes the function that the image data of finishing dealing with can be exported in the computer usually.Can be independent of outside the image processor 12 as for 13 of buffer storage, or be placed in one.
Yet, know that on business image sensor 11 is (no matter be the CMOS image sensor, or CCD image sensor), considers, often the image frame (frame) that is transmitted is not provided the flow control function of similar first in first out (FIFO) and so on for the real-time and the cost that transmit data.For example, if image processor 12 because previous image frame that some factor causes generation to receive comes in or last group image data still are untreated finishes, but image sensor 11 desire again at once will a back image frame or afterwards group image data transmit into the facts time, data excess (overrun) phenomenon promptly can take place.Therefore, seek to solve the method for these data excess phenomenons, seem important completely.As for other operation principles and the internal structure of relevant image sensor 11,, promptly no longer given unnecessary details at this because of it is a known technology.
Above-mentionedly carry out the data excess phenomenon that image data transmission is caused with known image frame transmission means for further understanding, existing to cooperate the mode of carrying out image processing with segmentation reception and segmentation be example, is described as follows.
See also Fig. 1 (b), it is that example illustrates known transmission image frame technology conception exemplary plot for handling image frame with segmented mode; And please cooperate and consult shown in Fig. 1 (a).Generally speaking, the 11 output required disposed of in its entirety times (can be described as the image frame processing time) of arbitrary image frame F of image sensor, refer to that promptly image sensor 11 per seconds can transmit image frame number (frame per second, inverse fps) at most.And it includes three partly: time for exposure t1 (this section period is very short usually), image data output time t2 and standby time t3.
In addition, image sensor 11 can produce transmission initial (initial) signal of output in response to image processor 12, to begin to carry out the image data transmission of arbitrary image frame F.Wherein, image sensor 11 must be divided into six group image data D1～D6 with image frame F and give being sent in batches, in order in the image processor 12 in the image data output time t2 after carrying out an exposure actions (time for exposure t1).So the image processor 12 that receives these six group images data D1～D6 shows the input and processing action that also must finish image data in the tp0 inter-sync of image data processing time.
If image processor 12 fails to dispose in time when receiving the second group image data D2 that image sensor 11 produces and export, then image sensor 11 continues the 3rd group image data D3 of generation and output again, the second group image data D2 before obviously promptly may overriding.Thus, will definitely cause image processor 12 follow-up receptions and a series of mistake of handling the 4th group～the 6th group image data D4～D6.
So, main purpose of the present invention is proposed, promptly be desirable to provide a kind of can be in the process of transmission image frame, avoid taking place previous image frame or last group image data cover still be untreated finish after the method for transmission image frame of image frame or back one group image data.
Summary of the invention
The present invention comprises the following steps: to import in partial image data to an image processor in the image frame (frame) about a kind of method of transmitting image frame; Wherein, this image frame is the image data that is produced output by an image sensor after an image frame carries out an exposure actions to an entity object in the processing time; Response is in one first state from a transmission of control signals of output that this image processor produces, so that this image sensor suspends other the follow-up image datas in this image frame of output; And respond this transmission of control signals and transfer one second state that is in to, so that this image sensor continues other follow-up image datas in this image frame of output to this image processor.
According to the above-mentioned conception of the present invention, wherein this image processor is one to have the image processor of Digital Signal Processing (DSP) function.
According to the above-mentioned conception of the present invention, wherein this image processor can be exported to the image data of finishing dealing with in the computer.
According to the above-mentioned conception of the present invention, wherein this image sensor is a CMOS image sensor, or is a CCD image sensor.
According to the above-mentioned conception of the present invention, wherein this image frame processing time refers to that this image sensor per second can transmit the inverse of image frame number at most.
According to the above-mentioned conception of the present invention, wherein this transmission of control signals transfers to from this first state and is in the required time of this second state, is one to suspend the delivery time.
According to the above-mentioned conception of the present invention, wherein this image sensor can be in a static image pattern.
According to the above-mentioned conception of the present invention, wherein receive in the process of this image frame in this image processor, produce at least once and should suspend the delivery time.
According to the above-mentioned conception of the present invention, wherein receive in the process of the arbitrary n of this image frame/image data in this image processor, promptly corresponding generation once should suspend the delivery time.
According to the above-mentioned conception of the present invention, wherein this image sensor can be in a dynamic image pattern.
According to the above-mentioned conception of the present invention, wherein receive in the process of this image frame in this image processor, produce at least once and should suspend the delivery time.
According to the above-mentioned conception of the present invention, wherein to receive the arbitrary n/image data in this image frame be corresponding generation this time-out delivery time once to this image processor.
According to the above-mentioned conception of the present invention, the delivery time of suspending for n time that is wherein produced in this image processor receives arbitrary n/image data process in this image frame adds that this image processor finishes receiving the required time span of whole image datas of this image frame, should be less than or equal to the time span after this image frame processing time deduction carries out this exposure actions required exposure time.
According to the above-mentioned conception of the present invention, wherein this first and second state can be respectively a low level and a high level state, maybe can be respectively a high level and a low level state.
According to the above-mentioned conception of the present invention, wherein this image sensor can respond a transmission initial signal of output that this image processor produces, to begin to carry out the image data transmission of this image frame.
Description of drawings
Fig. 1 (a): it is real-time (real time) the image transmission architecture exemplary plot by image sensor and image processor constituted.
Fig. 1 (b): it is that example illustrates known transmission image frame technology conception exemplary plot for handling image frame with segmented mode.
Fig. 2 (a): it is of the present invention one first preferable enforcement notion exemplary plot.
Fig. 2 (b): it is the detailed step exemplary plot of one first preferable enforcement notion of the present invention.
Fig. 3 (a): it is of the present invention one second preferable enforcement notion exemplary plot.
Fig. 3 (b): it is the detailed step exemplary plot of one second preferable enforcement notion of the present invention.
Wherein, description of reference numerals is as follows:
11: image sensor 12: image processor
13: buffer storage F: image frame
T1: time for exposure t2: output time
T3: standby time D1～D6: six group image data
Tp0, tp1, tp2, tp3, tp4: the total time of image processor process image data
TC1, TC2, TC3, TC4: transmission of control signals
E11～E13, E21～E26, E31～E33, E41～E46: suspend the delivery time
Embodiment
Based on the image frame transmission means shown in known Fig. 1 (a) and (b), give no thought to the flow control mechanism between image sensor 11 and the image processor 12, so the present invention promptly intend making full use of image sensor 11 when the arbitrary image frame F of output t3 standby time that must have, and cooperate a transmission of control signals that is produced by image processor 12, in order to regulate and to control the transmission speed of image sensor 11 image output frame F.
In detail, see also Fig. 2 (a), it is of the present invention one first preferable enforcement notion exemplary plot.And hypothesis image sensor 11 is in a static image (still image) pattern at this moment in present embodiment.Thus, present embodiment is obviously comparatively well-to-do for the time of image processor 12 processing image frame F.Also promptly, because of image sensor 11 is in the static image pattern, represent that same image frame F can remain in the image sensor 11 always.So image processor 12 can produce a transmission of control signals TC1 or TC2 to image sensor 11 according to the speed of himself process image data, whether decision desires to receive synchronously six group image data D1～D6 from image sensor 11.
With transmission of control signals TC1 is example, and its expression image processor 12 needs the more processing time when handling second, four, five group image data D2, D4, D5.So, still be untreated at image processor 12 and finish before second, four, five group image data D2, D4, D5 and image sensor 11 desires export next group image data D3, D5, D6, by transmission of control signals TC1 (for example from first state, be low level state) (for example transfer second state to, be high level state), suspend next group image data D3 of output, D5, D6 with notice image sensor 11.In addition, in case disposing, image processor 12 when second, four, five group image data D2, D4, D5, makes synchronously that promptly transmission of control signals TC1 goes back to first state from second state.So, but image sensor 11 just response transmission control signal TC1 signal transition action and continue next group image data D3 of output, D5, D6 to image processor 12.In other words, the formed time-out of signal transition action delivery time E11, E12, E13 by transmission of control signals TC1 can make image processor 12 win the extra time of handling second, four, five group image data D2, D4, D5.Thus, aforesaid data excess phenomenon promptly can not take place in transfer of data that image sensor 11 and image processor are 12 again.
Certainly, because of present embodiment hypothesis image sensor 11 is in the static image pattern,, promptly can not be restricted so suspend the time span of delivery time E11, E12, E13.In other words, image processor 12 produces transmission of control signals TC1 to receive the required total time length tp1 of six group image data D1～D6, can not be subjected to the time span restriction that the image data output time t2 of image frame in the processing time adds t3 standby time.
Be example with transmission of control signals TC2 again, its expression desires to make image processor 12 when receiving and handling six group image data D1～D6, can win some times more, the formed time-out of signal transition action delivery time E21～E26 by transmission of control signals TC2, can with image frame in the processing time standby time t3 time, mean allocation is given each group image data D1～D6.Also promptly, make image processor 12 produce transmission of control signals TC2, equal the time span that the image data output time t2 of image frame in the processing time adds t3 standby time to receive the required total time length tp2 of six group image data D1～D6.Thus, image processor 12 is received smoothly and the six group image data D1～D6 that dispose, avoid taking place aforesaid data excess phenomenon.
Now the above-mentioned relevant of the present invention first preferable enforcement notion is organized into the detailed step exemplary plot shown in Fig. 2 (b), and please cooperates and consult Fig. 1 (a) with shown in Fig. 2 (a):
Step 21: beginning;
Step 22: import in partial image data to an image processor 12 among the image frame F; Wherein, this image frame F is by the image sensor 11 that is in a static image pattern, produces the image data of output after an image frame carries out an exposure actions to an entity object (scheming not shown) in the processing time;
Wherein, this image processor 12 can be an image processor with Digital Signal Processing (DSP) function, and this image processor 12 can be exported to the image data of finishing dealing with in the computer; In addition, this image sensor 11 can be a CMOS image sensor, or is a CCD image sensor; As for this image frame processing time, refer to that then these image sensor 11 per seconds can transmit image frame number (frame per second, inverse fps) at most; Certainly, this image sensor 11 can respond transmission initial (initial) signal that this image processor 12 produces output, to begin to carry out the image data transmission of this image frame F;
Step 23: response is in one first state from a transmission of control signals TC1 or the TC2 that this image processor 12 produces output, so that this image sensor 11 suspends other the follow-up image datas among this image frame of output F;
Step 24: respond this transmission of control signals TC1 or TC2 and transfer one second state that is in to, so that other the follow-up image datas among this image sensor 11 this image frame of continuation output F are to this image processor 12;
Wherein, this transmission of control signals TC1 or TC2 transfer to from this first state and are in the required time of this second state, are one to suspend the delivery time; In addition, receive in the process of this image frame, produce at least once and should suspend the delivery time in this image processor; Preferably, receive in the process of the arbitrary n/image data in this image frame in this image processor, promptly corresponding generation once should suspend the delivery time, so, produce this time-out delivery time altogether n time; Again, this first and second state can be respectively a low level and a high level state, maybe can be respectively a high level and a low level state; And
Step 25: finish.
See also Fig. 3 (a) again, it is of the present invention one second preferable enforcement notion exemplary plot.And hypothesis image sensor 11 is in a dynamic image (dynamic image) pattern at this moment in present embodiment.Thus, the time that present embodiment is handled image frame F for image processor 12, obviously promptly can be subjected to the time span restriction that the image data output time t2 of image frame in the processing time adds t3 standby time.
With transmission of control signals TC3 is example, and its expression image processor 12 is being handled third and fourth, when five group image data D3, D4, D5, needed the more processing time.So, image processor 12 still be untreated finish third and fourth, before five group image data D3, D4, D5 and image sensor 11 desires export next group image data D4, D5, D6, by transmission of control signals TC3 (for example from first state, be low level state) (for example transfer second state to, be high level state), suspend next group image data D4 of output, D5, D6 with notice image sensor 11.In addition, in case image processor 12 disposes third and fourth, when five group image data D3, D4, D5, make synchronously that promptly transmission of control signals TC3 goes back to first state from second state.So, but image sensor 11 just response transmission control signal TC3 signal transition action and continue next group image data D4 of output, D5, D6 to image processor 12.In other words, formed time-outs of the signal transition action delivery time E31 by transmission of control signals TC3, E32, E33, can make image processor 12 win processing third and fourth, extra time of five group image data D3, D4, D5.Thus, aforesaid data excess phenomenon promptly can not take place in transfer of data that image sensor 11 and image processor are 12 again.
Certainly, because of present embodiment hypothesis image sensor 11 is in the dynamic image pattern,, promptly can be restricted so suspend the time span of delivery time E11, E12, E13.In other words, image processor 12 produces transmission of control signals TC3 to receive the required total time length tp3 of six group image data D1～D6, can be subjected to the time span restriction that the image data output time t2 of image frame in the processing time adds t3 standby time.
Be example with transmission of control signals TC4 again, its expression desires to make image processor 12 when receiving and handling six group image data D1～D6, can win some times more, the formed time-out of signal transition action delivery time E41～E46 by transmission of control signals TC4, can with image frame in the processing time standby time t3 time, mean allocation is given each group image data D1～D6.Also promptly, make image processor 12 produce transmission of control signals TC4, equal the time span that the image data output time t2 of image frame in the processing time adds t3 standby time to receive the required total time length tp4 of six group image data D1～D6.Thus, image processor 12 is received smoothly and the six group image data D1～D6 that dispose, avoid taking place aforesaid data excess phenomenon.
Now the above-mentioned relevant of the present invention second preferable enforcement notion is organized into the detailed step exemplary plot shown in Fig. 3 (b), and please cooperates and consult Fig. 1 (a) with shown in Fig. 3 (a):
Step 31: beginning;
Step 32: import in partial image data to an image processor 12 among the image frame F; Wherein, this image frame F is by the image sensor 11 that is in a dynamic image pattern, produces the image data of output after an image frame carries out an exposure actions to an entity object (scheming not shown) in the processing time;
Wherein, this image processor 12 can be an image processor with Digital Signal Processing (DSP) function, and this image processor 12 can be exported to the image data of finishing dealing with in the computer; In addition, this image sensor 11 can be a CMOS image sensor, or is a CCD image sensor; As for this image frame processing time, refer to that then these image sensor 11 per seconds can transmit image frame number (frame per second, inverse fps) at most; Certainly, this image sensor 11 can respond transmission initial (initial) signal that this image processor 12 produces output, to begin to carry out the image data transmission of this image frame F;
Step 33: response is in one first state from a transmission of control signals TC3 or the TC4 that this image processor 12 produces output, so that this image sensor 11 suspends other the follow-up image datas among this image frame of output F;
Step 34: respond this transmission of control signals TC3 or TC4 and transfer one second state that is in to, so that other the follow-up image datas among this image sensor 11 this image frame of continuation output F are to this image processor 12;
Wherein, this transmission of control signals TC3 or TC4 transfer to from this first state and are in the required time of this second state, are one to suspend the delivery time; In addition, receive in the process of this image frame, produce at least once and should suspend the delivery time in this image processor; Preferably, receive in the process of the arbitrary n/image data in this image frame in this image processor, promptly corresponding generation once should suspend the delivery time, so, produce this time-out delivery time altogether n time; Again, this first and second state can be respectively a low level and a high level state, maybe can be respectively a high level and a low level state; And
Step 35: finish.
In sum,, obviously can guarantee under the situation that does not influence the image frame processing time, make and the image data transmission of 12 of image sensor 11 and image processors data excess phenomenon can not take place again by way of the present invention.
The present invention must be undertaken modifying as all by those skilled in the art, however the protection range of neither disengaging claims.
Claims (9)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100049512A CN1320820C (en) | 2004-02-13 | 2004-02-13 | Method for transmitting image frame |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2004100049512A CN1320820C (en) | 2004-02-13 | 2004-02-13 | Method for transmitting image frame |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1558668A CN1558668A (en) | 2004-12-29 |
| CN1320820C true CN1320820C (en) | 2007-06-06 |
Family
ID=34350818
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2004100049512A Expired - Lifetime CN1320820C (en) | 2004-02-13 | 2004-02-13 | Method for transmitting image frame |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1320820C (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7647614B2 (en) | 2004-06-07 | 2010-01-12 | Sling Media, Inc. | Fast-start streaming and buffering of streaming content for personal media player |
| US7769756B2 (en) | 2004-06-07 | 2010-08-03 | Sling Media, Inc. | Selection and presentation of context-relevant supplemental content and advertising |
| US7917932B2 (en) * | 2005-06-07 | 2011-03-29 | Sling Media, Inc. | Personal video recorder functionality for placeshifting systems |
| US9998802B2 (en) | 2004-06-07 | 2018-06-12 | Sling Media LLC | Systems and methods for creating variable length clips from a media stream |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1999052067A2 (en) * | 1998-04-04 | 1999-10-14 | Viewgraphics, Incorporated | Apparatus and method of splicing digital video streams |
| CN1304127A (en) * | 2000-01-11 | 2001-07-18 | 达碁科技股份有限公司 | Driving method and driving circuit of plasma display panel |
| US20030194007A1 (en) * | 2002-04-12 | 2003-10-16 | William Chen | Method and apparatus for memory efficient compressed domain video processing |
-
2004
- 2004-02-13 CN CNB2004100049512A patent/CN1320820C/en not_active Expired - Lifetime
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1999052067A2 (en) * | 1998-04-04 | 1999-10-14 | Viewgraphics, Incorporated | Apparatus and method of splicing digital video streams |
| CN1304127A (en) * | 2000-01-11 | 2001-07-18 | 达碁科技股份有限公司 | Driving method and driving circuit of plasma display panel |
| US20030194007A1 (en) * | 2002-04-12 | 2003-10-16 | William Chen | Method and apparatus for memory efficient compressed domain video processing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1558668A (en) | 2004-12-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1744048A (en) | Video camera sharing | |
| CN101079939A (en) | Serial interface device and image forming apparatus | |
| CN1663278A (en) | Video Encoding and Decoding Technology | |
| CN101056385A (en) | Video communication method, video synthesizing processor, terminal and server | |
| CN101057492A (en) | camera device | |
| CN1320820C (en) | Method for transmitting image frame | |
| CN1942870A (en) | Burst memory access method to rectangular area | |
| CN1655593A (en) | Camera interface and method using dma unit to flip or rotate a digital image | |
| CN1913477A (en) | Systems, methods, and computer program products for arbitrating access to a shared resource | |
| CN1142498C (en) | Resource-bus interface | |
| CN1791219A (en) | Dual layer bus architecture for system-on-a-chip | |
| CN1886758A (en) | Method and apparatus for downscaling a digital matrix image | |
| CN1757226A (en) | Modular structure with reusable front end for processing digital video data | |
| CN101079993A (en) | Static frame loss method in video playing | |
| CN1819624A (en) | Data processing apparatus and method and its recording medium | |
| CN1652155A (en) | A method and device for changing the size of a digital image | |
| CN1825964A (en) | Method and system for processing video frequency data on chip | |
| CN111314606A (en) | Photographing method and device, electronic equipment and storage medium | |
| CN1640113A (en) | Noise filtering in images | |
| CN1146191C (en) | Data transmission control device and electronic equipment | |
| CN1130915C (en) | Motion image coding method and device and its coding programmed recording medium | |
| CN1255984C (en) | Picture processing device and camera, and picture processing method | |
| WO2022014141A1 (en) | Solid-state imaging element, imaging device, and information processing system | |
| CN1533137A (en) | Access audio frequency output through capturing service | |
| CN116010042A (en) | Control method and device of image acquisition equipment and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CX01 | Expiry of patent term | ||
| CX01 | Expiry of patent term |
Granted publication date: 20070606 |