JP2011091545A - Image recording system, image recording method - Google Patents

Abstract

Image data to be recorded is reliably recorded without missing the image transmission apparatus. The image transmission apparatus is configured to display image data displayed on an arbitrary image display apparatus and display timing of the image display apparatus. Capture at substantially the same timing. The image delay unit 23 generates delayed image data obtained by delaying the captured image data by a desired time. The transmission unit 24 transmits the delayed image data to the mobile device 30. The small image display unit 33 displays the delayed image data. The control unit 34 controls the recording of the delayed image data displayed on the small image display unit 33.
[Selection] Figure 1

Description

  The present invention relates to an image recording system and an image recording method, and more particularly to an image recording system and an image recording method suitable for recording image data whose contents change over time.

  In recent years, there are a wide variety of display devices that display image (still image, moving image) data. Examples of the display device include a television, a personal computer monitor, and digital signage. The user can visually obtain image data having a very large amount of information from these display devices. Here, the user may want to record desired image data from the image data displayed on these display devices on the portable device at hand.

  However, among the image data displayed on the display device, the image data to be recorded in the portable device at hand of the user is often only a part of the image data displayed on the display device. In other words, most of the image data displayed on the display device is not a target of recording and is often unnecessary. Therefore, it is important to reliably record only the necessary image data out of the image data displayed on the display device.

  Patent Document 1 discloses a mobile phone capture system that acquires contents for standby display of a mobile phone from a video signal and transfers them to the mobile phone. The configuration of the mobile phone capture system described in Patent Document 1 is shown in FIG. The mobile phone capture system 40 includes an AV (Audio Visual) processing unit 50 and a capture processing unit 60. The capture processing unit 60 includes an A / D (Analog / Digital) conversion unit 61, a DSP (Digital Signal Processor) unit 62, a local control CPU (Central Processing Unit) 63, a serial communication I / F (Interface) 64, And a memory 65.

  The AV processing unit 50 operates as a so-called AV device such as a television or a DVD (Digital Versatile Disc), displays the video signal on the video output device 51, and displays the displayed video signal in the A in the capture processing device 60. / D converter 61 outputs the result. The user designates information to be captured out of information displayed on the video output device 51 of the AV processing unit 50 via the remote control I / F 80. When the information to be captured is designated, the A / D converter 61 converts the input video signal into a digital signal, and inputs the converted digital signal to the DSP unit 62. The DSP unit 62 processes the input digital signal into image information of a predetermined format that conforms to the display specifications of the mobile phone 70, and temporarily stores the image information in the memory 65. The image information stored in the memory 65 is transferred as standby display content to the mobile phone 70 via the serial communication I / F 64 and the external connection cable 71. The local control CPU 63 controls recording and transfer of image information.

  Patent Document 2 discloses a technique related to a digital data streaming system to a portable device. This digital data streaming system provides media streams to portable devices for the purposes of captioning, language translation, and hearing aids. The configuration of the streaming system according to Patent Document 2 is shown in FIG. When the user moves around in the hall, the portable device held by the user receives an infrared ray or a radio signal corresponding to the position and stores it in a memory in the portable device. The user refers to, records, etc. information stored in the memory of the portable device.

JP 2002-247185 A JP-T-2006-507723

  However, depending on the above system, there are the following problems. In the system described in Patent Document 1, the user must perform recording processing in real time while referring to the video image data displayed on the display device. Also in the system described in Patent Document 2, the user must perform a recording process in real time while referring to information displayed on the portable device. When recording image data referred to by the user in real time, particularly moving image data with a lot of movement, it is impossible to recognize when the desired image data is displayed, and thus necessary image data may not be recorded.

  That is, depending on the above-described system, it is difficult to reliably record the image data displayed on the display device without losing necessary image data.

  One aspect of the image recording system according to the present invention is an image recording system comprising a first device that transmits image data and a second device that receives image data, the first device Includes an image capturing unit that captures image data displayed on an arbitrary image display device at substantially the same timing as the display timing of the image display device, and a transmission unit that transmits image data to the second device. Wherein either one of the first device and the second device includes an image delay unit that generates delayed image data obtained by delaying image data by a desired time, and the second device includes: And an image display unit that displays the delayed image data, and a control unit that controls recording of the delayed image data displayed on the image display unit.

  In the present invention, delayed image data is generated by delaying the image data displayed on the image display device by the image delay unit. By displaying the delayed image data on the second device, the same image data can be referred to at different timings in the image display device and the second device. The user can reliably record the image data to be recorded by recording the delayed image data in the second apparatus.

  According to the present invention, it is possible to reliably record without missing image data to be recorded.

1 is a block diagram of an image recording system according to a first embodiment. FIG. 3 is a configuration diagram of a FIFO memory in the image delay unit according to the first embodiment; FIG. 3 is a diagram illustrating an operation of the image recording system according to the first embodiment. FIG. 3 is a block diagram of an image recording system according to a second embodiment. FIG. 6 is a block diagram of an image recording system according to a third embodiment. It is a block diagram of the conventional capture system for mobile phones. It is a block diagram of the conventional streaming system.

Embodiment 1
Embodiments of the present invention will be described below with reference to the drawings. First, the basic configuration of the image recording system according to the present embodiment will be described with reference to FIG. The image recording system 1 includes an image display device 10, an image transmission device 20, and a mobile device 30. The image display device 10 is a display device for displaying a still image or a moving image. Examples of the image display device 10 include a television, a personal computer monitor, and a digital signage (electronic signage).

  The image display device 10 displays image data on a display and inputs the displayed image data to the image transmission device 20. For example, image data displayed on a television is input to the image transmission device 20 as a composite signal. The user holds the portable device 30 at hand and views the image data displayed on the image display device 10.

  The image transmission device 20 includes an image capturing I / F (Interface) 21, an image size adjustment unit 22, an image delay unit 23, and a transmission unit 24. The image capture I / F 21 is a processing unit that captures image data displayed on the image display device 10 into the image transmission device 20 at substantially the same timing as that displayed on the image display device 10. When the input image data is analog data, the image capture I / F 21 A / D converts the analog data and outputs the digitized image data to the image size adjustment unit 22.

  The image size adjustment unit 22 adjusts the input image data so as to have an image size (number of pixels) suitable for display on the small image display unit 33 in the portable device 30. In this embodiment, setting values (setting values such as the number of changed pixels) used for image size adjustment by the image size adjustment unit 22 are set in advance in the image transmission device 20. Note that this set value may be transmitted from the mobile device 30. Specifically, even when the mobile device 30 transmits a setting value of the image size or the like when a link is connected between the transmission unit 24 in the image transmission device 20 and the reception unit 31 in the mobile device 30. Good. The image adjustment unit 22 outputs the image data subjected to the image size adjustment to the image delay unit 23. Note that the image size adjustment unit 22 is not limited to the image size, and may have a function of adjusting arbitrary image characteristics, for example, the aspect ratio of the image in accordance with the specifications of the mobile device 30.

  The image delay unit 23 delays the image data input from the image size adjustment unit 22 by a desired time. The delay time by the image delay unit 23 can be any time, but it is desirable that the user who views the image data displayed on the image display device 10 can recognize the delay. . For example, the image delay time by the image delay unit 23 is about 3 to 30 seconds. The image delay time is preset in the image delay unit 23. The image delay unit 23 delays the input image data by a desired time, and then outputs the image data to the transmission unit 24. Details of the image delay processing by the image delay unit 23 will be described later.

  The transmission unit 24 transmits the image data input from the image delay unit 23 to the portable device 30. Here, the transmission unit 24 transmits the image data to the portable device 30 by a wireless method having a signal band sufficient to transfer the image data. For example, the transmission unit 24 transmits the image data to the portable device 30 via a WLAN (Wireless Local Area Network) or UWB (Ultra Wide Band). Note that the image transmission device 20 and the portable device 30 may be connected by a wired connection and may transmit and receive image data through a wired line.

  The portable device 30 is illustrated as an example of a device having an image display function and an image recording function, and may not necessarily be a portable device. Examples of the portable device 30 include a mobile phone, a PDA (Personal Data Assistance), and a portable digital music player. The mobile device 30 may be a television or the like.

  The portable device 30 includes a receiving unit 31, a storage unit 32, a small image display unit 33, and a control unit 34. The reception unit 31 is a processing unit that receives image data transmitted from the transmission unit 24. The receiving unit 31 outputs the received image data to the small image display unit 33.

  The small image display unit 33 is a display processing unit provided in the portable device 30. For example, a display screen of a mobile phone and a processing unit related to the display screen correspond to the small image display unit 33. Here, the image data displayed on the small image display unit 33 is given a delay of a predetermined time by the image delay unit 23. Therefore, the image data displayed on the small image display unit 33 is displayed with a certain time delay from the image data displayed on the image display device 10.

  The user views image data displayed on the image display device 10 and determines whether there is image data to be recorded in the mobile device 30. When there is image data to be recorded in the portable device 30, the user views the image data displayed on the small image display unit 33. That is, the user switches from viewing image data on the image display device 10 to viewing image data displayed on the small image display unit 33. Since the image data to be recorded is displayed on the small image display unit 33 with a delay of a predetermined time, the user can wait for the image data to be recorded to be displayed on the small image display unit 33. The user issues a recording command to the portable device 30 at the timing when the image data to be recorded is displayed on the small image display unit 33. The recording command performed by the user is performed, for example, by pressing a recording button provided in the mobile device 30.

  The above-described recording command is input to the control unit 34 in the mobile device 30. The control unit 34 is a control unit that controls processing of the series of portable devices 30. The control unit 34 records the image data displayed on the small image display unit 33 based on a recording command performed by the user. The control unit 34 stores the recorded image data in the storage unit 32. The storage unit 32 is a storage device for storing arbitrary data, and is, for example, a semiconductor device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The storage unit 32 may be a memory card connected from the outside of the portable device 30.

  Next, image delay processing by the image delay unit 23 will be described with reference to FIG. Image delay processing by the image delay unit 23 is realized by providing a FIFO (First In, First Out) memory in the image delay unit 23. FIG. 2 is a diagram showing the configuration of the FIFO memory in the image delay unit 23.

  The image delay unit 23 writes the input image data in the FIFO memory (IN). The image delay unit 23 reads the stored image data in the stored order after a predetermined delay time (OUT). The image writing (IN) process and the image reading process (OUT) change the cell in which the FIFO memory process is performed at the same timing. Therefore, the image delay unit 23 can adjust the delay time by adjusting the positional relationship between the pointer of the FIFO memory write process (IN) and the pointer of the FIFO memory read process (OUT). In this delay format, the size of the FIFO memory is proportional to the maximum delay amount given to the image data.

  The image delay processing by the image delay unit 23 is not limited to the processing by the FIFO memory described above, and may be realized by an arbitrary image delay processing method.

  Subsequently, an example of the application of the image recording system according to the present embodiment will be described. For example, an example of application when the above-described image display device 10 is configured by a television and the portable device 30 is configured by a mobile phone will be described. The user views the television and takes out the mobile phone when there is a moving image to be recorded on the mobile phone. On the mobile phone, the moving image displayed on the television is displayed with a delay. Here, the delay time of the image data by the image delay unit 23 needs to be sufficient to allow the user to operate the mobile phone without being impatient after watching the television, for example, 5 seconds to 30 seconds. is there. The user records a desired moving image by operating various buttons on the mobile phone. The user displays the recorded moving image on the display, or uses one frame of the recorded moving image as a standby image.

  In addition, an example of application in the case where the above-described image display device 10 is configured by a PC (Personal Computer) display connected to a projector and the portable device 30 is configured by a PDA will be described. Here, it is assumed that the listener records a desired slide image on his / her PDA at the conference presentation. In presentations at academic societies and the like, slide images are displayed on the projector. The slide image displayed on the projector is displayed on the PDA with a delay. The delay time of the image data by the image delay unit 23 needs to be sufficient to allow the listener to operate the PDA without rushing after referring to the slide image, and is, for example, 3 seconds to 10 seconds. In this case, the slide image has a small amount of change in information due to a change in time, and the same slide image is often displayed without changing for a certain time. Therefore, the delay time can be set relatively short. The listener refers to the slide image displayed on the projector and determines whether there is a slide image to be recorded on the PDA at hand. When there is a slide image to be recorded on the PDA, the listener records a desired slide image by operating the operation button of the PDA. Thereafter, the listener can refer to the recorded slide image again at an arbitrary timing.

  Next, effects of the above-described image recording system will be described. Through the above series of processing, the image data displayed on the image display device 10 is delayed by the image delay unit 23 for a predetermined time, and the delayed image data is transmitted to the portable device 30. The portable device 30 can display the delayed image data on the small image display unit 33. FIG. 3 is a diagram showing an operation concept of the image recording system according to the present embodiment.

  The user views the image display device 10 and determines whether there is image data to be recorded. When there is image data to be recorded, the user views the image data displayed on the small image display unit 33. Here, the same image data is displayed on the small image display unit 33 with a predetermined time delay from the display timing of the image data displayed on the image display device 10. Therefore, the user can issue an image recording command while grasping at what timing the image data to be recorded is displayed on the small image display unit 33. Thereby, the user can reliably record on the portable device 30 without missing the image data to be recorded.

  In the image recording process, the portable device 30 displays the received image data as it is on the small image display unit 33 without recording. In response to a recording command from the user, the control unit 34 records only necessary information of the image data displayed on the small image display unit 33 in the storage unit 32. In other words, the portable device 30 does not record image data that does not need to be recorded. That is, the portable device 30 does not need to save all the image data to be displayed in the memory and then display it on the small image display unit 33. Thereby, reduction of memory capacity and saving of power for driving the memory can be realized.

  Furthermore, when data transfer between the transmission unit 24 and the reception unit 31 is realized by wireless communication, it is not necessary to perform complicated work such as wiring work.

Embodiment 2
The second embodiment of the present invention is characterized in that a portable device that receives image data includes an image delay unit that performs image delay processing. With reference to FIG. 4, the basic configuration and operation of the image recording system according to the present embodiment will be described with respect to differences from the first embodiment. In FIG. 4, processing units with the same name and the same reference numerals perform basically the same processing as in the first embodiment.

  The image transmission device 20 includes an image capturing I / F 21 and a transmission unit 24. The image transmission device 20 has a configuration that does not include an image size adjustment unit that adjusts the pixel size and an image delay unit that performs image delay processing. On the other hand, the portable device 30 includes a reception unit 31, a storage unit 32, a small image display unit 33, a control unit 34, an image delay unit 35, and an image size adjustment unit 36.

  The image transmission device 20 captures the image data displayed on the image display device 10 into the image transmission device 20 at substantially the same timing as that displayed on the image display device 10. The image transmission device 20 transmits the image data to the portable device 30 via the image size adjustment unit 22 and the transmission unit 24. Here, since the image transmission device 20 does not have an image delay unit, the image transmission device 20 transmits the captured image data to the portable device 30 in almost real time.

  The reception unit 31 in the portable device 30 receives the image data input from the image transmission device 20 and inputs the received image data to the image size adjustment unit 36. The image size adjustment unit 36 adjusts the image size of the received image data in accordance with the specifications of the mobile device 30, and outputs the image data after the image size adjustment to the image delay unit 35. The image delay unit 35 delays the input image data by a desired time. Here, the image delay process is the same as the process according to the first embodiment, but the delay time of the image data can be set to an arbitrary value in the portable device 30. The image delay unit 35 outputs the delayed image data to the small display device 33. The subsequent processing is the same as in the first embodiment.

  Subsequently, an example of the application of the image recording system according to the present embodiment will be described. For example, an example of application in the case where the above-described image display device 10 is configured with digital signage for displaying moving images on a train and the portable device 30 is configured with a portable digital music player or a cellular phone will be described.

  Each user on the train views the video displayed on the digital signage. Here, for each device held by each user, image size setting and desired delay time information are set. For example, a user having a portable digital music player having sufficient device performance sets the delay time to 5 seconds or more and 30 seconds or less. On the other hand, a user having a mobile phone with insufficient device performance sets the delay time to 3 seconds or more and 10 seconds or less. After a predetermined delay time set by each user, an image displayed on the digital signage is displayed on the device at hand. Each user refers to the digital signage and determines whether there is a moving image to be recorded on the device at hand. When there is a moving image to be recorded on the device at hand, each user records a desired moving image by operating a recording button or the like with reference to the display of the device at hand.

  Next, effects of the image recording system according to the present embodiment will be described. In the series of processes, the mobile device 30 performs an image size adjustment process and an image delay process. Therefore, image size adjustment can be performed for each portable device 30, and appropriate image size adjustment can be performed even when a large number of users are referring to the image display device 10. In addition, each user of the mobile device 30 can set a delay time according to his / her preference. Since the user can set the delay time, each user can display the image data on the device at hand at a timing desired by the user. Thereby, even if it is image data which many users refer to, it becomes possible to record reliably the image data required for the apparatus which each user holds.

Embodiment 3
The third embodiment of the present invention is characterized in that each of the image transmission device and the portable device includes an image delay unit. With reference to FIG. 5, the basic configuration and operation of the image recording system according to the present embodiment will be described with respect to differences from the first and second embodiments. In FIG. 5, processing units with the same name and the same reference numerals perform basically the same processing as in the first and second embodiments.

  The image transmission device 20 includes an image capturing I / F 21, an image delay unit 23, and a transmission unit 24. The portable device 30 includes a receiving unit 31, a storage unit 32, a small image display unit 33, a control unit 34, an image delay unit 35, and an image size adjustment unit 36.

  The image transmission device 20 captures the image data displayed on the image display device 10 into the image transmission device 20 at substantially the same timing as that displayed on the image display device 10. The image transmission apparatus 20 outputs the captured image data to the image delay unit 23 after the image size adjustment unit 22 performs image size adjustment. The image delay unit 23 delays the image data by the delay time set on the image transmission device 20 side, and outputs the image data to the transmission unit 24. Here, as for the delay time by the image delay unit 23, it is desirable to select the minimum value from the delay time of the image data desired by each user who possesses the mobile device 30. That is, it is desirable to select the minimum value among the delay times of the image data set in the mobile device 30 connected to the image transmission device 20. The transmission unit 24 transmits the input image data to the mobile device 30. In addition, the transmission unit 24 transmits the delay time to the portable device 30 in order to notify the delay time delayed by the image delay unit 23.

  The reception unit 31 in the portable device 30 receives the image data input from the image transmission device 20 and inputs the received image data to the image size adjustment unit 36. The receiving unit 31 receives the delay time transmitted from the image transmission device 20. The image size adjustment unit 36 adjusts the image size of the received image data in accordance with the specifications of the mobile device 30, and outputs the image data after the image size adjustment to the image delay unit 35.

  The image delay unit 35 delays input image data by a time corresponding to a difference between a desired delay time set in the mobile device 30 and a delay time transmitted from the image transmission device 20. For example, when the user of the mobile device 30 wants to delay the image data by 10 seconds, when the delay time transmitted from the image transmission device 20 is 5 seconds, the image delay unit 35 adds 5 seconds to the input image data. Give a minute delay. On the other hand, when the user of the mobile device 30 wants to delay the image data by 10 seconds, when the delay time transmitted from the image transmission device 20 is 5 seconds, the image delay unit 35 does not perform the delay process. The image delay unit 35 outputs the delayed image data to the small image display unit 33. The subsequent processing is the same as in the first embodiment.

  Next, effects of the image recording system according to the present embodiment will be described. In the image recording system according to the present embodiment, the image transmission apparatus 20 gives the minimum necessary delay time to the image data. Thereafter, the mobile device 30 gives the image data a delay time corresponding to the difference between the delay time desired by the user possessing the mobile device 30 and the delay time given by the image transmission device 20. Thereby, the delay amount for the delay time desired by the user possessing the mobile device 30 can be given to the image data. Further, when the image delay process is realized by the above-described FIFO memory, the load of the delay process performed by the mobile device 30 can be reduced by the image transmission apparatus 20 performing a part of the delay process. That is, the memory size of the FIFO memory included in the mobile device 30 can be reduced. As a result, even when the mobile device 30 does not have sufficient device performance, it is possible to display image data given a delay amount by a delay time desired by the user of the mobile device 30 on the small image display unit 33. Become.

  Note that the present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention. For example, the image transmission device 20 is in a paused state or a stopped state until the mobile device 30 is activated. Then, the image transmission device 20 may be activated when the portable device 30 is activated. Thereby, the power consumption by the image transmission apparatus 20 can be reduced.

  The transmission unit 24 may have an image compression function for image data. The receiving unit 31 may have an image expansion function. Thereby, it is possible to improve the data quality when the image is wirelessly transmitted. Furthermore, the transmission unit 24 and the reception unit 31 may be configured to have a data retransmission processing function.

  Further, the image transmission device 20 may have a function of adjusting the number of frames of moving image data to be transmitted to the mobile device 30. For example, it is possible to reduce the amount of data transmitted to the mobile device 30 by providing a function of converting image data including data of 30 frames per second into data having an information amount of 15 frames per second.

DESCRIPTION OF SYMBOLS 1 Image recording system 10 Image display apparatus 20 Image transmission apparatus 21 Image capture I / F
22 image size adjustment unit 23 image delay unit 24 transmission unit 30 portable device 31 reception unit 32 storage unit 33 small image display unit 34 control unit 35 image delay unit 36 image size adjustment unit

Claims (15)

An image recording system comprising: a first device that transmits image data; and a second device that receives image data,
The first device includes an image capturing unit that captures image data displayed on an arbitrary image display device at substantially the same timing as the display timing of the image display device;
A transmission unit that transmits image data to the second device,
Either one of the first device and the second device includes an image delay unit that generates delayed image data obtained by delaying image data displayed on the image display device by a desired time,
The second device includes an image display unit that displays the delayed image data;
And a control unit that controls recording of the delayed image data displayed on the image display unit.   The image recording system according to claim 1, wherein the first device includes the image delay unit.   The image recording system according to claim 1, wherein the second device includes the image delay unit.   The image recording system according to claim 1, wherein the first device and the second device include the image delay unit.   The image delay unit writes image data to be subjected to delay processing to a FIFO (First In, First Out) memory, and generates the delayed image data by reading the image data from the FIFO memory after the desired time. The image recording system according to claim 1, wherein:   6. The image recording system according to claim 1, wherein the image recording system includes the image display device. Either the first device or the second device includes an image size adjustment unit that converts image data into an image size suitable for display on the image display unit,
The image recording system according to claim 1, wherein the image delay unit delays the image data converted by the image size adjustment unit. The image data displayed on an arbitrary image display device is taken into the first device at substantially the same timing as the display timing of the image display device,
Send image data from the first device to a second device having an image display function,
Generating delayed image data obtained by delaying the image data by a desired time before or after transmitting the image data;
In the second apparatus, an image recording method for displaying the delayed image data and recording the delayed image data in accordance with a user command.   9. The image recording method according to claim 8, wherein the generation of the delayed image data is performed before data transmission processing by the first device.   9. The image recording method according to claim 8, wherein the generation of the delayed image data is performed after data transmission processing by the first device.   9. The image recording method according to claim 8, wherein the generation of the delayed image data is performed step by step before the data transmission processing by the first device and after the data transmission processing.   The generation of the delayed image data is performed by writing image data to be subjected to delay processing to a FIFO (First In, First Out) memory and reading the image data from the FIFO memory after the desired time. The image recording method according to claim 8. In either the first device or the second device, the image data is converted into an image size suitable for display on the second device,
13. The image recording method according to claim 8, wherein the delayed image data is generated from the image data subjected to the image size conversion. Image data received from a transmission device that captures and transmits image data displayed on an arbitrary image display device at substantially the same timing as the display timing of the image display device is delayed by a desired time. An image delay unit for generating delayed image data;
An image receiving device comprising: a control unit that records the delayed image data in response to a user command that refers to the delayed image data displayed on an image display unit different from the display unit of the image display device. An image capturing unit that captures image data displayed on an arbitrary image display device at substantially the same timing as the display timing of the image display device;
Generate delayed image data obtained by delaying the image data captured by the image capturing unit by a desired time to display and record on an image receiving device different from the image display device on which the image data is displayed. And an image delay unit.

Images