JP2014050010A - Imaging device having communication device - Google Patents

Abstract

Provided is a communication device capable of performing display that is easier to appreciate.
In order to solve the above problem, an imaging unit that captures a subject image to generate a captured image, and a first resolution having a first resolution and a first frame rate from the generated captured image. And an image generation unit that generates a second image having a second resolution higher than the first resolution and lower than the first frame rate. An electronic apparatus comprising: a communication unit that transmits a first image to an external display device after receiving a first instruction, and then transmits a second image to the external display device.
[Selection] Figure 5

Description

The present invention relates to an imaging device provided with a communication device.

  In recent years, electronic devices equipped with communication functions have become widespread. By providing the communication function, data such as image data can be transmitted to other electronic devices. For example, a device described in Patent Document 1 is known.

JP 2002-354329 A

  A display device can be considered as one of the counterpart devices that transmit image data. The display device can display the received image data on its own display. The larger the display size, the more people can view the received image at the same time. At this time, the inventor recognizes that it is desired to display more easily.

  The present invention has been made in view of the above problems, and provides an imaging device including a communication device that can perform display that is easier to appreciate.

  In order to solve the above-described problem, an imaging unit that captures a subject image to generate a captured image, a first image having a first resolution and a first frame rate from the generated captured image, An image generation unit configured to generate a second image having a second resolution higher than the first resolution and lower than the first frame rate; and a first instruction An electronic apparatus comprising: a communication unit that transmits a first image to the external display device when the image is received, and then transmits a second image to the external display device.

  ADVANTAGE OF THE INVENTION According to this invention, the communication apparatus which can perform the display which is easier to appreciate can be provided.

The block diagram which shows the structure of the digital video camera 100 The block diagram which shows the structure of the display apparatus 200 Display operation flowchart according to the quality of the transferred video Image of display operation according to the quality of the transferred video Flowchart of display when a still image recording instruction is given while transferring a movie Display image when a still image recording instruction is given while transferring a movie

[Embodiment 1]
The digital video camera 100 according to the first embodiment can transmit a moving image or a still image to the display device 200 via the communication unit 171. The display device 200 can display a moving image or a still image received from the digital video camera 100 via the communication unit 211 on the liquid crystal display 215.

  Examples of the image quality of moving images and still images transmitted by the digital video camera 100 include VGA (Video Graphics Array) image quality and HD (High Definition) image quality. HD quality moving images or still images generally have higher image quality than VGA quality moving images or still images.

  It is desirable that the digital video camera 100 transmits HD quality images to an external display device in real time. However, depending on the capability of the image processing unit 122, it may be difficult to process an HD image. At this time, the digital video camera 100 is required for negotiation for communication with the display device 200 and for smoothly reproducing the image on the display device 200 in order to transmit the HD image to the external display device 200. Time is spent on buffering to ensure a minimum amount of data. Since an HD quality image has a higher bit rate than a VGA quality image, a relatively high delay occurs in the bandwidth of the same transmission path.

  The inventor has discovered the problem of delay through trial experiments and the like, and has recognized the problem of performing a display that is easier to appreciate. Hereinafter, configurations and operations of the digital video camera 100 and the display device 200 will be described.

  In the following embodiments, VGA image quality is exemplified as a relatively low image quality but low delay image quality, and HD image quality is exemplified as a relatively high image quality but high delay image quality. However, the technical idea is not limited thereto. Absent. That is, the technical idea can be applied to any electronic device that handles the first image quality with relatively low image quality but low delay and the second image quality with relatively high image quality but high delay.

[1. Constitution〕
Hereinafter, configurations of the digital video camera 100 and the display device 200 will be described with reference to the drawings.

[1-1. Configuration of Digital Video Camera 100]
FIG. 1 is a block diagram showing the configuration of the digital video camera of this embodiment. The digital video camera 100 captures a subject image formed via the optical system 110 with the CMOS image sensor 120. The CMOS image sensor 120 generates image data based on the captured subject image. The image data generated by the imaging is subjected to various processes in an AFE (AFE: Analog Front End) 121 and an image processing unit 122. The image data is stored in the flash memory 142 or the memory card 140. The image data stored in the flash memory 142 or the memory card 140 is displayed on the liquid crystal display 123 in response to an operation of the operation unit 150 by the user. Further, image data captured by the CMOS image sensor 120 and processed by the image processing unit 122 is displayed on the liquid crystal display 123 as a through image.

  The optical system 110 is an optical system including lenses such as a focus lens, a zoom lens, and an optical image stabilization lens OIS (Optical Image Stabilizer). The various lenses constituting the optical system 110 may be composed of any number of lenses or any number of groups.

  The CMOS image sensor 120 captures a subject image formed through the optical system 110 and generates imaging data. The CMOS image sensor 120 generates imaging data of a new frame at a predetermined frame rate (for example, 30 frames / second). The imaging data generation timing and the electronic shutter operation of the CMOS image sensor 120 are controlled by the controller 130. Instead of the CMOS image sensor, other imaging elements such as a CCD image sensor and an NMOS image sensor may be used.

  The AFE 121 performs processing such as correlated double sampling on the imaging data generated by the CMOS image sensor 120. Also, conversion from analog image data to digital image data is performed. Thereafter, the AFE 121 outputs the image data to the image processing unit 122.

  The image processing unit 122 performs various processes on the captured data. Examples of various processing include, but are not limited to, gamma correction, white balance correction, YC conversion processing, electronic zoom processing, compression processing, expansion processing, and the like. The image processing unit 122 generates image data from the captured data by performing various processes. The image processing unit 122 generates image data from the captured data based on the set image quality parameter. When the set image quality parameter indicates the VGA image quality, the image processing unit 122 generates image data from the imaging data based on the image quality parameter indicating the VGA image quality. When the set image quality parameter indicates the HD image quality, the image processing unit 122 generates image data from the imaging data based on the image quality parameter indicating the HD image quality. The image processing unit 122 may be configured with a hard-wired electronic circuit, or may be configured with a microcomputer that executes a program for performing these processes. Further, it may be configured as one integrated circuit together with the controller 150 or the like.

  The liquid crystal display 123 displays an image based on the image data (moving image data or still image data) processed by the image processing unit 122. The images displayed on the liquid crystal display 123 include a through image and a recorded image. The liquid crystal display 170 displays data processed as VGA image quality moving image data by the image processing unit 122 in real time as captured images for the captured images sequentially generated by the CMOS image sensor 120. The user can take a picture while confirming the composition of the subject by referring to the through image displayed on the liquid crystal display 123. The recorded image is an image indicated by image data (moving image data or still image data) recorded in the memory card 140 or the flash memory 142. In addition to the image indicated by the image data, the liquid crystal display 123 is used to operate a screen for changing setting values of the digital video camera 100 and display contents of the display device 200 in a communication state via the communication unit 171. An operation button screen or the like can be displayed. Instead of the liquid crystal display, other displays such as an organic EL display can be applied.

  The touch panel 173 is provided on the surface of the liquid crystal display 170, and outputs information related to electrode positions on the touch panel touched by the user.

  The detection processing unit 177 calculates the position coordinates on the touch panel touched by the user based on the information regarding the electrode position output from the touch panel 173, and outputs the position coordinates to the controller 130. Thereby, the controller 130 can grasp | ascertain the position on the touchscreen 173 which the user is touch-operating.

  The controller 130 controls the overall operation of the digital video camera 100. The controller 130 notifies the control signal to the CMOS image sensor 120, the image processing unit 122, and the like based on the vertical synchronization signal (VD). The controller 130 includes a ROM that stores information such as programs and a CPU that processes information such as programs. The ROM stores a program for controlling the overall operation of the digital video camera 100 in addition to programs related to autofocus control and auto exposure control.

  The controller 130 recognizes where the user touched in the photographing frame displayed on the liquid crystal display 123 from the position coordinate value output by the detection processing unit 177, and performs processing according to the operation. For example, the liquid crystal display 123 displays a screen for changing the setting value of the digital video camera 100 and an operation button screen for operating the display contents of the display device 200 in communication via the communication unit 171. When the user touches, processing is performed to execute the setting or operation corresponding to the touched position. Alternatively, when the liquid crystal display 123 is displaying a through image, processing is performed so that a still image recording instruction is executed after focusing on the image area corresponding to the touched position.

  The controller 130 may be configured with a hard-wired electronic circuit or a microcomputer. Further, it may be configured as one integrated circuit together with the image processing unit 122 and the like.

  The buffer memory 124 is a storage unit that functions as a work memory for the image processing unit 122 and the controller 130. The buffer memory 124 can be realized by a DRAM (Dynamic Random Access Memory) or the like.

  The flash memory 142 functions as an internal memory for storing image data and the like. The controller 130 stores the image data processed by the image processing unit 122 in the flash memory 142 or the memory card 140.

  The card slot 141 is a connection means to which the memory card 140 can be attached. The card slot 141 can connect the memory card 140 electrically and mechanically.

  The memory card 140 is an external memory provided with a storage unit such as a flash memory. The memory card 140 can store data such as image data processed by the image processing unit 122. In the present embodiment, the memory card 140 is shown as an example of the external memory, but a storage medium such as an optical disk or an HDD may be used as the external memory.

  The communication unit 171 is a wireless or wired communication interface, and the controller 130 can control the communication unit 171 to communicate with another electronic device having a communication function such as the display device 200. The communication unit 171 can be realized by, for example, USB, Bluetooth (registered trademark), a wireless LAN, a wired LAN, or the like.

  The operation unit 150 is a general term for operation buttons and operation levers provided on the exterior of the digital video camera 100, and receives an operation by a user. When the operation unit 150 receives an operation by the user, the operation unit 150 notifies the controller 130 of various operation instruction signals.

[1-2. Configuration of Display Device 200]
Next, the configuration of the display device 200 will be described with reference to FIG. FIG. 2 is a block diagram illustrating a configuration of the display device 200.

  The display device 200 includes a communication unit 211, a controller 212, a work memory 213, an HDD 214, a liquid crystal display 215, an operation unit 216, a flash memory 217, and the like.

  The controller 212 is a processing unit that executes processing on the display device 200. The controller 212 is electrically connected to the communication unit 211, work memory 213, HDD 214, liquid crystal display 215, flash memory 215, and operation unit 216. The controller 212 receives user operation information using the operation unit 216. The controller 212 can read information stored in the HDD 214 or the flash memory 217.

  The work memory 213 is a memory that temporarily stores information necessary for the controller 212 to execute various processing operations.

  The HDD 214 is a large-capacity disk drive that stores various data. As described above, various data (image data and the like) stored in the HDD 214 can be read by the controller 212 as appropriate.

  The communication unit 211 is a wireless or wired communication interface, and the controller 212 can communicate with the digital video camera 100 via the communication unit 211. For example, it can be realized by USB, Bluetooth (registered trademark), wireless LAN, wired LAN, or the like.

  The liquid crystal display 215 displays an image based on moving image data or still image data received from the digital video camera 100. The user can confirm the content of the image based on the moving image data or the still image data transmitted from the digital video camera 100 by referring to the image displayed on the liquid crystal display 215. Instead of the liquid crystal display, other displays such as an organic EL display can be applied.

  In the present embodiment, the display apparatus 200 is illustrated as an image transfer destination of the digital video camera 100, but the present invention is not limited to this. For example, a device that projects an image of the digital video camera 100 such as a projector device may be used. Furthermore, it may be a device that stores images of the digital video camera 100 such as a storage device.

  In addition, the digital video camera 100 and the display device, the projector device, and the storage device may establish a direct communication state, or may establish a communication state via a relay device. When communicating via a relay device, the relay device may process the transfer image according to the specifications required by the transfer destination device of the digital video camera 100.

[2. Operation)
Next, operations of the digital video camera 100 and the display device 200 will be described.

  The digital video camera 100 and the display device 200 each have a communication function. Establishment of a communication state between the digital video camera 100 and the display apparatus 200 is performed according to specific implementation means (such as WiFi) of the communication unit 171 and the communication unit 211. When the communication state between the digital video camera 100 and the display device 200 is established, the digital video camera 100 can transfer moving image data and still image data to the display device 200.

  The digital video camera 100 has a shooting mode and a playback mode. In the shooting mode, the digital video camera 100 shoots a subject and displays a through image based on the captured image on the liquid crystal display 123. In the shooting mode, the controller 130 of the digital video camera 100 receives a moving image recording instruction or a still image recording instruction by a touch operation on the touch panel 173 or an operation of the operation unit 150. On the other hand, in the playback mode, the digital video camera 100 reads out the image data recorded on the memory card 140 and displays it on the liquid crystal display 123.

  When the communication state with the display device 200 is established and the image transfer to the display device 200 is permitted in the shooting mode, the image processing unit 122 sets the VGA image quality parameter, and the VGA image quality moving image. Generate data. At this time, the image processing unit 122 generates a through image for displaying the liquid crystal display 123 and moving image data with VGA image quality from the captured data. The controller 130 displays the generated through image on the liquid crystal display 123. At the same time, the controller 130 controls the communication unit 171 to transfer the generated VGA-quality moving image data to the display device 200.

  On the other hand, when an instruction to transfer a higher-definition image to the display device 200 is given in the shooting mode, the image processing unit 122 sets an image quality parameter of HD image quality and outputs the HD image as a transmission image to the display device 200. Generate moving image data of image quality. The instruction to transfer a higher-definition image to the display device 200 is, for example, an instruction given when the viewer wants to observe the image in more detail. This instruction is realized by assigning a function to the operation of the operation unit 150 or the touch panel 173. The controller 130 controls the communication unit 171 to transfer the generated HD image quality moving image data to the display device 200.

  The image processing unit 122 reads moving image data recorded on the memory card 140 in the reproduction mode. At this time, the controller 130 transfers the read moving image data to the display device 200. The image displayed on the liquid crystal display 123 of the digital video camera 100 is changed according to the moving image to be transferred. Hereinafter, the operation steps will be described in order with reference to FIGS. 3 and 4. FIG. 3 is an operation flowchart of display according to the image quality of the transferred moving image.

  The operation from the state in which the digital video camera 100 is in the shooting mode will be described. When the digital video camera 100 is in the shooting mode, the controller 130 of the digital video camera 100 displays a through image on the liquid crystal display 123 (S300). Subsequently, the controller 130 of the digital video camera 100 detects whether or not the shooting mode is switched to the playback mode (S301). Unless switched to the playback mode (No in S301), the controller 130 of the digital video camera 100 displays a through image on the liquid crystal display 123.

  When the mode is switched to the playback mode (Yes in S301), the controller 130 of the digital video camera 100 displays the operation button screen on the liquid crystal display 123 (S302). At this time, the controller 130 of the digital video camera 100 detects whether or not the playback mode is switched to the shooting mode (S303). Unless the mode is switched to the shooting mode (No in S303), the controller 130 of the digital video camera 100 displays the operation button screen on the liquid crystal display 123. When the mode is switched to the shooting mode (Yes in S303), the controller 130 of the digital video camera 100 displays the through image again on the liquid crystal display 123 (S300). Thereafter, the digital video camera 100 repeats the operations from step S300 to step S303.

  Next, images of the screens of the liquid crystal display 123 of the digital video camera 100 and the liquid crystal display 215 of the display device 200 in step S300 and step S302 of the flowchart of FIG. 3 will be described. FIG. 4 is an image diagram of a display operation according to the shooting mode / playback mode.

  FIG. 4A is an image of display contents of the liquid crystal display 123 of the digital video camera 100 and the liquid crystal display 215 of the display device 200 in the shooting mode. As shown in FIG. 4A, in the shooting mode, the difference in display contents between the liquid crystal display 123 of the digital video camera 100 and the liquid crystal display 215 of the display device 200 (difference due to transfer delay) is relatively small. Therefore, the through image is displayed on the liquid crystal display 123. Thus, the user can check the moving image being transferred from the digital video camera 100 to the display device 200 on both the liquid crystal display 123 of the digital video camera 100 and the liquid crystal display 215 of the display device 200.

  FIG. 4B is an image of display contents on the liquid crystal display 123 of the digital video camera 100 and the liquid crystal display 215 of the display device 200 in the playback mode. In the playback mode, the difference in display contents between the liquid crystal display 123 of the digital video camera 100 and the liquid crystal display 215 of the display device 200 (difference due to transfer delay) is relatively large. If this is the case, the user of the digital video camera 100 and the viewer of the display device 200 will see moving images at different timings. For this reason, there is a risk that the content of the topic will be different between the user of the digital video camera 100 and the viewer of the display device 200. In particular, when the user of the digital video camera 100 and the viewer of the display device 200 are in the same room such as a school classroom, this problem becomes significant. Therefore, an operation button screen is displayed on the liquid crystal display 123 of the digital video camera 100 as shown in FIG. As a result, the line of sight of all the viewers including the user can be integrated into the display content of the display device 200. For the purpose of consolidating the gazes of all viewers, nothing may be displayed on the liquid crystal display 123 of the digital video camera 100, but the control of the moving image displayed on the display device 200 is displayed by displaying the operation button screen. (Pause, 30-second swingback, etc.) can be performed on the digital video camera 100 side. Thereby, the viewer can enjoy watching moving images more comfortably.

  The digital video camera 100 receives an instruction from a user to transfer a higher-definition image to the display device 200 when a moving image is displayed on the liquid crystal display 123. The user can give the instruction by a touch operation on the touch panel 173 or an operation of the operation unit 150. When the controller 130 of the digital video camera 100 receives the instruction, the controller 130 switches from VGA quality moving image transfer to HD quality moving image transfer. However, in order to transfer a higher definition image to the display device 200, the frame rate is reduced. For example, switching from VGA 30 fps moving image transfer to HD 1 fps moving image transfer is performed.

  For viewers, when the frame rate is relatively high, the low image quality is relatively unnoticeable, but when the frame rate is relatively low and very close to a still image, the moving image is compared to the low image quality. I am interested. For this reason, the digital video camera 100 transfers a high-definition moving image so that a higher-definition still image can be viewed even when a VGA-quality moving image is transferred to the display device 200. . Hereinafter, with reference to FIG. 5 and FIG. 6, an operation when receiving an instruction from a user who transfers a higher-definition image to the display device 200 while displaying a through image on the liquid crystal display 123 will be described. The steps will be described in order.

  FIG. 5 is an operation flowchart of display when an instruction from the user who transfers a higher-definition image to the display device 200 is given. FIG. 6 is a display image diagram in a case where an instruction from the user who transfers a higher-definition image to the display device 200 is given.

  Assume that the controller 130 of the digital video camera 100 transfers VGA 30 fps moving image data to the display device 200 (S400: see FIG. 6A). Upon receiving the VGA 30 fps moving image data from the digital video camera 100, the display device 200 displays the moving image indicated by the VGA 30 fps moving image data on the liquid crystal display 215 (S401: see FIG. 6A).

  The controller 130 of the digital video camera 100 accepts an instruction from the user who transfers a higher definition image to the display device 200 when transferring the moving image data of VGA 30 fps to the display device 200 (S402: FIG. 6 ( See B)). When the instruction is received, the controller 130 instructs the image processing unit 122 to perform HD1 fps moving image generation processing on the captured image.

  When the HD 1 fps moving image is generated, the controller 130 of the digital video camera 100 transfers the generated HD 1 fps moving image to the display device 200 (S403: see FIG. 6B). Upon receiving the HD 1 fps moving image from the digital video camera 100, the display device 200 replaces the display on the liquid crystal display 215 from the VGA 30 fps moving image to the HD 1 fps moving image (S404: see FIG. 6B).

  After switching to the HD 1 fps moving image, as illustrated in FIG. 6C, “drawing” can be performed by a touch operation on the touch panel 173. The content that the user “draws” is superimposed on the HD 1 fps moving image and transferred to the display device 200. Then, the display device 200 displays the HD 1 fps moving image on which the content of “drawing” is superimposed on the liquid crystal display 215. In the case of “drawing”, it is necessary to update the state of the drawing operation by the user. Therefore, the digital video camera 100 transfers the HD 1 fps moving image to the liquid crystal display 215. When “drawing” is not performed, there is no need to update, so it may be an HD still image instead of an HD 1 fps moving image.

  As described above, the digital video camera 100 includes the liquid crystal display 123, the communication unit 171 capable of transmitting a moving image to the display device 200, and a VGA-quality moving image (first delay is transmitted to the display device 200). When the first image generated) is transmitted to the display device 200, the liquid crystal display 123 is controlled to display a through image, whereas when transmitted to the display device 200, the delay is higher than that of the VGA image quality moving image. And a controller 130 that controls the liquid crystal display 123 so as not to display a moving image of HD image quality when the moving image is transmitted to the display device 200. As a result, the line of sight of all the viewers including the user can be integrated into the display content of the display device 200.

  Further, the liquid crystal display 123 of the digital video camera 100 displays an operation button screen without displaying a through image when transmitting a high-definition moving image having a higher delay than a moving image having a VGA image quality to the display device 200. The liquid crystal display 123 is controlled to do so. By displaying the operation button screen, control of the moving image displayed on the display device 200 (pause, swing back for 30 seconds, etc.) can be performed on the digital video camera 100 side. Thereby, the viewer can enjoy watching moving images more comfortably.

  Further, the digital video camera 100 captures a subject image and generates image data, and a VGA 30 fps moving image (first resolution and first frame rate) from the generated image data. And a second image having a second frame rate that is lower than the first frame rate and is a HD1 fps moving image (second resolution higher than the first resolution). ) And an instruction from a user who transfers a higher-definition image to the display device 200, after transmitting a VGA 30 fps moving image to the display device 200, HD1fps And a communication unit 171 that transmits the moving image to the display device 200. As a result, a high-definition moving image can be viewed.

  At this time, after receiving the VGA 30 fps moving image on the liquid crystal display 123, the display device 200 displays the VGA 30 fps moving image on the liquid crystal display 123 when receiving the liquid crystal display 123, the communication unit 211 that can receive an image from the digital video camera 100. Subsequently, a controller 212 is provided for switching the display on the liquid crystal display 123 from the VGA 30 fps moving image to the HD 1 fps moving image when the HD 1 fps moving image is received. As a result, a high-definition moving image can be viewed.

  In the above description, the case where the display on the liquid crystal display 123 is replaced from the VGA 30 fps moving image to the HD 1 fps moving image may be replaced by the HD 1 fps moving image to the VGA 30 fps moving image. Thereby, it is possible to easily switch from appreciation of a high-definition moving image to appreciation of another subject.

  The present invention is not limited to implementation on the digital video camera 100 or the display device 310. In other words, the present invention can be applied to a communication device including a communication unit such as a movie camera or a smartphone.

DESCRIPTION OF SYMBOLS 100 ... Digital video camera 123 ... Liquid crystal display 130 ... Controller 140 ... Memory card 142 ... Flash memory 150 ... Operation part 171 ... Communication part 200 ... Display apparatus 211 ... Communication part 212 ... Controller 214 ... HDD
215 ... Liquid crystal display 216 ... Operation unit

Claims (4)

An imaging unit that captures a subject image and generates a captured image;
From the generated captured image, a first image having a first resolution and a first frame rate, and a second resolution having a higher resolution than the first resolution, the first frame An image generation unit that generates a second image having a second frame rate lower than the rate;
An electronic apparatus comprising: a communication unit that transmits a first image to an external display device after receiving a first instruction, and then transmits a second image to the external display device. The external display device
A display unit;
A communication unit capable of receiving an image from the electronic device;
When the first image is received, the first image is displayed on the display unit, and then when the second image is received, the display on the display unit is displayed on the first image. A control unit for replacing the second image with the second image;
The electronic device according to claim 1, comprising: The communication unit is
When the second instruction is received, the second image is transmitted to the external display device, and then the first image is transmitted to the external display device.
The electronic device according to claim 1. In the external display device, the controller is
A display unit;
A communication unit capable of receiving an image from the electronic device;
When the second image is received, the second image is displayed on the display unit, and subsequently, when the first image is received, the display on the display unit is displayed on the second image. To the first image,
The electronic device according to claim 3.