[go: up one dir, main page]

WO2018100614A1 - Procédé de transmission d'informations et système de caméra embarquée - Google Patents

Procédé de transmission d'informations et système de caméra embarquée Download PDF

Info

Publication number
WO2018100614A1
WO2018100614A1 PCT/JP2016/085330 JP2016085330W WO2018100614A1 WO 2018100614 A1 WO2018100614 A1 WO 2018100614A1 JP 2016085330 W JP2016085330 W JP 2016085330W WO 2018100614 A1 WO2018100614 A1 WO 2018100614A1
Authority
WO
WIPO (PCT)
Prior art keywords
transmission
information
display device
control unit
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2016/085330
Other languages
English (en)
Japanese (ja)
Inventor
康明 瀧本
武史 三井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Priority to PCT/JP2016/085330 priority Critical patent/WO2018100614A1/fr
Publication of WO2018100614A1 publication Critical patent/WO2018100614A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/387—Composing, repositioning or otherwise geometrically modifying originals

Definitions

  • the present invention relates to an information transmission method using an imaging device and an in-vehicle camera system.
  • Patent Document 1 describes that a mobile terminal sequentially reads a plurality of two-dimensional codes printed on paper, restores the read two-dimensional codes into program data, and updates the operating system of the mobile terminal. Yes.
  • Patent Document 1 Since the invention according to Patent Document 1 uses a two-dimensional code printed on paper, the data capacity included in the two-dimensional code cannot be increased according to the performance of the portable terminal, and the portable terminal can be surely provided with a margin. Only the amount of data that can be read could be included in the two-dimensional code. For this reason, there is a problem that the data capacity per two-dimensional code cannot be increased and the transmission speed cannot be increased.
  • This invention has been made to solve the above-described problems, and aims to increase the transmission speed.
  • the imaging device and the display device transmit and receive the setting information via a communication path connecting the imaging device and the display device, and the display device sets based on the setting information.
  • the data capacity included in one image can be increased by adjusting the imaging device and the display device by sending and receiving the setting information via the communication path, and the transmission speed can be increased.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIG. 3A shows a display apparatus
  • FIG. 3B shows an imaging device.
  • FIGS. 7A to 7D are diagrams showing correspondence tables between transmission luminance and reception luminance. It is a flowchart which shows the detail of step ST20 of FIG. It is a flowchart which shows the detail of step ST30 of FIG. It is a figure which shows the correspondence table of transmission brightness
  • FIG. 1 is a diagram showing an outline of an in-vehicle camera system according to Embodiment 1 of the present invention.
  • the in-vehicle camera system according to Embodiment 1 includes a display device 10, an imaging device 20, a communication path 30, an in-vehicle device 40, a fixture 50, and an optical device 60.
  • the imaging device 20 includes an imaging unit such as a digital camera and is mounted on a vehicle.
  • the imaging device 20 is, for example, an image processing device with a camera for detecting a driver's line of sight or detecting a road lane.
  • the imaging device 20 and the in-vehicle device 40 are connected by a communication path 30 such as a CAN (Controller Area Network).
  • the imaging device 20 transmits the line-of-sight detection result or the lane detection result to the in-vehicle device 40 through the communication path 30.
  • the in-vehicle device 40 operates using the line-of-sight detection result or the lane detection result.
  • the in-vehicle camera system according to Embodiment 1 will be described using an example in which the image processing program of the imaging device 20 is updated to improve the gaze detection accuracy or the lane detection accuracy.
  • the display device 10 displays images such as a two-dimensional code one after another, and the imaging device 20 sequentially captures the displayed images, thereby transmitting a large amount of data at high speed.
  • the display device 10 includes a display unit such as a liquid crystal display.
  • the display device 10 is arranged so that the display unit faces the imaging unit of the imaging device 20, and is fixed to the imaging device 20 by a simple fixing tool 50 such as a hook or a suction cup. Is done.
  • An optical device 60 such as a lens may be installed between the display device 10 and the imaging device 20.
  • the installation method of the optical apparatus 60 is not ask
  • the optical device 60 may be fixed between the display device 10 and the imaging device 20 by a fixture (not shown), may be fixed by the fixture 50, or is fixed to the display device 10 in advance. May be.
  • the display device 10 is connected to the communication path 30, and the display device 10 and the imaging device 20 can communicate with each other via the communication path 30.
  • FIG. 2 is a block diagram showing a configuration example of the in-vehicle camera system according to Embodiment 1 of the present invention.
  • the display device 10 includes a communication unit 11, an input unit 12, a transmission / reception control unit 13, a transmission control unit 14, a transmission information storage unit 15, a display control unit 16, and a display unit 17.
  • the imaging device 20 includes a communication unit 21, a reception control unit 22, a reception information storage unit 23, an imaging unit 24, and an image analysis unit 25.
  • illustration is abbreviate
  • FIG. 3 is a hardware configuration diagram of the in-vehicle camera system according to the first embodiment of the present invention.
  • FIG. 3A shows the display device 10
  • FIG. 3B shows the imaging device 20.
  • the display unit 17 in the display device 10 is a display 101.
  • the communication unit 11 in the display device 10 is a communication device 102 that communicates using CAN or the like.
  • the input unit 12 in the display device 10 is an input device 105 such as a switch or a touch panel.
  • the transmission information storage unit 15 in the display device 10 is a memory 104.
  • Each function of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16 in the display device 10 is a processor 103 that executes a program stored in the memory 104.
  • Each function of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16 is realized by software.
  • the software is described as a program and stored in the memory 104.
  • the processor 103 reads out and executes the program stored in the memory 104, thereby realizing the functions of the respective units. That is, the display device 10 includes a memory 104 for storing a program that, when executed by the processor 103, results in the steps shown in the flowchart of FIG. It can also be said that this program causes a computer to execute the procedure or method of the transmission / reception control unit 13, the transmission control unit 14, and the display control unit 16.
  • the imaging unit 24 in the imaging device 20 is a camera 201.
  • the communication unit 21 in the imaging device 20 is a communication device 202 that communicates using CAN or the like.
  • the reception information storage unit 23 in the imaging device 20 is a memory 204.
  • the reception control unit 22 and the image analysis unit 25 in the imaging device 20 are a processor 203 that executes a program stored in the memory 204.
  • Each function of the reception control unit 22 and the image analysis unit 25 is realized by software.
  • the software is described as a program and stored in the memory 204.
  • the processor 203 reads out and executes the program stored in the memory 204, thereby realizing the functions of the respective units.
  • the imaging apparatus 20 includes a memory 204 for storing a program that, when executed by the processor 203, results in the steps shown in the flowchart of FIG. It can also be said that this program causes a computer to execute the procedures or methods of the reception control unit 22 and the image analysis unit 25.
  • a function for detecting the driver's line of sight or detecting a road lane is also realized by software.
  • the software is described as an image processing program and stored in the memory 204.
  • the processor 203 reads and executes an image processing program stored in the memory 204, thereby realizing a function for detecting the driver's line of sight or detecting a road lane.
  • the in-vehicle camera system according to Embodiment 1 updates this image processing program.
  • the processors 103 and 203 are a CPU (Central Processing Unit), a processing device, an arithmetic device, a microprocessor, a microcomputer, or the like.
  • the memories 104 and 204 may be a RAM (Random Access Memory), a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), or a nonvolatile or volatile semiconductor memory such as a flash memory, or a hard disk or the like. There may be.
  • FIG. 4 is a flowchart showing an information transmission method by the in-vehicle camera system according to Embodiment 1 of the present invention.
  • the input unit 12 instructs the transmission / reception control unit 13 to start processing.
  • the display device 10 and the imaging device 20 execute the processing shown in the flowchart of FIG.
  • step ST1 the display device 10 and the imaging device 20 transmit / receive setting information via the communication path 30 having a low transmission speed.
  • the input unit 12 receives a user operation instruction and instructs the transmission / reception control unit 13 to start processing.
  • the transmission / reception control unit 13 controls the transmission control unit 14 and the reception control unit 22 through the communication units 11 and 21 in order to transmit the information held by the transmission information storage unit 15 to the reception information storage unit 23 of the imaging device 20.
  • the transmission / reception control unit 13 Upon receiving an instruction to start processing from the input unit 12, the transmission / reception control unit 13 first sets the transmission control unit 14 and the reception control unit 22 in a transmission / reception preparation state, and performs negotiation for determining the specifications for image generation. Start.
  • the transmission / reception control unit 13 compares the image displayed on the display unit 17 by the transmission control unit 14 via the display control unit 16 with the feature information obtained from the reception control unit 22, and then the next image is displayed. The process of displaying and comparing is repeated, and specifications relating to image display and imaging are determined.
  • the specifications and feature information are setting information.
  • the transmission / reception control unit 13 When the transmission / reception control unit 13 is in a transmission / reception preparation state, the positional relationship between the display unit 17 and the imaging unit 24, the relationship between the brightness displayed by the display unit 17 and the brightness received by the imaging unit 24, and the imaging from the display unit 17.
  • An image for examining the maximum resolution that can be transmitted to the unit 24 is generated and provided to the display control unit 16.
  • the display control unit 16 gives the image received from the transmission control unit 14 to the display unit 17 for display.
  • the display unit 17 displays the image received from the display control unit 16.
  • the imaging unit 24 captures an image displayed on the display unit 17 in accordance with an instruction from the reception control unit 22, converts the image into image data, and supplies the image data to the image analysis unit 25.
  • the image analysis unit 25 extracts feature information in the image from the image data received from the imaging unit 24 and provides the feature information to the reception control unit 22.
  • the reception control unit 22 gives the feature information received from the image analysis unit 25 to the transmission / reception control unit 13 through the communication units 21 and 11.
  • the display device 10 converts transmission information having a capacity larger than the capacity of the setting information into an image based on the setting information and displays the image.
  • the transmission information is the above-described image processing program. If the capacity of transmission information is larger than the capacity per image determined as specifications, the transmission information is converted into a plurality of images.
  • the transmission control unit 14 acquires transmission information from the transmission information storage unit 15, converts it into an image according to specifications, and provides the image to the display control unit 16.
  • the display control unit 16 gives the image received from the transmission control unit 14 to the display unit 17 for display.
  • the display unit 17 displays the image received from the display control unit 16.
  • the imaging device 20 captures an image displayed by the display device 10 based on the setting information and restores it to transmission information.
  • the imaging unit 24 captures an image displayed on the display unit 17, converts the image into image data, and provides the image data to the image analysis unit 25.
  • the image analysis unit 25 restores the image data received from the imaging unit 24 to transmission information according to the specifications, and provides the transmission information to the reception control unit 22.
  • the reception control unit 22 gives the transmission information received from the image analysis unit 25 to the reception information storage unit 23 for storage.
  • the display device 10 and the imaging device 20 transmit a plurality of images by repeating step ST2 and step ST3 a plurality of times according to the specifications.
  • FIG. 5 is a flowchart showing details of step ST1 of FIG.
  • the transmission / reception preparation state in step ST1 includes brightness adjustment in step ST10, image display range adjustment in step ST20, image gradation adjustment in step ST30, image resolution adjustment in step ST40, and response speed adjustment in step ST50.
  • the instructions given to the display device 10 and the imaging device 20 by the transmission / reception control unit 13 via the communication path 30 in steps ST10 to ST50 are setting information.
  • the order in which steps ST10 to ST50 are executed is not limited to the order shown in FIG.
  • FIG. 6 is a flowchart showing details of step ST10 of FIG.
  • the transmission / reception control unit 13 controls the imaging unit 24 through the communication units 11 and 21 and the reception control unit 22, and sets a shutter speed, an aperture, an ND (Neutral Density) filter, and the like to predetermined values.
  • the predetermined value is assumed to be given to the transmission / reception control unit 13 in advance.
  • the transmission / reception control unit 13 displays a specific luminance on the entire display screen of the display unit 17 through the communication unit 11, the transmission control unit 14, and the display control unit 16, and sequentially changes the luminance.
  • the transmission / reception control unit 13 causes the imaging unit 24 to capture images for each luminance through the communication units 11 and 21 and the reception control unit 22, and the image analysis unit 25 has predetermined pixels (for example, a pixel at the center of the screen) in the image.
  • the received luminance is acquired and transmitted to the transmission / reception control unit 13 as feature information.
  • the transmission / reception control unit 13 creates a correspondence table between the transmission luminance displayed by the display unit 17 and the reception luminance captured by the imaging unit 24.
  • 7A to 7D are diagrams showing correspondence tables between transmission luminance and reception luminance.
  • the transmission / reception control unit 13 includes a predetermined number or more (for example, 10% or more) of transmission luminance samples within a predetermined range (for example, within 5%) from the lowest value of the reception luminance in the created correspondence table. If included, it is detected as lower saturation. In the case of the correspondence table as shown in FIG. 7A, since 10% or more of the transmission luminance samples are included within 5% from the lowest value of the reception luminance, it is detected as lower saturation. Similarly, the transmission / reception control unit 13 detects upper side saturation on the maximum value side of the reception luminance. In the case of the correspondence table as shown in FIG. 7B, since 10% or more of transmission luminance samples are included within 5% from the maximum value of the reception luminance, upper saturation is detected.
  • step ST14 the transmission / reception control unit 13 ends the brightness adjustment when the upper saturation and the lower saturation are not detected as shown in FIG. 7C, for example (step ST14 “YES”). Further, even if both the upper saturation and the lower saturation are detected, the transmission / reception control unit 13 has the same upper and lower saturations as shown in FIG. 7D (step ST14 “YES”). End brightness adjustment.
  • the transmission / reception control unit 13 detects upper saturation or lower saturation as shown in FIG. 7A or 7B, for example, or when the degree of saturation is different between the upper side and the lower side (step ST14 “NO”), the step Proceed to ST15.
  • step ST15 the transmission / reception control unit 13 decreases the sensitivity on the reception side when only the upper saturation is present or when the upper saturation is larger than the lower saturation.
  • the transmission / reception control unit 13 increases the sensitivity on the reception side when there is only lower saturation or when the lower saturation is larger than the upper saturation.
  • the sensitivity on the reception side can be adjusted by, for example, the ND filter of the imaging unit 24.
  • the transmission / reception control part 13 returns to step ST11 again, and controls the imaging part 24 based on the reception sensitivity corrected by step ST15.
  • the transmission / reception control unit 13 may lower the luminance standard on the transmission side when only the upper saturation is present or when the upper saturation is larger than the lower saturation. Further, the transmission / reception control unit 13 may increase the luminance standard on the transmission side when only the lower saturation is present or when the lower saturation is greater than the upper saturation.
  • the luminance reference on the transmission side can be adjusted by, for example, the backlight of the display unit 17 or the like.
  • FIG. 8 is a flowchart showing details of step ST20 in FIG.
  • the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, and causes the display unit 17 to display an image for specifying the position.
  • One or more feature points that can be extracted by image processing are included in the position specifying image.
  • the transmission / reception control unit 13 has a list of feature points and their transmission positions.
  • the position specifying image is, for example, a checkered flag image.
  • step ST22 the display screen of the display unit 17 is imaged by the imaging unit 24 and converted into image data, and the image analysis unit 25 performs image processing on the image data to extract the reception position of the feature point.
  • the image analysis unit 25 gives the feature point and its reception position as feature information to the transmission / reception control unit 13 through the reception control unit 22 and the communication units 21 and 11.
  • the transmission / reception control unit 13 compares the feature points and their transmission positions with the feature points that are feature information and the reception positions, and associates the feature points with each other. A discrete positional relationship of reception positions is obtained. And the transmission / reception control part 13 estimates the parameter of the conversion type showing the transmission / reception positional relationship in the whole display screen using the obtained discrete transmission / reception positional relationship. For example, assuming that the transmission position and the reception position are in a projective transformation relationship, the transmission / reception control unit 13 estimates the projection matrix by the method of least squares. Further, when lens distortion becomes a problem, the transmission / reception control unit 13 may use a positional relationship conversion formula including a lens distortion coefficient, such as a camera parameter in the Tsai method.
  • step ST24 when there is a feature point for which the reception position cannot be extracted (step ST24 “NO”), the transmission / reception control unit 13 proceeds to step ST25. Or the transmission / reception control part 13 progresses to step ST25, when the number of feature point samples sufficient to estimate the parameter of the conversion formula showing transmission / reception positional relationship cannot be extracted (step ST24 “NO”). In other cases (step ST24 “YES”), the transmission / reception control unit 13 ends the image display range adjustment.
  • step ST25 the transmission / reception control unit 13 moves the transmission position of the feature point for which the reception position could not be extracted to the inside of the display screen, or reduces the position specifying image. Or the transmission / reception control part 13 moves the transmission position of a feature point, when the feature point sample number enough to estimate the parameter of the transformation formula showing transmission / reception position relationship cannot be extracted. Then, the transmission / reception control unit 13 returns to step ST21 again and causes the display unit 17 to display the position specifying image corrected in step ST25.
  • the relationship between the transmission position and the reception position is obtained, and the imaging range, that is, the part displayed on the display unit 17 and imaged by the imaging unit 24 is also known.
  • the transmission / reception control unit 13 sets the imaging range as the transmission range, and does not use it outside the transmission range in future processing. Thereby, the largest transmission image size according to the performance of the display device 10 and the imaging device 20 can be determined.
  • FIG. 9 is a flowchart showing details of step ST30 in FIG. This is a process for correcting brightness unevenness due to a lens and an imaging angle.
  • the transmission / reception control unit 13 sequentially changes the luminance of the display unit 17 as in step ST12 of FIG. 6, and acquires the reception luminance for each transmission position.
  • the entire display screen of the display unit 17 is divided into a lattice shape, and a transmission / reception luminance relationship is obtained for each lattice.
  • a grid composed of a plurality of pixels is referred to as a block.
  • step ST32 the transmission / reception control unit 13 divides the relationship between the transmission luminance and the reception luminance obtained for each block with reference to the reception luminance, and assigns a representative transmission luminance to each.
  • FIG. 10 is a diagram showing a correspondence table between transmission luminance and reception luminance. In the example of FIG. 10, the range from the lowest received luminance value 10 to the highest value 70 is equally divided by ten. Then, a transmission luminance range is obtained for each divided reception luminance range, and the respective centers are set as representative transmission luminances 13, 33, 46, 56, 65, 78.
  • FIG. 11 is a flowchart showing details of step ST40 in FIG.
  • the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, and causes the display unit 17 to display an image for resolution adjustment.
  • the resolution adjustment image is for displaying the representative transmission luminance for each block on the transmission side.
  • step ST42 the image capturing unit 24 captures the display screen of the display unit 17 into image data, and the image analysis unit 25 performs image processing on the image data, and transmits the received luminance to the transmission / reception control unit 13 as feature information.
  • the transmission / reception control unit 13 extracts reception luminance corresponding to the representative transmission luminance for each block in the resolution adjustment image based on the feature information.
  • the transmission / reception control unit 13 determines, for each block, whether or not the representative transmission luminance matches the corresponding reception luminance. However, if the representative transmission luminance differs between a plurality of consecutive blocks, the reception luminance is mixed with the representative transmission luminance of those blocks, and the representative transmission luminance and the corresponding reception luminance do not completely match. Therefore, the transmission / reception control unit 13 may determine that they match when the difference between the representative transmission luminance and the reception luminance is within a preset allowable range.
  • step ST44 the transmission / reception control unit 13 has a predetermined ratio (for example, 90% or more) of the block in which the representative transmission luminance and the reception luminance match with respect to all the blocks of the resolution adjustment image (for example, 90% or more).
  • step ST44 “YES”) the image resolution adjustment is terminated.
  • step ST44 “NO”) the transmission / reception control unit 13 proceeds to step ST45. For example, if the image is divided into 10 blocks, the image resolution adjustment ends if there are 9 or more blocks whose representative transmission brightness and reception brightness match. Note that, in order to correct transmission information in a receiving state, which will be described later, the block matching ratio need not be 100%.
  • step ST45 the transmission / reception control unit 13 reduces the number of blocks included in the resolution adjustment image by lowering the resolution of the resolution adjustment image, that is, by increasing the number of pixels included in one block. Then, the transmission / reception control unit 13 returns to step ST41 again and causes the display unit 17 to display the resolution adjustment image corrected in step ST45. Thereby, the highest resolution according to the performance of the display device 10 and the imaging device 20 can be determined.
  • FIG. 12 is a flowchart showing details of step ST50 in FIG.
  • the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, displays an image for adjusting the response speed on the display unit 17, and acquires the reception luminance.
  • step ST52 the transmission / reception control unit 13 controls the display control unit 16 through the communication unit 11 and the transmission control unit 14, displays a response speed adjustment image different from that in step ST51 on the display unit 17, and sets the reception luminance. get.
  • the response speed adjustment image is an image having a predetermined representative transmission luminance.
  • the transmission / reception control unit 13 displays a white color image
  • step ST52 displays a black color image.
  • step ST53 the transmission / reception controller 13 changes the reception luminance corresponding to the representative transmission luminance of the response speed adjustment image in step ST52 from the reception luminance corresponding to the representative transmission luminance of the response speed adjustment image in step ST51. Is measured as a response speed, and the measured time interval is defined as a transmission cycle. Thereby, the shortest transmission cycle according to the performance of the display device 10 and the imaging device 20 can be determined.
  • the transmission / reception control unit 13 obtains specifications including the transmission / reception position correspondence and the transmission range, the transmission / reception luminance correspondence and the representative transmission luminance, the transmission resolution, and the transmission cycle in the transmission / reception ready state. After that, the transmission / reception control unit 13 sets the transmission control unit 14 to the transmission state and the reception control unit 22 to the reception state through the communication units 11 and 21, and transmits and receives transmission information according to the determined specifications. Further, the transmission / reception control unit 13 gives an instruction to switch the image to be displayed on the display unit 17 to the next image to the display control unit 16 through the communication unit 11 and the transmission control unit 14 according to the transmission cycle. This instruction is setting information. Further, the transmission / reception control unit 13 instructs the reception control unit 22 through the communication units 11 and 21 according to the transmission cycle to the timing for causing the imaging unit 24 to capture an image. This instruction is also setting information.
  • the transmission control unit 14 When in the transmission state of step ST2, the transmission control unit 14 obtains the number N of data used for transmission from the transmission range and the transmission resolution. The number of data N corresponds to the number of blocks. Also, the transmission control unit 14 assigns a code value for each divided representative transmission luminance, with the division number M when the transmission luminance is divided into the representative transmission luminance. For example, in the example of FIG. 10, one code value is assigned to the representative transmission luminance 13 corresponding to the range of the reception luminances 0 to 10. The transmission control unit 14 has a list of representative transmission luminances and their code values in advance. This list is transmitted as setting information to the image analysis unit 25 through the communication units 11 and 21 and the reception control unit 22.
  • an M-digit N-digit code value can be included in one transmission image. This is expressed in binary, a log 2 M N bits.
  • control information such as a sequence number indicating the current image number, and transmission information and an error correction code of the control information are included in this bit string. Include. Therefore, the capacity of transmission information included in one transmission image is smaller than log 2 MN bits.
  • the transmission control unit 14 acquires transmission information from the transmission information storage unit 15, divides the acquired transmission information into a capacity smaller than log 2 MN bits, and makes one or more pieces of divided transmission information. Then, the transmission control unit 14 adds control information and an error correction code to each divided transmission information.
  • FIG. 13 is a diagram showing an example of transmission information converted into one transmission image in the first embodiment of the present invention.
  • the transmission information 70 converted into one transmission image includes control information 71, one piece of transmission information 72, and an error correction code 73.
  • the capacity of this transmission information 70 is log 2 MN bits.
  • the transmission control unit 14 converts the transmission information 70 into an M-ary N-digit code value, determines a representative transmission luminance corresponding to the code value for each digit, and generates one transmission image.
  • FIG. 14 is a diagram showing an example of a transmission image 80 according to Embodiment 1 of the present invention.
  • One transmission image 80 is divided into N blocks 81, and one block 81 is assigned a luminance of one of the M gradations.
  • the transmission control unit 14 sequentially provides the generated transmission images to the display control unit 16 according to the instruction timing from the transmission / reception control unit 13 through the communication unit 11.
  • the display control unit 16 causes the display unit 17 to sequentially display the transmission images from the transmission control unit 14.
  • the imaging unit 24 captures the transmission image displayed on the display unit 17 in accordance with the instruction timing from the transmission / reception control unit 13 through the communication units 11 and 21 and the reception control unit 22.
  • the data is converted into data and given to the image analysis unit 25.
  • the image analysis unit 25 extracts the reception luminance from each reception position corresponding to each block of the transmission image, and obtains a code value assigned to the representative transmission luminance corresponding to the reception luminance. Note that the image analysis unit 25 may obtain the code value assigned to the representative transmission luminance using the list of the representative transmission luminance and its code value. In the example of FIG. 10, when the reception luminance extracted by the image analysis unit 25 is 35, the code value assigned to the representative transmission luminance 46 corresponding to the reception luminances 30 to 40 including the reception luminance 35 is acquired.
  • the image analysis unit 25 converts the code value N digits obtained from one transmission image into a binary number, performs error correction, and restores the control information and the divided transmission information. At this time, the image analysis unit 25 also performs error detection and error correction using an error correction code.
  • the reception control unit 22 When no error is detected by the image analysis unit 25 or when an error is detected and corrected, the reception control unit 22 stores the restored divided transmission information in the storage destination corresponding to the control information in the reception information storage unit 23. Write. On the other hand, when an error is detected by the image analysis unit 25 but cannot be corrected, that is, when the information amount of the error correction code is insufficient and the correction capability is low, the reception control unit 22 transmits the transmission control unit through the communication units 21 and 11. 14 is requested to retransmit the transmission image.
  • the input unit 12 exists in the display device 10, but may exist in the imaging device 20 or the in-vehicle device 40 connected via the communication path 30.
  • the transmission / reception control unit 13 that controls the entire in-vehicle camera system exists in the display device 10, but may exist in the imaging device 20 or the in-vehicle device 40 connected through the communication path 30.
  • the input unit 12 and the transmission / reception control unit 13 only need to be able to communicate with the display device 10 and the imaging device 20 via the communication path 30.
  • the imaging device 20 and the display device 10 transmit and receive setting information via the communication path 30 that connects the imaging device 20 and the display device 10.
  • the display device 10 converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on the setting information and displays the information, and the imaging device 20 displays the display device based on the setting information. And capturing one or more images displayed by 10 and restoring them to transmission information.
  • one of the imaging device 20 or the display device 10 includes the transmission / reception control unit 13. And in step ST1 which transmits / receives setting information via the communication path 30, the transmission / reception control part 13 adjusts setting information based on the image for position specification etc. which were imaged, etc., to the imaging device 20 or the display apparatus 10.
  • the transmission / reception control unit 13 transmits setting information to the display device 10, the display device 10 displays an image based on the setting information transmitted by the transmission / reception control unit 13, and the imaging device 20 An image displayed by the display device 10 is captured to generate feature information and transmitted to the transmission / reception control unit 13, and the transmission / reception control unit 13 has no adjustment based on the feature information of the image transmitted by the imaging device 20.
  • the setting information is adjusted and transmitted to the imaging device 20 or the display device 10.
  • the imaging device 20 and the display device 10 negotiate through the communication path 30, the settings of the imaging device 20 and the display device 10 can be automated. Therefore, it is easy to install the display device 10 when updating the image processing program.
  • the setting information instructs the display device 10 to switch the display to the next image in step ST2. Accordingly, a plurality of images can be transmitted without changing the positions of the display device 10 and the imaging device 20, and the transmission time interval can be shortened.
  • the transmission time interval is long.
  • the setting information is at least one of the range for displaying the image, the brightness, the resolution, the gradation, or the cycle for switching the image display on the display device 10 in step ST1.
  • One is instructed.
  • the negotiation can be automatically performed through the communication path 30, and the installation of the display device 10 when the image processing program is updated is easy.
  • the in-vehicle camera system includes a display device 10 and an imaging device 20 mounted on the vehicle.
  • the display device 10 converts transmission information having a capacity larger than the capacity of the setting information into one or more images based on the setting information transmitted / received via the communication path 30 connecting the imaging device 20 and the display device 10. And display.
  • the imaging device 20 captures one or more images displayed by the display device 10 based on the setting information transmitted / received via the communication path 30, and restores the transmission information. With this configuration, it is possible to increase the data capacity included in one image by transmitting / receiving setting information via the communication path 30 and increase the transmission speed.
  • the in-vehicle camera system according to Embodiment 1 may be configured to include the optical device 60 that shortens the distance between the imaging device 20 and the display device 10 between the imaging device 20 and the display device 10. According to this structure, a vehicle-mounted camera system can be reduced in size.
  • any component of the embodiment can be modified or any component of the embodiment can be omitted within the scope of the invention.
  • a large amount of information is transmitted using an image from a display device connected via a low-speed communication path to the imaging device. Suitable for use.
  • 10 display device 11 communication unit, 12 input unit, 13 transmission / reception control unit, 14 transmission control unit, 15 transmission information storage unit, 16 display control unit, 17 display unit, 20 imaging device, 21 communication unit, 22 reception control unit, 23 reception information storage unit, 24 imaging unit, 25 image analysis unit, 30 communication path, 40 in-vehicle device, 50 fixture, 60 optical device, 70 transmission information, 71 control information, 72 divided transmission information, 73 error correction code, 80 Transmission image, 81 block, 101 display, 102, 202 communication device, 103, 203 processor, 104, 204 memory, 105 input device, 201 camera.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

Dans la présente invention, un dispositif d'imagerie (20) et un dispositif d'affichage (10) émettent et reçoivent des informations de réglage par l'intermédiaire d'un trajet de communication (30). Ensuite, le dispositif d'affichage (10) convertit, sur la base des informations de réglage, des informations de transmission présentant un volume supérieur à celui des informations de réglage en une ou plusieurs image(s) et affiche les images. Le dispositif d'imagerie (20) capture ensuite, sur la base des informations de réglage, une ou plusieurs image(s) affichée(s) par le dispositif d'affichage (10) et reconvertit les images en informations de transmission.
PCT/JP2016/085330 2016-11-29 2016-11-29 Procédé de transmission d'informations et système de caméra embarquée Ceased WO2018100614A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/085330 WO2018100614A1 (fr) 2016-11-29 2016-11-29 Procédé de transmission d'informations et système de caméra embarquée

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/085330 WO2018100614A1 (fr) 2016-11-29 2016-11-29 Procédé de transmission d'informations et système de caméra embarquée

Publications (1)

Publication Number Publication Date
WO2018100614A1 true WO2018100614A1 (fr) 2018-06-07

Family

ID=62242387

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/085330 Ceased WO2018100614A1 (fr) 2016-11-29 2016-11-29 Procédé de transmission d'informations et système de caméra embarquée

Country Status (1)

Country Link
WO (1) WO2018100614A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2023181206A1 (fr) * 2022-03-23 2023-09-28

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005309756A (ja) * 2004-04-21 2005-11-04 Mitsubishi Electric Corp 情報伝達システム及び情報変換装置及び情報復元装置及び表示装置
JP2007028575A (ja) * 2005-07-19 2007-02-01 Vimicro Corp 二次元コード画像伝送システム及び二次元コード画像伝送レート制御方法
JP2007034625A (ja) * 2005-07-26 2007-02-08 Aruze Corp 情報表示装置
JP2009163632A (ja) * 2008-01-09 2009-07-23 Aplix Corp データ提供システム、データ提供側機器およびコンテンツ製造方法
JP2014216734A (ja) * 2013-04-24 2014-11-17 日立マクセル株式会社 撮像装置及び撮像システム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005309756A (ja) * 2004-04-21 2005-11-04 Mitsubishi Electric Corp 情報伝達システム及び情報変換装置及び情報復元装置及び表示装置
JP2007028575A (ja) * 2005-07-19 2007-02-01 Vimicro Corp 二次元コード画像伝送システム及び二次元コード画像伝送レート制御方法
JP2007034625A (ja) * 2005-07-26 2007-02-08 Aruze Corp 情報表示装置
JP2009163632A (ja) * 2008-01-09 2009-07-23 Aplix Corp データ提供システム、データ提供側機器およびコンテンツ製造方法
JP2014216734A (ja) * 2013-04-24 2014-11-17 日立マクセル株式会社 撮像装置及び撮像システム

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2023181206A1 (fr) * 2022-03-23 2023-09-28
WO2023181206A1 (fr) * 2022-03-23 2023-09-28 ファナック株式会社 Système de programmation de robot et dispositif de commande de robot

Similar Documents

Publication Publication Date Title
US10554880B2 (en) Image processing system, imaging apparatus, image processing method, and computer-readable storage medium
US9319583B2 (en) Camera device and methods for aiding users in use thereof
JP5414910B2 (ja) 表示ユニット、撮像ユニット及び表示システム装置
CN111083458B (zh) 一种亮度校正方法、系统、设备及计算机可读存储介质
CN104284169B (zh) 用于阴影补偿的白平衡方法和应用于该方法的设备
US20110050927A1 (en) Information processing apparatus and control method therefor
CN101340566A (zh) 图像处理系统和方法
CN105611188A (zh) 基于自动曝光的摄像头遮挡检测方法及装置
JP2017092795A (ja) 画像投射システム、プロジェクター、及び、画像投射システムの制御方法
US8996577B2 (en) Object information provision device, object information provision system, terminal, and object information provision method
JP2010016826A (ja) 画像処理オペレーションを効率的に実行するためのシステム及び方法
EP1921541A2 (fr) Appareil d'affichage et procédé de mise à jour d'informations prévu à cet effet
JP2020194998A (ja) 制御装置、投影システム、制御方法、プログラムおよび記憶媒体
CN107147901A (zh) 一种传感器校正方法、装置、设备以及存储介质
JP2018157444A (ja) 画像表示装置、画像表示装置の画像調整方法、及び画像調整プログラム
WO2018100614A1 (fr) Procédé de transmission d'informations et système de caméra embarquée
CN109391769B (zh) 控制设备、控制方法和存储介质
US8848237B2 (en) Wireless scanning device and method for scanning and transmitting scan data
US20190073558A1 (en) Information processing apparatus, information processing method, and computer program
JP2020184724A (ja) 通信システム、携帯端末、車載装置および通信プログラム
JP2006180445A (ja) 画像補正装置、撮影装置、及び、画像補正装置用のコンピュータプログラム
JP7073120B2 (ja) 映像送信装置、情報処理装置、システム、情報処理方法及びプログラム
JP4793449B2 (ja) ネットワーク映像合成表示システム
JP2008244950A (ja) 遠隔操作装置および映像表示システム
WO2018066161A1 (fr) Dispositif d'affichage, dispositif de commande et système multi-écran

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16922895

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

NENP Non-entry into the national phase

Ref country code: JP

122 Ep: pct application non-entry in european phase

Ref document number: 16922895

Country of ref document: EP

Kind code of ref document: A1