[go: up one dir, main page]

US20240112435A1 - Image recording device - Google Patents

Image recording device Download PDF

Info

Publication number
US20240112435A1
US20240112435A1 US18/243,100 US202318243100A US2024112435A1 US 20240112435 A1 US20240112435 A1 US 20240112435A1 US 202318243100 A US202318243100 A US 202318243100A US 2024112435 A1 US2024112435 A1 US 2024112435A1
Authority
US
United States
Prior art keywords
image
recording device
partial
pixels
adjusted
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US18/243,100
Inventor
Chun-Hsiung CHAO
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ability Enterprise Co Ltd
Original Assignee
Ability Enterprise Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ability Enterprise Co Ltd filed Critical Ability Enterprise Co Ltd
Assigned to ABILITY ENTERPRISE CO., LTD. reassignment ABILITY ENTERPRISE CO., LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CHAO, CHUN-HSIUNG
Publication of US20240112435A1 publication Critical patent/US20240112435A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/16Image acquisition using multiple overlapping images; Image stitching
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/10Image acquisition
    • G06V10/12Details of acquisition arrangements; Constructional details thereof
    • G06V10/14Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/141Control of illumination
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/625License plates
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle
    • G06T2207/30256Lane; Road marking

Definitions

  • the present invention relates in general to an image recording device and an image processing method.
  • the market demand for recording traffic information is not only limited to continuous recording of dynamic images as reference for future traffic accidents, but also users would like to quickly find out the cause of the accident or the license plate number of the vehicle involved in the accident rather than spending longer time to check the recorded data.
  • the existing vehicle recording devices adopt a relatively poor resolution recording mechanism, which causes drivers to have difficulties in accurately recognizing the license plate number of the vehicle involved in the accident after finding out the license plate number of the vehicle involved in the incident in the video. Therefore, it is necessary to propose a recording device and an image processing method for recording traffic information which can be quickly accessed, with high image resolution and reliable information.
  • One embodiment of the present invention provides an image recording device including a first image capturing module, a processor and a storage module.
  • the first image capturing module includes a first lens and a first sensor catching a light beam passing through the first lens and providing a first image;
  • the processor selects a first partial area of the first image, copies image data of the first partial area and provides a first partial image, and adjusts the first image and generates a first adjusted image;
  • the storage module stores the first image, the first partial image and the first adjusted image.
  • One embodiments of the present invention further provides an image recording device including a first image capturing module, a second image capturing module and a processor.
  • the first image capturing module catches light beam and provides a first image
  • the second image capturing module catches light beam and provides a second image
  • the processor generates a first partial image with the first image and/or generates a second partial image with the second image, and stitches the first image and the second image to generate an integrated image.
  • Another embodiment of the present invention provides an image processing method includes: capturing a first image by a first image capturing module; and selecting, by a processor, a first partial area of the first image, copying image data of the first partial area and generating a first partial image, and adjusting a first image and generating a first adjusted image.
  • FIG. 1 is a block diagram of an image recording device according to one embodiment of the present invention.
  • FIG. 2 is a flowchart of a method for preliminary processing of a first image according to one embodiment of the present invention.
  • FIG. 3 is a schematic diagram illustrating capturing a first partial image of a first partial area according to one embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a first adjusted image, a second image and a first partial image according to one embodiment of the present invention.
  • FIG. 5 is a block diagram of an image recording device according to another embodiment of the present invention.
  • FIG. 6 A is a schematic diagram of a first image according to one embodiment of the present invention.
  • FIG. 6 B is a schematic diagram showing a field of view photographed in a horizontal direction according to one embodiment of the present invention.
  • FIG. 6 C is a schematic diagram showing a field of view photographed in a vertical direction according to one embodiment of the present invention.
  • FIG. 7 A is a schematic diagram of a first image according to another embodiment of the present invention.
  • FIG. 7 B is a schematic diagram showing a field of view photographed in a horizontal direction according to another embodiment of the present invention.
  • FIG. 7 C is a schematic diagram showing a field of view photographed in a vertical direction according to another embodiment of the present invention.
  • FIG. 8 A is a schematic diagram of a first image according to still another embodiment of the present invention.
  • FIG. 8 B is a schematic diagram of a first image according to still another embodiment of the present invention.
  • FIG. 8 C is a schematic diagram of a first image according to further embodiment of the present invention.
  • FIG. 1 is a block diagram of an image recording device 10 according to one embodiment of the present invention.
  • the image recording device 10 at least includes a first image capturing module 102 , a processor 106 , and a storage module 108 .
  • the first image capturing module 102 includes a first lens 1021 and a first sensor 1022 .
  • the processor 106 is electrically connected to the first image capturing module 102 and the storage module 108 .
  • the image recording device 10 may be a vehicle recorder, which may be mounted on a motor vehicle, including but not limited to a car, truck, bus, motorcycle, etc.
  • the first sensor 1022 may be a photoelectric conversion element, including but not limited to a Charge Coupled Device (CCD) sensor or a Complementary Metal-Oxide Semiconductor (CMOS) sensor, CMOS photo transistor.
  • the processor 106 may be an image processing chip.
  • the processor 106 may be an image processing chip.
  • the storage module 108 may be non-transitory memory, such as flash memory.
  • FIG. 2 is a flowchart of a method for preliminary processing of a first image IMG1 according to one embodiment of the present invention.
  • FIG. 3 is a schematic diagram illustrating capturing a first partial image ROI1 of a first partial area R1 according to one embodiment of the present invention.
  • the first image capturing module 102 captures images in a first direction, and the first sensor 1022 may catch a light beam passing through the first lens 1021 and generate a first image IMG1, which may be received by the processor 106 .
  • the processor 106 may select a first partial area R1 of the first image IMG1, and copy the image data of the partial area R1 to form a first partial image ROI1.
  • the processor 106 may further perform image adjustment on the first image IMG1 and generate a first adjusted image SD1 after image adjustment.
  • the image recording device 10 may store the first image IMG1, the first partial image ROI1, and the first adjusted image SD1 in accordance with the storage module 108 .
  • the image adjustment is performed to generate the first adjusted image SD1 by reducing pixels, including but not limited to scaling down, compressing, and cropping the image, so that the pixels of the first adjusted image SD1 are less than the pixels of the first image IMG1.
  • the processor 106 may further perform preliminary image processing on the first image IMG1 before selecting the first partial area R1 of the first image IMG1.
  • the preliminary image processing includes, but is not limited to, removing the black edges of the image, improving the distorted area of the image, resolving the color deviation of the image, and trimming the deformation of the image edges.
  • the image adjustment procedure is performed after the preliminary image processing is completed.
  • the first image IMG1 may have m 1 ⁇ n 1 pixels
  • the first partial image ROI1 may have m 0 ⁇ n 0 pixels
  • the first adjusted image SD1 after image adjustment may have a 1 m 1 ⁇ b 1 n 1 pixels.
  • m 1 , a 1 m 1 , and m 0 are the number of columns arranged in the vertical direction of the first image IMG1, the first adjusted image SD1 and the first partial image ROI1, respectively, which may represent the length of the image; n 1 , b 1 n 1 , and n 0 are the number of rows arranged in the horizontal direction of the first image IMG1, the first adjusted image SD1 and the first partial image ROI1, respectively, which may represent the width of the image, and m 1 , n 1 , m 0 , and n 0 are all positive integers, a 1 and b 1 are all positive numbers less than 1, and a 1 m 1 and b 1 n 1 are all positive integers.
  • m 1 may be x times n 1
  • m 0 may be y times n 0
  • x and y are positive numbers, for example, x and y are between 1.7 and 2.3, respectively
  • a 1 and b 1 may be between 0.4 and 0.6, respectively
  • m 1 ⁇ n 1 3840 ⁇ 1920
  • m 0 ⁇ n 0 1920 ⁇ 1080
  • FIG. 4 is a schematic diagram of a first adjusted image SD1, a second image IMG2 and a first partial image ROI1 according to one embodiment of the present invention.
  • FIG. 5 is a block diagram of an image recording device 20 according to another embodiment of the present invention. As shown in FIG. 1 and FIG. 5 , the image recording device 20 is substantially similar to the image recording device 10 , and the elements are substantially designated with the same reference numerals. The main difference between the image recording device 20 and the image recording device 10 is that the image recording device further includes a second image capturing module 104 electrically connected to the processor 106 .
  • the second image capturing module 104 includes a second lens 1041 and a second sensor 1042 , the second image capturing module 104 may capture images in a second direction, and the second sensor 1042 may catch a light beam passing through the second lens 1041 and generate a second image IMG2.
  • the first image capturing module 102 and the second image capturing module 104 provide the first image IMG1 and the second image IMG2, respectively, to the processor 106 .
  • the processor 106 may select the first partial area R1 from the first image IMG1 and obtain the first partial image ROI1, and perform image adjustment on the first image IMG1 and generate the first adjusted image SD1 after image adjustment.
  • the processor 106 may further stitch the first adjusted image SD1 and the second image IMG2 and generate an integrated image, and may store the first image IMG1, the second image IMG2, the first partial image ROI1, the first adjusted image SD1, and the integrated image IMG in accordance with the storage module 108 .
  • the first image capturing module 102 and the second image capturing module 104 may have the same field of view or different fields of view.
  • the processor 106 may calculate image data of overlapping areas of the first adjusted image SD1 and the second image IMG2 for stitching.
  • the image data includes, but is not limited to, brightness, color saturation, RGB values, but the present invention is not limited thereto.
  • the processor 106 may perform preliminary image processing on the first image IMG1 and the second image IMG2 respectively; in another embodiment, the integrated image IMG may be a horizontal 360-degree panoramic image.
  • the second image IMG2 may have m 2 ⁇ n 2 pixels.
  • m 2 is the number of columns of the second image IMG2 arranged in the vertical direction, which may represent the length of the image
  • n 2 is the number of rows of the second image IMG2 arranged in the horizontal direction, which may represent the width of the image
  • m 2 and n 2 are positive integers.
  • the processor 106 may also select a second partial area of the second image IMG2 and generate a second partial image, and generate a second adjusted image after image adjustment in accordance with image adjustment.
  • the first image IMG1 has m 1 ⁇ n 1 pixels
  • the second image IMG2 has m 2 ⁇ n 2 pixels
  • the first partial image ROI1 has m 0 ⁇ n 0 pixels
  • the second partial image has m′ 0 ⁇ n′ 0 pixels
  • the first adjusted image SD1 has a 1 m 1 ⁇ b 1 n 1
  • the second adjusted image has a 2 m 2 ⁇ b 2 n 2 pixels, wherein m 1 , m 2 , m 0 , m′ 0 , n 1 , n 2 , n 0 , and n′ 0 are positive integers, a 1 , a 2 , b 1 , and b 2 are positive numbers less than 1, and aims, a 2 ,
  • the first image capturing module 102 and the second image capturing module 104 may capture images in opposite directions; that is, the first direction and the second direction may be substantially oriented by 180 degrees; in another specific embodiment, the first lens 1021 may be a fisheye lens, and the second lens 1041 may be a fisheye lens or a wide-angle lens; and in still another specific embodiment, the field of view of the first image capturing module 102 and the field of view of the second image capturing module 104 may overlap in the horizontal direction.
  • the fields of view of the first image capturing module 102 and the second image capturing module 104 in the horizontal direction are both 182 degrees, and thus the first image IMG1 and the second image IMG2 may have 2-degree overlaps respectively on both sides of the horizontal direction.
  • the first image capturing module 102 and the second image capturing module 104 may be disposed in a back-to-back manner, and the image recording device 10 may be disposed on the rearview mirror, the front windshield, or on top of the dashboard in the vehicle, so that the first image capturing module 102 may capture images of the scene in front of the vehicle, and the second image capturing module 104 may capture images of the situation in the vehicle.
  • the first image capturing module 102 may be disposed on the rearview mirror, the front windshield, or on top of the dashboard, and the second image capturing module 104 may be disposed on the rear windshield to capture images of the scene at the back of the vehicle.
  • FIG. 6 A is a schematic diagram of a first image IMG1 according to one embodiment of the present invention.
  • FIG. 6 B is a schematic diagram showing a field of view photographed in a horizontal direction according to one embodiment of the present invention.
  • FIG. 6 C is a schematic diagram showing a field of view photographed in a vertical direction according to one embodiment of the present invention.
  • a circular first image IMG1 may be obtained on the imaging surface 204 , and the circular first image IMG1 may be fully imaged on the first sensor 1022 .
  • the areas 209 , 210 are the black edges which do not contain data on the first sensor 1022 , and in practice, the areas 209 , 210 may be preliminarily image processed by removing the black edges, i.e., cropping or completely removing the black edges which do not contain data in the first image IMG1.
  • the image recording device 20 may provide an integrated image IMG with a 360-degree panoramic view in both the horizontal and the vertical directions.
  • FIG. 7 A is a schematic diagram of a first image according to another embodiment of the present invention.
  • FIG. 7 B is a schematic diagram showing a field of view photographed in a horizontal direction according to another embodiment of the present invention.
  • FIG. 7 C is a schematic diagram showing a field of view photographed in a vertical direction according to another embodiment of the present invention.
  • a circular first image IMG1 passing through the first lens 1021 is imaged on the first sensor 1022 , and the center of the first image IMG1 may substantially coincide with the center of the first sensor 1022 .
  • two edges of the first image IMG1 in initial size disposed along the horizontal direction may be substantially tangent to two perimeters of the first sensor 1022 disposed along the horizontal direction, while two portions of area along the vertical direction are outside of the first sensor 1022 and are not captured by the first sensor 1022 , and the area 316 with black edge is smaller in size and the utilization rate of the first sensor 1022 is higher.
  • the image recording device 20 may provide an integrated image IMG with a 360-degree panoramic view in the horizontal direction and discontinuous panoramic view in the vertical direction.
  • FIG. 8 A is a schematic diagram of a first image according to still another embodiment of the present invention.
  • FIG. 8 B is a schematic diagram of a first image according to still another embodiment of the present invention.
  • FIG. 8 C is a schematic diagram of a first image according to further embodiment of the present invention.
  • two edges of the first image IMG1 in initial size disposed along the horizontal direction and one edge of the first image IMG1 in initial size disposed along the vertical direction may be substantially tangent to two perimeters of the first sensor 1022 disposed along the horizontal direction and one perimeter of the first sensor 1022 disposed along the vertical direction, and a portion of area of the first image IMG1 in initial size disposed along another vertical direction is outside of the first sensor 1022 and is not captured by the first sensor 1022 ; or, as shown in FIG.
  • the first image IMG1 in initial size may circumscribe the imaging surface 204 of the first sensor 1022 so that portions of area of the first image IMG1 in initial size along the horizontal direction and the vertical direction are all outside of the first sensor 1022 .
  • the first partial area R1 of the first image IMG1 may be of interest to the driver or information which is required to be checked, such as the license plate number of the vehicle in front of the driver. In practice, it usually appears within a sector ranged from about 100 to 150 degrees in front of the image recording device 10 , 20 , and thus the present invention may capture the image within this region in accordance with the processor 106 , and may maintain the original resolution and avoid distortion and loss of information. Similarly, the processor 106 may also select the second partial area R2 from the second image IMG2 provided by the second image capturing module 104 and copy the second partial image for archiving.
  • the processor 106 may determine the selected first partial area R1 based on one or more features in the first image IMG1. Specifically, the processor 106 may identify the lane lines from the first image IMG1, calculate the intersection at which the lane lines extend, and determine the selected first partial area by regarding the intersection as the center. Similarly, the processor 106 may determine the selected second partial area according to the intersection at which the lane lines extend in the second image IMG2.
  • the present invention provides an image recording device and an image processing method, a target object which is located at a certain distance from a lens may be recorded with sufficient resolution and easily recognized in an integrated image IMG in condition of limited hardware performance.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
  • Traffic Control Systems (AREA)

Abstract

An image recording device and an image processing method are provided. The image recording device includes a first image capturing module, a processor and a storage module. The first image capturing module includes a first lens and a first sensor catching a light beam passing through the first lens and providing a first image; the processor receives the first image, selects a first partial area of the first image, copies image data of the first partial area and provides a first partial image, and performs image process on the first image and generates a first adjusted image; and the storage module stores the first image, the first partial image and the first adjusted image.

Description

  • This application claims the benefit of Taiwan application Serial No. 111136978, filed Sep. 29, 2022, the subject matter of which is incorporated herein by reference.
  • TECHNICAL FIELD
  • The present invention relates in general to an image recording device and an image processing method.
  • BACKGROUND
  • Nowadays, the market demand for recording traffic information is not only limited to continuous recording of dynamic images as reference for future traffic accidents, but also users would like to quickly find out the cause of the accident or the license plate number of the vehicle involved in the accident rather than spending longer time to check the recorded data. On the other hand, in consideration of the fact that long-time recording requires a large memory card capacity, the existing vehicle recording devices adopt a relatively poor resolution recording mechanism, which causes drivers to have difficulties in accurately recognizing the license plate number of the vehicle involved in the accident after finding out the license plate number of the vehicle involved in the incident in the video. Therefore, it is necessary to propose a recording device and an image processing method for recording traffic information which can be quickly accessed, with high image resolution and reliable information.
  • SUMMARY
  • One embodiment of the present invention provides an image recording device including a first image capturing module, a processor and a storage module. The first image capturing module includes a first lens and a first sensor catching a light beam passing through the first lens and providing a first image; the processor selects a first partial area of the first image, copies image data of the first partial area and provides a first partial image, and adjusts the first image and generates a first adjusted image; and the storage module stores the first image, the first partial image and the first adjusted image.
  • One embodiments of the present invention further provides an image recording device including a first image capturing module, a second image capturing module and a processor. The first image capturing module catches light beam and provides a first image; the second image capturing module catches light beam and provides a second image; and the processor generates a first partial image with the first image and/or generates a second partial image with the second image, and stitches the first image and the second image to generate an integrated image.
  • Another embodiment of the present invention provides an image processing method includes: capturing a first image by a first image capturing module; and selecting, by a processor, a first partial area of the first image, copying image data of the first partial area and generating a first partial image, and adjusting a first image and generating a first adjusted image.
  • The above and other aspects of the invention will become better understood with regard to the following detailed description of the preferred but non-limiting embodiment(s). The following description is made with reference to the accompanying drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram of an image recording device according to one embodiment of the present invention.
  • FIG. 2 is a flowchart of a method for preliminary processing of a first image according to one embodiment of the present invention.
  • FIG. 3 is a schematic diagram illustrating capturing a first partial image of a first partial area according to one embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a first adjusted image, a second image and a first partial image according to one embodiment of the present invention.
  • FIG. 5 is a block diagram of an image recording device according to another embodiment of the present invention.
  • FIG. 6A is a schematic diagram of a first image according to one embodiment of the present invention.
  • FIG. 6B is a schematic diagram showing a field of view photographed in a horizontal direction according to one embodiment of the present invention.
  • FIG. 6C is a schematic diagram showing a field of view photographed in a vertical direction according to one embodiment of the present invention.
  • FIG. 7A is a schematic diagram of a first image according to another embodiment of the present invention.
  • FIG. 7B is a schematic diagram showing a field of view photographed in a horizontal direction according to another embodiment of the present invention.
  • FIG. 7C is a schematic diagram showing a field of view photographed in a vertical direction according to another embodiment of the present invention.
  • FIG. 8A is a schematic diagram of a first image according to still another embodiment of the present invention.
  • FIG. 8B is a schematic diagram of a first image according to still another embodiment of the present invention.
  • FIG. 8C is a schematic diagram of a first image according to further embodiment of the present invention.
  • DETAILED DESCRIPTION
  • FIG. 1 is a block diagram of an image recording device 10 according to one embodiment of the present invention. As shown in FIG. 1 , the image recording device 10 at least includes a first image capturing module 102, a processor 106, and a storage module 108. The first image capturing module 102 includes a first lens 1021 and a first sensor 1022. The processor 106 is electrically connected to the first image capturing module 102 and the storage module 108. In one specific embodiment, the image recording device 10 may be a vehicle recorder, which may be mounted on a motor vehicle, including but not limited to a car, truck, bus, motorcycle, etc. The first sensor 1022 may be a photoelectric conversion element, including but not limited to a Charge Coupled Device (CCD) sensor or a Complementary Metal-Oxide Semiconductor (CMOS) sensor, CMOS photo transistor. The processor 106 may be an image processing chip. The processor 106 may be an image processing chip. The storage module 108 may be non-transitory memory, such as flash memory.
  • FIG. 2 is a flowchart of a method for preliminary processing of a first image IMG1 according to one embodiment of the present invention. FIG. 3 is a schematic diagram illustrating capturing a first partial image ROI1 of a first partial area R1 according to one embodiment of the present invention.
  • Referring to FIGS. 1-3 , as shown in step S201, the first image capturing module 102 captures images in a first direction, and the first sensor 1022 may catch a light beam passing through the first lens 1021 and generate a first image IMG1, which may be received by the processor 106. As shown in step S202, the processor 106 may select a first partial area R1 of the first image IMG1, and copy the image data of the partial area R1 to form a first partial image ROI1. On the other hand, as shown in Step S203, the processor 106 may further perform image adjustment on the first image IMG1 and generate a first adjusted image SD1 after image adjustment.
  • Next, the image recording device 10 may store the first image IMG1, the first partial image ROI1, and the first adjusted image SD1 in accordance with the storage module 108. The image adjustment is performed to generate the first adjusted image SD1 by reducing pixels, including but not limited to scaling down, compressing, and cropping the image, so that the pixels of the first adjusted image SD1 are less than the pixels of the first image IMG1.
  • In one embodiment, the processor 106 may further perform preliminary image processing on the first image IMG1 before selecting the first partial area R1 of the first image IMG1. The preliminary image processing includes, but is not limited to, removing the black edges of the image, improving the distorted area of the image, resolving the color deviation of the image, and trimming the deformation of the image edges. In one specific embodiment, the image adjustment procedure is performed after the preliminary image processing is completed.
  • In one embodiment, the first image IMG1 may have m1×n1 pixels, the first partial image ROI1 may have m0×n0 pixels, and the first adjusted image SD1 after image adjustment may have a1m1×b1n1 pixels. Herein, m1, a1m1, and m0 are the number of columns arranged in the vertical direction of the first image IMG1, the first adjusted image SD1 and the first partial image ROI1, respectively, which may represent the length of the image; n1, b1n1, and n0 are the number of rows arranged in the horizontal direction of the first image IMG1, the first adjusted image SD1 and the first partial image ROI1, respectively, which may represent the width of the image, and m1, n1, m0, and n0 are all positive integers, a1 and b1 are all positive numbers less than 1, and a1m1 and b1n1 are all positive integers.
  • In one specific embodiment, m1 may be x times n1, m0 may be y times n0, and x and y are positive numbers, for example, x and y are between 1.7 and 2.3, respectively; in another specific embodiment, a1 and b1 may be between 0.4 and 0.6, respectively; and in still another specific embodiment, m1×n1=3840×1920, m0×n0=1920×1080, a1m1×b1n1=1920×960, but the present invention is not limited thereto.
  • FIG. 4 is a schematic diagram of a first adjusted image SD1, a second image IMG2 and a first partial image ROI1 according to one embodiment of the present invention. FIG. 5 is a block diagram of an image recording device 20 according to another embodiment of the present invention. As shown in FIG. 1 and FIG. 5 , the image recording device 20 is substantially similar to the image recording device 10, and the elements are substantially designated with the same reference numerals. The main difference between the image recording device 20 and the image recording device 10 is that the image recording device further includes a second image capturing module 104 electrically connected to the processor 106. The second image capturing module 104 includes a second lens 1041 and a second sensor 1042, the second image capturing module 104 may capture images in a second direction, and the second sensor 1042 may catch a light beam passing through the second lens 1041 and generate a second image IMG2.
  • Referring to FIGS. 3-5 , the first image capturing module 102 and the second image capturing module 104 provide the first image IMG1 and the second image IMG2, respectively, to the processor 106. The processor 106 may select the first partial area R1 from the first image IMG1 and obtain the first partial image ROI1, and perform image adjustment on the first image IMG1 and generate the first adjusted image SD1 after image adjustment. In addition, the processor 106 may further stitch the first adjusted image SD1 and the second image IMG2 and generate an integrated image, and may store the first image IMG1, the second image IMG2, the first partial image ROI1, the first adjusted image SD1, and the integrated image IMG in accordance with the storage module 108. The first image capturing module 102 and the second image capturing module 104 may have the same field of view or different fields of view. Specifically, the processor 106 may calculate image data of overlapping areas of the first adjusted image SD1 and the second image IMG2 for stitching. The image data includes, but is not limited to, brightness, color saturation, RGB values, but the present invention is not limited thereto.
  • In one embodiment, before selecting the first partial area R1, the processor 106 may perform preliminary image processing on the first image IMG1 and the second image IMG2 respectively; in another embodiment, the integrated image IMG may be a horizontal 360-degree panoramic image.
  • In one embodiment, the second image IMG2 may have m2×n2 pixels. Herein, m2 is the number of columns of the second image IMG2 arranged in the vertical direction, which may represent the length of the image; n2 is the number of rows of the second image IMG2 arranged in the horizontal direction, which may represent the width of the image, and m2 and n2 are positive integers.
  • In one embodiment, the length of the second image IMG2 may not be equal to the length of the first adjusted image SD1, but the widths of both images are substantially equal, i.e., m2≠a1m1, n2=b1n1; in another embodiment, the length and width of the second image IMG2 are substantially equal to the length and width of the first adjusted image SD1, i.e., m2=a1m1, n2=b1n1; and in one specific embodiment, the number of pixels in the second image IMG2 is m2×n2=1920×960, but the present invention is not limited thereto.
  • In addition, referring to FIG. 5 , in one embodiment, the processor 106 may also select a second partial area of the second image IMG2 and generate a second partial image, and generate a second adjusted image after image adjustment in accordance with image adjustment. The first image IMG1 has m1×n1 pixels, the second image IMG2 has m2×n2 pixels, the first partial image ROI1 has m0×n0 pixels, the second partial image has m′0×n′0 pixels, the first adjusted image SD1 has a1m1×b1n1, and the second adjusted image has a2m2×b2n2 pixels, wherein m1, m2, m0, m′0, n1, n2, n0, and n′0 are positive integers, a1, a2, b1, and b2 are positive numbers less than 1, and aims, a2m2, b1n1, and b2n2 are positive integers. In one specific embodiment, a1, a2, b1 and b2 may be between 0.4 and 0.6, respectively.
  • In one specific embodiment, the first image capturing module 102 and the second image capturing module 104 may capture images in opposite directions; that is, the first direction and the second direction may be substantially oriented by 180 degrees; in another specific embodiment, the first lens 1021 may be a fisheye lens, and the second lens 1041 may be a fisheye lens or a wide-angle lens; and in still another specific embodiment, the field of view of the first image capturing module 102 and the field of view of the second image capturing module 104 may overlap in the horizontal direction. For example, the fields of view of the first image capturing module 102 and the second image capturing module 104 in the horizontal direction are both 182 degrees, and thus the first image IMG1 and the second image IMG2 may have 2-degree overlaps respectively on both sides of the horizontal direction.
  • In one specific embodiment, the first image capturing module 102 and the second image capturing module 104 may be disposed in a back-to-back manner, and the image recording device 10 may be disposed on the rearview mirror, the front windshield, or on top of the dashboard in the vehicle, so that the first image capturing module 102 may capture images of the scene in front of the vehicle, and the second image capturing module 104 may capture images of the situation in the vehicle. In another specific embodiment, the first image capturing module 102 may be disposed on the rearview mirror, the front windshield, or on top of the dashboard, and the second image capturing module 104 may be disposed on the rear windshield to capture images of the scene at the back of the vehicle.
  • FIG. 6A is a schematic diagram of a first image IMG1 according to one embodiment of the present invention. FIG. 6B is a schematic diagram showing a field of view photographed in a horizontal direction according to one embodiment of the present invention. FIG. 6C is a schematic diagram showing a field of view photographed in a vertical direction according to one embodiment of the present invention.
  • As shown in FIG. 6A, if the first lens 1021 is a fisheye lens, a circular first image IMG1 may be obtained on the imaging surface 204, and the circular first image IMG1 may be fully imaged on the first sensor 1022. The areas 209, 210 are the black edges which do not contain data on the first sensor 1022, and in practice, the areas 209, 210 may be preliminarily image processed by removing the black edges, i.e., cropping or completely removing the black edges which do not contain data in the first image IMG1.
  • Referring to FIGS. 6A-6C, if the second lens 1041 is also a fisheye lens, the light beam passing through the second lens 1041 is also fully imaged on the second sensor 1042, and the sum of the fields of view of the first image capturing module 102 and the second image capturing module 104 is greater than 360 degrees, then the images in the horizontal direction and the vertical direction of the vehicle will overlap. Thus, the image recording device 20 may provide an integrated image IMG with a 360-degree panoramic view in both the horizontal and the vertical directions.
  • FIG. 7A is a schematic diagram of a first image according to another embodiment of the present invention. FIG. 7B is a schematic diagram showing a field of view photographed in a horizontal direction according to another embodiment of the present invention. FIG. 7C is a schematic diagram showing a field of view photographed in a vertical direction according to another embodiment of the present invention.
  • As shown in FIG. 7A, in another embodiment, a circular first image IMG1 passing through the first lens 1021 is imaged on the first sensor 1022, and the center of the first image IMG1 may substantially coincide with the center of the first sensor 1022. In practice, at this time, two edges of the first image IMG1 in initial size disposed along the horizontal direction may be substantially tangent to two perimeters of the first sensor 1022 disposed along the horizontal direction, while two portions of area along the vertical direction are outside of the first sensor 1022 and are not captured by the first sensor 1022, and the area 316 with black edge is smaller in size and the utilization rate of the first sensor 1022 is higher.
  • Referring to FIGS. 7A-7C, if two edges of the second image IMG2 disposed along the horizontal direction may also be substantially tangent to two perimeters of the second sensor 1042 disposed along the horizontal direction, two portions of area of the second image IMG2 in initial size along the vertical direction are outside of the second sensor 1042 and are not captured by the second sensor 1042, and the sum of the fields of view of the first image capturing module 102 and the second image capturing module 104 is greater than 360 degrees, then the images in the horizontal direction of the vehicle will overlap while the images in the vertical direction will not overlap. Thus, the image recording device 20 may provide an integrated image IMG with a 360-degree panoramic view in the horizontal direction and discontinuous panoramic view in the vertical direction.
  • FIG. 8A is a schematic diagram of a first image according to still another embodiment of the present invention. FIG. 8B is a schematic diagram of a first image according to still another embodiment of the present invention. FIG. 8C is a schematic diagram of a first image according to further embodiment of the present invention.
  • Referring to FIG. 8A and FIG. 8B, in still another embodiment, two edges of the first image IMG1 in initial size disposed along the horizontal direction and one edge of the first image IMG1 in initial size disposed along the vertical direction may be substantially tangent to two perimeters of the first sensor 1022 disposed along the horizontal direction and one perimeter of the first sensor 1022 disposed along the vertical direction, and a portion of area of the first image IMG1 in initial size disposed along another vertical direction is outside of the first sensor 1022 and is not captured by the first sensor 1022; or, as shown in FIG. 8C, in further embodiment, the first image IMG1 in initial size may circumscribe the imaging surface 204 of the first sensor 1022 so that portions of area of the first image IMG1 in initial size along the horizontal direction and the vertical direction are all outside of the first sensor 1022.
  • In one embodiment, the first partial area R1 of the first image IMG1 may be of interest to the driver or information which is required to be checked, such as the license plate number of the vehicle in front of the driver. In practice, it usually appears within a sector ranged from about 100 to 150 degrees in front of the image recording device 10, 20, and thus the present invention may capture the image within this region in accordance with the processor 106, and may maintain the original resolution and avoid distortion and loss of information. Similarly, the processor 106 may also select the second partial area R2 from the second image IMG2 provided by the second image capturing module 104 and copy the second partial image for archiving.
  • In another embodiment, the processor 106 may determine the selected first partial area R1 based on one or more features in the first image IMG1. Specifically, the processor 106 may identify the lane lines from the first image IMG1, calculate the intersection at which the lane lines extend, and determine the selected first partial area by regarding the intersection as the center. Similarly, the processor 106 may determine the selected second partial area according to the intersection at which the lane lines extend in the second image IMG2.
  • The present invention provides an image recording device and an image processing method, a target object which is located at a certain distance from a lens may be recorded with sufficient resolution and easily recognized in an integrated image IMG in condition of limited hardware performance.
  • It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed embodiments. It is intended that the specification and examples be considered as exemplary only, with a true scope of the present invention being indicated by the following claims and their equivalents.

Claims (20)

What is claimed is:
1. An image recording device comprising:
a first image capturing module comprising a first lens and a first sensor, the first sensor catching a light beam passing through the first lens and providing a first image;
a processor selecting a first partial area of the first image, copying image data of the first partial area and providing a first partial image, and adjusting the first image and generating a first adjusted image; and
a storage module storing the first image, the first partial image and the first adjusted image.
2. The image recording device according to claim 1, wherein the first partial area is selected fixedly from an image corresponding to a specific angle ranged from a horizontal direction in which the first image capturing module captures images to both sides expanded from the horizontal direction; or, the first partial area is selected based on an intersection at which two lane lines extend in the first image.
3. The image recording device according to claim 1, wherein the processor generates the first adjusted image by reducing pixels of the first image.
4. The image recording device according to claim 1, further comprising a second image capturing module capturing a second image, wherein the processor stitches the first adjusted image and the second image and generates an integrated image.
5. The image recording device according to claim 4, wherein the first image has m1×n1 pixels, the second image has m2×n2 pixels, the first partial image has m0×n0 pixels, the first adjusted image has a1m1×b1n1 pixels, m1, m2, m0, n1, n2, n0, aims and bins are positive integers, and a1 and b1 are positive numbers less than one.
6. An image recording device comprising:
a first image capturing module comprising a first sensor, the first sensor catching light beam and providing a first image;
a second image capturing module catching light beam and providing a second image; and
a processor generating a first partial image with the first image, and/or generating a second partial image with the second image, and stitching the first image and the second image to generate an integrated image.
7. The image recording device according to claim 6, wherein the processor reduces pixels of the first image and/or the second image before stitching the first image and the second image.
8. The image recording device according to claim 6, wherein the processor adjusts the first image and/or the second image before stitching the first image and the second image for a width of the first image being substantially the same with a width of the second image.
9. The image recording device according to claim 8, wherein the first image has m1×n1 pixels, the second image has m2×n2 pixels, the first partial image has m0×n0 pixels, the second partial image has m′0×n′0 pixels, the first image after being adjusted has a1m1×b1n1 pixels, the second image after being adjusted has a2m2×b2n2 pixels, m1, m2, m0, m′0, n1, n2, n0, n′0, aims, bins, a2m2 and b2n2 are positive integers, and a1, a2, b1 and b2 are positive numbers less than one.
10. The image recording device according to claim 9, further comprising a storage module storing at least one of the first image, the second image, the first partial image, the second partial image, the integrated image, the first adjusted image and the second adjusted image.
11. The image recording device according to claim 6, wherein the first image is fully imaged on the first sensor, or two edges of the first image disposed along a horizontal direction are substantially tangent to two perimeters of the first sensor disposed along the horizontal direction.
12. The image recording device according to claim 6, wherein the processor recognizes two lane lines from the first image/the second image, calculates an intersection at which the two lane lines extend, and determines the first partial image/the second partial image with the intersection.
13. The image recording device according to claim 6, wherein the processor calculates image data of an overlapping area of the first image and the second image, and stitches the first image and the second image to generate the integrated image with 360-degree panorama.
14. The image recording device according to claim 6, wherein the first image capturing module is a fisheye lens, and the second image capturing module is a fisheye lens or a wide-angle lens.
15. An image processing device comprising:
a first image capturing module capturing a first image; and
a processor selecting a first partial area of the first image, copying image data of the first partial area and providing a first partial image, and adjusting the first image and generating a first adjusted image.
16. The image recording device according to claim 15, further comprising a second image capturing module providing a second image, and the processor stitching the first adjusted image and the second image and generating an integrated image.
17. The image recording device according to claim 16, wherein the processor reduces pixels of the first image and/or the second image before stitching the first adjusted image and the second image and a width of the first adjusted image being substantially the same with a width of the second image.
18. The image recording device according to claim 16, wherein the first image has m1×n1 pixels, the second image has m2×n2 pixels, the first partial image has m0×n0 pixels, the first adjusted image has a1m1×b1n1 pixels, m1, m2, m0, n1, n2, n0, aims and bins are positive integers, and a1 and b1 are positive numbers less than one.
19. The image recording device according to claim 16, further comprising a storage module storing at least one of the first image, the second image, the first partial image, the first adjusted image and the integrated image.
20. The image recording device according to claim 15, wherein the first partial area is selected fixedly from an image corresponding to a specific angle ranged from a horizontal direction in which the first image capturing module captures images to both sides expanded from the horizontal direction; or, the first partial area is determined by lane lines in which an user drives a vehicle.
US18/243,100 2022-09-29 2023-09-07 Image recording device Pending US20240112435A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW111136978A TW202415086A (en) 2022-09-29 2022-09-29 Image recording device and image processing method
TW111136978 2022-09-29

Publications (1)

Publication Number Publication Date
US20240112435A1 true US20240112435A1 (en) 2024-04-04

Family

ID=90471029

Family Applications (1)

Application Number Title Priority Date Filing Date
US18/243,100 Pending US20240112435A1 (en) 2022-09-29 2023-09-07 Image recording device

Country Status (3)

Country Link
US (1) US20240112435A1 (en)
JP (1) JP7696402B2 (en)
TW (1) TW202415086A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5948038A (en) * 1996-07-31 1999-09-07 American Traffic Systems, Inc. Traffic violation processing system
US20120069181A1 (en) * 2010-09-16 2012-03-22 Xue Li Object identification device, moving object controlling apparatus having object identification device, information presenting apparatus having object identification device, and spectroscopic image capturing apparatus
US20170353748A1 (en) * 2016-06-02 2017-12-07 Biamp Systems Corporation Systems and methods for bandwidth-limited video transport
US20180262683A1 (en) * 2017-03-10 2018-09-13 Gopro, Inc. Image Quality Assessment
US20210142055A1 (en) * 2019-11-07 2021-05-13 Ambarella International Lp Surveillance camera system looking at passing cars
US20220171981A1 (en) * 2020-11-30 2022-06-02 Sony Group Corporation Recognition of license plate numbers from bayer-domain image data

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006140908A (en) 2004-11-15 2006-06-01 Matsushita Electric Ind Co Ltd Image synthesizer
JP4783431B2 (en) 2006-09-28 2011-09-28 パイオニア株式会社 Traffic information detection apparatus, traffic information detection method, traffic information detection program, and recording medium
JP2010152026A (en) 2008-12-25 2010-07-08 Hitachi Ltd Distance measuring device and object moving speed measuring device
EP2764470A1 (en) 2011-10-05 2014-08-13 L-3 Communications Mobilevision Inc. Multiple resolution camera system for automated license plate recognition and event recording
JP2013256167A (en) 2012-06-12 2013-12-26 Toyoda Gosei Co Ltd Drive recorder system and in-vehicle camera system
JP5853345B2 (en) 2013-05-08 2016-02-09 住友電工システムソリューション株式会社 Focus index calculation apparatus, image processing apparatus, computer program, and focus index calculation method
JP6563694B2 (en) 2015-05-29 2019-08-21 株式会社デンソーテン Image processing apparatus, image processing system, image composition apparatus, image processing method, and program
JP6809495B2 (en) 2018-03-05 2021-01-06 株式会社デンソー Image creation device
JP2022063068A (en) 2020-10-09 2022-04-21 トヨタ自動車株式会社 Drive recorder device
JP7573420B2 (en) 2020-11-13 2024-10-25 株式会社デンソーテン Drive recorder and drive recorder control method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5948038A (en) * 1996-07-31 1999-09-07 American Traffic Systems, Inc. Traffic violation processing system
US20120069181A1 (en) * 2010-09-16 2012-03-22 Xue Li Object identification device, moving object controlling apparatus having object identification device, information presenting apparatus having object identification device, and spectroscopic image capturing apparatus
US20170353748A1 (en) * 2016-06-02 2017-12-07 Biamp Systems Corporation Systems and methods for bandwidth-limited video transport
US20180262683A1 (en) * 2017-03-10 2018-09-13 Gopro, Inc. Image Quality Assessment
US20210142055A1 (en) * 2019-11-07 2021-05-13 Ambarella International Lp Surveillance camera system looking at passing cars
US20220171981A1 (en) * 2020-11-30 2022-06-02 Sony Group Corporation Recognition of license plate numbers from bayer-domain image data

Also Published As

Publication number Publication date
TW202415086A (en) 2024-04-01
JP7696402B2 (en) 2025-06-20
JP2024050452A (en) 2024-04-10

Similar Documents

Publication Publication Date Title
US10412298B2 (en) Control method, control device and electronic device
US7227573B2 (en) Apparatus and method for improved-resolution digital zoom in an electronic imaging device
EP2042374B1 (en) Vehicle periphery monitoring apparatus and image displaying method
US8466989B2 (en) Camera having image correction function, apparatus and image correction method
WO2019056527A1 (en) Capturing method and device
KR20110116387A (en) Imager and image distortion correction method
CN115936995A (en) A method for panorama stitching of vehicle four-way fisheye camera
JP2023046953A (en) Image processing system, mobile device, image processing method, and computer program
JP2023046965A (en) Image processing system, moving device, image processing method, and computer program
JP4894708B2 (en) Imaging device
KR101726692B1 (en) Apparatus and method for extracting object
JP7198599B2 (en) Image processing device, image processing method, drive recorder
JP3446277B2 (en) Ambient situation display device for vehicles
US20240112435A1 (en) Image recording device
US20210377428A1 (en) Monitor camera
US20100103274A1 (en) Image distortion compensation method and apparatus
CN116843595A (en) Fusion photographing method and device, electronic equipment and vehicle
WO2021209018A1 (en) Imaging system and imaging method
JP7324866B2 (en) Imaging device
CN117857725A (en) Image recording apparatus and image processing method
KR102429893B1 (en) Apparatus and method for processing image around vehicle, and recording medium for recording program performing the method
KR20180067046A (en) Image view system and operating method thereof
JPH09224180A (en) Imaging device
JP7693643B2 (en) Image capture setting device, image capture device, and image capture setting method
US20240007595A1 (en) Camera monitoring system, control method for camera monitoring system, and storage medium

Legal Events

Date Code Title Description
AS Assignment

Owner name: ABILITY ENTERPRISE CO., LTD., TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHAO, CHUN-HSIUNG;REEL/FRAME:064822/0514

Effective date: 20230904

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER