US20240112435A1 - Image recording device - Google Patents
Image recording device Download PDFInfo
- Publication number
- US20240112435A1 US20240112435A1 US18/243,100 US202318243100A US2024112435A1 US 20240112435 A1 US20240112435 A1 US 20240112435A1 US 202318243100 A US202318243100 A US 202318243100A US 2024112435 A1 US2024112435 A1 US 2024112435A1
- Authority
- US
- United States
- Prior art keywords
- image
- recording device
- partial
- pixels
- adjusted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/16—Image acquisition using multiple overlapping images; Image stitching
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/141—Control of illumination
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
- G06V20/625—License plates
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
- G06T2207/30256—Lane; Road marking
Definitions
- the present invention relates in general to an image recording device and an image processing method.
- the market demand for recording traffic information is not only limited to continuous recording of dynamic images as reference for future traffic accidents, but also users would like to quickly find out the cause of the accident or the license plate number of the vehicle involved in the accident rather than spending longer time to check the recorded data.
- the existing vehicle recording devices adopt a relatively poor resolution recording mechanism, which causes drivers to have difficulties in accurately recognizing the license plate number of the vehicle involved in the accident after finding out the license plate number of the vehicle involved in the incident in the video. Therefore, it is necessary to propose a recording device and an image processing method for recording traffic information which can be quickly accessed, with high image resolution and reliable information.
- One embodiment of the present invention provides an image recording device including a first image capturing module, a processor and a storage module.
- the first image capturing module includes a first lens and a first sensor catching a light beam passing through the first lens and providing a first image;
- the processor selects a first partial area of the first image, copies image data of the first partial area and provides a first partial image, and adjusts the first image and generates a first adjusted image;
- the storage module stores the first image, the first partial image and the first adjusted image.
- One embodiments of the present invention further provides an image recording device including a first image capturing module, a second image capturing module and a processor.
- the first image capturing module catches light beam and provides a first image
- the second image capturing module catches light beam and provides a second image
- the processor generates a first partial image with the first image and/or generates a second partial image with the second image, and stitches the first image and the second image to generate an integrated image.
- Another embodiment of the present invention provides an image processing method includes: capturing a first image by a first image capturing module; and selecting, by a processor, a first partial area of the first image, copying image data of the first partial area and generating a first partial image, and adjusting a first image and generating a first adjusted image.
- FIG. 1 is a block diagram of an image recording device according to one embodiment of the present invention.
- FIG. 2 is a flowchart of a method for preliminary processing of a first image according to one embodiment of the present invention.
- FIG. 3 is a schematic diagram illustrating capturing a first partial image of a first partial area according to one embodiment of the present invention.
- FIG. 4 is a schematic diagram of a first adjusted image, a second image and a first partial image according to one embodiment of the present invention.
- FIG. 5 is a block diagram of an image recording device according to another embodiment of the present invention.
- FIG. 6 A is a schematic diagram of a first image according to one embodiment of the present invention.
- FIG. 6 B is a schematic diagram showing a field of view photographed in a horizontal direction according to one embodiment of the present invention.
- FIG. 6 C is a schematic diagram showing a field of view photographed in a vertical direction according to one embodiment of the present invention.
- FIG. 7 A is a schematic diagram of a first image according to another embodiment of the present invention.
- FIG. 7 B is a schematic diagram showing a field of view photographed in a horizontal direction according to another embodiment of the present invention.
- FIG. 7 C is a schematic diagram showing a field of view photographed in a vertical direction according to another embodiment of the present invention.
- FIG. 8 A is a schematic diagram of a first image according to still another embodiment of the present invention.
- FIG. 8 B is a schematic diagram of a first image according to still another embodiment of the present invention.
- FIG. 8 C is a schematic diagram of a first image according to further embodiment of the present invention.
- FIG. 1 is a block diagram of an image recording device 10 according to one embodiment of the present invention.
- the image recording device 10 at least includes a first image capturing module 102 , a processor 106 , and a storage module 108 .
- the first image capturing module 102 includes a first lens 1021 and a first sensor 1022 .
- the processor 106 is electrically connected to the first image capturing module 102 and the storage module 108 .
- the image recording device 10 may be a vehicle recorder, which may be mounted on a motor vehicle, including but not limited to a car, truck, bus, motorcycle, etc.
- the first sensor 1022 may be a photoelectric conversion element, including but not limited to a Charge Coupled Device (CCD) sensor or a Complementary Metal-Oxide Semiconductor (CMOS) sensor, CMOS photo transistor.
- the processor 106 may be an image processing chip.
- the processor 106 may be an image processing chip.
- the storage module 108 may be non-transitory memory, such as flash memory.
- FIG. 2 is a flowchart of a method for preliminary processing of a first image IMG1 according to one embodiment of the present invention.
- FIG. 3 is a schematic diagram illustrating capturing a first partial image ROI1 of a first partial area R1 according to one embodiment of the present invention.
- the first image capturing module 102 captures images in a first direction, and the first sensor 1022 may catch a light beam passing through the first lens 1021 and generate a first image IMG1, which may be received by the processor 106 .
- the processor 106 may select a first partial area R1 of the first image IMG1, and copy the image data of the partial area R1 to form a first partial image ROI1.
- the processor 106 may further perform image adjustment on the first image IMG1 and generate a first adjusted image SD1 after image adjustment.
- the image recording device 10 may store the first image IMG1, the first partial image ROI1, and the first adjusted image SD1 in accordance with the storage module 108 .
- the image adjustment is performed to generate the first adjusted image SD1 by reducing pixels, including but not limited to scaling down, compressing, and cropping the image, so that the pixels of the first adjusted image SD1 are less than the pixels of the first image IMG1.
- the processor 106 may further perform preliminary image processing on the first image IMG1 before selecting the first partial area R1 of the first image IMG1.
- the preliminary image processing includes, but is not limited to, removing the black edges of the image, improving the distorted area of the image, resolving the color deviation of the image, and trimming the deformation of the image edges.
- the image adjustment procedure is performed after the preliminary image processing is completed.
- the first image IMG1 may have m 1 ⁇ n 1 pixels
- the first partial image ROI1 may have m 0 ⁇ n 0 pixels
- the first adjusted image SD1 after image adjustment may have a 1 m 1 ⁇ b 1 n 1 pixels.
- m 1 , a 1 m 1 , and m 0 are the number of columns arranged in the vertical direction of the first image IMG1, the first adjusted image SD1 and the first partial image ROI1, respectively, which may represent the length of the image; n 1 , b 1 n 1 , and n 0 are the number of rows arranged in the horizontal direction of the first image IMG1, the first adjusted image SD1 and the first partial image ROI1, respectively, which may represent the width of the image, and m 1 , n 1 , m 0 , and n 0 are all positive integers, a 1 and b 1 are all positive numbers less than 1, and a 1 m 1 and b 1 n 1 are all positive integers.
- m 1 may be x times n 1
- m 0 may be y times n 0
- x and y are positive numbers, for example, x and y are between 1.7 and 2.3, respectively
- a 1 and b 1 may be between 0.4 and 0.6, respectively
- m 1 ⁇ n 1 3840 ⁇ 1920
- m 0 ⁇ n 0 1920 ⁇ 1080
- FIG. 4 is a schematic diagram of a first adjusted image SD1, a second image IMG2 and a first partial image ROI1 according to one embodiment of the present invention.
- FIG. 5 is a block diagram of an image recording device 20 according to another embodiment of the present invention. As shown in FIG. 1 and FIG. 5 , the image recording device 20 is substantially similar to the image recording device 10 , and the elements are substantially designated with the same reference numerals. The main difference between the image recording device 20 and the image recording device 10 is that the image recording device further includes a second image capturing module 104 electrically connected to the processor 106 .
- the second image capturing module 104 includes a second lens 1041 and a second sensor 1042 , the second image capturing module 104 may capture images in a second direction, and the second sensor 1042 may catch a light beam passing through the second lens 1041 and generate a second image IMG2.
- the first image capturing module 102 and the second image capturing module 104 provide the first image IMG1 and the second image IMG2, respectively, to the processor 106 .
- the processor 106 may select the first partial area R1 from the first image IMG1 and obtain the first partial image ROI1, and perform image adjustment on the first image IMG1 and generate the first adjusted image SD1 after image adjustment.
- the processor 106 may further stitch the first adjusted image SD1 and the second image IMG2 and generate an integrated image, and may store the first image IMG1, the second image IMG2, the first partial image ROI1, the first adjusted image SD1, and the integrated image IMG in accordance with the storage module 108 .
- the first image capturing module 102 and the second image capturing module 104 may have the same field of view or different fields of view.
- the processor 106 may calculate image data of overlapping areas of the first adjusted image SD1 and the second image IMG2 for stitching.
- the image data includes, but is not limited to, brightness, color saturation, RGB values, but the present invention is not limited thereto.
- the processor 106 may perform preliminary image processing on the first image IMG1 and the second image IMG2 respectively; in another embodiment, the integrated image IMG may be a horizontal 360-degree panoramic image.
- the second image IMG2 may have m 2 ⁇ n 2 pixels.
- m 2 is the number of columns of the second image IMG2 arranged in the vertical direction, which may represent the length of the image
- n 2 is the number of rows of the second image IMG2 arranged in the horizontal direction, which may represent the width of the image
- m 2 and n 2 are positive integers.
- the processor 106 may also select a second partial area of the second image IMG2 and generate a second partial image, and generate a second adjusted image after image adjustment in accordance with image adjustment.
- the first image IMG1 has m 1 ⁇ n 1 pixels
- the second image IMG2 has m 2 ⁇ n 2 pixels
- the first partial image ROI1 has m 0 ⁇ n 0 pixels
- the second partial image has m′ 0 ⁇ n′ 0 pixels
- the first adjusted image SD1 has a 1 m 1 ⁇ b 1 n 1
- the second adjusted image has a 2 m 2 ⁇ b 2 n 2 pixels, wherein m 1 , m 2 , m 0 , m′ 0 , n 1 , n 2 , n 0 , and n′ 0 are positive integers, a 1 , a 2 , b 1 , and b 2 are positive numbers less than 1, and aims, a 2 ,
- the first image capturing module 102 and the second image capturing module 104 may capture images in opposite directions; that is, the first direction and the second direction may be substantially oriented by 180 degrees; in another specific embodiment, the first lens 1021 may be a fisheye lens, and the second lens 1041 may be a fisheye lens or a wide-angle lens; and in still another specific embodiment, the field of view of the first image capturing module 102 and the field of view of the second image capturing module 104 may overlap in the horizontal direction.
- the fields of view of the first image capturing module 102 and the second image capturing module 104 in the horizontal direction are both 182 degrees, and thus the first image IMG1 and the second image IMG2 may have 2-degree overlaps respectively on both sides of the horizontal direction.
- the first image capturing module 102 and the second image capturing module 104 may be disposed in a back-to-back manner, and the image recording device 10 may be disposed on the rearview mirror, the front windshield, or on top of the dashboard in the vehicle, so that the first image capturing module 102 may capture images of the scene in front of the vehicle, and the second image capturing module 104 may capture images of the situation in the vehicle.
- the first image capturing module 102 may be disposed on the rearview mirror, the front windshield, or on top of the dashboard, and the second image capturing module 104 may be disposed on the rear windshield to capture images of the scene at the back of the vehicle.
- FIG. 6 A is a schematic diagram of a first image IMG1 according to one embodiment of the present invention.
- FIG. 6 B is a schematic diagram showing a field of view photographed in a horizontal direction according to one embodiment of the present invention.
- FIG. 6 C is a schematic diagram showing a field of view photographed in a vertical direction according to one embodiment of the present invention.
- a circular first image IMG1 may be obtained on the imaging surface 204 , and the circular first image IMG1 may be fully imaged on the first sensor 1022 .
- the areas 209 , 210 are the black edges which do not contain data on the first sensor 1022 , and in practice, the areas 209 , 210 may be preliminarily image processed by removing the black edges, i.e., cropping or completely removing the black edges which do not contain data in the first image IMG1.
- the image recording device 20 may provide an integrated image IMG with a 360-degree panoramic view in both the horizontal and the vertical directions.
- FIG. 7 A is a schematic diagram of a first image according to another embodiment of the present invention.
- FIG. 7 B is a schematic diagram showing a field of view photographed in a horizontal direction according to another embodiment of the present invention.
- FIG. 7 C is a schematic diagram showing a field of view photographed in a vertical direction according to another embodiment of the present invention.
- a circular first image IMG1 passing through the first lens 1021 is imaged on the first sensor 1022 , and the center of the first image IMG1 may substantially coincide with the center of the first sensor 1022 .
- two edges of the first image IMG1 in initial size disposed along the horizontal direction may be substantially tangent to two perimeters of the first sensor 1022 disposed along the horizontal direction, while two portions of area along the vertical direction are outside of the first sensor 1022 and are not captured by the first sensor 1022 , and the area 316 with black edge is smaller in size and the utilization rate of the first sensor 1022 is higher.
- the image recording device 20 may provide an integrated image IMG with a 360-degree panoramic view in the horizontal direction and discontinuous panoramic view in the vertical direction.
- FIG. 8 A is a schematic diagram of a first image according to still another embodiment of the present invention.
- FIG. 8 B is a schematic diagram of a first image according to still another embodiment of the present invention.
- FIG. 8 C is a schematic diagram of a first image according to further embodiment of the present invention.
- two edges of the first image IMG1 in initial size disposed along the horizontal direction and one edge of the first image IMG1 in initial size disposed along the vertical direction may be substantially tangent to two perimeters of the first sensor 1022 disposed along the horizontal direction and one perimeter of the first sensor 1022 disposed along the vertical direction, and a portion of area of the first image IMG1 in initial size disposed along another vertical direction is outside of the first sensor 1022 and is not captured by the first sensor 1022 ; or, as shown in FIG.
- the first image IMG1 in initial size may circumscribe the imaging surface 204 of the first sensor 1022 so that portions of area of the first image IMG1 in initial size along the horizontal direction and the vertical direction are all outside of the first sensor 1022 .
- the first partial area R1 of the first image IMG1 may be of interest to the driver or information which is required to be checked, such as the license plate number of the vehicle in front of the driver. In practice, it usually appears within a sector ranged from about 100 to 150 degrees in front of the image recording device 10 , 20 , and thus the present invention may capture the image within this region in accordance with the processor 106 , and may maintain the original resolution and avoid distortion and loss of information. Similarly, the processor 106 may also select the second partial area R2 from the second image IMG2 provided by the second image capturing module 104 and copy the second partial image for archiving.
- the processor 106 may determine the selected first partial area R1 based on one or more features in the first image IMG1. Specifically, the processor 106 may identify the lane lines from the first image IMG1, calculate the intersection at which the lane lines extend, and determine the selected first partial area by regarding the intersection as the center. Similarly, the processor 106 may determine the selected second partial area according to the intersection at which the lane lines extend in the second image IMG2.
- the present invention provides an image recording device and an image processing method, a target object which is located at a certain distance from a lens may be recorded with sufficient resolution and easily recognized in an integrated image IMG in condition of limited hardware performance.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
- Traffic Control Systems (AREA)
Abstract
An image recording device and an image processing method are provided. The image recording device includes a first image capturing module, a processor and a storage module. The first image capturing module includes a first lens and a first sensor catching a light beam passing through the first lens and providing a first image; the processor receives the first image, selects a first partial area of the first image, copies image data of the first partial area and provides a first partial image, and performs image process on the first image and generates a first adjusted image; and the storage module stores the first image, the first partial image and the first adjusted image.
Description
- This application claims the benefit of Taiwan application Serial No. 111136978, filed Sep. 29, 2022, the subject matter of which is incorporated herein by reference.
- The present invention relates in general to an image recording device and an image processing method.
- Nowadays, the market demand for recording traffic information is not only limited to continuous recording of dynamic images as reference for future traffic accidents, but also users would like to quickly find out the cause of the accident or the license plate number of the vehicle involved in the accident rather than spending longer time to check the recorded data. On the other hand, in consideration of the fact that long-time recording requires a large memory card capacity, the existing vehicle recording devices adopt a relatively poor resolution recording mechanism, which causes drivers to have difficulties in accurately recognizing the license plate number of the vehicle involved in the accident after finding out the license plate number of the vehicle involved in the incident in the video. Therefore, it is necessary to propose a recording device and an image processing method for recording traffic information which can be quickly accessed, with high image resolution and reliable information.
- One embodiment of the present invention provides an image recording device including a first image capturing module, a processor and a storage module. The first image capturing module includes a first lens and a first sensor catching a light beam passing through the first lens and providing a first image; the processor selects a first partial area of the first image, copies image data of the first partial area and provides a first partial image, and adjusts the first image and generates a first adjusted image; and the storage module stores the first image, the first partial image and the first adjusted image.
- One embodiments of the present invention further provides an image recording device including a first image capturing module, a second image capturing module and a processor. The first image capturing module catches light beam and provides a first image; the second image capturing module catches light beam and provides a second image; and the processor generates a first partial image with the first image and/or generates a second partial image with the second image, and stitches the first image and the second image to generate an integrated image.
- Another embodiment of the present invention provides an image processing method includes: capturing a first image by a first image capturing module; and selecting, by a processor, a first partial area of the first image, copying image data of the first partial area and generating a first partial image, and adjusting a first image and generating a first adjusted image.
- The above and other aspects of the invention will become better understood with regard to the following detailed description of the preferred but non-limiting embodiment(s). The following description is made with reference to the accompanying drawings.
-
FIG. 1 is a block diagram of an image recording device according to one embodiment of the present invention. -
FIG. 2 is a flowchart of a method for preliminary processing of a first image according to one embodiment of the present invention. -
FIG. 3 is a schematic diagram illustrating capturing a first partial image of a first partial area according to one embodiment of the present invention. -
FIG. 4 is a schematic diagram of a first adjusted image, a second image and a first partial image according to one embodiment of the present invention. -
FIG. 5 is a block diagram of an image recording device according to another embodiment of the present invention. -
FIG. 6A is a schematic diagram of a first image according to one embodiment of the present invention. -
FIG. 6B is a schematic diagram showing a field of view photographed in a horizontal direction according to one embodiment of the present invention. -
FIG. 6C is a schematic diagram showing a field of view photographed in a vertical direction according to one embodiment of the present invention. -
FIG. 7A is a schematic diagram of a first image according to another embodiment of the present invention. -
FIG. 7B is a schematic diagram showing a field of view photographed in a horizontal direction according to another embodiment of the present invention. -
FIG. 7C is a schematic diagram showing a field of view photographed in a vertical direction according to another embodiment of the present invention. -
FIG. 8A is a schematic diagram of a first image according to still another embodiment of the present invention. -
FIG. 8B is a schematic diagram of a first image according to still another embodiment of the present invention. -
FIG. 8C is a schematic diagram of a first image according to further embodiment of the present invention. -
FIG. 1 is a block diagram of animage recording device 10 according to one embodiment of the present invention. As shown inFIG. 1 , theimage recording device 10 at least includes a first image capturingmodule 102, aprocessor 106, and astorage module 108. The first image capturingmodule 102 includes afirst lens 1021 and afirst sensor 1022. Theprocessor 106 is electrically connected to the first image capturingmodule 102 and thestorage module 108. In one specific embodiment, theimage recording device 10 may be a vehicle recorder, which may be mounted on a motor vehicle, including but not limited to a car, truck, bus, motorcycle, etc. Thefirst sensor 1022 may be a photoelectric conversion element, including but not limited to a Charge Coupled Device (CCD) sensor or a Complementary Metal-Oxide Semiconductor (CMOS) sensor, CMOS photo transistor. Theprocessor 106 may be an image processing chip. Theprocessor 106 may be an image processing chip. Thestorage module 108 may be non-transitory memory, such as flash memory. -
FIG. 2 is a flowchart of a method for preliminary processing of a first image IMG1 according to one embodiment of the present invention.FIG. 3 is a schematic diagram illustrating capturing a first partial image ROI1 of a first partial area R1 according to one embodiment of the present invention. - Referring to
FIGS. 1-3 , as shown in step S201, the first image capturingmodule 102 captures images in a first direction, and thefirst sensor 1022 may catch a light beam passing through thefirst lens 1021 and generate a first image IMG1, which may be received by theprocessor 106. As shown in step S202, theprocessor 106 may select a first partial area R1 of the first image IMG1, and copy the image data of the partial area R1 to form a first partial image ROI1. On the other hand, as shown in Step S203, theprocessor 106 may further perform image adjustment on the first image IMG1 and generate a first adjusted image SD1 after image adjustment. - Next, the
image recording device 10 may store the first image IMG1, the first partial image ROI1, and the first adjusted image SD1 in accordance with thestorage module 108. The image adjustment is performed to generate the first adjusted image SD1 by reducing pixels, including but not limited to scaling down, compressing, and cropping the image, so that the pixels of the first adjusted image SD1 are less than the pixels of the first image IMG1. - In one embodiment, the
processor 106 may further perform preliminary image processing on the first image IMG1 before selecting the first partial area R1 of the first image IMG1. The preliminary image processing includes, but is not limited to, removing the black edges of the image, improving the distorted area of the image, resolving the color deviation of the image, and trimming the deformation of the image edges. In one specific embodiment, the image adjustment procedure is performed after the preliminary image processing is completed. - In one embodiment, the first image IMG1 may have m1×n1 pixels, the first partial image ROI1 may have m0×n0 pixels, and the first adjusted image SD1 after image adjustment may have a1m1×b1n1 pixels. Herein, m1, a1m1, and m0 are the number of columns arranged in the vertical direction of the first image IMG1, the first adjusted image SD1 and the first partial image ROI1, respectively, which may represent the length of the image; n1, b1n1, and n0 are the number of rows arranged in the horizontal direction of the first image IMG1, the first adjusted image SD1 and the first partial image ROI1, respectively, which may represent the width of the image, and m1, n1, m0, and n0 are all positive integers, a1 and b1 are all positive numbers less than 1, and a1m1 and b1n1 are all positive integers.
- In one specific embodiment, m1 may be x times n1, m0 may be y times n0, and x and y are positive numbers, for example, x and y are between 1.7 and 2.3, respectively; in another specific embodiment, a1 and b1 may be between 0.4 and 0.6, respectively; and in still another specific embodiment, m1×n1=3840×1920, m0×n0=1920×1080, a1m1×b1n1=1920×960, but the present invention is not limited thereto.
-
FIG. 4 is a schematic diagram of a first adjusted image SD1, a second image IMG2 and a first partial image ROI1 according to one embodiment of the present invention.FIG. 5 is a block diagram of animage recording device 20 according to another embodiment of the present invention. As shown inFIG. 1 andFIG. 5 , theimage recording device 20 is substantially similar to theimage recording device 10, and the elements are substantially designated with the same reference numerals. The main difference between theimage recording device 20 and theimage recording device 10 is that the image recording device further includes a secondimage capturing module 104 electrically connected to theprocessor 106. The secondimage capturing module 104 includes asecond lens 1041 and asecond sensor 1042, the secondimage capturing module 104 may capture images in a second direction, and thesecond sensor 1042 may catch a light beam passing through thesecond lens 1041 and generate a second image IMG2. - Referring to
FIGS. 3-5 , the firstimage capturing module 102 and the secondimage capturing module 104 provide the first image IMG1 and the second image IMG2, respectively, to theprocessor 106. Theprocessor 106 may select the first partial area R1 from the first image IMG1 and obtain the first partial image ROI1, and perform image adjustment on the first image IMG1 and generate the first adjusted image SD1 after image adjustment. In addition, theprocessor 106 may further stitch the first adjusted image SD1 and the second image IMG2 and generate an integrated image, and may store the first image IMG1, the second image IMG2, the first partial image ROI1, the first adjusted image SD1, and the integrated image IMG in accordance with thestorage module 108. The firstimage capturing module 102 and the secondimage capturing module 104 may have the same field of view or different fields of view. Specifically, theprocessor 106 may calculate image data of overlapping areas of the first adjusted image SD1 and the second image IMG2 for stitching. The image data includes, but is not limited to, brightness, color saturation, RGB values, but the present invention is not limited thereto. - In one embodiment, before selecting the first partial area R1, the
processor 106 may perform preliminary image processing on the first image IMG1 and the second image IMG2 respectively; in another embodiment, the integrated image IMG may be a horizontal 360-degree panoramic image. - In one embodiment, the second image IMG2 may have m2×n2 pixels. Herein, m2 is the number of columns of the second image IMG2 arranged in the vertical direction, which may represent the length of the image; n2 is the number of rows of the second image IMG2 arranged in the horizontal direction, which may represent the width of the image, and m2 and n2 are positive integers.
- In one embodiment, the length of the second image IMG2 may not be equal to the length of the first adjusted image SD1, but the widths of both images are substantially equal, i.e., m2≠a1m1, n2=b1n1; in another embodiment, the length and width of the second image IMG2 are substantially equal to the length and width of the first adjusted image SD1, i.e., m2=a1m1, n2=b1n1; and in one specific embodiment, the number of pixels in the second image IMG2 is m2×n2=1920×960, but the present invention is not limited thereto.
- In addition, referring to
FIG. 5 , in one embodiment, theprocessor 106 may also select a second partial area of the second image IMG2 and generate a second partial image, and generate a second adjusted image after image adjustment in accordance with image adjustment. The first image IMG1 has m1×n1 pixels, the second image IMG2 has m2×n2 pixels, the first partial image ROI1 has m0×n0 pixels, the second partial image has m′0×n′0 pixels, the first adjusted image SD1 has a1m1×b1n1, and the second adjusted image has a2m2×b2n2 pixels, wherein m1, m2, m0, m′0, n1, n2, n0, and n′0 are positive integers, a1, a2, b1, and b2 are positive numbers less than 1, and aims, a2m2, b1n1, and b2n2 are positive integers. In one specific embodiment, a1, a2, b1 and b2 may be between 0.4 and 0.6, respectively. - In one specific embodiment, the first
image capturing module 102 and the secondimage capturing module 104 may capture images in opposite directions; that is, the first direction and the second direction may be substantially oriented by 180 degrees; in another specific embodiment, thefirst lens 1021 may be a fisheye lens, and thesecond lens 1041 may be a fisheye lens or a wide-angle lens; and in still another specific embodiment, the field of view of the firstimage capturing module 102 and the field of view of the secondimage capturing module 104 may overlap in the horizontal direction. For example, the fields of view of the firstimage capturing module 102 and the secondimage capturing module 104 in the horizontal direction are both 182 degrees, and thus the first image IMG1 and the second image IMG2 may have 2-degree overlaps respectively on both sides of the horizontal direction. - In one specific embodiment, the first
image capturing module 102 and the secondimage capturing module 104 may be disposed in a back-to-back manner, and theimage recording device 10 may be disposed on the rearview mirror, the front windshield, or on top of the dashboard in the vehicle, so that the firstimage capturing module 102 may capture images of the scene in front of the vehicle, and the secondimage capturing module 104 may capture images of the situation in the vehicle. In another specific embodiment, the firstimage capturing module 102 may be disposed on the rearview mirror, the front windshield, or on top of the dashboard, and the secondimage capturing module 104 may be disposed on the rear windshield to capture images of the scene at the back of the vehicle. -
FIG. 6A is a schematic diagram of a first image IMG1 according to one embodiment of the present invention.FIG. 6B is a schematic diagram showing a field of view photographed in a horizontal direction according to one embodiment of the present invention.FIG. 6C is a schematic diagram showing a field of view photographed in a vertical direction according to one embodiment of the present invention. - As shown in
FIG. 6A , if thefirst lens 1021 is a fisheye lens, a circular first image IMG1 may be obtained on theimaging surface 204, and the circular first image IMG1 may be fully imaged on thefirst sensor 1022. Theareas first sensor 1022, and in practice, theareas - Referring to
FIGS. 6A-6C , if thesecond lens 1041 is also a fisheye lens, the light beam passing through thesecond lens 1041 is also fully imaged on thesecond sensor 1042, and the sum of the fields of view of the firstimage capturing module 102 and the secondimage capturing module 104 is greater than 360 degrees, then the images in the horizontal direction and the vertical direction of the vehicle will overlap. Thus, theimage recording device 20 may provide an integrated image IMG with a 360-degree panoramic view in both the horizontal and the vertical directions. -
FIG. 7A is a schematic diagram of a first image according to another embodiment of the present invention.FIG. 7B is a schematic diagram showing a field of view photographed in a horizontal direction according to another embodiment of the present invention.FIG. 7C is a schematic diagram showing a field of view photographed in a vertical direction according to another embodiment of the present invention. - As shown in
FIG. 7A , in another embodiment, a circular first image IMG1 passing through thefirst lens 1021 is imaged on thefirst sensor 1022, and the center of the first image IMG1 may substantially coincide with the center of thefirst sensor 1022. In practice, at this time, two edges of the first image IMG1 in initial size disposed along the horizontal direction may be substantially tangent to two perimeters of thefirst sensor 1022 disposed along the horizontal direction, while two portions of area along the vertical direction are outside of thefirst sensor 1022 and are not captured by thefirst sensor 1022, and thearea 316 with black edge is smaller in size and the utilization rate of thefirst sensor 1022 is higher. - Referring to
FIGS. 7A-7C , if two edges of the second image IMG2 disposed along the horizontal direction may also be substantially tangent to two perimeters of thesecond sensor 1042 disposed along the horizontal direction, two portions of area of the second image IMG2 in initial size along the vertical direction are outside of thesecond sensor 1042 and are not captured by thesecond sensor 1042, and the sum of the fields of view of the firstimage capturing module 102 and the secondimage capturing module 104 is greater than 360 degrees, then the images in the horizontal direction of the vehicle will overlap while the images in the vertical direction will not overlap. Thus, theimage recording device 20 may provide an integrated image IMG with a 360-degree panoramic view in the horizontal direction and discontinuous panoramic view in the vertical direction. -
FIG. 8A is a schematic diagram of a first image according to still another embodiment of the present invention.FIG. 8B is a schematic diagram of a first image according to still another embodiment of the present invention.FIG. 8C is a schematic diagram of a first image according to further embodiment of the present invention. - Referring to
FIG. 8A andFIG. 8B , in still another embodiment, two edges of the first image IMG1 in initial size disposed along the horizontal direction and one edge of the first image IMG1 in initial size disposed along the vertical direction may be substantially tangent to two perimeters of thefirst sensor 1022 disposed along the horizontal direction and one perimeter of thefirst sensor 1022 disposed along the vertical direction, and a portion of area of the first image IMG1 in initial size disposed along another vertical direction is outside of thefirst sensor 1022 and is not captured by thefirst sensor 1022; or, as shown inFIG. 8C , in further embodiment, the first image IMG1 in initial size may circumscribe theimaging surface 204 of thefirst sensor 1022 so that portions of area of the first image IMG1 in initial size along the horizontal direction and the vertical direction are all outside of thefirst sensor 1022. - In one embodiment, the first partial area R1 of the first image IMG1 may be of interest to the driver or information which is required to be checked, such as the license plate number of the vehicle in front of the driver. In practice, it usually appears within a sector ranged from about 100 to 150 degrees in front of the
image recording device processor 106, and may maintain the original resolution and avoid distortion and loss of information. Similarly, theprocessor 106 may also select the second partial area R2 from the second image IMG2 provided by the secondimage capturing module 104 and copy the second partial image for archiving. - In another embodiment, the
processor 106 may determine the selected first partial area R1 based on one or more features in the first image IMG1. Specifically, theprocessor 106 may identify the lane lines from the first image IMG1, calculate the intersection at which the lane lines extend, and determine the selected first partial area by regarding the intersection as the center. Similarly, theprocessor 106 may determine the selected second partial area according to the intersection at which the lane lines extend in the second image IMG2. - The present invention provides an image recording device and an image processing method, a target object which is located at a certain distance from a lens may be recorded with sufficient resolution and easily recognized in an integrated image IMG in condition of limited hardware performance.
- It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed embodiments. It is intended that the specification and examples be considered as exemplary only, with a true scope of the present invention being indicated by the following claims and their equivalents.
Claims (20)
1. An image recording device comprising:
a first image capturing module comprising a first lens and a first sensor, the first sensor catching a light beam passing through the first lens and providing a first image;
a processor selecting a first partial area of the first image, copying image data of the first partial area and providing a first partial image, and adjusting the first image and generating a first adjusted image; and
a storage module storing the first image, the first partial image and the first adjusted image.
2. The image recording device according to claim 1 , wherein the first partial area is selected fixedly from an image corresponding to a specific angle ranged from a horizontal direction in which the first image capturing module captures images to both sides expanded from the horizontal direction; or, the first partial area is selected based on an intersection at which two lane lines extend in the first image.
3. The image recording device according to claim 1 , wherein the processor generates the first adjusted image by reducing pixels of the first image.
4. The image recording device according to claim 1 , further comprising a second image capturing module capturing a second image, wherein the processor stitches the first adjusted image and the second image and generates an integrated image.
5. The image recording device according to claim 4 , wherein the first image has m1×n1 pixels, the second image has m2×n2 pixels, the first partial image has m0×n0 pixels, the first adjusted image has a1m1×b1n1 pixels, m1, m2, m0, n1, n2, n0, aims and bins are positive integers, and a1 and b1 are positive numbers less than one.
6. An image recording device comprising:
a first image capturing module comprising a first sensor, the first sensor catching light beam and providing a first image;
a second image capturing module catching light beam and providing a second image; and
a processor generating a first partial image with the first image, and/or generating a second partial image with the second image, and stitching the first image and the second image to generate an integrated image.
7. The image recording device according to claim 6 , wherein the processor reduces pixels of the first image and/or the second image before stitching the first image and the second image.
8. The image recording device according to claim 6 , wherein the processor adjusts the first image and/or the second image before stitching the first image and the second image for a width of the first image being substantially the same with a width of the second image.
9. The image recording device according to claim 8 , wherein the first image has m1×n1 pixels, the second image has m2×n2 pixels, the first partial image has m0×n0 pixels, the second partial image has m′0×n′0 pixels, the first image after being adjusted has a1m1×b1n1 pixels, the second image after being adjusted has a2m2×b2n2 pixels, m1, m2, m0, m′0, n1, n2, n0, n′0, aims, bins, a2m2 and b2n2 are positive integers, and a1, a2, b1 and b2 are positive numbers less than one.
10. The image recording device according to claim 9 , further comprising a storage module storing at least one of the first image, the second image, the first partial image, the second partial image, the integrated image, the first adjusted image and the second adjusted image.
11. The image recording device according to claim 6 , wherein the first image is fully imaged on the first sensor, or two edges of the first image disposed along a horizontal direction are substantially tangent to two perimeters of the first sensor disposed along the horizontal direction.
12. The image recording device according to claim 6 , wherein the processor recognizes two lane lines from the first image/the second image, calculates an intersection at which the two lane lines extend, and determines the first partial image/the second partial image with the intersection.
13. The image recording device according to claim 6 , wherein the processor calculates image data of an overlapping area of the first image and the second image, and stitches the first image and the second image to generate the integrated image with 360-degree panorama.
14. The image recording device according to claim 6 , wherein the first image capturing module is a fisheye lens, and the second image capturing module is a fisheye lens or a wide-angle lens.
15. An image processing device comprising:
a first image capturing module capturing a first image; and
a processor selecting a first partial area of the first image, copying image data of the first partial area and providing a first partial image, and adjusting the first image and generating a first adjusted image.
16. The image recording device according to claim 15 , further comprising a second image capturing module providing a second image, and the processor stitching the first adjusted image and the second image and generating an integrated image.
17. The image recording device according to claim 16 , wherein the processor reduces pixels of the first image and/or the second image before stitching the first adjusted image and the second image and a width of the first adjusted image being substantially the same with a width of the second image.
18. The image recording device according to claim 16 , wherein the first image has m1×n1 pixels, the second image has m2×n2 pixels, the first partial image has m0×n0 pixels, the first adjusted image has a1m1×b1n1 pixels, m1, m2, m0, n1, n2, n0, aims and bins are positive integers, and a1 and b1 are positive numbers less than one.
19. The image recording device according to claim 16 , further comprising a storage module storing at least one of the first image, the second image, the first partial image, the first adjusted image and the integrated image.
20. The image recording device according to claim 15 , wherein the first partial area is selected fixedly from an image corresponding to a specific angle ranged from a horizontal direction in which the first image capturing module captures images to both sides expanded from the horizontal direction; or, the first partial area is determined by lane lines in which an user drives a vehicle.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW111136978A TW202415086A (en) | 2022-09-29 | 2022-09-29 | Image recording device and image processing method |
TW111136978 | 2022-09-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
US20240112435A1 true US20240112435A1 (en) | 2024-04-04 |
Family
ID=90471029
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/243,100 Pending US20240112435A1 (en) | 2022-09-29 | 2023-09-07 | Image recording device |
Country Status (3)
Country | Link |
---|---|
US (1) | US20240112435A1 (en) |
JP (1) | JP7696402B2 (en) |
TW (1) | TW202415086A (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5948038A (en) * | 1996-07-31 | 1999-09-07 | American Traffic Systems, Inc. | Traffic violation processing system |
US20120069181A1 (en) * | 2010-09-16 | 2012-03-22 | Xue Li | Object identification device, moving object controlling apparatus having object identification device, information presenting apparatus having object identification device, and spectroscopic image capturing apparatus |
US20170353748A1 (en) * | 2016-06-02 | 2017-12-07 | Biamp Systems Corporation | Systems and methods for bandwidth-limited video transport |
US20180262683A1 (en) * | 2017-03-10 | 2018-09-13 | Gopro, Inc. | Image Quality Assessment |
US20210142055A1 (en) * | 2019-11-07 | 2021-05-13 | Ambarella International Lp | Surveillance camera system looking at passing cars |
US20220171981A1 (en) * | 2020-11-30 | 2022-06-02 | Sony Group Corporation | Recognition of license plate numbers from bayer-domain image data |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006140908A (en) | 2004-11-15 | 2006-06-01 | Matsushita Electric Ind Co Ltd | Image synthesizer |
JP4783431B2 (en) | 2006-09-28 | 2011-09-28 | パイオニア株式会社 | Traffic information detection apparatus, traffic information detection method, traffic information detection program, and recording medium |
JP2010152026A (en) | 2008-12-25 | 2010-07-08 | Hitachi Ltd | Distance measuring device and object moving speed measuring device |
EP2764470A1 (en) | 2011-10-05 | 2014-08-13 | L-3 Communications Mobilevision Inc. | Multiple resolution camera system for automated license plate recognition and event recording |
JP2013256167A (en) | 2012-06-12 | 2013-12-26 | Toyoda Gosei Co Ltd | Drive recorder system and in-vehicle camera system |
JP5853345B2 (en) | 2013-05-08 | 2016-02-09 | 住友電工システムソリューション株式会社 | Focus index calculation apparatus, image processing apparatus, computer program, and focus index calculation method |
JP6563694B2 (en) | 2015-05-29 | 2019-08-21 | 株式会社デンソーテン | Image processing apparatus, image processing system, image composition apparatus, image processing method, and program |
JP6809495B2 (en) | 2018-03-05 | 2021-01-06 | 株式会社デンソー | Image creation device |
JP2022063068A (en) | 2020-10-09 | 2022-04-21 | トヨタ自動車株式会社 | Drive recorder device |
JP7573420B2 (en) | 2020-11-13 | 2024-10-25 | 株式会社デンソーテン | Drive recorder and drive recorder control method |
-
2022
- 2022-09-29 TW TW111136978A patent/TW202415086A/en unknown
-
2023
- 2023-09-07 US US18/243,100 patent/US20240112435A1/en active Pending
- 2023-09-11 JP JP2023146823A patent/JP7696402B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5948038A (en) * | 1996-07-31 | 1999-09-07 | American Traffic Systems, Inc. | Traffic violation processing system |
US20120069181A1 (en) * | 2010-09-16 | 2012-03-22 | Xue Li | Object identification device, moving object controlling apparatus having object identification device, information presenting apparatus having object identification device, and spectroscopic image capturing apparatus |
US20170353748A1 (en) * | 2016-06-02 | 2017-12-07 | Biamp Systems Corporation | Systems and methods for bandwidth-limited video transport |
US20180262683A1 (en) * | 2017-03-10 | 2018-09-13 | Gopro, Inc. | Image Quality Assessment |
US20210142055A1 (en) * | 2019-11-07 | 2021-05-13 | Ambarella International Lp | Surveillance camera system looking at passing cars |
US20220171981A1 (en) * | 2020-11-30 | 2022-06-02 | Sony Group Corporation | Recognition of license plate numbers from bayer-domain image data |
Also Published As
Publication number | Publication date |
---|---|
TW202415086A (en) | 2024-04-01 |
JP7696402B2 (en) | 2025-06-20 |
JP2024050452A (en) | 2024-04-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10412298B2 (en) | Control method, control device and electronic device | |
US7227573B2 (en) | Apparatus and method for improved-resolution digital zoom in an electronic imaging device | |
EP2042374B1 (en) | Vehicle periphery monitoring apparatus and image displaying method | |
US8466989B2 (en) | Camera having image correction function, apparatus and image correction method | |
WO2019056527A1 (en) | Capturing method and device | |
KR20110116387A (en) | Imager and image distortion correction method | |
CN115936995A (en) | A method for panorama stitching of vehicle four-way fisheye camera | |
JP2023046953A (en) | Image processing system, mobile device, image processing method, and computer program | |
JP2023046965A (en) | Image processing system, moving device, image processing method, and computer program | |
JP4894708B2 (en) | Imaging device | |
KR101726692B1 (en) | Apparatus and method for extracting object | |
JP7198599B2 (en) | Image processing device, image processing method, drive recorder | |
JP3446277B2 (en) | Ambient situation display device for vehicles | |
US20240112435A1 (en) | Image recording device | |
US20210377428A1 (en) | Monitor camera | |
US20100103274A1 (en) | Image distortion compensation method and apparatus | |
CN116843595A (en) | Fusion photographing method and device, electronic equipment and vehicle | |
WO2021209018A1 (en) | Imaging system and imaging method | |
JP7324866B2 (en) | Imaging device | |
CN117857725A (en) | Image recording apparatus and image processing method | |
KR102429893B1 (en) | Apparatus and method for processing image around vehicle, and recording medium for recording program performing the method | |
KR20180067046A (en) | Image view system and operating method thereof | |
JPH09224180A (en) | Imaging device | |
JP7693643B2 (en) | Image capture setting device, image capture device, and image capture setting method | |
US20240007595A1 (en) | Camera monitoring system, control method for camera monitoring system, and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: ABILITY ENTERPRISE CO., LTD., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CHAO, CHUN-HSIUNG;REEL/FRAME:064822/0514 Effective date: 20230904 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |