KR102814326B1 - Method and apparatus for processing welding images - Google Patents

Abstract

A welding image processing device and method are provided. A method for processing a welding image according to one embodiment of the present invention includes: a step of determining a welding environment; a step of selecting one of a plurality of filters based on the welding environment; and a step of driving a motor so that the selected filter moves to a predetermined position.

Description

METHOD AND APPARATUS FOR PROCESSING WELDING IMAGES

The present invention relates to a method for processing a welding image and a device therefor.

Protective gear is worn to protect workers from light and high heat generated during welding processes such as arc welding. Since workers can only check the welding process through the protective gear while wearing the protective gear, there is the inconvenience of having to remove the protective gear and visually check various information for welding, such as the conditions set for the welding device.

If the worker's skill level is not high, especially when wearing an automatic welding mask or manual welding mask, the worker can only see the part adjacent to the welding light, and it is difficult to recognize the specific welding situation, such as the welding environment. Accordingly, it is necessary to provide the worker with a high-definition image that allows the worker to visually check the welding environment, and to provide the worker with specific information about the welding area.

In particular, when performing a welding process in which smoke is generated, there is a problem in that it is difficult to identify the welding area even when using a welding light or lighting of a welding device.

The above problem can cause the same problem to medical staff not only in welding work, but also in skin treatment and/or diagnosis using high-brightness/high-intensity light such as laser light, and is the same problem in other work using high-brightness/high-intensity light.

The present invention is in accordance with the above-described necessity, and aims to provide a welding image processing device that can show the welding environment as well as the welding spot to the worker in a welding environment where smoke is generated, thereby improving the welding accuracy of the worker.

Embodiments of the present invention disclose a method for obtaining a clear welding image of a welding portion using a camera.

The present invention can provide accurate information to a user in work handling high brightness/high illuminance light.

However, these tasks are exemplary and the scope of the present invention is not limited thereby.

A method for processing a welding image according to one aspect of the present invention comprises the steps of: determining a welding environment; selecting one of a plurality of filters based on the welding environment; and driving a motor to move the selected filter to a predetermined position.

A welding image processing device according to another aspect of the present invention includes a camera unit for photographing a welding area; a plurality of filters arranged adjacent to the camera unit; and a processor; wherein the processor determines a welding environment, selects one of the plurality of filters based on the welding environment, and drives a motor to move the selected filter to a predetermined position.

Other aspects, features and advantages other than those described above will become apparent from the following drawings, claims and detailed description of the invention.

FIG. 1 is a drawing for explaining the structure of a welding system that performs a welding image processing method according to one embodiment of the present invention.
FIG. 2 is a block diagram illustrating components of a welding system according to one embodiment of the present invention.
Figure 3 illustrates the internal configuration of a processor according to one embodiment of the present invention.
Figure 4 is a flowchart of a welding image processing method according to one embodiment of the present invention.
FIG. 5 is a drawing for explaining image frames acquired according to a shooting mode according to one embodiment of the present invention.
FIG. 6 is a drawing for explaining an example of a welding processing device according to one embodiment of the present invention.
FIG. 7 is a flowchart illustrating a method for processing a welding image without a photo sensor according to one embodiment of the present invention.
FIG. 8 is a flowchart illustrating a method of controlling a cartridge based on a photo sensor value according to one embodiment of the present invention.
FIG. 9 is a flowchart illustrating a method for controlling the position of a filter by a welding processing device according to one embodiment of the present invention.
FIG. 10 is a drawing for explaining an example of a mechanical filter control method according to one embodiment of the present invention.
FIG. 11 is a drawing for explaining another example of a mechanical filter control method according to one embodiment of the present invention.
FIG. 12 is a drawing for explaining an example of a position to which a selected filter moves according to one embodiment of the present invention.
FIG. 13 is a drawing for explaining another example of a position to which a selected filter moves according to one embodiment of the present invention.

Hereinafter, various embodiments of the present disclosure will be described in connection with the accompanying drawings. Various embodiments of the present disclosure may have various modifications and various embodiments, and thus specific embodiments are illustrated in the drawings and detailed descriptions related thereto are described. However, this is not intended to limit various embodiments of the present disclosure to specific embodiments, but should be understood to include all modifications and/or equivalents or substitutes included in the spirit and technical scope of various embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals have been used for similar components.

In various embodiments of the present disclosure, the expressions such as “includes,” “may include,” etc., indicate the presence of the disclosed corresponding function, operation, or component, etc., and do not limit one or more additional functions, operations, or components, etc. In addition, in various embodiments of the present disclosure, it should be understood that the terms such as “includes,” “have,” etc., are intended to specify the presence of a feature, a number, a step, an operation, a component, a part, or a combination thereof described in the specification, but do not exclude in advance the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

The expressions “first,” “second,” “first,” or “second,” etc., used in various embodiments of the present disclosure can modify various components of the various embodiments, but do not limit the components. For example, the expressions do not limit the order and/or importance of the components. The expressions can be used to distinguish one component from another component. For example, the first user device and the second user device are both user devices, and represent different user devices. For example, without departing from the scope of the various embodiments of the present disclosure, the first component can be referred to as the second component, and similarly, the second component can also be referred to as the first component.

When it is said that a component is "connected" or "mounted" to another component, it should be understood that said component may be directly connected or connected to said other component, but that there may also be other new components between said component and said other component. On the other hand, when it is said that a component is "directly connected" or "directly mounted" to another component, it should be understood that no other new components exist between said component and said other component.

In the embodiments of the present disclosure, terms such as “unit,” “part,” etc. are terms used to refer to components that perform at least one function or operation, and these components may be implemented as hardware or software, or as a combination of hardware and software. In addition, a plurality of “units,” “parts,” etc. may be integrated into at least one module or chip and implemented as at least one processor, except in cases where each of them needs to be implemented as individual specific hardware.

Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and will not be interpreted in an idealized or overly formal sense unless explicitly defined in various embodiments of the present disclosure.

Hereinafter, various embodiments of the present invention will be described in detail using the attached drawings.

FIG. 1 is a drawing for explaining the structure of a welding system according to one embodiment of the present invention.

Referring to FIG. 1, the welding system of the present invention may include a welding image processing device (100) and a welding torch (200). The welding image processing device (100) and the welding torch (200) may be connected to each other through a communication network to transmit and receive data. The welding image processing device (100) and the welding torch (200) may be operated in a 1:1 matching manner, but is not limited thereto, and a 1:n relationship is possible. That is, n welding torches (200) may be connected to 1 welding image processing device (100) and implemented, and n welding image processing devices (100) may be connected to 1 welding torch (200). In addition, the welding image processing device (100) and the welding torch (200) may communicate with a separate server (not shown) to transmit and receive data.

The welding image processing device (100) can provide information about the welding situation to the worker. Specifically, the welding image processing device (100) can obtain a welding image obtained by using at least one camera module included in the camera section of the welding image processing device (100), generate a composite image based on the obtained welding image, and display the obtained image to the worker. At this time, the welding image processing device (100) can generate a composite image by using HDR (High Dynamic Range) technology, and can display and provide a high-quality composite image and/or composite image to the worker. At this time, the worker can visually confirm information about the shape of the welding bead and the surrounding environment other than the part adjacent to the welding light through the high-quality composite image.

The welding image processing device (100) according to one embodiment of the present invention can obtain images through a camera unit and display each image through at least one display unit in order to synthesize and provide a high-quality welding image. At this time, the welding image processing device (100) can synthesize images by repeatedly shooting images with different shutter speeds, ISO sensitivity, and gain values of each camera. The welding image processing device (100) according to one embodiment of the present invention can improve image quality through contrast processing of the acquired synthesized image.

In addition, the welding image processing device (100) of the present invention can provide a function of displaying welding information in a preferred color (e.g., green, blue) using RGB. In addition, the welding image processing device (100) of the present invention can provide a magnifying glass degree correction function (e.g., screen enlargement and reduction). In addition, the welding image processing device (100) of the present invention can provide a temperature synthesis image using a separate thermal imaging camera. At this time, the welding image processing device (100) can display the welding temperature in color. The welding image processing device (100) of the present invention can support a function of providing all of the above-described functions as sound (e.g., guidance alarm) or guidance voice.

A welding torch (200) according to one embodiment of the present invention can detect a welding situation including a welding temperature, a welding direction, a welding inclination, a welding speed, and a gap between a workpiece and a welding torch for real-time welding work through at least one sensor. The welding torch (200) can monitor the status of the torch and change the setting value of the torch work according to the welding situation.

The welding image processing device (100) of the present invention can receive information on work settings and work status from the welding torch (200) through a communication network connected to the welding torch (200), and can provide work information to the worker through visual feedback based on the received welding information.

For example, when the welding image processing device (100) receives sensing information on a welding temperature value, it can output a notification corresponding to the temperature value in various ways, such as light, vibration, or a message. At this time, the notification can be visual feedback provided on the display unit or display of the welding image processing device (100), or auditory feedback through sound (e.g., a guidance alarm) or guidance voice.

Meanwhile, sensing information about the temperature value may include information about whether it exceeds a preset temperature range, etc. In addition, sensing information about the temperature value may include a numerical value, grade, level, etc. corresponding to the temperature value of the welding surface.

The welding image processing device (100) according to one embodiment of the present invention can guide the worker to stop work if it is determined that the temperature values of the torch and the welding surface are outside the preset temperature range. In the case of welding outside the preset temperature range, there is a risk of quality deterioration, and thus the worker can be guided to adjust the temperature value of the torch.

When the current or voltage state of the welding torch (200) is detected as abnormal, the welding image processing device (100) according to one embodiment of the present invention can provide visual feedback for a warning.

At this time, the visual feedback may be to provide an icon indicating danger in a part of the display area of the welding image processing device (100) displaying the work site. As another example, the welding image processing device (100) may provide work stoppage guidance through visual feedback by repeatedly increasing and decreasing the saturation of the entire display screen for a specific color (e.g., red).

According to one embodiment of the present invention, the welding image processing device (100) can sense welding information through a sensor (e.g., a first sensor) included in the welding image processing device (100) in addition to at least one sensor (e.g., a second sensor) included in the welding torch (200). At this time, the welding information can detect a welding situation including light intensity, welding temperature, welding direction, welding inclination, welding speed, and a gap between a workpiece and a welding torch, etc. related to real-time welding work, through at least one sensor.

Similarly, the welding image processing device (100) can provide guiding corresponding to the welding information based on the welding information detected through a sensor (e.g., a first sensor) included in the welding image processing device (100).

According to one embodiment of the present invention, the welding image processing device (100) can change the operation of the welding torch by sensing a preset user movement or a preset user voice after guidance for stopping work is provided.

In another embodiment, the welding image processing device (100) can obtain the temperature values of the torch and the welding surface through image sensing provided by itself when communication with the welding torch (200) is not smooth. For example, the welding image processing device (100) can obtain the temperature values of the torch and the welding surface based on image data obtained through a thermal imaging camera.

The above-described example only describes the case where the information received from the welding torch (200) is welding temperature information, and the welding image processing device (100) can provide various guiding for various welding information.

FIG. 2 is a simplified block diagram illustrating components of a welding system according to one embodiment of the present invention.

Referring to FIG. 2, the welding system (10) may include a welding image processing device (100) and a welding torch (200). The welding image processing device (100) may include a camera unit (110), a lighting unit (112), a communication unit (120), a display unit (130), a first processor (150), and a sensor unit (140), and the welding torch (200) may include a communication unit (210), a sensor unit (220), and a second processor (230).

The camera unit (110) may include at least one camera module, for example, the camera module may include a camera for capturing images of a welding work site. The camera unit (110) according to one embodiment of the present invention may be a camera positioned adjacent to the display unit (130) of the welding image processing device (100). For example, the first camera and the second camera of the camera unit (110) may be mounted symmetrically on one area of the front of the welding image processing device (100), respectively.

The camera unit (110) receives a control command from the first processor (150) and, in response to the control command, changes settings such as shutter speed, ISO sensitivity, and GAIN to capture a welding work site. The camera unit (110) may include a first camera and a second camera, each of which may capture a welding work site using different shooting settings.

The camera unit (110) according to one embodiment of the present invention may be included in an area of the front of the display unit (130), and may have a structure in which a light shielding cartridge is positioned in front of a lens that receives light from a subject.

The automatic shading cartridge can block welding light generated when a worker performs welding. That is, the automatic shading cartridge (not shown) can increase the shading degree of the cartridge by blackening based on welding light information detected by a sensor unit (140), for example, an image sensor or a photo sensor. At this time, the automatic shading cartridge can include, for example, a liquid crystal display (LCD) panel whose blackening degree can be adjusted according to the alignment direction of liquid crystals. However, the present invention is not limited thereto, and can be implemented with various panels such as a VA (Vertical Align) type LCD, a TN (Twist Nematic) type LCD, and an IPS (In Plane Switching) type LCD.

The blackening degree of the automatic shading cartridge can be automatically adjusted according to the brightness of the welding light. As described above, when automatically adjusted according to the brightness of the welding light, the sensor unit (140) can be used. The sensor unit (140) detects the brightness of the welding light to obtain welding light information, and transmits information about the brightness of the welding light included in the welding light information as a predetermined electrical signal to the first processor (150) to be described later, so that the first processor (150) can control the blackening degree based on the brightness of the welding light.

That is, the automatic shading cartridge (not shown) can change the shading level of the panel in real time to correspond to the brightness of light generated from the welding surface at the welding work site, and the camera unit (110) can capture a welding image with a certain amount of welding light blocked by the automatic shading cartridge installed on the front.

According to another embodiment of the present invention, the welding image processing device (100) may not include an automatic shading cartridge. In this case, the user can perform welding work using only the welding image acquired through the camera unit (110).

The camera unit (110) according to one embodiment of the present invention may include a thermal imaging camera. The welding image processing device (100) may obtain a temperature image by synthesizing a thermal image obtained through the thermal imaging camera with an image of a welding site.

According to one embodiment of the present invention, a lighting unit (112) electrically connected to the first processor (150) may be further included. The lighting unit (112) is located outside the welding image processing device (100) and is configured to irradiate light at least toward a welding work area. The lighting unit (112) may include a plurality of LED modules, and the output level of light irradiated through the lighting unit (112) may be adjusted by the control of the first processor (150). According to one embodiment, the lighting unit (112) may operate in conjunction with the operation of the camera unit (110) according to the control of the first processor (150). A more specific embodiment will be described later.

The communication unit (120) is configured to receive welding information from the welding torch (200) and transmit a command to control the welding torch (200). According to one embodiment of the present invention, the communication unit (120) can transmit a composite image to an external device other than the welding torch (200). At this time, the external device can include various devices including a communication module, such as a smartphone or computer of a worker/third party.

The communication unit (120) may be configured to perform communication with various types of external devices according to various types of communication methods. The communication unit (120) may include at least one of a Wi-Fi chip, a Bluetooth chip, a wireless communication chip, and an NFC chip. In particular, when a Wi-Fi chip or a Bluetooth chip is used, various connection information such as an SSID and a session key may be first transmitted and received, and then communication may be established using the information, and then various pieces of information may be transmitted and received. The wireless communication chip refers to a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), and LTE (Long Term Evolution). The NFC chip refers to a chip that operates in the NFC (Near Field Communication) method using a 13.56MHz band among various RF-ID frequency bands such as 135kHz, 13.56MHz, 433MHz, 860~960MHz, and 2.45GHz.

The display unit (130) is configured to provide a high-definition composite image to the operator. Specifically, the display unit (130) may be implemented in the form of goggle glasses including a display that displays a composite image obtained by synthesizing an image acquired through the camera unit (110) to the operator.

According to one embodiment of the present invention, the rear portion of the display unit (130), i.e., the portion facing the operator, may include a display for displaying a high-definition image to the operator, and an eyepiece and an eyepiece for viewing the display.

The display included in the display unit (130) can display a high-definition composite image so that the worker can visually check the surrounding environment (e.g., the shape of the welding bead that has already been worked on) other than the part adjacent to the welding light. In addition, the display unit (130) can guide the worker with visual feedback on the welding progress status (e.g., the welding progress direction).

The display included in the display unit (130) may be implemented with various display technologies such as LCD (Liquid Crystal Display), OLED (Organic Light Emitting Diodes), LED (Light-Emitting Diode), LcoS (Liquid Crystal on Silicon), or DLP (Digital Light Processing). In this case, the display according to one embodiment of the present invention is implemented with a panel made of an opaque material, and the operator may not be directly exposed to harmful light. However, the present invention is not necessarily limited thereto, and the display may be provided as a transparent display.

The sensor unit (140) may include a plurality of sensor modules configured to detect various information about the welding site and obtain welding information. At this time, the welding information may include welding temperature, welding direction, welding inclination, welding speed, and the gap between the mother material and the welding torch for real-time welding work. Furthermore, the sensor unit (140) may include a light sensor module configured to detect light intensity at least within the welding work area.

According to one embodiment of the present invention, the sensor unit (140) may include an illuminance sensor, and at this time, the sensor unit (140) may obtain information on the brightness of welding light at a welding site. In addition to the illuminance sensor, the sensor unit (140) may further include various types of sensors such as a proximity sensor, a noise sensor (a video sensor), an ultrasonic sensor, an RF sensor, and an optical sensor, and may detect various changes related to a welding work environment.

The first processor (150) can generate a high-quality composite image by synthesizing welding image frames received through the camera unit (110). The first processor (150) can obtain a composite image by synthesizing frames acquired in time order in parallel while setting different shooting conditions for each frame by the camera unit (110). Specifically, the first processor (150) can control the camera unit (110) to take pictures by changing the shutter speed, ISO sensitivity, GAIN, etc. of the camera unit (110).

At this time, the first processor (150) can set the shooting conditions differently according to conditions such as the welding light, ambient light, and the degree of movement of the welding torch (200) at the sensed welding site. Specifically, the first processor (150) can set the shooting conditions so that the ISO sensitivity and GAIN are reduced as the welding light and/or ambient light at the welding site are high. In addition, the shooting conditions can be set so that the shutter speed is increased when the movement and/or working speed of the welding torch (200) is detected to be fast.

The first processor (150) can synthesize images of a preset number of frames in parallel. According to one embodiment of the present invention, each image within the preset frames may be captured under different shooting conditions.

According to one embodiment of the present invention, the first processor (150) can control shooting by setting shooting conditions of each camera unit differently when there are two or more camera units (110). In this case as well, the first processor (150) can synthesize images of a preset number of frames in parallel.

In addition, according to some embodiments of the present invention, the first processor (150) receives a sensor value from the welding device, sets the shooting mode of the camera module to the first mode or the second mode based on the sensor value, and obtains an image frame for the welding portion from the camera module, and when the shooting mode of the camera module is set to the first mode, an infrared image frame for the welding portion can be obtained.

The first processor (150) can control the overall operation of the welding image processing device (100) using various programs stored in the memory (not shown). For example, the first processor (150) can include a CPU, a RAM, a ROM, and a system bus. Here, the ROM is a configuration in which a command set for system booting is stored, and the CPU copies the operating system stored in the memory of the welding image processing device (100) to the RAM according to the command stored in the ROM, and executes the O/S to boot the system. When booting is complete, the CPU can copy various applications stored in the memory to the RAM and execute them to perform various operations. In the above, the first processor (150) has been described as including only one CPU, but it can be implemented with multiple CPUs (or DSPs, SoCs, etc.) when implemented.

According to one embodiment of the present invention, the first processor (150) may be implemented as a digital signal processor (DSP) for processing a digital signal, a microprocessor, and/or a time controller (TCON). However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a communication processor (CP), an ARM processor, or may be defined by the corresponding terms. In addition, the first processor (150) may be implemented as a system on chip (SoC) having a processing algorithm built-in, a large scale integration (LSI), or may be implemented in the form of a field programmable gate array (FPGA).

The welding torch (200) may include a communication unit (210), a sensor unit (220), and a second processor (230).

The communication unit (210) transmits and receives data with the welding image processing device (100). The communication unit (210) may include a module capable of short-range wireless communication (e.g., Bluetooth, Wifi, Wifi-Direct) or long-range wireless communication (3G, HSDPA (High-Speed Downlink Packet Access) or LTE (Long Term Evolution)).

The sensor unit (220) or the second sensor is included in the welding torch and is configured to sense welding conditions such as welding temperature, welding speed, welding inclination, welding direction, and the gap between the workpiece and the welding torch.

The sensor unit (220) can detect at least one of various changes, such as a change in the posture of a user holding a welding torch (200), a change in the illuminance of a welding surface, a change in the acceleration of the welding torch (200), etc., and transmit an electrical signal corresponding thereto to the second processor (230). That is, the sensor unit (220) can detect a state change that occurs based on the welding torch (200), generate a detection signal accordingly, and transmit the same to the second processor (230).

In the present disclosure, the sensor unit (220) may be composed of various sensors, and when the welding torch (200) is driven (or based on user settings), power may be supplied to at least one preset sensor according to control to detect a change in the status of the welding torch (200).

In this case, the sensor unit (220) may be configured to include at least one of all types of sensing devices capable of detecting a change in the state of the welding torch (200). For example, the sensor unit (220) may be configured to include at least one sensor of various sensing devices such as an acceleration sensor, a gyro sensor, an illuminance sensor, a proximity sensor, a pressure sensor, a noise sensor, a video sensor, a gravity sensor, etc. The light intensity within the welding work area detected by the light intensity sensor of the welding torch (200) can be transmitted to the first processor (150) through the communication unit (210), and the first processor (150) can control the lighting unit (112) and/or the camera unit (110) based on the light intensity transmitted through the light intensity sensor of the welding torch (200) without going through the sensor unit (140) of the welding image processing device (100).

Meanwhile, the acceleration sensor is a component for detecting the movement of the welding torch (200). Specifically, the acceleration sensor can measure dynamic forces such as acceleration, vibration, and impact of the welding torch (200), and thus can measure the movement of the welding torch (200).

The gravity sensor is a component for detecting the direction in which gravity is directed. That is, the detection result of the gravity sensor can be used to determine the movement of the welding torch (200) together with the acceleration sensor. In addition, the direction in which the welding torch (200) is held can be determined through the gravity sensor.

In addition to the types of sensors described above, the welding torch (200) may further include various types of sensors such as a gyroscope sensor, a geomagnetic sensor, an ultrasonic sensor, and an RF sensor, and may detect various changes related to the welding work environment.

FIG. 3 illustrates the internal configuration of a first processor (150) of a welding image processing device (100) according to one embodiment of the present invention.

Hereinafter, referring to FIG. 3, a detailed review will be given of a configuration of a first processor (150) according to an embodiment of the present invention. For ease of understanding, the processor described below is assumed to be the first processor (150) of the welding image processing device (100) illustrated in FIG. 2. However, in another embodiment, when the welding image processing method is performed in a welding torch (200), the welding image processing method described below may be performed by a second processor (230), and in another embodiment, when the welding image processing method is performed in an external server, the processor described below may be a processor of the external server. Note that

The first processor (150) of the welding image processing device (100) according to one embodiment of the present invention includes a sensor value receiving unit (151), a shooting mode setting unit (152), and an image frame obtaining unit (153). According to some embodiments, the components of the first processor (150) described above may be selectively included or excluded from the processor. In addition, according to some embodiments, the components of the processor may be separated or merged to express the function of the processor.

These processors (150) and components of the processor (150) can control the welding image processing device to perform steps (S110 to S150) included in the welding image processing method of FIG. 4. For example, the processor (150) and components of the processor (150) can be implemented to execute instructions according to codes of an operating system included in a memory (not shown) and codes of at least one program. Here, the components of the processor (150) can be expressions of different functions of the processor (150) performed by the processor (150) according to instructions provided by program codes stored in the welding image processing device (100). The internal configuration and specific operation of the processor (150) will be described with reference to the welding image processing method of FIG. 4 and the embodiments of FIGS. 5 to 10.

Figure 4 is a flowchart of a welding image processing method according to one embodiment of the present invention.

In step S110, the welding image processing device can receive a sensor value from the welding device. More specifically, the welding image processing device can receive a sensor value related to the degree of smoke generation at the welding site from the smoke detection sensor.

In step S120, the welding image processing device can set the shooting mode of the camera module to the first mode or the second mode based on the sensor value. In one embodiment, the first mode described above can be an infrared shooting mode and the second mode can be a visible light shooting mode. In this embodiment, the welding image processing device can transmit a setting signal to the first mode or the second mode to the camera.

In step S130, the welding image processing device can check whether the shooting mode of the camera module is set to the first mode. If the sensor value is equal to or greater than the threshold, the welding image processing device can set the shooting mode of the camera module to the first mode, and if the sensor value is less than the threshold, the shooting mode of the camera module can be set to the second mode. In one embodiment, the welding image processing device can perform step S140 if the sensor value is equal to or greater than the threshold, and in an optional embodiment, the welding image processing device can perform step S150 if the sensor value is less than the threshold.

In step S140, the welding image processing device can obtain an infrared image frame for the welding portion. In one embodiment, the welding image processing device can obtain an infrared image frame from a camera module including an infrared transmission filter when the shooting mode is set to the first mode.

That is, the method of acquiring an infrared image frame is not limited. For example, an infrared image frame may be acquired by placing an infrared transmitting filter in front of a camera included in a welding image processing device, or an infrared image frame may be acquired through an infrared shooting mode set electronically.

In step S150, the welding image processing device can obtain an image frame for the welding portion. That is, in the present embodiment, the welding image processing device can obtain a visible light image frame for the welding portion.

FIG. 5 is a drawing for explaining image frames acquired according to a shooting mode according to one embodiment of the present invention.

In one embodiment, the welding image processing device (100) may receive a sensor value related to the degree of smoke generation at a welding site and obtain a visible light image frame (301) or an infrared image frame (302) based on the above-described sensor value.

More specifically, the welding image processing device (100) can set the camera's shooting mode to the first mode or the second mode based on the sensor value described above. In one embodiment, the camera's shooting mode may be set in response to a user input of a worker performing a welding process, but according to another embodiment, the camera's shooting mode may be set based on whether the sensor value described above exceeds a reference value.

According to some embodiments of the present invention, the shooting mode of the camera is automatically set based on the sensor values, thereby obtaining a welding image optimized for the surrounding environment without additional operation by the user.

Below, a method for obtaining an infrared image frame using an infrared transmitting filter is described in detail.

A welding image processing device can receive a sensor value related to the degree of smoke generation at a welding site from a smoke detection sensor.

The welding image processing device sets the shooting mode of the camera module to the first mode when the sensor value is greater than or equal to a threshold value, and in one embodiment, the welding image processing device can obtain an infrared image frame from a camera module including an infrared transmitting filter when the shooting mode is set to the first mode.

A welding image processing device according to one embodiment can obtain an infrared image frame by placing an infrared transmitting filter in front of a camera.

That is, the welding image processing device can be equipped with multiple filters in front of the camera so that only light of a predetermined wavelength band can be transmitted. For example, the camera filter can be designed so that light of only an infrared wavelength band can pass through the filter.

For example, an infrared transmitting filter may consist of, but is not limited to, a long pass filter and a band pass filter.

As described above, the welding image processing device (100) can generate images so that only a predetermined band of wavelengths is transmitted using the welding filter described above. Accordingly, the welding image processing device (100) can obtain various optimized image frames using various filters that satisfy various criteria.

In one embodiment, the welding image processing device (100) may be equipped with a filter that satisfies certain safety standards. In one embodiment, the welding image processing device may be equipped with a filter that satisfies international standards for ultraviolet safety. The welding image processing device according to this embodiment can ensure the safety of workers by satisfying ultraviolet safety standards (CE, ANSI).

Meanwhile, the camera unit of the welding image processing device (100) may include an image sensor. Alternatively, the cartridge of the welding image processing device (100) may include a photo sensor. Alternatively, the welding image processing device (100) may include both an image sensor and a photo sensor. Hereinafter, an image sensor and a photo sensor are described as examples of sensors included in the welding image processing device (100), but are not limited thereto. In other words, the welding image processing device (100) may include various types of optical sensors, and any type of sensor that performs sensing for controlling the transmittance of the cartridge may be used.

The welding image processing device (100) can control the transmittance of the cartridge based on the sensor value of the image sensor and/or the sensor value of the photo sensor. Here, the operation of controlling the transmittance of the cartridge means the operation of increasing or decreasing the light shielding degree by adjusting the blackening degree of the cartridge.

In general, the brightness of the welding light generated during welding work is higher than the brightness of light in a normal environment (e.g., sunlight). Therefore, a camera with higher specifications than a normal camera is required to capture a welding image. Meanwhile, as the camera specifications increase, the price of the camera also increases, so the manufacturing cost of a welding image processing device including a high-spec camera is bound to be high.

A welding image processing device (100) according to one embodiment of the present invention has a cartridge placed in front of a camera section, and controls the transmittance of the cartridge according to the sensor values of an image sensor and/or a photo sensor. Therefore, the camera of the welding image processing device (100) can capture high-quality welding images even with just a normal camera.

Accordingly, since the camera unit of the welding image processing device (100) according to one embodiment of the present invention does not need to be implemented as a high-spec camera, the manufacturing cost of the welding image processing device (100) can be reduced, and at the same time, a high-quality welding image can be obtained.

Hereinafter, with reference to FIG. 6, examples of image sensors and photo sensors included in the welding image processing device (100) will be described.

FIG. 6 is a drawing for explaining an example of a welding processing device according to one embodiment of the present invention.

Referring to FIG. 6, the welding image processing device (100) includes a main body (160), a display unit (130) installed on the front of the main body (160), and a camera unit (110) mounted on the outside of the main body. In addition, although not shown in FIG. 6, the welding image processing device (100) may further include a lighting unit (112), a communication unit (120), a sensor unit (140), and a processor (150), as described above with reference to FIG. 2.

The camera unit (110) may be implemented with one or more cameras. For example, if the camera unit (110) is implemented with a single camera, the single camera may be placed in one area of the main body (160). As another example, if the camera unit (110) is implemented with a plurality of cameras, the camera unit (110) may be symmetrically placed in one area of the main body (160). However, the position where the camera unit (110) is placed in the welding image processing device (100) is not limited to a specific position. In addition, if necessary, the camera unit (110) may be implemented in a detachable form by changing the position.

The front part of the display part (130) may be an external area (as shown in FIG. 1) corresponding to the direction in which the welding work is performed. Conversely, the rear part of the display part (130) may be an internal area corresponding to the direction of the worker's face.

As described above with reference to FIG. 5, the welding image processing device (100) includes a cartridge capable of controlling the transmittance. For example, the cartridge may be placed in front of the camera unit (110). Accordingly, light (including welding light) filtered through the cartridge is received by the camera unit (110), and the camera unit (110) can generate a welding image according to the filtered light.

In addition, as described above with reference to FIG. 5, the sensor unit (140) includes an image sensor and/or a photo sensor. For example, the image sensor may be included in the camera unit (110) or may be positioned adjacent to the camera unit (110). In addition, the photo sensor may be included in the cartridge or may be positioned adjacent to the cartridge. Accordingly, the image sensor and/or the photo sensor can accurately sense the brightness of light at a point viewed by the camera unit (100).

Hereinafter, with reference to FIGS. 7 and 8, an example of controlling the transmittance of a cartridge based on the sensor value of an image sensor or the sensor value of a photo sensor will be described.

FIG. 7 is a flowchart illustrating a method for processing a welding image without a photo sensor according to one embodiment of the present invention.

In step S111, the welding image processing device (100) can obtain a welding image. Thereafter, in step S112, the welding image processing device (100) can obtain a sensor value for the welding image obtained from the image sensor. Then, in step S113, the welding image processing device can control the transmittance of the cartridge based on the image sensor value.

According to the present embodiment, the welding image processing device (100) can control the light shielding degree or transmittance of the cartridge based on the image sensor value for the welding image described above. For example, the image sensor of the welding image processing device (100) can measure the brightness of the welding light based on the welding image. If the measured brightness of the welding light is higher than a threshold value, the welding image processing device (100) can adjust the blackening degree of the cartridge to increase the light shielding degree of the cartridge. Therefore, even if the actual welding light exceeds the range of brightness or illuminance that the camera unit (110) can capture, the camera unit (110) can generate a high-quality welding image by using the light filtered by the cartridge.

FIG. 8 is a flowchart illustrating a method of controlling a cartridge based on a photo sensor value according to one embodiment of the present invention.

When using a neutral density filter to adjust the exposure amount of a welding camera, there is the inconvenience of having to use a filter of different density depending on the situation, and there is a limitation that fine adjustment of the exposure amount is impossible. The welding image processing device (100) according to one embodiment of the present invention can adjust the exposure amount in real time by controlling the transmittance of the cartridge based on the photo sensor value, thereby obtaining an optimal welding image for the welding area.

For example, in step S210, the welding image processing device (100) can obtain a photo sensor value for the welding image being captured. In step S220, the welding image processing device (100) can determine whether the photo sensor value exceeds a specified threshold range.

If the photo sensor value exceeds the specified critical range, in step S230, the welding image processing device (100) can control the transmittance of the cartridge based on the photo sensor value. Alternatively, if the photo sensor value is included in the specified critical range, the welding image processing device (100) may not separately perform a process of controlling the transmittance of the cartridge. In step S240, the welding image processing device (100) can obtain a welding image of the welding area using light filtered through the cartridge.

As described above with reference to FIGS. 7 and 8, the welding image processing device (100) can obtain an optimal welding image for a welding environment even when using a low-cost camera module with a wide brightness range.

Meanwhile, as described above with reference to FIG. 2, the welding image processing device (100) may include an automatic shading cartridge, but is not limited thereto. In other words, the welding image processing device (100) includes a plurality of filters having preset shading levels, and the positions of the plurality of filters may be changed according to mechanical control.

For example, the welding image processing device (100) can determine the welding environment and select one of a plurality of filters according to the welding environment. Then, the welding image processing device (100) can drive a motor that changes the position of the filter so that the selected filter moves to a predetermined position.

Hereinafter, with reference to FIGS. 9 to 13, examples of a welding image processing device (100) selecting one of a plurality of filters and controlling the position of the selected filter will be described.

FIG. 9 is a flowchart illustrating a method for controlling the position of a filter by a welding processing device according to one embodiment of the present invention.

At step S310, the welding image processing device (100) determines the welding environment.

The processor (150) can determine the welding environment through the sensor unit (140). For example, an optical sensor (e.g., an image sensor, a photo sensor, etc.) included in the sensor unit (140) can detect welding light generated while welding is performed, and the processor (150) can determine the welding environment based on the detected welding light.

Here, judging the welding environment includes judging that welding has started or that the brightness of the welding light has changed.

When welding starts and a welding arc is generated, the sensor unit (140) can detect welding light according to the welding arc. The welding arc emits very bright light compared to light in a general environment. Therefore, when the sensor unit (140) detects light that is brighter than normal light, the processor (150) can determine that welding has started. For example, when the brightness of the light detected by the sensor unit (140) exceeds a predetermined value, the processor (150) can determine that welding has started. However, the method by which the processor (150) determines the moment of start of welding is not limited to the above-described example.

Even during welding, the brightness of the welding light may vary depending on various conditions such as welding temperature, welding speed, welding inclination, welding direction, and the distance between the mother material and the welding torch. Accordingly, the processor (150) can determine the change in brightness of the welding light based on the light detected through the sensor unit (140).

Examples of the processor (150) determining the welding environment through the sensor unit (140) are as described above with reference to FIGS. 7 and 8.

At step S320, the welding image processing device (100) selects one of a plurality of filters based on the welding environment.

Here, each of the plurality of filters may exhibit a preset degree of light blocking. In other words, each filter may have a predetermined degree of light transmission (i.e., light transmittance). For example, the filter may be implemented by bonding an optical filter to a neutral density filter, but is not limited thereto.

As another example, the filter may have a band of light filtered therein that is determined in advance. For example, the filter may be implemented by coating a glass filter with a predetermined material, but is not limited thereto. The band of light passing through the filter may be determined or changed by the coating described above.

The processor (150) selects a filter capable of filtering welding light corresponding to the current welding environment from among a plurality of filters. As described above in step S310, the brightness of the welding light may vary depending on the start of welding or changes in the welding environment. Therefore, an appropriate filter must be selected in response to the brightness of the welding light, so that the camera unit (110) can generate a high-quality welding image using the welding light filtered by the filter. Here, filtering the welding light by the filter means that the transmittance and/or the transmission band of the welding light are filtered so that it is included in the range of brightness or illuminance that the camera unit (110) can capture.

At step S330, the welding image processing device (100) drives a motor to move the selected filter to a predetermined position.

As an example, the processor (150) may drive a motor so that a selected filter moves to a predetermined position by causing a plurality of filters to move in a linear manner. As another example, the processor (150) may drive a motor so that a selected filter moves to a predetermined position by causing a plurality of filters to move in a rotational manner. Examples of the processor (150) driving a motor to move the positions of the filters will be described below with reference to FIGS. 10 and 11.

As described above with reference to step S320, each of the plurality of filters exhibits a preset degree of shading, and an appropriate filter among the plurality of filters is selected based on the welding environment. In other words, a filter that filters the welding light so that a high-quality welding image can be generated by the camera unit (100) is selected. Therefore, the selected filter must be located so that it can filter the welding light before the welding image is generated.

The processor (150) checks where the selected filter is currently located. Then, the processor (150) drives the motor so that the selected filter can move to a predetermined location.

As an example, the predetermined position may be between the lens of the camera unit (110) and the image sensor. As another example, the predetermined position may be in front of the lens of the camera unit (110). Examples of the predetermined position are described below with reference to FIGS. 12 and 13.

FIG. 10 is a drawing for explaining an example of a mechanical filter control method according to one embodiment of the present invention.

FIG. 10 illustrates some components of a welding image processing device (100). For example, the welding image processing device (100) includes a PCB (1010), a motor (1020), a filter moving part (1030), filters (1041, 1042, 1043), and an image sensor (1050).

Referring to FIG. 10, filters (1041, 1042, 1043) are arranged in series on the filter moving unit (1030). Accordingly, the processor (150) drives the motor (1020) so that the filter moving unit (1030) moves linearly (e.g., left-right or up-down), thereby changing the positions of the filters (1041, 1042, 1043).

For example, when the processor (150) selects the filter (1043) among the filters (1041, 1042, 1043), the processor (150) can check the current position of the filter (1043) and drive the motor (1020) so that the filter (1043) is positioned on the image sensor (1050).

Meanwhile, although FIG. 10 illustrates that the filter (1043) is positioned on the image sensor (1050), it is not limited thereto. Examples of positions where the filter (1043) is moved will be described later with reference to FIG. 12 and FIG. 13.

FIG. 11 is a drawing for explaining another example of a mechanical filter control method according to one embodiment of the present invention.

FIG. 11 illustrates some components of a welding image processing device (100). For example, the welding image processing device (100) includes a PCB (1110), a motor (1120), a filter moving part (1130), filters (1141, 1142, 1143, 1144), and an image sensor (1150).

Referring to FIG. 10, filters (1141, 1142, 1143, 1144) are arranged in a circular shape on the filter moving part (1130). Accordingly, the processor (150) drives the motor (1120) to cause the filter moving part (1130) to rotate, thereby changing the positions of the filters (1141, 1142, 1143, 1144).

For example, when the processor (150) selects filter (1143) among filters (1141, 1142, 1143, 1144), the processor (150) can check the current position of the filter (1143) and drive the motor (1120) so that the filter (1143) is positioned on the image sensor (1150).

Meanwhile, although FIG. 11 illustrates that the filter (1143) is positioned on the image sensor (1150), it is not limited thereto. Examples of positions where the filter (1143) is moved will be described later with reference to FIGS. 12 and 13.

FIG. 12 is a drawing for explaining an example of a position to which a selected filter moves according to one embodiment of the present invention.

FIG. 12 illustrates some components of a welding image processing device (100). For example, the welding image processing device (100) includes a PCB (1210), a motor (1220), a filter (1230), a lens (1240), and an image sensor (1150). The PCB (1210), the motor (1220), the filter (1230), and the image sensor (1250) illustrated in FIG. 12 are the same as those illustrated in FIGS. 10 and 11.

The lens (1240) refers to a lens included in the camera unit (110). In addition, the filter (1230) refers to a filter selected by the processor (150) from among a plurality of filters.

As described above with reference to FIGS. 9 to 11, the filter (1230) has a light shielding degree that appropriately filters the welding light so that the camera unit (110) can generate a high-quality welding image. Accordingly, the filter (1230) must be moved to a position where the camera unit (110) can generate a welding image according to the filtered welding light.

The processor (150) drives the motor (1220) to move the filter (1230) to a predetermined position. For example, the processor (150) may drive the motor (1220) so that the filter (1230) is positioned in front of the lens (1240). Accordingly, the image sensor (1250) may detect light filtered by the filter (1230).

FIG. 13 is a drawing for explaining another example of a position to which a selected filter moves according to one embodiment of the present invention.

FIG. 13 illustrates some configurations of a welding image processing device (100). For example, the welding image processing device (100) includes a PCB (1310), a motor (1320), a filter (1330), a lens (1340), and an image sensor (1350). The PCB (1310), the motor (1320), the filter (1330), the lens (1340), and the image sensor (1350) illustrated in FIG. 13 are the same as those illustrated in FIG. 12.

The processor (150) drives the motor (1320) to move the filter (1330) to a predetermined position. For example, the processor (150) may drive the motor (1320) so that the filter (1330) is positioned between the lens (1340) and the image sensor (1350). Accordingly, the image sensor (1350) can detect light filtered by the filter (1330).

All embodiments described in this specification can be applied in combination with each other to other embodiments.

Meanwhile, the welding image processing device (100) of the embodiments described above has been exemplified as being used for welding work, but the present invention is not necessarily limited thereto. That is, the welding image processing device (100) of the embodiments described above can be implemented as an information providing device, and the information providing device can be used as, for example, a firefighting, medical and/or skin treatment information providing device with the configuration described above. That is, when performing work that irradiates high-brightness/high-illuminance light such as laser light, the user can provide an environment in which the optimal image can be obtained while reducing unnecessary power waste by adjusting the output of the lighting unit according to the situation using the firefighting, medical and/or skin treatment information providing device as described above. The present invention can also be used as an information providing device in various other work that irradiates high-brightness/high-illuminance light.

Although the present invention has been described with reference to the embodiments shown in the drawings, these are merely exemplary, and those skilled in the art will understand that various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention should be determined by the technical idea of the appended claims.

Claims (8)

A method for processing a welding image, performed by a computing device,
A step of receiving a sensor value from a sensor;
A step of controlling the transmittance of the filter based on the received sensor value; and
Comprising a step of obtaining a welding image at a welding site based on light passing through the filter having the above-mentioned controlled transmittance,
The step of obtaining the above welding image is:
Obtain a welding image based on a pair that has passed through a filter whose transmittance is controlled by the above filter,
The above filter is,
The processor of the computing device determines the welding environment based on the sensor value, and based on the determined welding environment, one of a plurality of filters is selected by the processor, and the filter is controlled to move between the lens and the image sensor of the camera unit arranged to obtain the welding image by driving the motor.
In the step of obtaining the above welding image, the welding environment is determined.
It is determined that welding has started at the welding area by determining that either the brightness or the illuminance of the light at the welding area exceeds a predetermined intensity and is out of the range that the camera unit can capture.
How to process welding images. In paragraph 1,
Each of the above multiple filters exhibits a preset degree of light blocking,
The above selection steps are:
A method for selecting a filter capable of filtering welding light corresponding to the above welding environment. delete In paragraph 1,
The above driving steps are:
A method of driving the motor so that the selected filter moves to the predetermined position by the linear movement of the plurality of filters, or driving the motor so that the selected filter moves to the predetermined position by the rotational movement of the plurality of filters. Camera section for filming the welding area;
A plurality of filters arranged adjacent to the camera section; and
a processor; including;
The above processor,
Controlling the transmittance of the filters based on the sensor values received from the sensor, and obtaining a welding image through the camera unit based on light passing through the filter whose transmittance is controlled;
A welding environment is determined based on the sensor value received from the sensor, and one of the plurality of filters is selected based on the determined welding environment, and a motor is driven so that the selected filter moves between the lens of the camera unit and the image sensor of the camera unit.
A welding image processing device, wherein the welding environment is determined by determining that either the brightness or the illuminance of light at the welding area exceeds a predetermined intensity and is outside the range that the camera unit can capture, thereby determining that welding has started at the welding area. In paragraph 5,
Each of the above multiple filters exhibits a preset degree of light blocking,
The above processor,
A device for selecting a filter capable of filtering welding light corresponding to the above welding environment. delete In paragraph 5,
The above processor,
A device that drives the motor so that the selected filter moves to the predetermined position by the linear movement of the plurality of filters, or drives the motor so that the selected filter moves to the predetermined position by the rotational movement of the plurality of filters.

Images