KR100656875B1 - Method and device for preparing household account book using mobile terminal - Google Patents

Abstract

A method and an apparatus for keeping a housekeeping account book using a mobile terminal are provided to stably provide purchase information to a user regardless of a communication network situation so that the user can keep a housekeeping account book with respect to purchase particulars. A character recognizing unit(21) recognizes characters from an image of a subject captured by a camera unit(15). A text extracting unit(22) extracts text information from the recognized characters. A text separating unit(23) separates a character string and a number string from the extracted text information. A screen display unit(17) displays the character string and the number string. A housekeeping account book creating unit(24) classifies a goods category of the character string and calculates a purchase amount or the number of goods of the number string.

Description

Method and apparatus for creating a household account book using a mobile terminal {Method and apparatus for keeping a household account book with a portable terminal}

1 is a block diagram of an embodiment of an account book creating apparatus using a mobile terminal according to the present invention,

2 is a flowchart illustrating an embodiment of a method of creating an account book using a mobile terminal according to the present invention.

The present invention relates to a method and apparatus for creating an account book using a mobile terminal, in particular, to a method and a device for creating an account book using a mobile terminal having a digital camera. The present invention relates to a method and an apparatus for creating an account book by taking a document in which text) is written and extracting text from the receipt photo.

In the related art of account book making using a mobile phone, a text message transmitted from a card company is stored separately, or a character, a payment amount, a payment time, etc. are obtained by using letters and numbers included in the text message and displayed to the user. Korean Patent Laid-Open Publication No. 2004-0034913 (Receipt payment history account book management device and method of a mobile terminal). The present invention is to receive the credit card payment information with a portable terminal, to record and store the account book information to edit management.

However, in the method of creating a household account using the conventional invention, when a user pays in cash or uses a gift certificate, the corresponding text message is not transmitted to the purchaser's mobile phone. Therefore, in this case, the mobile phone can be created by the conventional invention. There is a problem that can not be.

In addition, even if a credit card is used, if the text message is not transmitted due to unstable network status, the user has not applied for SMS service, and the purchase related information text message is not sent to the buyer's mobile phone for other reasons, There is a problem that the account book preparation according to the conventional invention cannot be performed.

The present invention is to solve the problems described above, it is an object of the user to conveniently and simply manage all the purchase history of the user using the camera of the mobile phone. In addition, an object of the present invention is to provide an accounting history for the purchase history by stably providing the purchase history information to the user regardless of the communication network situation without providing information through the communication network.

According to an embodiment of the present invention, there is provided a method of creating an account book of a mobile terminal having a digital camera, comprising: a first step of recognizing a character from a subject photographed by the camera; Extracting text information from the recognized characters; Separating a string and a numeric string from the extracted text information; A fourth step of displaying the string and the numeric string; An account book making method using a portable terminal having a digital camera comprising a fifth step of carrying out book management or settlement management for the character string and the numeric string is achieved.

Preferably, the photographing mode setting command or the photographing command signal is input by pushing on the photographing function key of the mobile terminal.

Preferably, the subject to be photographed includes an object of a material from which text information can be expressed by a method of writing, printing, and engraving. The photographed subject is an electronic identifier, and the electronic identifier includes a bar-code or an RFID tag (Radio Frequency Identification Tag).

The character recognition according to an embodiment of the present invention is performed by a character recognition program built in the portable terminal. The string is a name of a purchased product and the number string is a purchase price or a quantity of a purchased product. In addition, the string and the numeric string can be searched, modified and sorted by a key input operation of the mobile terminal.

The book management is performed by the editing process of the character string and the string of numbers in the income, expenditure, and saving items by date, and the accounting management is a process of classifying the category by the designated period or the purchased goods and summing the purchase amount for the category. Is performed by.

On the other hand, the above object is, according to an embodiment of the present invention, a mobile terminal having a digital camera, a character recognition unit for recognizing a character from a subject photographed by the camera; A text extraction unit for extracting text information from the recognized characters; A text separator that separates a string and a numeric string from the extracted text information; A screen display unit displaying the string and the numeric string; An accounting unit preparation apparatus using a portable terminal having a digital camera including an accounting unit preparing unit for classifying a product category of the character string and paying the purchase amount of the number string.

The character recognition unit incorporates a character recognition program and has a function of reading an electronic identifier.

In addition, the electronic identification code includes a barcode or an RFID tag, and the account book preparing unit includes an account book management program.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the same elements in the figures are represented by the same numerals wherever possible. In addition, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention will be omitted.

   1 is a view showing the configuration of an embodiment of an account book creating apparatus using a mobile terminal according to the present invention.

Referring to FIG. 1, the RF unit 18 performs a wireless communication function of the portable terminal. The RF unit 18 includes an RF transmitter for upconverting and amplifying a frequency of a transmitted signal, and an RF receiver for low noise amplifying and downconverting a received signal.

The data processor 19 includes a transmitter for encoding and modulating the transmitted signal, a receiver for demodulating and decoding the received signal, and the like. That is, the data processor 19 may be configured of a modem and a codec CODDEC. The codec includes a data codec for processing packet data and an audio codec for processing an audio signal such as voice.

The audio processor 12 plays a function of reproducing the received audio signal output from the audio codec of the data processor 19 or transmitting the transmitted audio signal generated from the microphone to the audio codec of the data processor 19.

The memory unit 11 stores a data memory. The data memory temporarily stores data generated during operation of the mobile terminal. In addition, the memory unit 11 may be a database (DB) in which a receipt photo file photographed by a digital camera is stored.

The portable terminal controller 20 performs a function of controlling the overall operation of the portable terminal. In addition, the controller 20 may include the data processor 19. In addition, the control unit 20 is connected to the character recognition unit 21, the text extraction unit 22, the text separation unit 23, the account book creation unit 24 according to an embodiment of the present invention, exchange data, processing , Control to process.

The character recognition unit 21 has a function of recognizing a character from a photographic image taken by a digital camera by embedding a character recognition program. In addition, the character recognition unit 21 has a function of reading the electronic identification code. The electronic identification code includes a bar code or a radio frequency identification tag.

The text extraction unit 22 extracts text information from the characters recognized by the character recognition unit 21. The text separating unit separates a string (purchase product name) and a number string (purchase product price) from the extracted text information.

On the other hand, the account book creating unit 24 has an account book management program built-in, and manages the account book using the information contained in the string and the numeric string according to the key input of the user of the portable terminal.

The camera module 15 photographs a material in which text information is expressed by handwriting, printing, and engraving, and a camera sensor for converting a photographed optical signal into an electrical signal, and an analog image photographed from the camera sensor. And a signal processor for converting the signal into digital data. Herein, it is assumed that the camera sensor is a CCD sensor, and the signal processor may be implemented by a digital signal processor (DSP). In addition, the camera sensor and the signal processor may be integrally implemented or may be separately implemented.

The image processor 16 performs a function of generating screen data for displaying an image signal output from the camera unit 15. The image processor 16 processes the image signal output from the camera unit 15 in units of frames, and outputs the frame image data according to the characteristics and size of the screen display unit 17. In addition, the image processing unit 16 includes an image codec and performs a function of compressing the frame image data displayed on the screen display unit 17 in a set manner or restoring the compressed frame image data to the original frame image data. do. The image codec may be a JPEG codec, an MPEG4 codec, a wavelet codec, or the like. It is assumed that the image processor 16 has an On Screen Display (OSD) function, and may output on-screen display data according to a screen size controlled and displayed by the controller 20. .

The screen display unit 17 displays an image signal output from the image processing unit 16 on a screen, and displays data output from the control unit 20. In this case, the screen display unit 17 may use an LCD. In this case, the screen display unit 17 may include an LCD controller, a memory capable of storing image data, and an LCD display element.

The key input unit 13 includes keys for inputting numeric and character information and function keys for setting various functions. According to an embodiment of the present invention, the mobile terminal user inputs and controls an editing command such as searching, correcting, and sorting the string and the numeric string through the key input unit 13. In addition, a shortcut key for switching to the editing mode may be provided. For example, the shortcut key may be '#' or '*'.

2 is a flowchart of an embodiment of a method of creating an account book using a mobile terminal according to the present invention.

In the standby state 201 of FIG. 2, the portable terminal is turned on. The portable terminal user sets the shooting mode by key input of the portable terminal (203). When the photographing mode of the portable terminal is set, the character recognition program built in the character recognition unit 21 of the portable terminal is operated at step 205.

The user of the portable terminal photographs the material on which the purchase item receipt or the electronic identification code is recorded by key input (207). The photographed picture image is displayed on the screen display unit 17 (209), the mobile terminal user can check the still image (211) after deleting (213) can be retaken.

A character recognition program built in the character recognition unit 21 of the portable terminal recognizes a character from the still image. The text extracting unit 22 of the mobile terminal extracts text information from the recognized character (215), and the text separating unit 23 extracts a character string (purchase product name) and a numeric string (purchase amount) from the extracted text information. (217), a string (purchase product name) and a number string (purchase amount or purchase quantity) are displayed on the screen display (219).

In this case, the user of the portable terminal may check the string and the numeric string displayed on the screen display unit 17 (221) and may modify the string and the numeric string through a key input command (223).

In addition, the user of the portable terminal may take a photographic image of the purchased product (225), and may combine the purchased product name string and the photographic image through a key input command (227). The text information or the text information combined with the photo image is stored in the memory unit 11 in the name of 'same day expenditure' (229).

On the other hand, the user of the portable terminal inputs a detailed account display menu display command through the portable terminal key input command to create the account book (231).

At this time, the account book program built in the account book creating unit 24 is operated, and the detailed account book menu (1. Book Management 2. Settlement) is displayed on the screen display unit 17 by the command (233).

In the case of selecting No. 1 in the detailed account book section, when the calendar screen is displayed on the screen display unit 17 and the user of the mobile terminal clicks the corresponding date (235a), the management detailed menu (for example, 1.import 2.expenditure 3. Saving) is displayed on the display unit 17 (237), when each submenu is selected, the submenu (1.Add 2.Edit. 3Delete 4.Sort) is displayed, and the mobile terminal user issues a key input command. Instructing the execution command for the sub-menu through the account book management task (239).

In addition, when the number 2 of the detailed account book menu is selected, the calendar screen is displayed on the screen display unit 17, and when the user of the mobile terminal clicks the corresponding date (235b), the detailed settlement menu (for example, 1.month 2.product 3. category by designation period) is displayed on the screen display unit 17 (241). That is, when the user of the portable terminal clicks on the last day of the month, the monthly settlement is executed, or when the period is designated through the key input operation, the settlement by the designated period is executed. In addition, if a product category such as foodstuffs, household goods, clothing, etc. is designated by key input operation, the list of purchased products is classified by category, and the purchase amount calculation of the corresponding category can be calculated or items can be searched by category. do.

On the other hand, by connecting the mobile terminal to the printer using a wired or wireless local area communication function, such as printing the contents of the account book on a paper can be produced and managed off-line, or stored as a computer file on the computer It may be.

According to the present invention, it is possible to conveniently and simply manage the spending history of the user.

In addition, even without providing information through the communication network, it is possible to create a household account book for the purchase history by stably providing the purchase history information to the user regardless of the communication network situation.

Claims (16)

In the account book making method of a mobile terminal having a digital camera, A first step of recognizing a character from a subject photographed by the camera; Extracting text information from the recognized characters; Separating a string and a numeric string from the extracted text information; A fourth step of displaying the string and the numeric string; And a fifth step of performing book management or settlement management for the character string and the string of numbers. According to claim 1, And a photographing mode setting command or a photographing command signal is input by pressing the photographing function key of the portable terminal. According to claim 1, The method of claim 2, wherein the photographed subject comprises an object made of a material in which text information can be expressed by handwriting, printing, and engraving. According to claim 1, The method of claim 2, wherein the photographed subject is an electronic identifier. The method of claim 4, wherein The electronic identification code is a method of creating an account book using a mobile terminal, characterized in that it comprises a barcode or RFID tag. According to claim 1, The character recognition is an account book creation method using a mobile terminal, characterized in that performed by a character recognition program built in the mobile terminal. According to claim 1, The character string is a purchase product name and the number string is a purchase amount or purchase product using a mobile terminal, characterized in that the quantity of the purchased product. According to claim 1, The character string is a method of creating an account book using a mobile terminal, characterized in that stored in conjunction with the purchase product pictures. According to claim 1, The character string and the number string is an account book creation method using a mobile terminal, characterized in that search, correction and sorting by a key input operation of the mobile terminal. According to claim 1, The book management method using the mobile terminal, characterized in that performed by the editing process for the character string and the string in the income, expenses and saving items by date. According to claim 1, The accounting management is performed by the process of classifying the category by the specified period or purchase product and the purchase amount for the category is added to the account book creation method using a mobile terminal. In a mobile terminal having a digital camera, A character recognition unit recognizing a character from a subject photographed by the camera; A text extraction unit for extracting text information from the recognized characters; A text separator that separates a string and a numeric string from the extracted text information; A screen display unit displaying the string and the numeric string; And an account book preparing unit to classify the product categories of the character string and settle the purchase amount or the product quantity of the number string. The method of claim 12, The character recognition unit is a mobile terminal, characterized in that a built-in character recognition program. The method of claim 12, And the character recognition unit has a function of reading an electronic identification code. The method of claim 13, The electronic identifier is a mobile terminal, characterized in that it comprises a barcode or RFID tag. The method of claim 12, The account book preparation unit is a mobile terminal, characterized in that the built-in account book management program.

Images