[go: up one dir, main page]

WO2016104965A1 - Learning assessment service system - Google Patents

Learning assessment service system Download PDF

Info

Publication number
WO2016104965A1
WO2016104965A1 PCT/KR2015/012784 KR2015012784W WO2016104965A1 WO 2016104965 A1 WO2016104965 A1 WO 2016104965A1 KR 2015012784 W KR2015012784 W KR 2015012784W WO 2016104965 A1 WO2016104965 A1 WO 2016104965A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
answer
answer sheet
test
sheet
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2015/012784
Other languages
French (fr)
Korean (ko)
Inventor
오종현
허상형
도병학
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of WO2016104965A1 publication Critical patent/WO2016104965A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • G06Q50/205Education administration or guidance
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • G06Q50/205Education administration or guidance
    • G06Q50/2053Education institution selection, admissions, or financial aid

Definitions

  • the present invention relates to a learning evaluation service system and a method thereof. More specifically, the present invention relates to a learning evaluation service system and method capable of providing an individual customized answer sheet to a test taker, and scanning and answering the answer sheet image by photographing the prepared answer sheet using a terminal.
  • test taker simply provides a summary of the test taker's individual scores, allowing the test taker to provide an objective, comprehensive, in-depth, detailed and individualized assessment of his or her skills. There was a disadvantage of not being able to.
  • candidates want to evaluate their skills efficiently and objectively without regard to time and place, and need objective evaluation and diagnosis of areas they are good at and lack of. in need.
  • OMR Optical Mark Reader
  • OMR Optical Mark Reader
  • sheets are being used, in which expensive OMR card readers and sheet readers are used to read them, using a timing mark displayed on the OMR card or sheet to instantaneously pass the mark through the sensor as light passes through it. The sensing method is used.
  • the OMR card reader and sheet reader Due to the structure of the OMR card reader and sheet reader, it is sensitive to external conditions (instantaneous current supply state, sensor change due to weather fluctuations, etc.), and thus, there is a possibility of an unexpected scoring error.
  • the OMR card or sheet reader is very sensitive to the surface condition of the OMR card or sheet, and there is a problem in that the candidate recognizes that the corrected answer is corrected with a predetermined amount of correction. There is this.
  • the present invention is to solve the problems as described above can generate a personalized answer sheet according to the test paper information, question information and candidate information, and by taking a photograph of the completed answer sheet using the terminal to scan the answer sheet image to score and analyze the results It is to provide a possible learning evaluation service system and method thereof.
  • the present invention as an embodiment test paper containing test paper information and item information;
  • a management server including a database including a problem information database and an answer sheet generating unit, and transmitting the answer sheet generated by the answer sheet generating unit to the terminal through a wired or wireless communication network;
  • output means for receiving the answer sheet transmitted through the wired / wireless communication network from the terminal and outputting the answer sheet, wherein the problem information database stores problem information inputted with an identification tag, and the answer sheet generating unit is a test sheet through the terminal.
  • the learning evaluation service system for searching for a question having an identification tag that matches the test sheet information and the question information and generating an answer sheet in which an answer area corresponding to the corresponding test sheet problem is provided.
  • the database may further include a candidate information database.
  • the candidate information database may store personal information and learning evaluation information of the candidate taking the assessment, and the answer sheet generation unit may further include a candidate code including stored candidate information. Provides a learning assessment service system to generate.
  • the terminal may further include a photographing unit, and photographs the answer sheet prepared by the candidate through the learning application and the photographing unit to transmit the scanned answer sheet image to the management server, wherein the management server includes a scoring processor and a result analyzing unit.
  • the apparatus may further include a data processor, extracting answer information and candidate information from an answer area and a candidate code of the answer sheet image received through the scoring processor, comparing the correct answer information with the correct answer information stored in the problem information database, and scoring the result analysis unit.
  • the present invention provides a learning evaluation service system capable of transmitting analysis information obtained by analyzing a scoring result to the terminal through a wired or wireless communication network.
  • the database may further include an analysis information database, in which the grading results and the analysis information obtained through the data processing unit are cumulative data for each test paper in the analysis information database, and the individual test takers of the test scores are provided to the individual test takers.
  • an analysis information database in which the grading results and the analysis information obtained through the data processing unit are cumulative data for each test paper in the analysis information database, and the individual test takers of the test scores are provided to the individual test takers.
  • Provide learning assessment service system provided.
  • Another embodiment of the present invention is a test paper including test paper information and item information; A terminal on which a learning application for inputting the test paper information and the item information is installed and executed; And a management server capable of transmitting the generated answer sheet to the terminal through a wired / wireless communication network, the database including a problem information database and an answer sheet generating unit.
  • the answer sheet generating unit when the test sheet information and the item information are input through the terminal, searches for a question having an identification tag that matches the test sheet information and the item information, and an answer sheet having an answer area corresponding to the corresponding test sheet problem is disposed. It provides, and provides a learning evaluation service system capable of writing an answer directly to the answer sheet generated through the terminal.
  • Learning evaluation service system can provide a service capable of efficient and convenient learning evaluation to the questions and test takers regardless of time and place.
  • the questions contained in the test paper (or textbook) according to the present invention can be provided by the identification tag is stored in the database so that the answer sheet by entering the test paper information and question information can be provided.
  • a personalized answer sheet may be provided.
  • the learning evaluation service system may provide the candidates and the candidates with a database of not only the individual grade result analysis for each candidate through the candidate registration, but also the total score analysis information of the candidates who took the same test.
  • the scores of the candidates who purchased the test papers or books individually constitute cumulative data and can measure the candidates' ability on the same test paper (or textbook).
  • the learning evaluation service system can recognize the answer sheet simply, quickly and accurately by photographing through a terminal even without an OMR reader or a scanner, and scoring can also be done quickly and accurately in multiple choice, subjective and narrative types.
  • the automatic shooting algorithm of the learning application enables automatic shooting of answer sheets, thereby improving user convenience.
  • FIG. 1 is a block diagram and a schematic diagram of a learning evaluation service system according to an embodiment of the present invention.
  • Figure 2 shows an embodiment of a test paper according to the present invention.
  • FIG. 3 shows a block diagram of a management server according to an embodiment of the present invention.
  • Figure 4 shows an embodiment of the answer sheet according to the present invention.
  • FIG 5 illustrates an automatic shooting algorithm of an application according to an embodiment of the present invention.
  • FIG. 6 is a conceptual diagram illustrating an automatic shooting recognition condition according to an embodiment of the present invention.
  • FIG. 7 is a block diagram of a learning evaluation service system according to another embodiment of the present invention.
  • Learning evaluation service system comprises a test paper (10) comprising a test paper information 101 and item information (102); A terminal 20 in which a learning application 203 capable of inputting the test paper information 101 and the item information 102 is installed and executed;
  • the answer sheet 50 including the database 301 including the problem information database 3011 and the answer sheet generator 302, and the answer sheet 50 generated through the answer sheet generator 302 may be transmitted to the terminal 20 through a wired or wireless communication network.
  • Management server 30 And output means 40 for receiving the answer sheet 50 transmitted from the terminal 20 through the wired / wireless communication network and outputting the answer sheet 50.
  • the problem information database 3011 stores problem information in which an identification tag is input, and the answer sheet generating unit 302 receives the test paper information 101 and the question information 102 through the terminal 20, and then inputs the test paper information.
  • the question with the identification tag that matches the 101 and the question information 102 is searched to generate an answer sheet 50 in which an answer area 501 corresponding to the corresponding test sheet question is disposed.
  • FIG. 1 is a block diagram and a schematic diagram of a learning evaluation service system according to an embodiment of the present invention.
  • the test paper 10 includes test paper information 101 and item information 102, and the test paper information 101 includes a test type (large classification), a test paper source (middle classification), and a test range (small classification). 102) includes the item number, item type, and item data.
  • the answer sheet generator 302 may generate an answer region 501 corresponding to the corresponding test sheet 10 problem through the test sheet information 101 and the question information 102 inputted when the answer sheet 50 is generated.
  • the test paper 10 may be in the form of a sheet or may be in the form of a booklet, but is not limited thereto.
  • the test paper 10 may include test papers provided through various forms and various media. As the question recorded in the test paper (or the textbook) is inputted with an identification tag and stored in the problem information database 3011, the test paper customized answer sheet may be provided by inputting the test paper information 101 and the item information 102. 2 shows one embodiment of the test paper 10.
  • the test paper information 101 includes a test range (sub-category) such as foreign language, examination, certification, test type (classification) such as general test, textbooks, source of test paper (sub-category) such as test organization, unit, range, etc.
  • the information 102 includes item-related data such as an item number such as a start number and an end number, an item form such as a multiple choice, a short answer, a narrative type, a URL uploaded with a problem, and a solution.
  • the management server 30 includes a database 301, an answer sheet generator 302, and a data processor 303.
  • the database 301 includes a problem information database 3011, a candidate information database 3012, and an analysis information database 3013
  • the data processing unit 303 includes a scoring processor 3031 and a result analyzing unit 3032.
  • . 3 shows a block diagram of the management server 30.
  • the problem information database 3011 stores problem information in which an identification tag is input, and also correct answer information and commentary information for each problem.
  • the identification tag includes a test range (sub-category) such as foreign language, exam, certification, and general test type (classification), textbooks, test paper source (sub-category) such as test organization, section, range, and the like. Includes item-related data, such as the URL of the item format, questions, and answers.
  • the candidate information database 3012 stores personal information such as the name, phone number, and e-mail of the candidate taking the assessment, and also stores the study evaluation information for each candidate.
  • the answer sheet generator 302 when the answer sheet 50 is generated, the candidate code 502 including information distinguished from other test takers is disposed to provide a personalized answer sheet.
  • the analysis information database 3013 is cumulative data for each test paper, such as scoring results and grade distribution, error rate, and type of error, and the analysis information may be provided to the candidate or the candidate at any time, and the individual test taker's grade distribution May be provided. In other words, when the candidate information is registered, not only the individual grade result analysis for each candidate but also the entire test result analysis information of the candidate taking the same test may be provided to the candidate and the candidate.
  • the answer sheet generating unit 302 receives the test sheet information 101 and the item information 102 through the learning application 203 of the terminal 20, and the test sheet information 101 and the item information ( The question with the identification tag matching 102 is searched to generate an answer sheet 50, for example, an OMR card, with an answer area 501 corresponding to the corresponding test sheet question.
  • an answer sheet 50 for example, an OMR card
  • the answer sheet generating unit 302 generates an answer sheet on which the candidate code 502 including the candidate information is disposed when the information corresponds to the candidate having information stored in the candidate information database 3012.
  • the candidate code 502 may include, but is not limited to, a QR code and a barcode, and may use any type of identification code that can hold information.
  • the answer sheet 50 in which only the answer area 501 corresponding to the corresponding test paper question is disposed is generated.
  • the output means 40 outputs the answer sheet 50 in which the answer area 501 and the candidate code 502 (if candidate information is input) are arranged.
  • the printed answer sheet 50 is issued to the test taker so that the learning evaluation is made.
  • the terminal 20 includes a photographing unit 201 and a screen display unit 202, and the learning application 203 is installed and executed.
  • the terminal 20 captures the answer sheet 50 prepared by the test taker through the photographing unit 201 and scans the answer sheet image required for scoring the answer sheet by the learning application 203. to provide.
  • the photographing unit 201 includes an optical device such as a camera capable of photographing the test paper 10 and serves as a means for recognizing the answer sheet 50.
  • the photographing command by the learning application 203 is performed.
  • the screen display unit 202 may be an interface means that allows a candidate or a candidate to input test paper information, item information, and candidate information through an application, and to select and execute other menus.
  • the photographing state may be displayed, or the result of scoring and analysis, commentary, etc. may be displayed.
  • the learning application 203 transmits the test paper information, the question information, and the test taker information inputted by the questionnaire or the test taker so that the answer sheet generating unit 301 can generate the answer sheet 50 corresponding to the test paper 10.
  • the prepared answer sheet 50 may be automatically photographed. More specifically, when generating the answer sheet 51 by further placing a reference marker 503 having a photographing indicator function on three or four of each corner of the answer sheet 50 when generating the answer sheet, the learning application 203 is a reference. A guideline for identifying the position of the marker 503 is internally generated and the position of the reference marker 503 is identified to automatically photograph the test paper when the recognition condition is satisfied.
  • the reference marker 503 may have a polygonal shape having a border of a predetermined thickness, for example, a rectangle, but is not limited thereto.
  • the reference marker 503 may include all shapes that may be recognized as reference markers by the guidelines to be described later.
  • FIG. 4 the answer sheet 50 in which the answer area 501, the candidate code 502, and the reference marker 503 are disposed is illustrated, and FIG. 5 illustrates the automatic photographing algorithm of the learning application.
  • the learning application 203 internally generates a guideline for identifying the position of the reference marker 503, and checks the guideline area every frame to determine the position of the reference marker 503. If the recognition condition is satisfied, the test paper is automatically photographed and the test paper image is scanned. Since only the guideline area is checked without checking the entire screen, recognition can be performed at a high speed, and the user's convenience can be improved by automatically photographing.
  • Recognition conditions for automatic photographing allow the photographing to be taken automatically only when the reference marker is recognized in three or more guidelines so that the image of the entire test paper can be recognized with a high recognition rate.
  • the photographing is automatically performed because the image of the entire test paper can be recognized without wrinkling or tilting.
  • the photographing is prevented from being photographed, thereby preventing the scanning of the incorrect answer sheet image.
  • the burden of 3031 can be reduced, and the reliability of the scoring result can be improved.
  • the guideline is two or more straight lines having a predetermined interval, and the edge area of the reference marker 503 is recognized as 1, and other areas are recognized as 0, so that the guide line is 010 and 01010 on the straight line of the guideline. Only those recognized in the form of are recognized as reference markers. When using such a method, it is possible to recognize even when the reference marker 503 is rotated.
  • the entire screen display unit 202 of the terminal 20 can be checked automatically by using a method of recognizing a reference marker. This is a method that forms a guideline on the entire screen display unit 202 and is automatically photographed when three or four reference markers are recognized. Only the user does not need to match the position of the reference marker 503 has the advantage that it is convenient.
  • the test sheets are photographed and recognized by the terminal 20 without using a separate device such as a reader or a scanner. Even if the answer sheet can be recognized by minimizing the wrinkles or skew of the entire image, the recognition rate of the answer sheet can be increased to obtain an accurate answer sheet image. This makes it possible to reduce the processing burden of the subsequent scoring processing unit, thereby enabling quick and accurate scoring.
  • the fiducial marker 503 is located at three of the corners of the answer sheet 50, if the fiducial marker 12 is recognized only in the three guide areas, it is automatically photographed so that a quick scan is possible and the rotation of the scanned answer sheet image is rotated. There is an advantage to know whether or not. However, due to the nature of the answer sheet 50 made of easily deformable paper, it is difficult to accurately locate the remaining corners in which the reference marker 503 is not located.
  • the reference marker 503 is located at four places of each corner of the answer sheet 50 so as to accurately locate the answer sheet 50. In this case, there is a problem in which the rotation of the test sheet image is unknown.
  • the answer sheet 50 may be solved by further including a QR code, a triangular marker, or the like, on the answer sheet 50.
  • the terminal 20 may further include a gyro sensor, which may help maintain horizontality when the answer sheet is automatically photographed, and may further include an illuminance sensor to allow recording in a dark environment.
  • a gyro sensor which may help maintain horizontality when the answer sheet is automatically photographed
  • an illuminance sensor to allow recording in a dark environment.
  • the answer sheet image recognized by the terminal 20 is transmitted to the management server 30 through a wired or wireless communication network.
  • the management server 30 is a server including a database 301, answer sheet generating unit 302, and data processing unit 303, receives the answer sheet image, and then scores the result after scoring processing such as image correction, answer region extraction, answer scoring, and the like.
  • Analysis information such as analysis and problem solving (commentary) is stored in the analysis information database 3013.
  • the terminal 20 may be a personal computer (PC), a smart terminal, a PDA, or the like, but is not limited thereto.
  • PC personal computer
  • PDA personal area network
  • the scoring processor 3031 performs scoring processing through an image correction step, an answer area extraction step, and an answer scoring step.
  • the image correction step removes noise of the answer sheet image transmitted from the questionnaire terminal 21 through image binarization, and corrects the tilt through the reference marker 503 in the answer sheet image.
  • the answer region extraction step the answer region 501 is extracted based on an outline connecting the reference marker 503 from the corrected answer sheet image.
  • the answer scoring step calculates a binary value for each problem of the extracted answer area 501, and moves an area having a value greater than or equal to a certain value based on the lowest value with the most empty space to a marking position or a check position. It recognizes and scores compared with the correct answer information stored in the problem information database 3011.
  • FIG. 1 A block diagram illustrating an exemplary computing environment in accordance with the present disclosure.
  • the answer area 501 is provided to the questionnaire (scorer) to be graded.
  • the questionnaire can see only the answer except for the problem, so the readability is improved, so the scoring is easy.
  • the scoring results analyze not only the overall grade distribution but also the percentage of incorrect answers and types of incorrect answers.
  • Each candidate's scoring results and analysis information are stored in the candidate information database and analysis information database. Score results and analysis information may be provided to the questions or candidates at any time, either online or offline.
  • Learning evaluation service system is an embodiment of the present invention through the registration of candidates can be provided to the candidate and the examinee by analyzing not only the individual grade result analysis by each candidate, but also the database of the test taker total grade analysis information that took the same test.
  • the scores of the candidates who purchased the test papers or books individually constitute cumulative data and can measure the candidate's ability on the same test paper (or textbook).
  • the terminal 20 is a questionnaire terminal 21, and the questionnaire test paper information and question information through the questionnaire terminal 21.
  • the answer sheet generator can generate a plurality of answer sheets having the same answer area, each of which a candidate code is generated, and outputs it through an output means and issues it to the candidate for evaluation. Is done.
  • the answer sheet prepared by each candidate is photographed by the questionnaire terminal 21, and the result analysis is performed after scoring by the above-described system.
  • the terminal 20 is the test taker terminal 22 and the test taker information and the questionnaire through the test taker terminal 22.
  • the answer sheet generating unit generates the answer sheet in which the answer answer and the test taker codes are generated, and outputs it through the output means to prepare the answer sheet.
  • the answer sheet prepared by the test taker is photographed by the test taker terminal 22 and the score analysis is performed by the above-described system.
  • the scores of the test takers who have taken the same test paper stored in the analysis information database can be used to measure the skills of individual test takers and can efficiently and conveniently evaluate learning regardless of time and place. Can provide services.
  • the answer sheet may be outputted and stared through the output means 40, but the answer sheet may be prepared directly in the learning application 223 without outputting the block diagram shown in FIG.
  • the answer sheet generated by the answer sheet generating unit 302 is transmitted to the test taker terminal 22, and the answer sheet generated on the screen display unit 222 is displayed through the learning application 223. It is possible. In this case, there is no need to photograph the answer sheet, which makes it easy to extract the answer region.
  • the learning evaluation service system which is an embodiment of the present invention, is a business model for generating revenue, and may charge a fee for signal transmission through a network between the media constituting the present invention.
  • the management server 30 further includes a fee charging unit 304 to transmit test paper information and question information from the terminal 20 to the answer sheet generating unit 302 or the answer sheet photographed by the terminal 20.
  • the fee charging unit 304 may allow a fee for generating an answer sheet or a fee for providing analysis information.
  • an embodiment of the learning evaluation service method includes a questionnaire step (S1) of receiving answer information inputted through a terminal from a questionnaire or a candidate and generating an answer sheet in an answer sheet generation unit of a management server; A gazing step (S2) in which the test taker writes the answer sheet by outputting and issuing the generated answer sheet; And a scoring step (S3) of receiving the answer sheet image obtained by photographing the answer sheet prepared through the terminal, scoring the data in the management server, analyzing the result, and providing a scoring and analysis result.
  • the answer sheet generation unit of the management server searches for a problem having an identification tag that matches the test paper information and the question information inputted, and the answer sheet having the corresponding answer area is arranged.
  • the question-taking step S1 when the candidate information is further input, the question-taking step S1 generates an answer sheet in which a candidate code corresponding to the candidate information input by the answer sheet generator of the management server is further disposed.
  • Examination step (S2) is the candidate to output the generated answer sheet to be given to a large number of candidates to take the gaze (S21), or to take a gaze by outputting the answer sheet generated by the candidate (S22), or do not output the answer sheet generated by the candidate It may be gaze (S23) through the candidate terminal without.
  • the scoring step S3 when the gaze is taken by the method of S21 or S22, the answering sheet (s) photographed by the candidate terminal or the candidate terminal are photographed and the scanned answer sheet image is transmitted to the management server. And result analysis.
  • the scoring step includes providing analysis information to the candidate.
  • the scoring step S3 when the gaze is performed by the method of S23, when the answer information input to the candidate terminal is transmitted to the management server, the scoring and the result analysis are performed through the above-described data processing.
  • the scoring step includes providing analysis information to the candidate.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Tourism & Hospitality (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Strategic Management (AREA)
  • Human Resources & Organizations (AREA)
  • General Health & Medical Sciences (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The present invention relates to a learning assessment service system, and provides a service system comprising: a question information database in which question information having identification tags input therein is stored; and an answer paper generation unit which, when examination paper information and question information are input, searches for questions having identification tags coinciding with the examination paper information and the question information, and generates an answer paper in which corresponding answer areas corresponding to the examination paper questions are arranged. Accordingly, the present invention enables an examiner and an examinee to efficiently and conveniently perform learning assessment regardless of time and place.

Description

학습 평가 서비스 시스템Learning Assessment Service System

본 발명은 학습 평가 서비스 시스템 및 그 방법에 관한 것이다. 보다 구체적으로 본 발명은 응시자에게 개별 맞춤형 답안지를 제공할 수 있고, 작성된 답안지를 단말기를 이용하여 촬영함으로써 답안지 이미지를 스캔하여 채점 및 결과 분석이 가능한 학습 평가 서비스 시스템 및 그 방법에 관한 것이다.The present invention relates to a learning evaluation service system and a method thereof. More specifically, the present invention relates to a learning evaluation service system and method capable of providing an individual customized answer sheet to a test taker, and scanning and answering the answer sheet image by photographing the prepared answer sheet using a terminal.

최근 모바일 기술의 발달로 스마트폰, 태블릿 PC, PDA 등의 단말기를 이용한 새로운 학습 방안들이 제시하고 있으며, 이로 인해 학습 관련 어플리케이션 시장이 급성장하고 있는 추세이다. 그러나 현재 제공되는 학습 평가 관련 어플리케이션들은 단순히 시험 문제들을 응시자 단말기에 다운로드받아 푼 후, 그 결과를 전송하여 이를 채점하도록 하는 방식을 채택하고 있으며, 상기 어플리케이션 관리자는 그 채점 결과에 의해 개인의 성적을 단순 누계하여 제공하고 있다.Recently, with the development of mobile technology, new learning methods using terminals such as smartphones, tablet PCs, PDAs, etc. are being proposed, which is causing a rapid growth of the learning-related application market. However, currently provided learning evaluation-related applications simply adopt a method of downloading the test questions to the test taker terminal, transmitting the results, and scoring the results, and the application manager simply selects an individual's grade based on the scoring result. Cumulatively provided.

그러나 평가 응시자의 성적 결과에 대하여 응시자 전체의 전반적인 자료를 제공하지 않고, 응시자 개인의 성적만을 단순 누계하여 제공하도록 함으로써, 시험 응시자가 자신의 실력에 대한 객관적이고, 포괄적, 심층적, 세부적, 개별화된 평가를 할 수 없다는 단점이 있었다.However, rather than providing the overall test taker's overall data on the test taker's scores, the test taker simply provides a summary of the test taker's individual scores, allowing the test taker to provide an objective, comprehensive, in-depth, detailed and individualized assessment of his or her skills. There was a disadvantage of not being able to.

또한, 응시자(학습자)는 자신의 실력을 시간과 장소의 구애 없이 효율적이면서도 객관적으로 평가받고자 하며, 자신이 잘하는 영역과 부족한 영역에 대한 객관적인 평가와 진단이 필요하고, 이의 결과 분석에 의해 맞춤형 학습을 필요로 한다.In addition, candidates (learners) want to evaluate their skills efficiently and objectively without regard to time and place, and need objective evaluation and diagnosis of areas they are good at and lack of. in need.

그러나, 학교나 학원 등에서도 학생 개인별로 각각의 영역별 분석이나 평가 등을 시간과 장소의 구애 없이 제공하기 어렵고, 이를 평가 및 진단하기 위한 수단이 없었다.However, even in schools and academies, it is difficult to provide analysis or evaluation for each student without regard to time and place, and there is no means for evaluating and diagnosing them.

또한 중고등학교(일부 초등학교 포함)의 성적처리 및 대학입시, 강의 평가, 기타 학원의 성적처리, 수학능력평가, 각종 국가자격시험, 운전면허시험 등의 대부분의 평가방법으로 OMR(Optical Mark Reader) 카드 또는 쉬트가 이용되고 있는데, 이들을 판독하기 위해 고가의 OMR 카드 리더기 및 쉬트 리더기가 사용되어, OMR 카드 또는 쉬트 상에 표시된 타이밍 마크(timing mark)를 이용하여 순간적으로 빛이 통과하면서 센서를 통해 마크를 감지하는 방식이 사용되고 있다. In addition, OMR (Optical Mark Reader) card is used for most evaluation methods such as grades in secondary schools (including some elementary schools), college entrance examinations, lecture evaluations, grades in other schools, mathematics skills assessments, various national qualification tests, and driver's license tests. Or sheets are being used, in which expensive OMR card readers and sheet readers are used to read them, using a timing mark displayed on the OMR card or sheet to instantaneously pass the mark through the sensor as light passes through it. The sensing method is used.

이러한 감지를 위해 OMR 카드 또는 쉬트의 인쇄나 커팅(cutting)에서 상당한 정도 이상의 정교함을 요구하게 되어, 특수 재질의 용지(대부분이 수입 용지)와 특수 인쇄가 요구된다. 이러한 특수 용지 및 인쇄는 OMR 카드 또는 쉬트의 제작비용을 상승시킬 뿐만 아니라, 매년 학기 초 각 학교에서는 일정 물량을 확보하기 위해 많은 어려움을 겪고 있다. Such sensing requires a considerable degree of sophistication in the printing or cutting of OMR cards or sheets, requiring special materials (mostly imported paper) and special printing. These special papers and printing not only increase the manufacturing cost of the OMR card or sheet, but also have a lot of difficulties to secure a certain quantity at each school at the beginning of each semester.

또한, OMR 카드 또는 쉬트를 사용할 경우, OMR 카드 리더기 및 쉬트 리더기에 투입되는 방향이 타이밍 마크에 따라 일정하게 정해져 있기 때문에, 이 방향을 수정하는 작업도 상당한 시간과 노력을 요구하게 된다.In addition, when the OMR card or sheet is used, since the directions to be inserted into the OMR card reader and the sheet reader are fixed according to the timing marks, the work of correcting this direction also requires considerable time and effort.

또한, OMR 카드 리더기 및 쉬트 리더기의 구조상 외부의 조건(순간적인 전류 공급 상태, 날씨 변동에 따른 센서의 변화 등)에 민감하여, 예상치 못한 채점 상의 오류가 발생할 소지가 다분하다.In addition, due to the structure of the OMR card reader and sheet reader, it is sensitive to external conditions (instantaneous current supply state, sensor change due to weather fluctuations, etc.), and thus, there is a possibility of an unexpected scoring error.

또한, OMR 카드 또는 쉬트 리더기는 OMR 카드 또는 쉬트의 표면 상태에 상당히 민감하여서, 응시자가 소정의 수정액으로 수정한 답도 답이 표시된 것으로 오인하여 인식하는 문제점이 있어, 응시자가 답의 수정에 있어서 어려움이 있다.In addition, the OMR card or sheet reader is very sensitive to the surface condition of the OMR card or sheet, and there is a problem in that the candidate recognizes that the corrected answer is corrected with a predetermined amount of correction. There is this.

상기와 같은 문제점을 해결하기 위하여 OMR 카드 또는 쉬트를 스캐너로 스캔한 후 이미지 보정을 통해 마킹상태를 판독하는 OMR 독취방법 등이 개시(한국등록특허 제10-0468461호)되고 있다. In order to solve the above problems, an OMR reading method for scanning an OMR card or sheet with a scanner and reading a marking state through image correction has been disclosed (Korean Patent No. 10-0468461).

그러나 이러한 경우에도 응시자가 구입한 시험지나 교재 등을 이용하여 개별적으로 학습 평가가 필요한 경우, OMR 카드를 구하기도 힘들뿐더러, 시험지나 교재 별로 문항의 개수, 형식이 상이하여 맞춤형 평가가 어렵고 이를 채점하는 것 역시 불편한 문제점이 있다.However, even in such a case, if the candidate needs to individually evaluate the test paper or textbook, the OMR card is difficult to obtain, and the number and format of questions are different for each test paper or textbook, making it difficult to evaluate the score. There is also an uncomfortable problem.

본 발명은 상기와 같은 문제점을 해결하기 위한 것으로 시험지 정보, 문항 정보 및 응시자 정보에 따라 개별 맞춤형 답안지를 생성할 수 있고, 작성된 답안지를 단말기를 이용하여 촬영함으로써 답안지 이미지를 스캔하여 채점 및 결과 분석이 가능한 학습 평가 서비스 시스템 및 그 방법을 제공하는 것이다. The present invention is to solve the problems as described above can generate a personalized answer sheet according to the test paper information, question information and candidate information, and by taking a photograph of the completed answer sheet using the terminal to scan the answer sheet image to score and analyze the results It is to provide a possible learning evaluation service system and method thereof.

본 발명은 일실시예로서 시험지 정보 및 문항 정보를 포함하는 시험지; 상기 시험지 정보 및 문항 정보를 입력할 수 있는 학습 어플리케이션이 설치되어 실행되는 단말기; 문제 정보 데이터베이스를 포함하는 데이터베이스 및 답안지 생성부를 포함하고, 상기 답안지 생성부에 의해 생성된 답안지를 유무선 통신망을 통해 상기 단말기로 송신할 수 있는 관리서버; 및 상기 단말기로부터 유무선 통신망을 통해 전송된 답안지를 수신하여 답안지를 출력하는 출력수단;을 포함하며, 상기 문제 정보 데이터베이스는 식별 태그가 입력된 문제 정보가 저장되고, 상기 답안지 생성부는 상기 단말기를 통해 시험지 정보 및 문항 정보가 입력되면, 상기 시험지 정보 및 문항 정보와 일치하는 식별 태그를 가진 문제를 검색하여 해당하는 시험지 문제에 대응하는 답안 영역이 배치된 답안지를 생성하는 학습 평가 서비스 시스템을 제공한다. The present invention as an embodiment test paper containing test paper information and item information; A terminal on which a learning application for inputting the test paper information and the item information is installed and executed; A management server including a database including a problem information database and an answer sheet generating unit, and transmitting the answer sheet generated by the answer sheet generating unit to the terminal through a wired or wireless communication network; And output means for receiving the answer sheet transmitted through the wired / wireless communication network from the terminal and outputting the answer sheet, wherein the problem information database stores problem information inputted with an identification tag, and the answer sheet generating unit is a test sheet through the terminal. When the information and the item information are input, the learning evaluation service system for searching for a question having an identification tag that matches the test sheet information and the question information and generating an answer sheet in which an answer area corresponding to the corresponding test sheet problem is provided.

또한 상기 데이터베이스는 응시자 정보 데이터베이스를 더 포함하며, 상기 응시자 정보 데이터베이스는 평가에 응시한 응시자의 개인 정보 및 학습 평가 정보가 저장되고, 상기 답안지 생성부는 저장된 응시자 정보가 포함된 응시자 코드가 더 배치된 답안지를 생성하는 학습 평가 서비스 시스템을 제공한다.The database may further include a candidate information database. The candidate information database may store personal information and learning evaluation information of the candidate taking the assessment, and the answer sheet generation unit may further include a candidate code including stored candidate information. Provides a learning assessment service system to generate.

또한 상기 단말기는 촬영부를 더 포함하여, 상기 학습 어플리케이션 및 상기 촬영부를 통해 응시자에 의해 작성된 답안지를 촬영하여 스캔된 답안지 이미지를 상기 관리서버로 송신하며, 상기 관리서버는 채점 처리부 및 결과 분석부를 포함하는 데이터 처리부를 더 포함하여, 상기 채점 처리부를 통해 수신한 답안지 이미지의 답안 영역 및 응시자 코드에서 답안 정보 및 응시자 정보를 추출하고, 상기 문제 정보 데이터베이스에 저장된 정답 정보와 비교하여 채점하고, 상기 결과 분석부를 통해 채점 결과를 분석하여 얻은 분석 정보를 유무선 통신망을 통해 상기 단말기로 송신할 수 있는 학습 평가 서비스 시스템을 제공한다. The terminal may further include a photographing unit, and photographs the answer sheet prepared by the candidate through the learning application and the photographing unit to transmit the scanned answer sheet image to the management server, wherein the management server includes a scoring processor and a result analyzing unit. The apparatus may further include a data processor, extracting answer information and candidate information from an answer area and a candidate code of the answer sheet image received through the scoring processor, comparing the correct answer information with the correct answer information stored in the problem information database, and scoring the result analysis unit. The present invention provides a learning evaluation service system capable of transmitting analysis information obtained by analyzing a scoring result to the terminal through a wired or wireless communication network.

또한, 상기 데이터베이스는 분석 정보 데이터베이스를 더 포함하여, 상기 데이터 처리부를 통해 얻은 채점 결과 및 분석 정보를 상기 분석 정보 데이터베이스에 시험지별로 누적 데이터화하여 동일한 시험지로 응시한 개별 응시자에게 응시자의 전체 성적 분석 정보를 제공하는 학습 평가 서비스 시스템을 제공한다. The database may further include an analysis information database, in which the grading results and the analysis information obtained through the data processing unit are cumulative data for each test paper in the analysis information database, and the individual test takers of the test scores are provided to the individual test takers. Provide learning assessment service system provided.

본 발명의 또 다른 실시예로서 시험지 정보 및 문항 정보를 포함하는 시험지; 상기 시험지 정보 및 문항 정보를 입력할 수 있는 학습 어플리케이션이 설치되어 실행되는 단말기; 및 문제 정보 데이터베이스를 포함하는 데이터베이스 및 답안지 생성부를 포함하고, 생성된 답안지를 유무선 통신망을 통해 상기 단말기로 송신할 수 있는 관리서버;를 포함하며, 상기 문제 정보 데이터베이스는 식별 태그가 입력된 문제 정보가 저장되고, 상기 답안지 생성부는 상기 단말기를 통해 시험지 정보 및 문항 정보가 입력되면, 상기 시험지 정보 및 문항 정보와 일치하는 식별 태그를 가진 문제를 검색하여 해당하는 시험지 문제에 대응하는 답안 영역이 배치된 답안지를 생성하며, 상기 단말기를 통해 생성된 답안지에 직접 답안 작성이 가능한 학습 평가 서비스 시스템을 제공한다.Another embodiment of the present invention is a test paper including test paper information and item information; A terminal on which a learning application for inputting the test paper information and the item information is installed and executed; And a management server capable of transmitting the generated answer sheet to the terminal through a wired / wireless communication network, the database including a problem information database and an answer sheet generating unit. The answer sheet generating unit, when the test sheet information and the item information are input through the terminal, searches for a question having an identification tag that matches the test sheet information and the item information, and an answer sheet having an answer area corresponding to the corresponding test sheet problem is disposed. It provides, and provides a learning evaluation service system capable of writing an answer directly to the answer sheet generated through the terminal.

본 발명에 의한 학습 평가 서비스 시스템은 시간과 장소에 상관없이 출제자 및 응시자에게 효율적이고 편리하게 학습 평가가 가능한 서비스를 제공할 수 있다.Learning evaluation service system according to the present invention can provide a service capable of efficient and convenient learning evaluation to the questions and test takers regardless of time and place.

또한 본 발명에 의한 시험지(또는 교재)에 수록된 문제는 식별 태그가 입력되어 데이터베이스에 저장되므로 시험지 정보 및 문항 정보를 입력함으로써 맞춤형 답안지를 제공할 수 있다. 또한 응시자 정보를 입력함으로써 개인별 맞춤형 답안지를 제공할 수 있다.In addition, the questions contained in the test paper (or textbook) according to the present invention can be provided by the identification tag is stored in the database so that the answer sheet by entering the test paper information and question information can be provided. In addition, by inputting candidate information, a personalized answer sheet may be provided.

또한 본 발명에 의한 학습 평가 서비스 시스템은 응시자 등록을 통해 응시자별 개인 성적 결과 분석뿐만 아니라 동일한 시험에 응시한 응시자 전체 성적 분석 정보를 데이터베이스화하여 응시자 및 출제자에게 제공할 수 있다.In addition, the learning evaluation service system according to the present invention may provide the candidates and the candidates with a database of not only the individual grade result analysis for each candidate through the candidate registration, but also the total score analysis information of the candidates who took the same test.

또한 개별적으로 시험지나 책(교재)을 구입하여 응시한 응시자들의 채점 결과는 누적 데이터를 구성하고 동일한 시험지(또는 교재)에 대하여 응시자의 실력을 가늠할 수 있도록 한다.In addition, the scores of the candidates who purchased the test papers or books (textbooks) individually constitute cumulative data and can measure the candidates' ability on the same test paper (or textbook).

또한 본 발명에 의한 학습 평가 서비스 시스템은 OMR 리더기나 스캐너 등이 없어도 단말기를 통해 촬영함으로써 답안지를 간편하고 빠르고 정확하게 인식할 수 있으며, 채점 또한 객관식, 주관식 및 서술형 모두 신속하고 정확하게 할 수 있다. 또한 학습 어플리케이션의 자동 촬영 알고리즘을 통해 답안지의 자동촬영이 가능하여 사용자의 편의성을 향상시킬 수 있다. In addition, the learning evaluation service system according to the present invention can recognize the answer sheet simply, quickly and accurately by photographing through a terminal even without an OMR reader or a scanner, and scoring can also be done quickly and accurately in multiple choice, subjective and narrative types. In addition, the automatic shooting algorithm of the learning application enables automatic shooting of answer sheets, thereby improving user convenience.

또한 응시자에게 채점 결과 및 분석 정보, 해설 등을 제공하여 응시자의 학습 능률을 향상시킬 수 있다.In addition, by providing candidates with grading results, analysis information, and commentary, the candidates' learning efficiency can be improved.

도 1은 본 발명의 일실시예에 따른 학습 평가 서비스 시스템의 블록 구성도 및 모식도를 나타낸 것이다. 1 is a block diagram and a schematic diagram of a learning evaluation service system according to an embodiment of the present invention.

도 2는 본 발명에 따른 시험지의 일실시예를 나타낸 것이다. Figure 2 shows an embodiment of a test paper according to the present invention.

도 3은 본 발명의 일실시예에 따른 관리서버의 블록 구성도를 나타낸 것이다. Figure 3 shows a block diagram of a management server according to an embodiment of the present invention.

도 4는 본 발명에 따른 답안지의 일실시예를 나타낸 것이다.Figure 4 shows an embodiment of the answer sheet according to the present invention.

도 5는 본 발명의 일실시예에 따른 어플리케이션의 자동 촬영 알고리즘을 나타낸 것이다. 5 illustrates an automatic shooting algorithm of an application according to an embodiment of the present invention.

도 6은 본 발명의 일실시예에 따른 자동 촬영 인식 조건의 개념도를 나타낸 것이다. 6 is a conceptual diagram illustrating an automatic shooting recognition condition according to an embodiment of the present invention.

도 7은 본 발명의 또 다른 일실시예에 따른 학습 평가 서비스 시스템의 블록 구성도이다.7 is a block diagram of a learning evaluation service system according to another embodiment of the present invention.

이하에 본 발명을 상세하게 설명하기에 앞서, 본 명세서에 사용된 용어는 특정의 실시예를 기술하기 위한 것일 뿐 첨부하는 특허청구의 범위에 의해서만 한정되는 본 발명의 범위를 한정하려는 것은 아님을 이해하여야 한다. 본 명세서에 사용되는 모든 기술용어 및 과학용어는 다른 언급이 없는 한은 기술적으로 통상의 기술을 가진 자에게 일반적으로 이해되는 것과 동일한 의미를 가진다.Prior to describing the present invention in detail below, it is understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the invention, which is limited only by the scope of the appended claims. shall. All technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise indicated.

본 명세서 및 청구범위의 전반에 걸쳐, 다른 언급이 없는 한 포함(comprise, comprises, comprising)이라는 용어는 언급된 물건, 단계 또는 일군의 물건, 및 단계를 포함하는 것을 의미하고, 임의의 어떤 다른 물건, 단계 또는 일군의 물건 또는 일군의 단계를 배제하는 의미로 사용된 것은 아니다.Throughout this specification and claims, unless otherwise indicated, the termcomprise, constitutes, and configure means to include the referenced article, step, or group of articles, and step, and any other article It is not intended to exclude a stage or group of things or groups of stages.

한편, 본 발명의 여러 가지 실시예들은 명확한 반대의 지적이 없는 한 그 외의 어떤 다른 실시예들과 결합될 수 있다. 특히 바람직하거나 유리하다고 지시하는 어떤 특징도 바람직하거나 유리하다고 지시한 그 외의 어떤 특징 및 특징들과 결합될 수 있다. On the other hand, various embodiments of the present invention can be combined with any other embodiment unless clearly indicated to the contrary. Any feature indicated as particularly preferred or advantageous may be combined with any other feature and features indicated as preferred or advantageous.

본 명세서 및 청구범위 전반에 걸쳐 기재된 '어플리케이션(application)'이라는 용어는 특정한 업무를 수행하기 위해 고안된 일련의 단말기용 프로그램 집합을 의미하는 것으로, '응용 프로그램' 내지 '응용 소프트웨어'로도 표현될 수 있다. 이하, 첨부된 도면을 참조하여 본 발명의 실시예 및 이에 따른 효과를 설명하기로 한다. The term 'application' described throughout the present specification and claims refers to a set of terminal program sets designed to perform a specific task, and may also be expressed as an 'application program' to 'application software'. . Hereinafter, with reference to the accompanying drawings will be described an embodiment of the present invention and the effects thereof.

본 발명의 일 실시예에 의한 학습 평가 서비스 시스템은 시험지 정보(101) 및 문항 정보(102)를 포함하는 시험지(10); 시험지 정보(101) 및 문항 정보(102)를 입력할 수 있는 학습 어플리케이션(203)이 설치되어 실행되는 단말기(20); 문제 정보 데이터베이스(3011)를 포함하는 데이터베이스(301) 및 답안지 생성부(302)를 포함하고, 답안지 생성부(302)를 통해 생성된 답안지(50)를 유무선 통신망을 통해 단말기(20)로 송신할 수 있는 관리서버(30); 및 단말기(20)로부터 유무선 통신망을 통해 전송된 답안지(50)를 수신하여 답안지(50)를 출력하는 출력수단(40);을 포함한다.Learning evaluation service system according to an embodiment of the present invention comprises a test paper (10) comprising a test paper information 101 and item information (102); A terminal 20 in which a learning application 203 capable of inputting the test paper information 101 and the item information 102 is installed and executed; The answer sheet 50 including the database 301 including the problem information database 3011 and the answer sheet generator 302, and the answer sheet 50 generated through the answer sheet generator 302 may be transmitted to the terminal 20 through a wired or wireless communication network. Management server 30; And output means 40 for receiving the answer sheet 50 transmitted from the terminal 20 through the wired / wireless communication network and outputting the answer sheet 50.

문제 정보 데이터베이스(3011)는 식별 태그가 입력된 문제 정보가 저장되며, 답안지 생성부(302)는 단말기(20)를 통해 시험지 정보(101) 및 문항 정보(102)가 입력되면, 입력된 시험지 정보(101) 및 문항 정보(102)와 일치하는 식별 태그를 가진 문제를 검색하여 해당하는 시험지 문제에 대응하는 답안 영역(501)이 배치된 답안지(50)를 생성한다. The problem information database 3011 stores problem information in which an identification tag is input, and the answer sheet generating unit 302 receives the test paper information 101 and the question information 102 through the terminal 20, and then inputs the test paper information. The question with the identification tag that matches the 101 and the question information 102 is searched to generate an answer sheet 50 in which an answer area 501 corresponding to the corresponding test sheet question is disposed.

도 1에 본 발명의 일 실시예인 학습 평가 서비스 시스템의 블록 구성도 및 모식도를 나타내었다.1 is a block diagram and a schematic diagram of a learning evaluation service system according to an embodiment of the present invention.

시험지(10)는 시험지 정보(101) 및 문항 정보(102)를 포함하고, 시험지 정보(101)는 시험 종류(대분류), 시험지 출처(중분류), 시험 범위(소분류)를 포함하며, 문항 정보(102)는 문항 번호, 문항 형식, 문항 관련 자료를 포함한다. 답안지 생성부(302)에서 답안지(50) 생성 시 입력된 시험지 정보(101) 및 문항 정보(102)를 통해 해당하는 시험지(10) 문제에 대응하는 답안 영역(501)을 생성할 수 있도록 한다.The test paper 10 includes test paper information 101 and item information 102, and the test paper information 101 includes a test type (large classification), a test paper source (middle classification), and a test range (small classification). 102) includes the item number, item type, and item data. The answer sheet generator 302 may generate an answer region 501 corresponding to the corresponding test sheet 10 problem through the test sheet information 101 and the question information 102 inputted when the answer sheet 50 is generated.

시험지(10)는 낱장 형태일 수 있고, 또는 책자 형태일 수 있으나 이에 제한되는 것은 아니며, 다양한 형태 및 다양한 매체를 통해 제공되는 시험지를 포함한다. 시험지(또는 교재)에 수록된 문제는 식별 태그가 입력되어 문제 정보 데이터베이스(3011)에 저장되므로 시험지 정보(101) 및 문항 정보(102)를 입력함으로써 시험지 맞춤형 답안지를 제공하도록 한다. 도 2에 시험지(10)의 일실시예를 나타내었다. The test paper 10 may be in the form of a sheet or may be in the form of a booklet, but is not limited thereto. The test paper 10 may include test papers provided through various forms and various media. As the question recorded in the test paper (or the textbook) is inputted with an identification tag and stored in the problem information database 3011, the test paper customized answer sheet may be provided by inputting the test paper information 101 and the item information 102. 2 shows one embodiment of the test paper 10.

시험지 정보(101)는 외국어, 수험, 자격증, 일반 시험 등의 시험 종류(대분류), 교재, 시험주관 기관 등의 시험지 출처(중분류), 단원, 범위 등의 시험 범위(소분류)를 포함하고, 문항 정보(102)는 시작번호, 끝번호 등의 문항 번호, 객관식, 주관식, 서술형 등의 문항 형식, 문제, 풀이 등이 업로드 된 URL 등의 문항 관련 자료를 포함한다. The test paper information 101 includes a test range (sub-category) such as foreign language, examination, certification, test type (classification) such as general test, textbooks, source of test paper (sub-category) such as test organization, unit, range, etc. The information 102 includes item-related data such as an item number such as a start number and an end number, an item form such as a multiple choice, a short answer, a narrative type, a URL uploaded with a problem, and a solution.

관리서버(30)는 데이터베이스(301), 답안지 생성부(302), 및 데이터 처리부(303)를 포함한다. 데이터베이스(301)는 문제 정보 데이터베이스(3011), 응시자 정보 데이터베이스(3012), 분석 정보 데이터베이스(3013)를 포함하며, 데이터 처리부(303)는 채점 처리부(3031), 결과 분석부(3032)를 포함한다. 도 3에 관리서버(30)의 블록 구성도를 나타내었다.The management server 30 includes a database 301, an answer sheet generator 302, and a data processor 303. The database 301 includes a problem information database 3011, a candidate information database 3012, and an analysis information database 3013, and the data processing unit 303 includes a scoring processor 3031 and a result analyzing unit 3032. . 3 shows a block diagram of the management server 30.

문제 정보 데이터베이스(3011)는 식별 태그가 입력된 문제 정보가 저장되고, 또한 각 문제에 대한 정답 정보 및 해설 정보가 저장된다. 식별 태그는 외국어, 수험, 자격증, 일반 시험 등의 시험 종류(대분류), 교재, 시험주관 기관 등의 시험지 출처(중분류), 단원, 범위 등의 시험 범위(소분류)를 포함하고, 문항 번호, 객관식, 주관식, 서술형 등의 문항 형식, 문제, 풀이 등이 업로드 된 URL 등의 문항 관련 자료를 포함한다. The problem information database 3011 stores problem information in which an identification tag is input, and also correct answer information and commentary information for each problem. The identification tag includes a test range (sub-category) such as foreign language, exam, certification, and general test type (classification), textbooks, test paper source (sub-category) such as test organization, section, range, and the like. Includes item-related data, such as the URL of the item format, questions, and answers.

응시자 정보 데이터베이스(3012)는 평가에 응시한 응시자의 성명, 전화번호, 이메일 등의 개인 정보가 저장되며, 또한 응시자별 응시한 학습 평가 정보가 저장된다. 답안지 생성부(302)에서 답안지(50) 생성 시 다른 응시자와 구별되는 정보가 포함된 응시자 코드(502)를 배치하여 개인별 맞춤형 답안지를 제공한다.The candidate information database 3012 stores personal information such as the name, phone number, and e-mail of the candidate taking the assessment, and also stores the study evaluation information for each candidate. In the answer sheet generator 302, when the answer sheet 50 is generated, the candidate code 502 including information distinguished from other test takers is disposed to provide a personalized answer sheet.

분석 정보 데이터베이스(3013)는 채점 결과 및 성적 분포, 오답율, 오답 유형 등의 분석 정보가 시험지별로 누적 데이터화되며, 분석 정보는 언제든지 출제자 또는 응시자에게 제공될 수 있고, 개별 응시자에게도 전체 응시자의 성적 분포가 제공될 수 있다. 즉, 응시자 정보가 등록된 경우 응시자별 개인 성적 결과 분석뿐만 아니라 동일한 시험에 응시한 응시자 전체 성적 분석 정보를 데이터베이스화하여 응시자 및 출제자에게 제공할 수 있다.The analysis information database 3013 is cumulative data for each test paper, such as scoring results and grade distribution, error rate, and type of error, and the analysis information may be provided to the candidate or the candidate at any time, and the individual test taker's grade distribution May be provided. In other words, when the candidate information is registered, not only the individual grade result analysis for each candidate but also the entire test result analysis information of the candidate taking the same test may be provided to the candidate and the candidate.

답안지 생성부(302)는 단말기(20)의 학습 어플리케이션(203)을 통해 시험지 정보(101) 및 문항 정보(102)가 입력되면, 문제 정보 데이터베이스(3011)에서 시험지 정보(101) 및 문항 정보(102)와 일치하는 식별 태그를 가진 문제를 검색하여 해당하는 시험지 문제에 대응하는 답안 영역(501)이 배치된 답안지(50), 예를 들면, OMR 카드를 생성한다.The answer sheet generating unit 302 receives the test sheet information 101 and the item information 102 through the learning application 203 of the terminal 20, and the test sheet information 101 and the item information ( The question with the identification tag matching 102 is searched to generate an answer sheet 50, for example, an OMR card, with an answer area 501 corresponding to the corresponding test sheet question.

또한, 답안지 생성부(302)는 응시자 정보 데이터베이스(3012)에 정보가 저장된 응시자에 해당하는 경우 응시자 정보가 포함된 응시자 코드(502)가 배치된 답안지를 생성한다. 응시자 코드(502)는 QR 코드, 바코드를 포함하나 이에 제한되는 것은 아니며, 정보를 담을 수 있는 어떠한 형태의 식별코드도 사용할 수 있다.In addition, the answer sheet generating unit 302 generates an answer sheet on which the candidate code 502 including the candidate information is disposed when the information corresponds to the candidate having information stored in the candidate information database 3012. The candidate code 502 may include, but is not limited to, a QR code and a barcode, and may use any type of identification code that can hold information.

응시자 정보 데이터베이스(3012)에 정보가 저장되지 않은 응시자에 해당하는 경우에는 해당하는 시험지 문제에 대응하는 답안 영역(501)만이 배치된 답안지(50)가 생성된다. In the case of the test taker whose information is not stored in the test taker information database 3012, the answer sheet 50 in which only the answer area 501 corresponding to the corresponding test paper question is disposed is generated.

출력수단(40)은 답안 영역(501) 및 응시자 코드(502)(응시자 정보가 입력된 경우)가 배치된 답안지(50)를 출력한다. 출력된 답안지(50)는 응시자에게 교부되어 작성됨으로써 학습 평가가 이루어지도록 한다. The output means 40 outputs the answer sheet 50 in which the answer area 501 and the candidate code 502 (if candidate information is input) are arranged. The printed answer sheet 50 is issued to the test taker so that the learning evaluation is made.

단말기(20)는 촬영부(201) 및 화면표시부(202)를 포함하며, 학습 어플리케이션(203)이 설치되어 실행된다. 단말기(20)는 촬영부(201)를 통해 응시자에 의해 작성된 답안지(50)를 촬영하여 답안지 이미지를 스캔할 수 있는 학습 어플리케이션(203)에 의해 답안지 채점에 필요한 답안지 이미지를 채점 처리부(3031)에 제공한다. The terminal 20 includes a photographing unit 201 and a screen display unit 202, and the learning application 203 is installed and executed. The terminal 20 captures the answer sheet 50 prepared by the test taker through the photographing unit 201 and scans the answer sheet image required for scoring the answer sheet by the learning application 203. to provide.

촬영부(201)는 시험지(10)를 촬영할 수 있는 카메라 등의 광학기기를 포함하며, 답안지(50)를 인식하는 수단이 된다. 학습 어플리케이션(203)에 의한 촬영 명령을 수행한다.The photographing unit 201 includes an optical device such as a camera capable of photographing the test paper 10 and serves as a means for recognizing the answer sheet 50. The photographing command by the learning application 203 is performed.

화면표시부(202)는 출제자 또는 응시자가 어플리케이션을 통해 시험지 정보, 문항 정보 및 응시자 정보 등을 입력하고, 기타 메뉴 선택 및 실행을 할 수 있도록 하는 인터페이스 수단이 된다. 또한 답안지(50) 인식 시 촬영 상태가 표시되거나 채점 및 분석 결과, 해설 등이 표시될 수 있다. The screen display unit 202 may be an interface means that allows a candidate or a candidate to input test paper information, item information, and candidate information through an application, and to select and execute other menus. In addition, when the answer sheet 50 is recognized, the photographing state may be displayed, or the result of scoring and analysis, commentary, etc. may be displayed.

학습 어플리케이션(203)은 출제자 또는 응시자가 입력한 시험지 정보, 문항 정보 및 응시자 정보를 전송하여 답안지 생성부(301)에서 해당 시험지(10)에 대응하는 답안지(50)를 생성할 수 있도록 한다.The learning application 203 transmits the test paper information, the question information, and the test taker information inputted by the questionnaire or the test taker so that the answer sheet generating unit 301 can generate the answer sheet 50 corresponding to the test paper 10.

답안지(50)의 특정 영역에 촬영 지표 기능을 갖는 기준 마커를 더 배치하는 경우, 작성된 답안지(50)를 자동 촬영할 수 있다. 더욱 구체적으로 답안지 생성시 답안지(50)의 각 모서리 중 3군데 또는 4군데에 촬영 지표 기능을 갖는 기준 마커(503)를 더 배치하여 답안지(51)를 생성한 경우, 학습 어플리케이션(203)은 기준 마커(503)의 위치를 파악할 수 있는 가이드라인을 내부적으로 생성하고 기준 마커(503)의 위치를 파악하여 인식 조건을 만족하면 시험지를 자동으로 촬영하도록 한다. When a reference marker having a photographing indicator function is further disposed in a specific area of the answer sheet 50, the prepared answer sheet 50 may be automatically photographed. More specifically, when generating the answer sheet 51 by further placing a reference marker 503 having a photographing indicator function on three or four of each corner of the answer sheet 50 when generating the answer sheet, the learning application 203 is a reference. A guideline for identifying the position of the marker 503 is internally generated and the position of the reference marker 503 is identified to automatically photograph the test paper when the recognition condition is satisfied.

기준 마커(503)는 일정 두께의 테두리를 가지는 다각형, 예를 들면, 사각형 등의 형태를 가질 수 있으나 이에 제한되는 것은 아니며 후술할 가이드라인에 의해 기준 마커로 인식될 수 있는 형태를 모두 포함한다. The reference marker 503 may have a polygonal shape having a border of a predetermined thickness, for example, a rectangle, but is not limited thereto. The reference marker 503 may include all shapes that may be recognized as reference markers by the guidelines to be described later.

도 4에 답안 영역(501), 응시자 코드(502), 기준 마커(503)가 배치된 답안지(50)를 나타내었으며, 도 5에 학습 어플리케이션의 자동 촬영 알고리즘을 나타내었다.In FIG. 4, the answer sheet 50 in which the answer area 501, the candidate code 502, and the reference marker 503 are disposed is illustrated, and FIG. 5 illustrates the automatic photographing algorithm of the learning application.

도 5에 도시된 바와 같이 학습 어플리케이션(203)은 기준 마커(503)의 위치를 파악할 수 있는 가이드라인을 내부적으로 생성하고, 가이드라인 영역을 매 프레임마다 체크하여 기준 마커(503)의 위치를 파악함으로써 인식 조건을 만족하면 시험지를 자동으로 촬영하도록 하여 시험지 이미지를 스캔한다. 화면 전체를 체크하지 않고, 가이드라인 영역만을 체크하면 되므로 빠른 속도로 인식이 가능하고, 자동으로 촬영됨으로써 사용자 편의성을 향상시킬 수 있다.As shown in FIG. 5, the learning application 203 internally generates a guideline for identifying the position of the reference marker 503, and checks the guideline area every frame to determine the position of the reference marker 503. If the recognition condition is satisfied, the test paper is automatically photographed and the test paper image is scanned. Since only the guideline area is checked without checking the entire screen, recognition can be performed at a high speed, and the user's convenience can be improved by automatically photographing.

자동 촬영이 되는 인식 조건은 3개 이상의 가이드라인에서 기준 마커가 인식되는 경우에만 자동으로 촬영이 이루어지도록 하여 시험지 전체의 이미지를 높은 인식률로 인식할 수 있도록 한다. 바람직하게는 4개의 가이드라인에서 기준 마커가 인식 되는 경우에 자동으로 촬영이 이루어지는 것이 시험지 전체의 이미지를 구김이나 기울어짐 없이 인식할 수 있으므로 좋다.Recognition conditions for automatic photographing allow the photographing to be taken automatically only when the reference marker is recognized in three or more guidelines so that the image of the entire test paper can be recognized with a high recognition rate. Preferably, when the reference marker is recognized in the four guidelines, the photographing is automatically performed because the image of the entire test paper can be recognized without wrinkling or tilting.

2개 이상의 가이드라인에서 기준 마커(503)가 인식 되지 않는 경우, 즉 답안지(50)가 구겨지거나 기울어짐이 심한 상태인 경우에는 촬영되지 않도록 하여 부정확한 답안지 이미지의 스캔을 차단하고, 이로써 채점 처리부(3031)의 부담을 줄일 수 있으며, 채점 결과의 신뢰도를 높일 수 있다. When the reference marker 503 is not recognized in two or more guidelines, that is, when the answer sheet 50 is creased or is inclined, the photographing is prevented from being photographed, thereby preventing the scanning of the incorrect answer sheet image. The burden of 3031 can be reduced, and the reliability of the scoring result can be improved.

도 6에 가이드라인 상에 기준 마커가 모두 위치하는지 여부를 판단하는 개념도를 나타내었다. 도 6에 나타나는 것과 같이 가이드라인은 일정간격을 가진 2개 이상의 일직선으로, 기준 마커(503)의 테두리 영역을 1로 인식하고, 이외의 영역을 0으로 인식하여, 가이드라인의 일직선상에서 010 및 01010의 형태로 인식되는 것만을 기준 마커로 인식한다. 이와 같은 방법을 사용하는 경우, 기준 마커(503)가 회전되어 있는 경우라도 인식이 가능하다. 6 is a conceptual diagram for determining whether all of the reference markers are positioned on the guideline. As shown in FIG. 6, the guideline is two or more straight lines having a predetermined interval, and the edge area of the reference marker 503 is recognized as 1, and other areas are recognized as 0, so that the guide line is 010 and 01010 on the straight line of the guideline. Only those recognized in the form of are recognized as reference markers. When using such a method, it is possible to recognize even when the reference marker 503 is rotated.

또한 단말기(20)의 화면표시부(202) 전체를 체크하여 기준 마커를 인식하는 방법을 사용하여 자동 촬영할 수 있다. 이는 화면표시부(202) 전체에 가이드라인을 형성하여 3개 또는 4개의 기준 마커가 인식되면 자동으로 촬영되는 방법으로 일부분에서 가이드라인을 형성하여 인식 하는 방법보다 전체 화면을 체크해야 하므로 촬영 속도는 느리지만 사용자가 기준 마커(503)의 위치를 맞출 필요가 없어 편리한 장점이 있다.In addition, the entire screen display unit 202 of the terminal 20 can be checked automatically by using a method of recognizing a reference marker. This is a method that forms a guideline on the entire screen display unit 202 and is automatically photographed when three or four reference markers are recognized. Only the user does not need to match the position of the reference marker 503 has the advantage that it is convenient.

답안지(50)의 모서리에 위치하는 3개 이상의 기준 마커(503) 및 이를 인식할 수 있는 가이드라인을 통하여 시험지를 리더기, 스캐너 등의 별도의 장비를 이용하지 않고 단말기(20)로 촬영을 하여 인식하더라도 답안지 전체 이미지의 구겨짐이나 기울어짐을 최소화하여 인식할 수 있게 하여 답안지 인식률을 높여 정확한 답안지 이미지를 얻을 수 있다. 이로 인하여 후의 채점 처리부의 처리 부담을 줄일 수 있어 신속하고 정확한 채점 또한 가능하게 한다. Through the three or more reference markers 503 located at the corners of the answer sheet 50 and guidelines for recognizing them, the test sheets are photographed and recognized by the terminal 20 without using a separate device such as a reader or a scanner. Even if the answer sheet can be recognized by minimizing the wrinkles or skew of the entire image, the recognition rate of the answer sheet can be increased to obtain an accurate answer sheet image. This makes it possible to reduce the processing burden of the subsequent scoring processing unit, thereby enabling quick and accurate scoring.

기준 마커(503)가 답안지(50)의 각 모서리 중 3군데에 위치하는 경우, 3개의 가이드라인 영역에서만 기준 마커(12)를 인식하면 자동 촬영되므로 빠른 스캔이 가능하고, 스캔된 답안지 이미지의 회전 여부를 알 수 있는 장점이 있다. 그러나 쉽게 변형이 가능한 종이로 된 답안지(50)의 특성상 기준 마커(503)가 위치하지 않은 나머지 모서리의 정확한 위치파악이 어려운 단점이 있다. If the fiducial marker 503 is located at three of the corners of the answer sheet 50, if the fiducial marker 12 is recognized only in the three guide areas, it is automatically photographed so that a quick scan is possible and the rotation of the scanned answer sheet image is rotated. There is an advantage to know whether or not. However, due to the nature of the answer sheet 50 made of easily deformable paper, it is difficult to accurately locate the remaining corners in which the reference marker 503 is not located.

따라서 답안지(50)의 정확한 위치파악이 가능하도록 기준 마커(503)가 답안지(50)의 각 모서리 중 4군데에 위치하는 것이 바람직하며, 이 경우 시험지 이미지의 회전 여부를 알 수 없는 문제가 있지만, QR 코드, 삼각 마커 등의 회전 여부 식별수단(504)을 답안지(50)에 더 포함함으로써 해결할 수 있다. Therefore, it is preferable that the reference marker 503 is located at four places of each corner of the answer sheet 50 so as to accurately locate the answer sheet 50. In this case, there is a problem in which the rotation of the test sheet image is unknown. The answer sheet 50 may be solved by further including a QR code, a triangular marker, or the like, on the answer sheet 50.

또한 단말기(20)는 자이로 센서를 더 포함함으로써 답안지 자동 촬영 시 수평을 유지하는데 도움될 수 있으며, 조도 센서를 더 포함하여 어두운 환경에서도 촬영할 수 있도록 한다.In addition, the terminal 20 may further include a gyro sensor, which may help maintain horizontality when the answer sheet is automatically photographed, and may further include an illuminance sensor to allow recording in a dark environment.

단말기(20)에서 인식된 답안지 이미지는 유무선 통신망을 통해 관리서버(30)로 전송된다. 관리서버(30)는 데이터베이스(301), 답안지 생성부(302) 및 데이터 처리부(303)를 포함하는 서버로서, 답안지 이미지를 전송받아 이미지 보정, 답안 영역 추출, 답안 채점 등의 채점 처리 후 채점 결과 분석, 문제 풀이(해설) 등의 분석 정보를 분석 정보 데이터베이스(3013)에 저장한다.The answer sheet image recognized by the terminal 20 is transmitted to the management server 30 through a wired or wireless communication network. The management server 30 is a server including a database 301, answer sheet generating unit 302, and data processing unit 303, receives the answer sheet image, and then scores the result after scoring processing such as image correction, answer region extraction, answer scoring, and the like. Analysis information such as analysis and problem solving (commentary) is stored in the analysis information database 3013.

단말기(20)는 퍼스널컴퓨터(PC)나 스마트 단말기, PDA 등일 수 있으나 이에 한정되는 것은 아니다. The terminal 20 may be a personal computer (PC), a smart terminal, a PDA, or the like, but is not limited thereto.

채점 처리부(3031)는 이미지 보정 단계, 답안 영역 추출 단계, 답안 채점 단계를 통해 채점 처리를 수행한다.The scoring processor 3031 performs scoring processing through an image correction step, an answer area extraction step, and an answer scoring step.

이미지 보정 단계는 영상 이진화(adaptive threshold)를 통해 출제자용 단말기(21)로부터 전송된 답안지 이미지의 노이즈를 제거하고, 답안지 이미지 내의 기준 마커(503)를 통해 기울임을 보정한다.The image correction step removes noise of the answer sheet image transmitted from the questionnaire terminal 21 through image binarization, and corrects the tilt through the reference marker 503 in the answer sheet image.

답안 영역 추출 단계는 보정된 답안지 이미지에서 기준 마커(503)를 연결하는 외곽선을 기준으로 답안 영역(501)을 추출한다.In the answer region extraction step, the answer region 501 is extracted based on an outline connecting the reference marker 503 from the corrected answer sheet image.

답안 채점 단계는 객관식 문제인 경우, 추출된 답안 영역(501)의 문제별로 바이너리(binary) 수치를 계산하고, 빈 공간이 가장 많은 최저값을 기준으로 특정값 이상의 수치를 가진 영역을 마킹 위치 또는 체크 위치로 인식하고, 문제 정보 데이터베이스(3011)에 저장된 정답 정보와 비교하여 채점한다.In the case of a multiple-choice question, the answer scoring step calculates a binary value for each problem of the extracted answer area 501, and moves an area having a value greater than or equal to a certain value based on the lowest value with the most empty space to a marking position or a check position. It recognizes and scores compared with the correct answer information stored in the problem information database 3011. FIG.

답안 영역(501)의 마킹, 체크, 기재 위치로 인식되는 바이너리 수치를 절대값으로 지정하지 않고 문제별로 최저값을 각각 계산하여 상대적으로 마킹 위치 또는 체크 위치를 인식하도록 함으로써 채점 결과에 대한 신뢰도를 높일 수 있다. It is possible to increase the reliability of the scoring result by calculating the lowest value for each problem and recognizing the marking position or the check position without specifying the binary value recognized as the marking, checking, or writing position of the answer area 501 as an absolute value. have.

주관식 또는 서술형 문제인 경우, 답안 영역(501)을 출제자(채점자)에게 제공하여 채점하도록 한다. 출제자(채점자)는 문제를 제외한 답안만 볼 수 있어 가독성이 높아져 채점이 용이한 효과가 있다. 또한 각 문항 별로 여러 응시자의 답안 영역을 동시에 제공할 수도 있으며, 추출된 답안과 정답을 한 화면에 함께 제공하여 빠른 속도로 채점이 가능하다. 채점 결과를 통해 전체 성적 분포뿐만 아니라 오답율, 오답 유형 등의 분석이 이루어진다. 응시자 각각의 채점결과 및 분석 정보는 응시자 정보 데이터베이스 및 분석 정보 데이터베이스에 저장된다. 채점결과 및 분석 정보는 온라인 또는 오프라인을 통해 언제든지 출제자 또는 응시자에게 제공될 수 있다.In the case of a short answer or a narrative question, the answer area 501 is provided to the questionnaire (scorer) to be graded. The questionnaire (marker) can see only the answer except for the problem, so the readability is improved, so the scoring is easy. In addition, it is possible to provide the answer areas of several test takers for each question at the same time, it is possible to score quickly by providing the extracted answer and the correct answer on one screen. The scoring results analyze not only the overall grade distribution but also the percentage of incorrect answers and types of incorrect answers. Each candidate's scoring results and analysis information are stored in the candidate information database and analysis information database. Score results and analysis information may be provided to the questions or candidates at any time, either online or offline.

본 발명의 일 실시예인 학습 평가 서비스 시스템은 응시자 등록을 통해 응시자별 개인 성적 결과 분석뿐만 아니라 동일한 시험에 응시한 응시자 전체 성적 분석 정보를 데이터베이스화하여 응시자 및 출제자에게 제공할 수 있다. 또한 개별적으로 시험지나 책을 구입하여 응시한 응시자들의 채점 결과는 누적 데이터를 구성하고 동일한 시험지(또는 교재)에 대하여 응시자의 실력을 가늠할 수 있도록 한다.Learning evaluation service system is an embodiment of the present invention through the registration of candidates can be provided to the candidate and the examinee by analyzing not only the individual grade result analysis by each candidate, but also the database of the test taker total grade analysis information that took the same test. In addition, the scores of the candidates who purchased the test papers or books individually constitute cumulative data and can measure the candidate's ability on the same test paper (or textbook).

본 발명의 일 실시예인 학습 평가 서비스 시스템은 다수의 응시자가 동시에 학습 평가를 받는 경우, 단말기(20)는 출제자용 단말기(21)로서, 출제자는 출제자용 단말기(21)를 통해 시험지 정보 및 문항 정보를 입력하고, 필요에 따라 응시자 정보를 입력하면 답안지 생성부에서는 동일한 답안 영역을 갖되, 응시자 코드가 각각 생성된 다수의 답안지를 생성할 수 있고, 이를 출력수단을 통해 출력하여 응시자에게 교부함으로써 학습 평가가 이루어진다. 각 응시자에 의해 작성된 답안지는 출제자용 단말기(21)에 의해 촬영되어 상술한 시스템에 의해 채점 후 결과 분석이 이루어진다. In the learning evaluation service system according to an embodiment of the present invention, when a plurality of test takers receive a learning evaluation at the same time, the terminal 20 is a questionnaire terminal 21, and the questionnaire test paper information and question information through the questionnaire terminal 21. And inputting candidate information as necessary, the answer sheet generator can generate a plurality of answer sheets having the same answer area, each of which a candidate code is generated, and outputs it through an output means and issues it to the candidate for evaluation. Is done. The answer sheet prepared by each candidate is photographed by the questionnaire terminal 21, and the result analysis is performed after scoring by the above-described system.

본 발명의 다른 일실시예에 의한 학습 평가 서비스 시스템은 개별 응시자가 학습 평가를 하려는 경우, 단말기(20)는 응시자용 단말기(22)로서, 응시자는 응시자용 단말기(22)를 통해 시험지 정보 및 문항 정보를 입력하고, 필요에 따라 응시자 정보를 입력하면 답안지 생성부에서는 답안 영영 및 응시자 코드가 생성된 답안지를 생성하고, 이를 출력수단을 통해 출력하여 답안지를 작성함으로써 학습 평가가 이루어진다. 응시자에 의해 작성된 답안지는 응시자용 단말기(22)에 의해 촬영 되어 상술한 시스템에 의해 채점 후 결과 분석이 이루어진다. In the learning evaluation service system according to another embodiment of the present invention, when the individual test taker wants to evaluate the learning, the terminal 20 is the test taker terminal 22 and the test taker information and the questionnaire through the test taker terminal 22. When the information is input and the candidate information is input as necessary, the answer sheet generating unit generates the answer sheet in which the answer answer and the test taker codes are generated, and outputs it through the output means to prepare the answer sheet. The answer sheet prepared by the test taker is photographed by the test taker terminal 22 and the score analysis is performed by the above-described system.

개별적으로 응시한 경우에도, 분석 정보 데이터베이스에 저장된 동일한 시험지에 응시한 응시자들의 채점 결과가 누적된 데이터를 통해 개별 응시자의 실력을 가늠할 수 있으며, 시간과 장소에 구애 없이 효율적이고 편리하게 학습 평가가 가능한 서비스를 제공할 수 있다. Even in the case of individual exams, the scores of the test takers who have taken the same test paper stored in the analysis information database can be used to measure the skills of individual test takers and can efficiently and conveniently evaluate learning regardless of time and place. Can provide services.

또한 본 실시예의 경우 출력수단(40)을 통해 답안지를 출력하여 응시할 수도 있지만, 도 8에 나타난 블록 구성도와 같이 출력하지 않고 학습 어플리케이션(223)에서 직접 답안지를 작성할 수도 있다. 답안지 생성부(302)에서 생성된 답안지는 응시자 단말기(22)로 전송되어 학습 어플리케이션(223)을 통해 화면표시부(222)에 생성된 답안지가 표시되고, 응시자는 직접 답안을 작성하여 제출함으로써 채점이 가능하다. 이 경우 답안지를 촬영할 필요가 없어, 답안 영역 추출이 용이한 장점이 있다. In addition, in the present embodiment, the answer sheet may be outputted and stared through the output means 40, but the answer sheet may be prepared directly in the learning application 223 without outputting the block diagram shown in FIG. The answer sheet generated by the answer sheet generating unit 302 is transmitted to the test taker terminal 22, and the answer sheet generated on the screen display unit 222 is displayed through the learning application 223. It is possible. In this case, there is no need to photograph the answer sheet, which makes it easy to extract the answer region.

본 발명의 일실시예인 학습 평가 서비스 시스템은 수익 창출을 위한 사업 모델로서, 본 발명을 이루는 각 매체 사이에서 네트워크를 통한 신호 전달 시 수수료를 부과할 수 있다. 예를 들면, 관리서버(30)는 수수료 부과부(304)를 더 포함하여 단말기(20)로부터 시험지 정보 및 문항 정보를 답안지 생성부(302)로 전송하는 경우나 단말기(20)에서 촬영한 답안지 이미지를 데이터 처리부(303)로 전송하는 경우에 수수료 부과부(304)에서 답안지 생성에 대한 수수료나 분석 정보 제공에 대한 수수료를 결제하도록 할 수 있다.The learning evaluation service system, which is an embodiment of the present invention, is a business model for generating revenue, and may charge a fee for signal transmission through a network between the media constituting the present invention. For example, the management server 30 further includes a fee charging unit 304 to transmit test paper information and question information from the terminal 20 to the answer sheet generating unit 302 or the answer sheet photographed by the terminal 20. When the image is transmitted to the data processing unit 303, the fee charging unit 304 may allow a fee for generating an answer sheet or a fee for providing analysis information.

본 발명의 다른 측면에서 본 학습 평가 서비스 방법의 일실시예는 출제자 또는 응시자로부터 단말기를 통해 입력된 정보를 전송받아 관리서버의 답안지 생성부에서 답안지를 생성하는 출제단계(S1); 생성된 답안지를 출력 및 교부하여 응시자가 답안지를 작성하는 응시단계(S2); 및 단말기를 통해 작성된 답안지를 촬영하여 얻은 답안지 이미지를 전송받아 관리서버의 데이터 처리부에서 채점하고 결과를 분석하여 채점 및 분석 결과를 제공하는 채점단계(S3);를 포함한다. In another aspect of the present invention, an embodiment of the learning evaluation service method includes a questionnaire step (S1) of receiving answer information inputted through a terminal from a questionnaire or a candidate and generating an answer sheet in an answer sheet generation unit of a management server; A gazing step (S2) in which the test taker writes the answer sheet by outputting and issuing the generated answer sheet; And a scoring step (S3) of receiving the answer sheet image obtained by photographing the answer sheet prepared through the terminal, scoring the data in the management server, analyzing the result, and providing a scoring and analysis result.

출제단계(S1)는 시험지 정보 및 문항 정보가 입력되면, 관리서버의 답안지 생성부에서 입력된 시험지 정보 및 문항 정보와 일치하는 식별 태그를 갖는 문제를 검색하고, 이에 대응하는 답안 영역이 배치된 답안지를 생성한다. In the question step S1, when the test paper information and the question information are inputted, the answer sheet generation unit of the management server searches for a problem having an identification tag that matches the test paper information and the question information inputted, and the answer sheet having the corresponding answer area is arranged. Create

또한 출제단계(S1)는 응시자 정보가 더 입력되는 경우, 관리서버의 답안지 생성부에서 입력된 응시자 정보에 대응하는 응시자 코드가 더 배치된 답안지를 생성한다. In addition, when the candidate information is further input, the question-taking step S1 generates an answer sheet in which a candidate code corresponding to the candidate information input by the answer sheet generator of the management server is further disposed.

응시단계(S2)는 출제자가 생성된 답안지를 출력하여 다수의 응시자에게 교부하여 응시하도록 하거나(S21), 응시자가 생성된 답안지를 출력하여 스스로 응시하거나(S22), 응시자가 생성된 답안지를 출력하지 않고 응시자 단말기를 통해 응시(S23)할 수 있다.Examination step (S2) is the candidate to output the generated answer sheet to be given to a large number of candidates to take the gaze (S21), or to take a gaze by outputting the answer sheet generated by the candidate (S22), or do not output the answer sheet generated by the candidate It may be gaze (S23) through the candidate terminal without.

채점단계(S3)는 S21 또는 S22의 방법으로 응시한 경우, 출제자용 단말기 또는 응시자용 단말기를 통해 작성된 답안지(들)을 촬영하여 스캔된 답안지 이미지가 관리서버에 전송되면 상술한 데이터 처리를 통해 채점 및 결과 분석 수행한다. 채점 단계는 응시자에게 분석 정보를 제공하는 것을 포함한다.In the scoring step S3, when the gaze is taken by the method of S21 or S22, the answering sheet (s) photographed by the candidate terminal or the candidate terminal are photographed and the scanned answer sheet image is transmitted to the management server. And result analysis. The scoring step includes providing analysis information to the candidate.

채점단계(S3)는 S23의 방법으로 응시한 경우, 응시자용 단말기에 입력된 답안 정보가 관리서버에 전송되면 상술한 데이터 처리를 통해 채점 및 결과 분석 수행한다. 채점 단계는 응시자에게 분석 정보를 제공하는 것을 포함한다.In the scoring step S3, when the gaze is performed by the method of S23, when the answer information input to the candidate terminal is transmitted to the management server, the scoring and the result analysis are performed through the above-described data processing. The scoring step includes providing analysis information to the candidate.

전술한 각 실시예에서 예시된 특징, 구조, 효과 등은 실시예들이 속하는 분야의 통상의 지식을 가지는 자에 의하여 다른 실시예들에 대해서도 조합 또는 변형되어 실시 가능하다. 따라서 이러한 조합과 변형에 관계된 내용들은 본 발명의 범위에 포함되는 것으로 해석되어야 할 것이다.Features, structures, effects, and the like illustrated in the above-described embodiments may be combined or modified with respect to other embodiments by those skilled in the art to which the embodiments belong. Therefore, contents related to such combinations and modifications should be construed as being included in the scope of the present invention.

Claims (5)

시험지 정보 및 문항 정보를 포함하는 시험지;A test paper including test paper information and item information; 상기 시험지 정보 및 문항 정보를 입력할 수 있는 학습 어플리케이션이 설치되어 실행되는 단말기;A terminal on which a learning application for inputting the test paper information and the item information is installed and executed; 문제 정보 데이터베이스를 포함하는 데이터베이스 및 답안지 생성부를 포함하고, 상기 답안지 생성부에 의해 생성된 답안지를 유무선 통신망을 통해 상기 단말기로 송신할 수 있는 관리서버; 및 A management server including a database including a problem information database and an answer sheet generating unit, and transmitting the answer sheet generated by the answer sheet generating unit to the terminal through a wired or wireless communication network; And 상기 단말기로부터 유무선 통신망을 통해 전송된 답안지를 수신하여 답안지를 출력하는 출력수단;을 포함하며,And output means for receiving the answer sheet transmitted through the wired / wireless communication network from the terminal and outputting the answer sheet. 상기 문제 정보 데이터베이스는 식별 태그가 입력된 문제 정보가 저장되고, The problem information database stores problem information in which an identification tag is input, 상기 답안지 생성부는 상기 단말기를 통해 시험지 정보 및 문항 정보가 입력되면, 상기 시험지 정보 및 문항 정보와 일치하는 식별 태그를 가진 문제를 검색하여 해당하는 시험지 문제에 대응하는 답안 영역이 배치된 답안지를 생성하는 학습 평가 서비스 시스템.When the answer sheet information and the item information are input through the terminal, the answer sheet generating unit searches for a question having an identification tag that matches the test sheet information and the question information, and generates an answer sheet in which an answer area corresponding to the corresponding test sheet problem is disposed. Learning Assessment Service System. 제1항에 있어서,The method of claim 1, 상기 데이터베이스는 응시자 정보 데이터베이스를 더 포함하며,The database further includes a candidate information database, 상기 응시자 정보 데이터베이스는 평가에 응시한 응시자의 개인 정보 및 학습 평가 정보가 저장되고,The test taker information database stores the test taker's personal information and learning evaluation information, 상기 답안지 생성부는 저장된 응시자 정보가 포함된 응시자 코드가 더 배치된 답안지를 생성하는 학습 평가 서비스 시스템.The answer sheet generator generates an answer sheet including a candidate code including stored candidate information. 제1항 또는 제2항에 있어서,The method according to claim 1 or 2, 상기 단말기는 촬영부를 더 포함하여, The terminal further includes a photographing unit, 상기 학습 어플리케이션 및 상기 촬영부를 통해 응시자에 의해 작성된 답안지를 촬영하여 스캔된 답안지 이미지를 상기 관리서버로 송신하며,Photographing the answer sheet created by the candidate through the learning application and the photographing unit and transmitting the scanned answer sheet image to the management server, 상기 관리서버는 채점 처리부 및 결과 분석부를 포함하는 데이터 처리부를 더 포함하여, The management server further includes a data processing unit including a scoring processing unit and a result analysis unit, 상기 채점 처리부를 통해 수신한 답안지 이미지의 답안 영역 및 응시자 코드에서 답안 정보 및 응시자 정보를 추출하고, 상기 문제 정보 데이터베이스에 저장된 정답 정보와 비교하여 채점하고, The answer information and the candidate information are extracted from the answer area and the candidate code of the answer sheet image received through the scoring processor, and compared with the correct answer information stored in the problem information database, and scored. 상기 결과 분석부를 통해 채점 결과를 분석하여 얻은 분석 정보를 유무선 통신망을 통해 상기 단말기로 송신할 수 있는 학습 평가 서비스 시스템.Learning evaluation service system that can transmit the analysis information obtained by analyzing the scoring results through the result analysis unit to the terminal via a wired or wireless communication network. 제3항에 있어서,The method of claim 3, 상기 데이터베이스는 분석 정보 데이터베이스를 더 포함하여,The database further includes an analysis information database, 상기 데이터 처리부를 통해 얻은 채점 결과 및 분석 정보를 상기 분석 정보 데이터베이스에 시험지별로 누적 데이터화하여 동일한 시험지로 응시한 개별 응시자에게 응시자의 전체 성적 분석 정보를 제공하는 학습 평가 서비스 시스템.And a grading result and analysis information obtained through the data processing unit into cumulative data for each test paper in the analysis information database, and provide the test taker's overall grade analysis information to individual test takers who take the same test paper. 시험지 정보 및 문항 정보를 포함하는 시험지;A test paper including test paper information and item information; 상기 시험지 정보 및 문항 정보를 입력할 수 있는 학습 어플리케이션이 설치되어 실행되는 단말기; 및A terminal on which a learning application for inputting the test paper information and the item information is installed and executed; And 문제 정보 데이터베이스를 포함하는 데이터베이스 및 답안지 생성부를 포함하고, 생성된 답안지를 유무선 통신망을 통해 상기 단말기로 송신할 수 있는 관리서버;를 포함하며,And a management server including a database including a problem information database and an answer sheet generator, and configured to transmit the generated answer sheet to the terminal through a wired or wireless communication network. 상기 문제 정보 데이터베이스는 식별 태그가 입력된 문제 정보가 저장되고, The problem information database stores problem information in which an identification tag is input, 상기 답안지 생성부는 상기 단말기를 통해 시험지 정보 및 문항 정보가 입력되면, 상기 시험지 정보 및 문항 정보와 일치하는 식별 태그를 가진 문제를 검색하여 해당하는 시험지 문제에 대응하는 답안 영역이 배치된 답안지를 생성하며,If the answer sheet information and the item information is input through the terminal, the answer sheet generating unit searches for a question having an identification tag that matches the test sheet information and the question information, and generates an answer sheet having an answer area corresponding to the corresponding test sheet problem. , 상기 단말기를 통해 생성된 답안지에 직접 답안 작성이 가능한 학습 평가 서비스 시스템.A learning evaluation service system capable of writing an answer directly on the answer sheet generated through the terminal.
PCT/KR2015/012784 2014-12-23 2015-11-26 Learning assessment service system Ceased WO2016104965A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2014-0186807 2014-12-23
KR1020140186807A KR101663311B1 (en) 2014-12-23 2014-12-23 Studying evaluation service system

Publications (1)

Publication Number Publication Date
WO2016104965A1 true WO2016104965A1 (en) 2016-06-30

Family

ID=56150939

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/012784 Ceased WO2016104965A1 (en) 2014-12-23 2015-11-26 Learning assessment service system

Country Status (2)

Country Link
KR (1) KR101663311B1 (en)
WO (1) WO2016104965A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107622264A (en) * 2017-08-22 2018-01-23 王云亮 A kind of intelligence reads and makes comments method and device
CN109740436A (en) * 2018-12-03 2019-05-10 李卫强 A kind of intelligence marking system
CN110399421A (en) * 2019-08-05 2019-11-01 洛阳市洛书神韵文化传播有限公司 A kind of wrong topic collection method for teaching auxiliary books applied to papery
CN110889406A (en) * 2019-12-10 2020-03-17 艾小本科技(武汉)有限公司 Method, system and terminal for information collection of exercise data card
CN111368808A (en) * 2020-04-10 2020-07-03 刘志锋 Method, device, system and teaching equipment for collecting question answering data
CN111488454A (en) * 2020-03-10 2020-08-04 北京中税双运财税科技有限公司 Online education system, method, electronic equipment and computer readable medium
CN112307245A (en) * 2020-03-02 2021-02-02 北京字节跳动网络技术有限公司 Method and apparatus for processing images
CN114116763A (en) * 2021-11-24 2022-03-01 中国建设银行股份有限公司 Information processing method, information processing device, electronic equipment and storage medium
CN114358224A (en) * 2021-12-27 2022-04-15 北京云思智学科技有限公司 Electronic information endorsement method, automatic correction method and device for test question data
CN114495124A (en) * 2022-01-18 2022-05-13 上海应用技术大学 A system for analyzing test scores and improving practice

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20190066395A (en) 2017-12-05 2019-06-13 동서대학교 산학협력단 The System for Providing and Evaluating an Examination Using Single Output Device for Examination Question and Examinee’s Terminal
KR101945692B1 (en) * 2017-12-18 2019-02-08 캐논코리아비즈니스솔루션 주식회사 Record handling method and system
KR102241515B1 (en) 2019-07-12 2021-04-15 동서대학교 산학협력단 Online platform system based on humanity
CN110728233A (en) * 2019-10-10 2020-01-24 北京课程帮科技有限公司 Objective question template detection method based on component detection

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003255812A (en) * 2001-12-28 2003-09-10 Ntt Docomo Inc On-line test system, and test provider side equipment, system user side equipment, terminal device, writing device, printer device, scoring sheet, answer sheet, test system control program, terminal device control program used for the online test system, And a writing device control program
KR20120088261A (en) * 2011-01-31 2012-08-08 김정원 An examination paper marking system make use of barcode and method thereof
KR20120092421A (en) * 2011-02-11 2012-08-21 이형곤 System for improving studying capability using relational questions and operating method thereof
KR101180383B1 (en) * 2011-03-03 2012-09-10 조권현 System and method for connecting online and offline learning
KR101466696B1 (en) * 2013-07-16 2014-12-10 (주)제이케이데이터시스템즈 Apparatus and method for managing of examination question

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003255812A (en) * 2001-12-28 2003-09-10 Ntt Docomo Inc On-line test system, and test provider side equipment, system user side equipment, terminal device, writing device, printer device, scoring sheet, answer sheet, test system control program, terminal device control program used for the online test system, And a writing device control program
KR20120088261A (en) * 2011-01-31 2012-08-08 김정원 An examination paper marking system make use of barcode and method thereof
KR20120092421A (en) * 2011-02-11 2012-08-21 이형곤 System for improving studying capability using relational questions and operating method thereof
KR101180383B1 (en) * 2011-03-03 2012-09-10 조권현 System and method for connecting online and offline learning
KR101466696B1 (en) * 2013-07-16 2014-12-10 (주)제이케이데이터시스템즈 Apparatus and method for managing of examination question

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107622264A (en) * 2017-08-22 2018-01-23 王云亮 A kind of intelligence reads and makes comments method and device
CN109740436A (en) * 2018-12-03 2019-05-10 李卫强 A kind of intelligence marking system
CN110399421A (en) * 2019-08-05 2019-11-01 洛阳市洛书神韵文化传播有限公司 A kind of wrong topic collection method for teaching auxiliary books applied to papery
CN110889406A (en) * 2019-12-10 2020-03-17 艾小本科技(武汉)有限公司 Method, system and terminal for information collection of exercise data card
CN110889406B (en) * 2019-12-10 2023-09-26 艾小本科技(武汉)有限公司 An information collection method, system and terminal for exercise data cards
CN112307245A (en) * 2020-03-02 2021-02-02 北京字节跳动网络技术有限公司 Method and apparatus for processing images
CN112307245B (en) * 2020-03-02 2024-03-26 北京字节跳动网络技术有限公司 Methods and devices for processing images
CN111488454A (en) * 2020-03-10 2020-08-04 北京中税双运财税科技有限公司 Online education system, method, electronic equipment and computer readable medium
CN111368808A (en) * 2020-04-10 2020-07-03 刘志锋 Method, device, system and teaching equipment for collecting question answering data
CN114116763A (en) * 2021-11-24 2022-03-01 中国建设银行股份有限公司 Information processing method, information processing device, electronic equipment and storage medium
CN114358224A (en) * 2021-12-27 2022-04-15 北京云思智学科技有限公司 Electronic information endorsement method, automatic correction method and device for test question data
CN114495124A (en) * 2022-01-18 2022-05-13 上海应用技术大学 A system for analyzing test scores and improving practice

Also Published As

Publication number Publication date
KR20160076601A (en) 2016-07-01
KR101663311B1 (en) 2016-10-06

Similar Documents

Publication Publication Date Title
WO2016104965A1 (en) Learning assessment service system
WO2015170822A1 (en) System for grading examination paper and for managing incorrect-answer data
US9754500B2 (en) Curriculum assessment
CN104835365B (en) Method, intelligent device and device suitable for writing operation inspection
US20030180703A1 (en) Student assessment system
CN112837031A (en) Automatic job reading and amending method and device based on high-speed scanning and printing
TWI409722B (en) Examining system and method thereof
CN101866415A (en) Answer sheet recognition device and method of computer marking system
CN110879965A (en) Automatic marking method, electronic device, equipment and storage medium for objective questions of test paper
WO2019013387A1 (en) LEARNING SERVICE SYSTEM FOR CONNECTING OFFLINE AND ONLINE TEACHING MATERIALS
KR20130021684A (en) System for managing answer paper and method thereof
San Myint et al. Fingerprint based attendance system using arduino
WO2020171283A1 (en) Automatic scoring system using qr code
CN111754448A (en) Method and device for collecting operation test paper information based on image collection and analysis
CN106355176A (en) Test question checking system
CN112396897A (en) Teaching system
JP2008180838A (en) Grade report creation system and grade report creation method
KR101180383B1 (en) System and method for connecting online and offline learning
US20070048718A1 (en) System and Method for Test Creation, Verification, and Evaluation
WO2024101754A1 (en) Ai math tutoring service providing system capable of automatic unit and difficulty level classification and re-editing of math question , and method for implementing same
WO2014088133A1 (en) System and method for explaining questions using image codes
KR101240428B1 (en) Omr card having image code and data processing system and method using the same
CN211124089U (en) Exercise data acquisition device
KR20220000582A (en) Method and system for answer processing
CN113723543B (en) Automatic cutting question display method and device, computer equipment and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15873492

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15873492

Country of ref document: EP

Kind code of ref document: A1