JPH07200564A - Document processor - Google Patents

Abstract

(57) [Summary] (Correction) [Purpose] The input voice data can be recorded in association with the document data, and when the voice data is played back, the voice data after the designated document data can be played back. [Arrangement] Document and voice position data are paired with each other and registered in a correspondence table. During playback, step S27
Then, the document data designated by the document addresses TXAi to TXAi + 1 is read from the document memory and displayed on the display. In step S28, the position data of the voice corresponding to the position data of the document is set in the register, and step S2
At 9, the reproduction start signal is output, and the recorder / reproducer reproduces the voice corresponding to the document displayed on the display and outputs it from the speaker. When the counter value reaches the register value, a coincidence signal is output, and this signal is sent to the CPU as an interrupt signal. The CPU updates the value of the pointer register in the interrupt process from step 31 onward, executes the process from step S27 onward, and reproduces the subsequent audio data one after another.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention
The present invention relates to a document processing device such as a word processor that records / reproduces audio data as well as displaying.

[0002]

2. Description of the Related Art Conventionally, an electronic computer having a voice output function is known. For example, this is such that a voice message is also output corresponding to the guidance screen of the operation procedure of the automatic teller machine, etc., and has a correspondence table of screen numbers and voice data numbers and corresponds to the display screen. The audio is read from the audio file and the audio is output.
Further, as another example, there is one in which a message such as an error to the operator is output from the electronic computer by voice in parallel with the output of the console typewriter. this is,
A voice search code is also stored in a message storage position such as an error, and a voice corresponding to the search code is output when an error is output. In either case, a predetermined message corresponding to the displayed screen is output by voice, or a voice is output corresponding to the output of a predetermined message when an error occurs.

[0003]

The above-mentioned electronic computer having a so-called voice output function is one in which a specific voice message is incorporated in association with a screen or an error at the stage of system design of the computer, and the user can arbitrarily select it. Record audio in /
Not playable. Moreover, the usage form is limited to the one-sided output of the system-related voice from the electronic computer.

On the other hand, in a document processing apparatus such as a word processor, the creation / display of document data can be freely performed by a user's operation and its use is expanding, but the data that can be handled is limited to the document data.

An object of the present invention is to provide an apparatus capable of arbitrarily recording / reproducing voice data in association with document data.

[0006]

The means of the present invention are as follows. The document storage means is a memory or the like that stores the input document data. The designating means is a key or the like for designating the start of voice recording corresponding to the designated document data. The voice recording means is a recorder or the like that records the input voice data. The correspondence information storage means is a correspondence table that stores correspondence information between the document data and the voice data. The display means is a display unit that displays the document data. The instructing means for instructing the reproduction of the voice is a cursor for instructing a position with respect to the document data displayed on the display means, a key for specifying reproduction, or the like. The first control means is a CPU or the like for controlling so as to read voice data corresponding to the instructed document data with reference to the correspondence information in the correspondence information storage means. The audio output means is a speaker or the like. The second control means reads the voice data corresponding to the next instructed document data from the voice recording means with reference to the correspondence information in the correspondence information storage means in response to the end of the voice output. It is a CPU or the like that controls to output to the voice output means.

[0007]

The operation of the present invention is as follows. The document storage unit stores the document data input by the unit for inputting the document data. When recording the voice, the recording of the voice data is designated by the designation means in correspondence with the designated document data. Then, voice data is input from a microphone or the like and recorded in the voice recording means. At this time, the correspondence information storage means stores correspondence information between the designated document data and the input voice data in accordance with the designation by the designation means.

When reproducing the voice, the user designates the arbitrary document data displayed on the display means by the instruction means,
When the reproduction of the corresponding voice is instructed, the first control means
The corresponding voice data is read from the voice recording means based on the correspondence information storage means, the voice data is controlled to be sent to the voice output means, and the voice output means outputs the voice. When the output of the voice is completed, the second control means controls the voice data corresponding to the next document data to be read from the voice recording means based on the correspondence information storage means and output to the voice output means. To do. By this control, it is possible to automatically reproduce the voice data recorded in association with the arbitrary position of the document data one after another.

Therefore, not only the voice data input corresponding to the designated document data can be recorded in association with each other, but also the voice data after the designated document data can be reproduced one after another. .

[0010]

【Example】

(1) Configuration FIG. 1 is a block diagram showing the configuration of an embodiment according to the present invention. In the figure, reference numeral 10 denotes a CPU that controls the entire apparatus and performs various document processing including kana-kanji conversion processing, which will be described later. At the time of kana-kanji conversion, the processing shown in FIG. When the key is operated, the processing shown in FIG. 3 is executed. Reference numeral 11 denotes an input unit provided with a kana character key for inputting a document and further various function keys. Here, as a function key operated when inputting a kanji mixed sentence, the input character is not a kana-kanji conversion target. There is a "no conversion" key that indicates that it is a character, a "conversion" key that specifies kana-kanji conversion, etc. Also, as a specification key for selecting one of the displayed candidate character groups, here Uses numeric keys. Further, here, a "reproduction display" key for outputting the document and the voice in association with each other, a "reproduction stop" key for stopping the reproduction of the voice, and the like are provided.

Reference numeral 12 denotes the CPU 10 when converting kana / kanji characters.
Is a dictionary referred to by. Reference numeral 13 denotes a display unit including a display unit 13A for displaying an input and edited document and a display memory 13B. At the time of Kana-Kanji conversion, a character string after Kana-Kanji conversion, an input character string being converted and an input before conversion. A character (kana character) string is displayed, and candidate characters are displayed at a specific line position. A printing unit 14 prints out a document.

Reference numerals 15 to 19 are storage units connected to the memory bus of the CPU 10, respectively, which are access-controlled by the CPU 10, 15 is an input buffer for storing an input character string, 16 is a document memory for storing document information, A ROM 17 stores a character generator and various control programs including kana-kanji conversion by dictionary search as shown in FIG. Also, 18 is C
An unconverted character number register INC for storing the number of unconverted characters input to the input buffer 15 is provided as a register for the Kana-Kanji conversion process, which is a work RAM of the PU 10. This register INC has an input unit 1
The number is incremented each time a character is input from 1 to the input buffer 15 and decremented each time the conversion process is executed. The content of the decrement process is determined by the CPU 10 every time the decrement process is performed, and the number of characters is equal to or less than a predetermined number. In this case (when the number of unconverted characters becomes "0" in this embodiment), a recording start signal (RST) that prompts recording for the next sentence input is output. Also, the document memory 1 is used as registers for managing the voice and the document in association with each other.
6, the document address register TXA for storing the storage start address of the document, the cursor register CUA for storing the cursor address, the pointer register i for storing the position information of the correspondence table described later, and the conversion end of the characters stored in the input buffer 15. Accordingly, a flag register F1 set to "1", a flag register F2 set to "1" when an interrupt is generated due to the end of the reproduction of the voice corresponding to the output document (display output document in this case), and the like are provided.

Reference numeral 19 is a correspondence table for managing the storage position of the document and the recording position of the voice in association with each other. Here, the document address (TXA) in the document memory 16 is stored.
i) and a voice address (CNTi) indicating the recording position of the voice corresponding to the above-mentioned document on a recording medium (here, CMT) of the recording / reproducing device 20 described later are stored as a pair. A pair of position data (TX
Ai, CNTi) is designated by the pointer register i in the work RAM 18.

Reference numeral 20 records voice information of a document to be input on, for example, a cassette type magnetic tape (hereinafter referred to as CMT),
It is a recording / reproducing device for reproducing, and here has a microphone (MIC) and a speaker (SP), and has the above CPU.
10 receives the reproduction start signal (PST) and executes the reproduction operation, receives the recording start signal (RST) and executes the recording operation, and outputs the stop signal (STO) or the interrupt signal (I
NT) to interrupt the recording / reproducing operation (in a pause state), receive a fast-forward signal to fast-forward the CMT, and receive a return signal to rewind the CMT.

Reference numerals 21 to 27 denote recording / reproducing apparatus 20 respectively.
Is a component of the peripheral control circuit of. Here, 21 is a counter that performs a count operation according to the CMT running amount of the recording / playback device 20 to obtain position data, 22 is a register that stores the position data of the CMT, and 23 is a count value of the counter 21, that is, position data. And the position data stored in the register 22 are compared with each other, and 24 is the output of the AND gate 26 (interrupt signal; CN when the coincidence signal is output from the coincidence detection circuit 23 during voice reproduction).
T = “1”) delay circuit for delaying by a predetermined time, 25 is CP
A flip-flop 26 is set by the reproduction start signal (PST) output from U10 and reset by the output signal ("1") of the delay circuit 24, and 26 is a set output of the flip-flop 25 and an output of the coincidence detection circuit 23. In response to the signal, an interrupt signal (INT = “1”) when a match signal is output from the match detection circuit 23 during voice reproduction
AND gate 27 for outputting the reproduction stop signal (STO) output from the CPU 10 and the AND gate 2
It is an OR gate that receives an interrupt signal (INT) output from the device 6 and outputs a stop signal to the recording / playback device 20 by any one of the signals.

FIG. 2 is a flow chart showing a kana-kanji conversion processing flow in the above embodiment.

FIG. 3 is a flow chart showing a processing flow when the "playback display" key is operated in the above embodiment.

(2) Action When a kana-mixed sentence is entered by operating the character keys of the input unit 11, the entered kana characters are sequentially stored in the input buffer 15 under the control of the CPU 10 and are not shown. The dots are expanded on the display memory and displayed on the display unit 13, and the number of characters input to the input buffer 15 at that time is stored in the unconverted character number register INC in the work RAM 18 as the unconverted character number.

At the time of converting kana to kanji, a kana character string to be converted is input by inputting a character key on the input unit 11, and then a "convert" key on the input unit 11 is operated. As a result, the kana-kanji conversion processing as shown in FIG. 2 is started under the control of the CPU 10. The specific operation will be described below.

First, "conversion" provided on the input section 11
By operating the key, the contents of the flag register F1 are checked in step S1 of FIG.

Here, if the content of the flag register F1 is "0" (that is, it indicates that the "conversion" key operation is performed when the kana character string to be converted is input to the input buffer 15. If so, the stop signal (STO) is output in step S2.

As a result, when the recording / reproducing device 20 is in the recording mode, the recording operation is suspended.

Next, in step S3, the work RA is used.
The contents of the unconverted character number register INC in M18 are examined.

Here, the unconverted character number register INC
Is not "0", indicating that the character to be converted (unconverted character) is stored (remains) in the input buffer 15, the above-mentioned input buffer 15 in step S4. A character to be converted is read out from, and the dictionary 12 is searched based on the character.

When the corresponding kanji is searched by the search process of the dictionary 12, it is judged in step S5 whether or not there is a homophone, and if there is a homophone, the homophone is displayed in step S6. To do.

Here, in step S7, the input unit 11
When one of the displayed homophones is selected in accordance with the operation of the number keys and the "select / execute" key, the selected kanji character is registered in the document memory 16 in step S8, and The contents of the document memory 16 are displayed on the display unit 13. Further, in this case, in step S9, the content of the unconverted character number register INC is decremented in accordance with the number of converted characters in the input buffer 15, and the process returns to step S3 to check the content.

Further, in step S5, even when the same phoneme does not exist, the same processes as in step S8 and thereafter are executed.

In step S3, if the content of the unconverted character number register INC is not "0" (that is, if there are unconverted characters remaining in the input buffer 15), the processes in step S4 and thereafter are repeatedly executed. However, the above register I
When it is determined that the content of NC is "0", "1" is set in the flag register F1 in step S10.
Is set.

This flag register F1 becomes "1",
After the conversion, when there is no character input,
When the "convert" key is operated, in step S11, position data (TXAi, CNTi) in which the value of the document address register TXA in the work RAM 18 at that time and the value of the counter 21 are paired with each other. Is written and registered in the storage area of the correspondence table 19 indicated by the ponita register i.

After registration of the voice and document position data in the correspondence table 19, a recording start signal (RST) is output in step S12, and the recording operation which has been paused is restarted.

The document input by the key input operation of the input unit 11 and the voice recording by the recording operation of the microphone (MIC) and the recording / reproducing device 20 are sequentially performed, and a document is written each time the conversion process is performed. Audio position data (T
XAn, CNTn) form a pair with each other and the correspondence table 19
Will be registered in.

The position data of the document and the voice registered in the correspondence table 19 as described above are effectively used in the synchronous output of the document and the voice, and the "playback display" key at that time is used. The processing associated with the operation will be described with reference to the flowchart shown in FIG.

Here, the process shown in FIG. 3 is executed by operating the "playback display" key after designating a certain character displayed on the display 13A with the cursor.

First, in step S21, the working R
The document address (TXAi, TXAi + 1) registered in the correspondence table 19 is searched based on the cursor address stored in the cursor register CUA in the AM 18,
The storage location of the document address TXAi that satisfies [TXAi ≦ (CUA) <TXAi + 1] is searched, and the correspondence table 1
The reproduction start position of the stored character string including the cursor designated character on 9 is detected.

Next, when the reproduction start position on the correspondence table 19 is detected, in step S22, the position data (TXAi) of the document among the detected position data (TXAi, CNTi) is detected. The position data (CNTi) of the paired voices is set in the register 22.

Then, in step S23, the position data (CNTi) stored in the register 22 is compared with the count value (CMT position data) of the counter 21,
If the value of the counter 21 is larger than the value of the position data (CNTi), a return signal is output in step S35 to rewind the CMT. If the value of the counter 21 is smaller than the value of the position data (CNTi), the fast-forward signal is output in step S24 to fast-forward the CMT.

Then, when it is detected in step S25 that the coincidence signal indicating that the value of the counter 21 has reached the value of the register 22 is output from the coincidence detection circuit 23, the stop signal is output in step S26. (STO) is output and the return or fast-forward operation is stopped.

Thereafter, in step S27, the document data stored in the storage area of the document memory 16 designated by the document addresses TXAi to TXAi + 1 is read out, transferred to the display memory 13B, and the document is displayed on the display. 1
It is highlighted on 3A. At this time, the characters read from the document memory 16 are displayed in the display range of the display 13A (for example, 1 line / 2.
If it exceeds the number of digits, it will be displayed in flow characters according to the playback speed.

Next, in step S28, the position data (TXAi +) of the document registered in the correspondence table 19 is recorded.
1) The position data (CNTi + 1) of the voice corresponding to 1) is read, and this position data (CNTi + 1) is stored in the register 2
The reproduction start signal (PST) is output in step S29.

As a result, the recording / reproducing device 20 reproduces the voice corresponding to the document displayed on the display 13A and outputs it from the speaker. At this time, the cursor designates the corresponding character in synchronization with the reproduced voice.

Further, the transfer of the document from the document memory to the display memory at this time is performed as follows. That is,
When the cursor is moved within the display range of the display 13A, there is no transfer from the document memory 16 to the display memory 13B, and the display of the cursor mark only moves corresponding to the operation of the cursor key. Next, when the cursor is moved beyond the display range of the display 13B, the data is transferred from the document memory 16 to the display memory 13B so that the cursor position is within the display range. When the cursor key is operated, the cursor address of the cursor register CUA in the work RAM 18 is updated accordingly.

The value of the counter 21 is stored in the register 22.
When the value of (CNTi + 1) is reached, a match signal is output from the match detection circuit 23, and this signal is sent to the CPU 10
To the AND gate 26.
At this time, the flip-flop 25 is set by the reproduction start signal (PST) output in step S29, and therefore the AND gate 26 is opened, and the stop signal is sent from the gate 26 to the recording / reproducing device 20. While being output, an interrupt signal (INT) is sent to the CPU 10.

The CPU 10 checks the contents of the flag register F2 in step S30. If the flag register F2 is "0", the interrupt signal (INT) is received from the AND gate 26 and the interrupt process from step S31 is started. First, in step S31, "1" is set in the flag register F2, and in step S32, the pointer register i is set.
The value of is updated (+1). Further, in step S33, it is checked whether or not the value of the pointer register i has reached the pointer address of the last position data registered in the correspondence table 19, and if not, the interrupt process is terminated,
The process after step S27 is started again. When the value of the pointer register i reaches the pointer address of the final position data registered in the correspondence table 19, the content of the flag register F2 is returned to "0" and the synchronous reproduction operation of voice and document is completed. .

Also, at the time of reproducing the voice, the input unit 11
When the "playback stop" key is operated, a stop signal (STO) is output from the CPU 10, and the signal is transmitted to the OR gate 27.
Is input to the recording / reproducing device 20 via the, and the reproduction of voice is stopped.

By such a synchronous storage process of the document and the voice and a synchronous reproduction process thereof, the input document and the voice can be managed in a state of being associated with each other, and the document and the voice stored at the time of reproduction are extremely small. It can be output easily and with high synchronization.

In the above-mentioned embodiment, the storage positions of the voice and the document are stored at the time of starting the input of the character string to be exchanged. ), The memory storage position of the voice at that time is automatically identified and stored, and when the character string is converted, the storage position of the sentence (or phrase or character) is identified, and both are associated. It may be configured to store. Also, voice memory (or document memory)
The data indicating the storage position of the document memory (or the voice memory) may be stored in the memory. Alternatively, the voice data and the document data may be alternately stored for each sentence (or for each phrase, or for each character).

In the above embodiment, the voice input period is almost the same as the input period of the unconverted character string.
This may be different. For example, before the input operation of the unconverted character string is performed (or after the conversion operation or after the conversion is completed), the voice may be input corresponding to the character string and stored in the voice storage means.

Further, in the above-mentioned embodiment, the CRT display control is taken as an example of the reproduction output means, but it is also possible to print the character corresponding to the reproduced sound, for example, to make the reproduction speed correspond to the printing speed. Further, the reproduction speed may be arbitrarily designated so that the document data is displayed according to the reproduction speed.

[0049]

As described above, according to the present invention, the operator can appropriately record the voice corresponding to the designated document data, and the recorded voice can be properly designated and reproduced.
Compared to the conventional document data created by word processors, etc., which was created only for visual output, auditory data can be handled freely, and its usage pattern can be dramatically expanded. It is possible, and moreover, it is possible to reproduce the voice data that is after the designated document data one after another,
The range of use is expanded by automatically reproducing voice data related to a plurality of document data.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of the present invention.

FIG. 2 is a flowchart showing a processing flow associated with a “conversion” key operation.

FIG. 3 is a flowchart showing a processing flow associated with a “playback display” key operation.

[Explanation of symbols]

 10 CPU 11 input unit 12 dictionary 13 display unit 14 printing unit 15 input buffer 16 document memory 17 ROM 18 working RAM 19 correspondence table 20 recording / reproducing device 21 counter 22 register 23 coincidence detection circuit 24 delay circuit 25 flip-flop 26 AND gate INT interrupt signal

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Office reference number FI Technical display location G10L 3/00 E G11B 27/00 E 8224-5D

Claims (1)

[Claims] 1. A document storage means for storing document data,
Designating means for designating recording of voice data corresponding to the document data of the document storing means, and voice recording means for recording the inputted voice data according to the designation of the designating means,
Correspondence information storage means for storing correspondence between the designated document data and the voice data, display means for displaying the document data stored in the document storage means, and instruction for instructing reproduction of voice in the document data. Means, and first control means for reading, from the voice recording means, voice data corresponding to the document data instructed to be reproduced by the instruction means based on the correspondence information storage means, and the read voice data. Voice output means for outputting, and in response to the end of voice output, voice data corresponding to the next document data is read from the voice recording means based on the correspondence information storage means and output to the voice output means. And a second control means for controlling the document processing apparatus.