JP2013125372A - Character display unit, auxiliary information output program, and auxiliary information output method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a character display unit which properly outputs auxiliary information required by a user, allowing the user to more easily read characters without obtaining unnecessary auxiliary information.SOLUTION: A mobile phone 10 includes a display 14 and a touch panel 16. The display 14 displays characters obtained from net work. The displayed characters are updated with scroll operation to touch panel 16. For example, it is determined that a user does not understand the reading of a specific word including a Chinese character when no scroll operation is performed in a second predetermined time period after a scroll operation. This determination allows identifying a specific row based on a predetermined output setting value, and retrieving a specific word on the basis of the specific row. When the specific word is found, auxiliary information such as ruby characters is outputted for the specific word.

Description

  The present invention relates to a character display device, an auxiliary information output program, and an auxiliary information output method, and more particularly to a character display device, an auxiliary information output program, and an auxiliary information output method that can output auxiliary information for a displayed character.

An example of a character display device that can output auxiliary information with respect to displayed characters is disclosed in Patent Document 1. When the reading process is started by the document / speech conversion apparatus of Patent Document 1, the reading is performed one sentence at a time from the beginning of the paragraph. Also, when the user requests to read out again, it is read out again from the beginning of a paragraph or a certain time before.
JP 2004-240217 A [G10L 13/06, G10L 13/00]

  However, in the document / speech conversion device of Patent Document 1, all selected data is read out, so even a sentence that the user does not need to read out is read out. Therefore, the user must listen to unnecessary reading in order to hear the reading voice of the necessary sentence.

  Therefore, a main object of the present invention is to provide a novel character display device, auxiliary information output program, and auxiliary information output method.

  Another object of the present invention is to provide a character display device, an auxiliary information output program, and an auxiliary information output method that enable a user to easily read characters.

  The present invention employs the following configuration in order to solve the above problems. The reference numerals in parentheses, supplementary explanations, and the like indicate the corresponding relationship with the embodiments described in order to help understanding of the present invention, and do not limit the present invention.

  1st invention is the character display device which outputs the auxiliary information regarding the character currently displayed on the display screen, Comprising: The judgment part which judges whether auxiliary information needs to be output, Need to output auxiliary information When it is determined that there is a character display device, the character display device includes a specifying unit that specifies a character for which auxiliary information is to be output, and an output unit that outputs auxiliary information regarding the character specified by the specifying unit.

  In the first invention, characters and the like written on the HP are displayed on the display screen of the character display device (10: reference numerals exemplifying corresponding parts in the embodiment, the same applies hereinafter). Auxiliary information related to is output. For example, a character that cannot be read by the user may be displayed, and the determination unit (30, S39, S57) determines whether it is necessary to output auxiliary information for the character. The identification unit (30, S93) identifies characters that cannot be read by the user, for example. When the character as described above is specified, the output unit (30, S101, S141) outputs auxiliary information to the user so that the user can understand how to read the character.

  According to the first aspect, auxiliary information required by the user is appropriately output. Accordingly, the user does not have to acquire unnecessary auxiliary information, and thus it is easy to read the characters.

  The second invention is dependent on the first invention, and the determination unit determines whether it is necessary to output auxiliary information according to a length of time for which the display screen is updated.

  According to the second invention, it is possible to determine whether or not auxiliary information needs to be output by using the time until the characters displayed on the display screen are updated.

  The third invention is dependent on either the first invention or the second invention, and the display screen is updated according to the update operation.

  In the third invention, for example, when an update operation (scroll operation) is performed by an input device including a touch panel, the display of characters is updated.

  According to the third aspect, the user can read the characters by performing an update operation.

  A fourth invention is dependent on the third invention, and the determination unit determines whether an update operation has been performed from when the character is displayed until the first predetermined time elapses. When it is determined that the update operation has not been performed until the first predetermined time elapses after the display, the character for which auxiliary information is to be output is specified.

  In the fourth invention, the specifying unit specifies a character for which auxiliary information is to be output unless an update operation is performed before the first predetermined time elapses.

  5th invention depends on 3rd invention or 4th invention, a judgment part judges whether update operation was carried out after the display of a character was updated until 2nd predetermined time passed, The determining unit specifies a character for which auxiliary information is to be output when it is determined that the update operation has not been performed until the second predetermined time has elapsed after the display of the character is updated.

  In the fifth invention, the specifying unit specifies a character for which auxiliary information is to be output if the character display is not updated before the second predetermined time elapses after the character display is updated.

  According to the fourth and fifth aspects of the present invention, if the character display is not updated, the position of the character that cannot be read by the user can be specified, and auxiliary information can be output.

  A sixth invention is according to the fifth invention, and is based on a speed at which a character is read and a calculation unit that calculates a speed at which the character is read (reading speed) based on an update operation, And a setting unit for setting the second predetermined time.

  In the sixth invention, the calculation unit (30, S43, S63) calculates the speed at which characters are read (reading speed) based on the time until the update operation is performed and the number of updated characters. The setting unit (30, S65) sets the second predetermined time to be shorter, for example, when the speed at which characters are read is high. On the other hand, when the speed at which characters are read is slow, the second predetermined time is set longer.

  According to the sixth aspect, the timing for determining whether the output of auxiliary information is necessary is determined based on the speed at which the user reads characters. For this reason, auxiliary information is output at an appropriate timing.

  The seventh invention is dependent on any one of the first to sixth inventions, and the specifying unit is based on the row specifying unit (30, S83, S85) for specifying the specific row and the specified specific row. A search unit (30, S89) for searching for a specific word is included, and a character for which auxiliary information is to be output is specified based on the specific word searched by the search unit.

  In the seventh invention, the line specifying unit (30, S83, S85) specifies a specific line based on a speed at which characters are read or a predetermined value. The search unit (30, S89) searches for a specific word included between the specific line and the last line. And the character which should output auxiliary information is specified based on the specific word discovered by the search.

  According to the seventh aspect, since the specific word is searched after the specific line that is highly likely to include the specific word is searched, the processing time until the auxiliary information is output can be shortened.

  The eighth invention is dependent on the seventh invention, and the specifying unit determines whether the specific word searched by the searching unit is displayed before the specific line specified by the line specifying unit. The search unit re-searches for another specific word when it is determined that the searched specific word is displayed before the specified specific line.

  In the eighth invention, the display determination unit (30, S91) determines whether or not the specific word found by the search is displayed in a line before the specific line. If the found specific word is included in a line before the specific line, the search unit re-searches for another specific word.

  According to the eighth aspect, unnecessary auxiliary information can be prevented from being output to the user.

  A ninth invention is dependent on the seventh invention or the eighth invention, and the specific word includes at least one Chinese character.

  A tenth invention is dependent on any one of the seventh to ninth inventions, and the specific word includes English words having a predetermined number of characters or more.

  According to the ninth and tenth aspects, auxiliary information can be output regardless of the displayed language.

  An eleventh invention is dependent on any one of the first to eighth inventions, and changes a touch panel, a detection unit that detects a touch operation on the touch panel, and a character to which auxiliary information is output when the touch operation is performed. The change part to perform is further provided.

  In the eleventh aspect, the touch panel (16) is called a pointing device. The touch operation on the touch panel is detected by the detection unit (48). For example, when a touch operation is performed while auxiliary information is being output, the changing unit (30, S109, S151) changes a character for which auxiliary information is to be output based on the touch position.

  According to the eleventh aspect, even if the auxiliary information being output is incorrect, the user can easily correct it.

  A twelfth invention is dependent on any one of the first to ninth inventions, and the auxiliary information includes ruby.

  A thirteenth invention is dependent on any one of the first invention to the tenth invention, and the auxiliary information includes a reading voice of characters.

  According to the twelfth and thirteenth aspects, the auxiliary information is appropriately output according to the situation in which the character display device is used.

  In a fourteenth aspect, the processor (30) of the character display device (10) that outputs auxiliary information related to characters displayed on the display screen determines whether or not auxiliary information needs to be output ( S39, S57), when it is determined that it is necessary to output auxiliary information, a specifying unit (S93) for specifying a character for which auxiliary information is to be output, and an output for outputting auxiliary information regarding the character specified by the specifying unit This is an auxiliary information output program that functions as a unit (S101, S141).

  In the fourteenth invention, as in the first invention, auxiliary information required by the user is appropriately output. Accordingly, the user does not have to acquire unnecessary auxiliary information, and thus it is easy to read the characters.

  A fifteenth aspect of the invention is an auxiliary information output method for a character display device (10) that outputs auxiliary information related to characters displayed on a display screen, and determines whether auxiliary information needs to be output ( S39, S57) When it is determined that it is necessary to output auxiliary information, a character to which auxiliary information is to be output is specified (S93), and auxiliary information regarding the specified character is output (S101, S141). This is an auxiliary information output method.

  In the fifteenth invention, as in the first invention, auxiliary information required by the user is appropriately output. Accordingly, the user does not have to acquire unnecessary auxiliary information, and thus it is easy to read the characters.

  According to the present invention, the user can easily read a character.

  The above object, other objects, features, and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

FIG. 1 is an external view showing a mobile phone according to an embodiment of the present invention. FIG. 2 is an illustrative view showing an electrical configuration of the mobile phone shown in FIG. FIG. 3 is an illustrative view showing one example of characters displayed on the display shown in FIG. FIG. 4 shows an example of an update operation for updating the characters displayed on the display shown in FIG. 1. FIG. 4A shows the direction of the touch operation performed on the scroll bar shown in FIG. 4 (B) shows an example of the result of updating the characters displayed on the display. FIG. 5 is an illustrative view showing one example of a first predetermined time measured by the processor shown in FIG. FIG. 6 is an illustrative view showing the frequency with which the update operation described in FIG. 4 is performed. FIG. 6A shows an example of a state in which the update operation is performed at regular time intervals, and FIG. Shows an example of a state in which the update operation is temporarily stopped. FIG. 7 is an illustrative view showing an example of a flow until auxiliary information is output to the display shown in FIG. 1. FIG. 7 (A) shows a state where the update operation is temporarily stopped, and FIG. ) Shows a state in which auxiliary information is output as a result of the temporary stop of the update operation. FIG. 8 is an illustrative view showing an example of an operation for changing auxiliary information output on the display shown in FIG. 1, FIG. 8 (A) shows an example of an input operation showing a change position, and FIG. Shows an example of the result of changing the auxiliary information. FIG. 9 is an illustrative view showing one example of a state in which auxiliary information is output to the display shown in FIG. FIG. 10 is an illustrative view showing another example of a state in which auxiliary information is output to the display shown in FIG. FIG. 11 is an illustrative view showing one example of a memory map of the RAM shown in FIG. 12 is an illustrative view showing one example of details of the data storage area shown in FIG. FIG. 13 is a flowchart showing an example of determination processing of the processor shown in FIG. FIG. 14 is a flowchart showing an example of a part of the auxiliary information output processing of the processor shown in FIG. FIG. 15 is an example of another part of the auxiliary information output processing of the processor shown in FIG. 2, and is a flowchart subsequent to FIG. FIG. 16 is an example of another part of the auxiliary information output processing of the processor shown in FIG. 2, and is a flowchart following FIG. 14 and FIG. FIG. 17 is an example of still another part of the auxiliary information output process of the processor shown in FIG. 2, and is a flowchart subsequent to FIG. FIG. 18 is an example of another part of the auxiliary information output process of the processor shown in FIG. 2, and is a flowchart subsequent to FIG. FIG. 19 is an example of still another part of the auxiliary information output process of the processor shown in FIG. 2, and is a flowchart subsequent to FIG. FIG. 20 is a flowchart showing an example of manner mode switching processing of the processor shown in FIG.

  Referring to FIG. 1, a mobile phone 10 according to one embodiment of the present invention is a smartphone as an example, and includes a vertically long flat rectangular housing 12. However, it should be pointed out in advance that the present invention can be applied to any portable terminal such as an electronic book terminal, a tablet terminal, a PDA, and a feature phone.

  On one main surface (front surface) of the housing 12, for example, a display 14 such as a liquid crystal or an organic EL that functions as a display unit is provided. A touch panel 16 is provided on the display 14. Therefore, in the cellular phone 10 of this embodiment, most of the input operations except those by hard key operations described later are performed through the touch panel 16.

  A speaker 18 is built in the surface of one end of the housing 12 in the vertical direction, and a microphone 20 is built in the surface of the other end in the vertical direction.

  In this embodiment, a call key 22, an end key 24, and a menu key 26 are provided as hard keys constituting the input operation unit together with the touch panel 16.

  For example, the user can input a telephone number by performing a touch operation on the dial key displayed on the display 14 using the touch panel 16, and can start a voice call by operating the call key 22. If the end call key 24 is operated, the voice call can be terminated. Note that the power supply of the mobile phone 10 can be turned on / off by long-pressing the end call key 24.

  When the menu key 26 is operated, a menu screen is displayed on the display 14, and the menu is displayed by touching the touch panel 16 with respect to the soft keys and menu icons displayed on the display 14 in that state. Select and confirm the selection.

  Note that a switching key for switching manner mode settings is provided on the side surface of the mobile phone 10 (not shown).

  Referring to FIG. 2, the mobile phone 10 of the embodiment shown in FIG. 1 includes a processor 30 called a computer or CPU. A wireless communication circuit 32, an A / D converter 36, a D / A converter 38, an input device 40, a display driver 42, a flash memory 44, a RAM 46, a touch panel control circuit 48, a vibrator 50, and the like are connected to the processor 30. .

  The processor 30 controls the entire mobile phone 10. All or part of the program preset in the flash memory 44 is expanded in the RAM 46 when used, and the processor 30 operates according to the program on the RAM 46. The RAM 46 is further used as a working area or a buffer area for the processor 30.

  The input device 40 includes the touch panel 16, the call key 22, the call end key 24, and the menu key 26 shown in FIG. 1, and constitutes an operation unit or an input unit. Information on the hard key operated by the user (key data) is input to the processor 30.

  The wireless communication circuit 32 is a circuit for transmitting and receiving radio waves for voice calls and mails through the antenna 34. In the embodiment, the wireless communication circuit 32 is a circuit for performing wireless communication by the CDMA method. For example, when the user operates the input device 40 to instruct a telephone call (calling), the wireless communication circuit 32 performs a telephone call processing under the instruction of the processor 30 and sends a telephone call signal via the antenna 34. Output. The telephone call signal is transmitted to the other party's telephone through the base station and the communication network. When an incoming call process is performed at the other party's telephone, a communicable state is established, and the processor 30 executes a call process.

  The normal call processing will be described in detail. The modulated audio signal transmitted from the other party's telephone is received by the antenna 34. The received modulated audio signal is demodulated and decoded by the wireless communication circuit 32. The received voice signal obtained by these processes is converted to a voice signal by the D / A converter 38 and then output from the speaker 18. On the other hand, the transmission voice signal captured through the microphone 20 is converted into voice data by the A / D converter 36 and then given to the processor 30. The audio data is subjected to encoding processing and modulation processing by the wireless communication circuit 32 under the instruction of the processor 30, and is output via the antenna 34. Therefore, the modulated voice signal is transmitted to the other party's telephone through the base station and the communication network.

  When a telephone call signal from the other party's telephone is received by the antenna 34, the radio communication circuit 32 notifies the processor 30 of an incoming call (incoming call). In response to this, the processor 30 controls the display driver 42 to display caller information (such as a telephone number) described in the incoming call notification on the display 14.

  In accordance with these processes, the processor 30 causes the speaker 18 to output a ringtone (sometimes called a ringing melody or a ringing voice) and vibrate the vibrator 50. However, when the manner mode in which no ring tone is output when a call is received is set, the ring tone is not output and the incoming call is notified by vibration of the vibrator 50.

  When the user performs a response operation using the call key 22 (FIG. 1) included in the input device 40, the wireless communication circuit 32 executes a call incoming process under the instruction of the processor 30. Further, a communicable state is established, and the processor 30 executes the above-described call processing.

  Further, when the call termination operation is performed by the call termination key 24 (FIG. 1) included in the input device 40 after the transition to the call ready state, the processor 30 controls the wireless communication circuit 32 to terminate the call to the other party. Send a signal. Then, after transmitting the call end signal, the processor 30 ends the call process. The processor 30 also ends the call process when a call end signal is received from the other party first. Furthermore, the processor 30 also ends the call process when a call end signal is received from the mobile communication network regardless of the call partner.

  The microphone 20 shown in FIG. 1 is connected to the A / D converter 36, and the audio signal from the microphone 20 is input to the processor 30 as digital audio data through the A / D converter 36 as described above. The speaker 18 is connected to the D / A converter 38. The D / A converter 38 converts digital audio data into an audio signal and supplies the audio signal to the speaker 18 through an amplifier. Therefore, sound based on the sound data is output from the speaker 18.

  The processor 30 adjusts the volume of the sound output from the speaker 18 by controlling the amplification factor of the amplifier connected to the D / A converter 38, for example, in response to the volume operation by the user. Can do.

  The display driver 42 is connected to the display 14 shown in FIG. 1. Accordingly, the display 14 displays a video or an image according to the video or image data output from the processor 30. That is, the display driver 42 controls display on the display 14 connected to the display driver 42 under the instruction of the processor 30. The display driver 42 includes a video memory that temporarily stores image data to be displayed. The display 14 is provided with a backlight using, for example, an LED as a light source, and the display driver 42 controls the brightness of the backlight and lighting / extinguishing in accordance with instructions from the processor 30.

  The touch panel 16 shown in FIG. 1 is connected to the touch panel control circuit 48. The touch panel control circuit 48 applies necessary voltage and the like to the touch panel 16 and also displays a touch start signal indicating the start of touch by the user on the touch panel 16, an end signal indicating the end of touch by the user, and a touch position touched by the user. The indicated coordinate data is input to the processor 30. Therefore, the processor 30 can determine which icon or key the user touched at that time based on the coordinate data.

  In the embodiment, the touch panel 16 is a capacitance type that detects a change in capacitance between electrodes caused by an object such as a finger approaching the surface. For example, one or more fingers touch the touch panel 16. Detect that. The touch panel 16 is provided on the display 14 and is a pointing device for instructing an arbitrary position within the screen. The touch panel control circuit 48 functions as a detection unit, detects a touch operation within the touch effective range of the touch panel 16, and outputs coordinate data indicating the position of the touch operation to the processor 30. That is, the user inputs the operation position, the operation direction, and the like to the mobile phone 10 by touching, sliding, releasing, and a combination thereof on the surface of the touch panel 16.

  The detection method of the touch panel 16 may employ a surface type capacitance method, or may be a resistance film method, an ultrasonic method, an infrared method, an electromagnetic induction method, or the like. The touch operation is not limited to the user's finger, and may be performed with a stylus pen or the like.

  Although detailed description is omitted, the mobile phone 10 can execute a mail function, a browser function, and the like by communicating with the network in addition to the telephone function.

  The wireless communication circuit 32, the A / D converter 36, and the D / A converter 38 described above may be included in the processor 30.

  With reference to FIG. 3, for example, when the mobile phone 10 executes a browser function and acquires character data from the server, the mobile phone 10 displays a character (document) corresponding to the character data on the display 14. Therefore, the mobile phone 10 is sometimes called a character display device.

  The display screen of the display 14 includes a status display area 60 and a function display area 62. In the status display area 60, an antenna icon (pict) indicating the radio wave reception status by the antenna 34, a battery icon indicating the remaining battery capacity of the secondary battery, a manner icon 64 indicating that the manner mode is set, and the date and time are displayed. Is done. Note that when the manner mode is canceled by the above-described switching key, the manner mode icon 64 disappears.

  In the function display area 62, a character string based on the acquired character data is displayed. On the right side of the function display area 62, an up scroll icon 70 and a down scroll icon 72 indicating the scroll direction are displayed, and a scroll bar 74 for scrolling (updating) the display contents is provided. The scroll bar 74 represents the position of the displayed character in the acquired character data.

  For example, referring to FIGS. 4A and 4B, when the user touches the scroll bar 74 and performs an operation of sliding downward, the display content is scrolled downward. On the other hand, when an operation of sliding the scroll bar 74 upward is performed, the display content scrolls upward. Accordingly, the user can arbitrarily display characters that are not displayed by performing a touch operation on the scroll bar 74 with reference to the position of the scroll bar 74. And a user can advance a character by performing such update operation. However, when the scroll bar 74 is adjacent to the up scroll icon 70 or the down scroll icon 72, the display content cannot be scrolled up or down.

  In another embodiment, when a touch operation is performed on the up scroll icon 70, the display content may be scrolled upward, and the position of the scroll bar 74 may be changed upward. Similarly, even if a touch operation is performed on the downward scroll icon 72, the display content may be scrolled downward, and the position of the scroll bar 74 may be changed downward. In other embodiments, the display content may be scrolled or may be slid after being touched, regardless of the display position of the up scroll icon 70, the down scroll icon 72, and the scroll bar 74. In the following description, an operation of sliding after touching the scroll bar 74 is referred to as a “scroll operation”.

  Here, in the present embodiment, when a user is reading a displayed character and there is a word (morpheme) that cannot be read, based on the position of the word, ruby (phonetic) or reading voice Auxiliary information such as is output. Hereinafter, processing until auxiliary information is output will be described.

  First, it is determined whether or not there is a word (specific word) for which auxiliary information is output in the displayed characters. Referring to FIG. 5, for example, in the case of the top screen as shown in FIG. 3, it is determined that there is a specific word when the first predetermined time elapses from when the top screen is displayed until the scroll operation is performed. Is done.

  In addition, when the user proceeds with reading characters, the user needs to perform a scrolling operation in order to read characters that are not displayed. If the user continues reading without any problem, the time interval t during which the scroll operation is performed becomes substantially constant as shown in FIG. However, when the user cannot read a certain word, the scroll operation is temporarily stopped. Therefore, as shown in FIG. 6B, even if the second predetermined time (> time interval t) elapses after the scroll operation is performed, the next scroll operation is not performed. In such a case, it is determined that there is a specific word in the displayed document.

  Next, the position of the specific word is specified. In the present embodiment, the specifying method differs depending on whether the screen is the top screen or the screen after the scroll operation.

  In the case of the first screen, the number of characters read is calculated based on the display time of the first screen and the speed at which characters are read (hereinafter referred to as reading speed), and specific lines that are likely to contain specific words are identified. To do.

  Here, the reading speed is the number of characters that the user can read within a certain time (for example, 1 second), and is expressed using a unit of “characters / second” in the present embodiment. And the reading speed of a present Example is calculated | required from the number of characters updated by one scroll operation. For example, when a scroll operation is performed on the top screen, it is considered that the user has finished reading the characters displayed on the top screen. Therefore, the scroll time from when the top screen is displayed until the scroll operation is performed is measured. The quotient of the number of characters on the top screen and the scroll time is the reading speed (characters / second). In this embodiment, the reading speed is “fast (12 characters / second or more)”, “normal (less than 12 characters / second, 10 characters / second or more)”, or “slow (less than 10 characters / second)”. Divided into three categories.

  In the case of the screen after the scroll operation, it is considered that the specific line including the specific word is included within several lines from the bottom of the displayed line. Therefore, in this embodiment, an output setting value for designating a predetermined line (for example, the second line) from the bottom of the displayed line is set in advance.

  Then, from the reading speed and the specific line described above, the start position for starting the search for the specific word is determined. For example, when 36 characters are included in one line and the reading speed is slow, the start position (for example, the first character) of the specific line including the specific word is the start position. Similarly, when the reading speed is normal, the center (for example, the 12th character) of the specific line is the start position. When the reading speed is high, the rear part (for example, the 24th character) of the specific line is the start position.

  When the start position is determined in this way, a search for a specific word is started. When a specific word is found as a result of the search, the character of the specific word is specified as a character for which auxiliary information is to be output. Then, auxiliary information related to the specified character (specific word) is output.

  At this time, if the manner mode is not set, a sentence displayed after the specific word is read out. On the other hand, when the manner mode is set, ruby is given to the same type of specific word displayed after the specific word. That is, the auxiliary information is appropriately output according to the situation where the mobile phone 10 is used. However, in other embodiments, ruby may be displayed even if the manner mode is not set as long as no sound is output (for example, the volume is the lowest value).

  From the above, in this embodiment, auxiliary information required by the user is appropriately output. Accordingly, the user does not have to acquire unnecessary auxiliary information, and thus it is easy to read the characters. Further, the processing load on the processor 30 can be reduced as compared with the case where auxiliary information for the entire document is output. Furthermore, it is possible to determine whether auxiliary information needs to be output using the time until the characters displayed on the display screen are updated.

  In particular, in this embodiment, since a specific word is searched after a specific line that is highly likely to include a specific word is searched, the processing time until the auxiliary information is output can be shortened.

  Here, in this embodiment, the reading speed is calculated every time the scroll operation is performed, and the average reading speed is obtained or the second predetermined time is changed.

  First, when the reading speed is calculated every time the scroll operation is performed, first, the scroll time from the previous scroll operation to the current scroll operation and the number of characters updated by the scroll operation are obtained. The number of characters updated by the scroll operation is the product of the number of lines updated by one scroll operation and the number of characters included in one line. The quotient of the number of characters updated by the scroll operation and the scroll time from the previous scroll operation to the current scroll operation is the reading speed in one scroll operation.

  In this embodiment, the reading speed is calculated every time the scroll operation is performed, and the average reading speed is obtained. Specifically, an average reading speed is set in advance, and each time the reading speed is calculated, the sum of the calculated reading speed and the preset average reading speed is divided by “2”. A new average reading speed is required. In this embodiment, the average reading speed is used to specify a specific line or set a search start position.

  However, when the difference between the calculated reading speed and the preset average reading speed is large, the newly calculated average reading speed is a value far from the actual user reading speed. Therefore, auxiliary information is not output correctly even if a specific line is specified using the newly calculated average reading speed or a search start position is set. Therefore, in this embodiment, when the difference between the calculated reading speed and the preset average reading speed is large, the calculated average reading speed is reset as the average reading speed as it is. Thereby, the above-mentioned problem is solved.

  In another embodiment, a plurality of reading speeds may be stored, and the average reading speed may be obtained after outliers are omitted.

  Next, the second predetermined time is reset based on the reading speed calculated from one scroll operation. When the reading speed is slow, the time interval t at which the user performs the scroll operation becomes long. For example, if the second predetermined time is short, auxiliary information is displayed even though there are no unreadable characters. Therefore, when the reading speed is slow, the currently set second predetermined time is lengthened by a certain time. On the other hand, when the reading speed is fast, the currently set second predetermined time is shortened by a certain time. For example, if the second predetermined time is long, even if there are characters that cannot be read, it takes time until the auxiliary information is output. Therefore, in this embodiment, the timing for determining whether the output of auxiliary information is necessary is determined based on the speed at which the user reads the characters. For this reason, auxiliary information is output at an appropriate timing.

  Hereinafter, with reference to FIGS. 7A and 7B, in the cellular phone 10 in which the manner mode is set, a user whose reading speed is normal performs a scroll operation to read characters, and is output in this state. The auxiliary information will be specifically described. In the following description, the specific word includes at least one Chinese character.

  As shown in FIG. 7A, nine lines of characters are displayed on the display 14 as a result of the scroll operation performed by the user. On the 7th to 9th lines, words including kanji are written. In this state, when the second predetermined time elapses after the scroll operation is performed, the center of the second line from the bottom is determined based on the output setting value (for example, the second line) and the user's writing speed (“normal”). The starting position for searching for a specific word is set. If “Shirayu” is found as a result of the search, “Shirayu” is specified as a character for which auxiliary information should be output.

  Since the manner mode is set here, based on the ruby dictionary stored in the RAM 46, the ruby of the specific word including the kanji displayed after “Shirayu” is read out. As a result, as shown in FIG. 7 (B), ruby of “Sayu” and “Tokoten” is given to “Shirayu” and “Kokota”. When the manner mode is not set, a sound for reading out characters (sentences) after “Shirayu” is output from the speaker 18 based on the synthesized speech data stored in the RAM 46. However, in other embodiments, the reading voice and ruby may be output simultaneously.

  Thus, if the display of the character is not updated, the position of the character that the user cannot read can be specified, and auxiliary information can be output. Although not shown, in the case of the top screen, the character for which auxiliary information is to be output is specified based on the reading speed, and the auxiliary information is output.

  8A and 8B, when the auxiliary information is not output as intended by the user, the user can arbitrarily change the output auxiliary information by a touch operation. For example, when the specific word that the user cannot read is “bitter juice”, when the user performs a touch operation on “bitter juice”, the output content of the auxiliary information is changed based on the touch coordinates. As a result, as shown in FIG. 8B, the ruby “Kuju” is newly output. Thus, even if the auxiliary information being output is incorrect, the user can easily correct it. If the auxiliary information is a reading voice, the characters after “bitter juice” are read out. Further, when the position where the auxiliary information starts to be output is changed, the output set value is also changed.

  Referring to FIG. 9, when searching for a specific word, the display position of the word already displayed on the page is not set as the search start position. For example, although “bitter juice” is included in a specific line, since this word is also displayed in the third line, it can be considered that the user knows how to read. For this reason, “guardian” next to “bitter juice” is specified as a character for which auxiliary information is to be output, and a ruby (auxiliary information) for “Sakimori” is output. Thus, in this embodiment, unnecessary auxiliary information can be prevented from being output to the user.

  Referring to FIG. 10, when the character (document) is other than Japanese, a word having a predetermined number of characters or more is searched as a specific word. For example, when an English sentence is displayed using an alphabet, an English word of eight or more characters is set as a specific word. In FIG. 10, “competition” in the specific line is specified as a character (word) to which auxiliary information is to be output, and a “campation” ruby is given in katakana. That is, the above-described ruby dictionary includes a dictionary indicating alphabets and kana of the language to be used. If a specific language is written in alphabets, a character string indicating how to read is read from the above-described ruby dictionary. And displayed as ruby. On the other hand, when reading out, a voice corresponding to the read character string is output. Thus, in this embodiment, auxiliary information can be output regardless of the displayed language.

  If the auxiliary information is a read-out voice, the read-out voice is output again if the scroll operation is not performed even after the third predetermined time has elapsed since the end of the read-out. When the same reading voice is repeated a predetermined number of times (for example, three times), ruby is displayed instead of the reading voice.

  Although the features of the embodiment have been outlined above, a detailed description will be given below with reference to the memory maps shown in FIGS. 11 and 12 and the flowcharts shown in FIGS.

  Referring to FIG. 11, program storage area 302 and data storage area 304 are formed in RAM 46 shown in FIG. As described above, the program storage area 302 is an area for reading and storing (developing) part or all of the program data set in advance in the flash memory 44 (FIG. 2).

  The program storage area 302 includes a determination program 310 for determining whether a touch operation or a scroll operation has been performed, an auxiliary information output program 312 for outputting auxiliary information, and a manner mode switching program 314 for switching manner mode settings. Etc. are included. The program storage area 302 includes a program for displaying characters (documents) acquired from the network.

  12, the data storage area 304 of the RAM 46 is provided with a touch buffer 330, a display character buffer 332, a scroll amount buffer 334, a reading speed buffer 336, and the like, as well as touch coordinate map data 338 and synthesized voice data 340. Ruby dictionary data 342, average reading speed data 344, output set value data 346, and the like are stored. The data storage area 304 also includes a touch flag 348, a manner mode flag 350, a scroll flag 352, a reading speed counter 354, a first auxiliary information counter 356, a second auxiliary information counter 358, a third auxiliary information counter 360, and the like. It is done.

  The touch buffer 330 temporarily stores the touch operation start coordinates, the current touch coordinates (current coordinates), the touch coordinate change history, and the touch operation end coordinates output from the touch panel control circuit 48. The display character buffer 332 temporarily stores character string data displayed on the display 14. The scroll amount buffer 334 temporarily stores a numerical value indicating the row updated by the scroll operation. The reading speed buffer 336 temporarily stores the reading speed calculated from one scroll operation.

  The touch coordinate map data 338 is data for associating the touch coordinates in the touch operation with the display coordinates on the display 14. That is, based on the touch coordinate map data 338, the result of the touch operation performed on the touch panel 16 is reflected on the display 14.

  The synthesized voice data 340 is data for artificially outputting a human voice, and is read when a read-out voice is output. The ruby dictionary data 342 is data in which a character string of a kana is associated with a specific word such as a kanji or an English word, and is read when auxiliary information is output. When the read-out voice is output as auxiliary information, the voice corresponding to the character string read from the ruby dictionary data 342 and the character string included in the display character buffer 332 is created based on the synthesized voice data 340. The created read-out voice (synthesized voice) is output from the speaker 18.

  The average reading speed data 344 is data indicating the set average reading speed. The output set value data 346 is data used when a specific row is specified.

  The touch flag 348 is a flag for determining whether or not the touch panel 16 is touched. For example, the touch flag 338 is composed of a 1-bit register. When the touch flag 348 is turned on (established), a data value “1” is set in the register. On the other hand, when the touch flag 348 is turned off (not established), a data value “0” is set in the register. Touch flag 348 is switched on / off based on a signal output from touch panel control circuit 48.

  The manner mode flag 350 is a flag for determining whether the manner mode is set. Therefore, the manner mode flag 350 is turned on in accordance with an operation for setting the manner mode, and is turned off in accordance with an operation for canceling the manner mode. The scroll flag 352 is a flag for determining whether a scroll operation is being performed. Therefore, when a scroll operation is performed, the scroll flag 352 is turned on.

  Note that the manner mode flag 350 and the scroll flag 352 have substantially the same configuration as the touch flag 348, and thus detailed description thereof is omitted. The touch flag 348 and the scroll flag 352 are switched on / off based on the processing of the determination program 310 described above.

  The reading speed counter 354 is a counter that measures time for calculating the reading speed. The reading speed counter 354 is reset when a character is displayed or a scroll operation is performed, and starts counting (measurement). Therefore, the reading speed counter 354 may be called a reading speed timer.

  The first auxiliary information counter 356 is a counter for measuring the first predetermined time when the head screen is displayed. The second auxiliary information counter 358 is a counter for measuring a second predetermined time after the scroll operation is performed. The third auxiliary information counter 360 is a counter for counting a third predetermined time. When the first auxiliary information counter 356, the first auxiliary information counter 358, and the third auxiliary information counter 360 are reset, counting (measurement) is started. Therefore, each counter may be referred to as a first auxiliary information timer, a second auxiliary information timer, and a third auxiliary information timer.

  The data storage area 304 stores image data displayed in a standby state, downloaded character data, and the like, and is provided with a counter and a flag necessary for the operation of the mobile phone 10.

  The processor 30 performs a determination process shown in FIG. 13 and an auxiliary information output process shown in FIGS. 14 to 19 under the control of a Linux (registered trademark) -based OS such as Android (registered trademark) and REX, and other OSs. A plurality of tasks including the manner mode switching process shown in FIG. 20 are processed in parallel.

  The determination process is repeatedly executed at regular intervals (for example, one frame) when the power of the mobile phone 10 is turned on. In step S1, the processor 30 determines whether or not a touch operation has been performed. That is, the processor 30 determines whether touch coordinate data is output from the touch panel control circuit 48. If “NO” in the step S1, that is, if the touch position data is not output, the processor 30 turns off the touch flag 348 in a step S3, and proceeds to a step S19. On the other hand, if “YES” in the step S1, that is, if touch position data is output, the processor 30 determines whether or not the touch flag 348 is turned on in a step S5. That is, the processor 30 determines that the touch operation is performed and determines whether the touch flag 348 is turned on. If “NO” in the step S5, that is, if the touch operation is started, the processor 30 turns on the touch flag 348 in a step S7, and proceeds to the step S9.

  If “YES” in the step S5, that is, if it is determined that the touch operation is performed, the processor 30 determines whether or not the touch coordinates are changed in a step S9. For example, the processor 30 reads the start coordinates, the current coordinates, and the previous touch coordinates (previous coordinates) from the touch buffer 330. Then, the processor 30 determines whether the current coordinates have changed with respect to the previous coordinates in a state where the start coordinates are included in the display range of the scroll bar 74. In another embodiment, when the scroll bar 74 is not displayed in a scrollable state, it is determined whether the current coordinate has changed with respect to the previous coordinate.

  If “YES” in the step S9, for example, if the touch coordinates change while the current coordinates are included in the display range of the scroll bar 74, the processor 30 calculates a change amount of the touch coordinates in a step S11. The amount of change indicates the distance that the user's finger has moved from the previous coordinate to the current coordinate. Therefore, in step S11, the distance between the current coordinates and the previous coordinates is calculated as the amount of change.

  Subsequently, in step S13, the processor 30 integrates the total amount of change. The total change amount indicates the distance that the user's finger or the like has moved from the touch to the release. Then, the processor 30 obtains the total amount of change by integrating the amount of change calculated in step S11 in step S13 until the scroll operation ends.

  In step S15, the processor 30 determines whether or not the scroll flag 352 is turned on. That is, the processor 30 determines that the scroll operation is being performed, and determines whether the scroll flag 352 is turned on. If “NO” in the step S15, that is, if the scroll operation is started, the processor 30 turns on the scroll flag 352 in a step S17, and temporarily ends the determination process. On the other hand, if “YES” in the step S15, that is, if the scroll operation is being performed, the processor 30 once ends the determination process.

  If “NO” in the step S9, that is, if the touch coordinates are not changed, the processor 30 determines whether or not the scroll flag 352 is turned on in a step S19. That is, it is determined whether the scroll operation has been performed. If “NO” in the step S19, that is, if the scroll operation is not performed, the processor 30 ends the determination process.

  If “YES” in the step S19, that is, if the touch coordinates do not change while the scroll operation is being performed, the processor 30 turns off the scroll flag 352 in a step S21. Subsequently, in step S23, the processor 30 calculates the scroll amount. For example, the processor 30 calculates the distance traveled by the scroll bar 74 from the start coordinates and end coordinates stored in the touch buffer 330. Then, the processor 30 calculates, as the scroll amount, the number of lines in which the displayed characters are updated based on the distance that the scroll bar 74 has moved. Note that the calculated scroll amount is stored in the scroll amount buffer 334. Subsequently, in step S25, the processor 30 deletes the total integrated amount. That is, since the scroll amount is calculated, the total integrated amount is deleted.

  Note that when an operation to turn off the power is performed, the processor 30 ends the determination process regardless of the flow of the flowchart.

  FIG. 14 is a flowchart of auxiliary information output processing. For example, when an operation for displaying characters is performed by the user, the processor 30 displays the characters in step S31. That is, characters (documents) such as HP acquired from the network are displayed on the display 14. Subsequently, the processor 30 initializes the reading speed timer in step S33, and initializes the first auxiliary information timer in step S35. That is, the processor 30 resets the reading speed counter 354 and the first auxiliary information counter 356 and starts measuring time.

  Subsequently, in step S37, the processor 30 determines whether or not scrolling is performed. That is, it is determined whether a scroll operation has been performed and the scroll flag 352 is on. If “NO” in the step S37, that is, if the scroll operation is not performed, the processor 30 determines whether or not the first auxiliary information timer has expired in a step S39. That is, it is determined whether the first predetermined time has elapsed since the top screen was displayed on the display 14. The processor 30 that executes the process of step S39 functions as a determination unit.

  If “YES” in the step S39, that is, if the first predetermined time has elapsed after the top screen is displayed, the process proceeds to a step S81 (see FIG. 16). On the other hand, if “NO” in the step S39, that is, if the first predetermined time has not elapsed since the top screen was displayed, the processor 30 returns to the step S37.

  If “YES” in the step S37, that is, if a scroll operation is performed, the processor 30 stops the reading speed timer in a step S41. That is, the time measurement by the reading timer is terminated. Subsequently, in step S43, the processor 30 calculates the reading speed. That is, the processor 30 calculates the reading speed from the number of characters stored in the display character buffer 332 and the time measured by the reading speed counter 354. The calculated reading speed is stored in the reading speed buffer 336. The processor 30 that executes the process of step S43 functions as a calculation unit.

  Subsequently, in step S45, the processor 30 sets an average reading speed. For example, if the average reading speed of the user is not set, the reading speed stored in the reading speed buffer 336 is set as the average reading speed as it is. On the other hand, if the average reading speed is already set, a new average reading speed is calculated from the reading speed stored in the reading speed buffer 336 and the set average reading speed, and the average reading speed is reset. The The average reading speed set in this way is recorded in the RAM 46 as average reading speed data 344.

  Subsequently, the processor 30 initializes the reading speed timer in step S51 of FIG. 15, and initializes the second auxiliary information timer in step S53. That is, the time after the display of the character is updated by the scroll operation is measured by the reading speed counter 354 and the second auxiliary information counter 358. Subsequently, in step S55, the processor 30 determines whether or not scrolling is performed. That is, it is determined whether a scroll operation has been performed and the scroll flag 352 is on. If “NO” in the step S55, that is, if the scroll operation is not performed, the processor 30 determines whether or not the second auxiliary information timer has expired in a step S57. The processor 30 that executes the process of step S57 functions as a determination unit.

  If “YES” in the step S57, that is, if the second predetermined time elapses after the scroll operation is performed, the process proceeds to a step S81 (FIG. 16). On the other hand, if “NO” in the step S57, that is, if the second predetermined time has not elapsed since the scroll operation was performed, the processor 30 returns to the step S55.

  If “YES” in the step S55, that is, if a scroll operation is performed, the processor 30 stops the reading speed timer in a step S59. That is, the time measurement by the reading speed timer is stopped. Subsequently, in step S61, the processor 30 calculates the number of scroll characters. That is, the processor 30 reads the number of lines updated by the scroll operation from the scroll amount buffer 334 after the scroll flag 352 is turned off, and performs the scroll operation from the number of characters included in one line and the updated number of lines. Calculate the number of updated characters. Subsequently, the reading speed is calculated in step S63. That is, the reading speed is calculated from the number of characters calculated as described above and the time measured by the reading speed counter 354. As in step S43, the calculated reading speed is stored in the reading speed buffer 336. Further, the processor 30 that executes the process of step S63 functions as a calculation unit.

  Subsequently, in step S65, the second auxiliary information timer is reset. That is, the value at which the second auxiliary information timer expires, that is, the second predetermined time is reset based on the calculated reading speed. For example, if the calculated reading speed is slower than the average reading speed, the value at which the second auxiliary information timer expires is changed so that the second predetermined time becomes longer by a predetermined time. On the other hand, if the calculated reading speed is faster than the average reading speed, the value at which the second auxiliary information timer expires is changed so that the second predetermined time is shortened by a certain time. Note that the value to be changed is determined based on the calculated reading speed and the average reading speed. The processor 30 that executes the process of step S65 functions as a setting unit.

  Subsequently, in step S67, the processor 30 determines whether or not it is necessary to reset the average reading speed. For example, it is determined whether the difference between the calculated reading speed and the average reading speed is a predetermined value or more. If “YES” in the step S67, for example, if the difference between the reading speed and the average reading speed is a predetermined value or more, the processor 30 resets the average reading time in a step S69, and returns to the step S51. That is, the calculated reading speed is reset as the average reading speed as it is. On the other hand, if “NO” in the step S67, for example, if the difference between the reading speed and the average reading speed is less than a predetermined value, the processor 30 calculates the average reading speed in a step S71 and returns to the step S51. That is, a new average reading speed is obtained from the reading speed and the average reading speed.

  Referring to FIG. 16, when the first predetermined time or the second predetermined time elapses in a state where a word that cannot be read by the user is displayed, processor 30 determines whether or not it is the top screen in step S <b> 81. . That is, the processor 30 determines whether the first screen is displayed and the first auxiliary information timer has expired. If “NO” in the step S81, that is, if the screen after the scroll operation is displayed, the processor 30 specifies a specific line on the basis of the output setting value in a step S83. For example, if the output set value data 346 indicates “2”, the second line from the bottom among the displayed lines is set as the specific line. On the other hand, if “YES” in the step S81, that is, if the top screen is displayed, the processor 30 specifies a specific row based on the average reading speed in a step S85. First, the processor 30 calculates the number of characters read based on the first predetermined time and the average reading speed indicated by the average reading speed data 344. Then, the processor 30 sets a line including the character read last as a specific line. Note that the processor 30 that executes the processes of step S83 and step S85 functions as a row specifying unit.

  Subsequently, in step S87, the processor 30 sets a start position based on the average reading speed. For example, the processor 30 determines whether the average reading speed is “fast”, “normal”, or “slow” as described above. If the average reading speed is “slow”, the beginning of the specific line is the start position, and if the average reading speed is “normal”, the center of the specific line is the start position, and the average reading speed is “fast”. If there is, the rear part of the specific line is set as the start position.

  Subsequently, in step S89, the processor 30 determines whether or not the word is a specific word. For example, it is determined whether the candidate word at the start position includes at least one Chinese character. If “YES” in the step S89, for example, if the candidate word includes at least one kanji, the processor 30 determines whether or not the specific word appears for the first time in a step S91. That is, the processor 30 determines whether the candidate word is displayed before the candidate word on the current display screen. If “YES” in the step S91, for example, if the word is displayed for the first time as “Shirayu” shown in FIG. 7A, the processor 30 selects a character for which auxiliary information is to be output in a step S93. Identify. For example, “Shirayu” is specified as a character for which auxiliary information is to be output. Subsequently, in step S95, the processor 30 determines whether the manner mode is set. That is, it is determined whether the manner mode flag 350 is on. If “NO” in the step S95, that is, if the manner mode is not set, the process proceeds to a step S101 (FIG. 17). On the other hand, if “YES” in the step S95, that is, if the manner mode is set, the process proceeds to a step S141 (FIG. 19).

  The processor 30 that executes the process of step S89 functions as a search unit. Further, the processor 30 that executes the process of step S91 functions as a display determination unit. And the processor 30 which performs the process of step S93 functions as a specific part.

  On the other hand, if “NO” in the step S89, for example, if the word is only “Hiragana”, the processor 30 determines whether or not it is the last word being displayed in a step S97. That is, the processor 30 determines whether the candidate word is the last word displayed on the display 14. If “NO” in the step S97, that is, if the candidate word is not the last word being displayed, the processor 30 changes the candidate word in a step S99 and returns to the step S89. For example, a current candidate word is "Good morning", if the word then is stored in the display character buffer 332 is "Hello", the next candidate word is changed to "Hello". If “YES” in the step S97, that is, if the candidate word is the last word being displayed, the processor 30 returns to the step S51 (FIG. 15).

  Referring to FIG. 17, in step S101, processor 30 outputs a reading voice. For example, the processor 30 reads a character string displayed after the specified character. Next, the processor 30 creates speech data corresponding to the read character string from the synthesized speech data 340. Then, sound based on the created sound data is output from the speaker 18. In this way, when the reading voice is output, the user can read a word that cannot be read, and can continue to read characters (documents) after the word. The processor 30 that executes the process of step S101 functions as an output unit.

  Subsequently, in step S103, the processor 30 determines whether or not scrolling is performed. That is, it is determined whether a scroll operation has been performed and the scroll flag 352 has been turned on. If “YES” in the step S103, for example, if the user performs a scroll operation after hearing how to read a word that the user does not understand, the processor 30 stops outputting the reading voice in a step S105, and the step S51 (FIG. 15). Return to). For example, the output of the reading voice is stopped.

  If “NO” in the step S103, that is, if the scroll operation is not performed, the processor 30 determines whether or not the change operation is performed in a step S107. For example, it is determined whether the user has performed a touch operation in order to change a word (character) to be read out. If “YES” in the step S107, for example, as shown in FIG. 8, when a touch operation is performed on the displayed character, the processor 30 changes the word to be read out in a step S109. For example, as shown in FIG. 8, when a touch operation is performed on the word “bitter”, the word read out first is changed to “bitter”. The processor 30 that executes the process of step S109 functions as a changing unit.

  Subsequently, in step S111, the processor 30 calculates a change amount. For example, if the first row containing the word to be read is the eighth row and the row containing the changed word is the sixth row, the change amount is calculated as “+2 rows”. Subsequently, in step S113, the processor 30 changes the output set value and returns to step S101. For example, half of the change amount is added to the output set value. More specifically, when the change amount is “+2 lines” and the output setting value is “second line from the bottom”, the change amount is “+1 line”, which is half the change amount “+2 lines”. Is added to the value. As a result, the changed output set value is “third line from the bottom”. However, if the change amount is “−2 lines”, the changed output set value is “first line from the bottom”. In addition, when the value of half of the change amount is a decimal, the decimal part is rounded down. For example, when the change amount is “+1 line”, the half value is “+0.5”, and thus “0” is set. Therefore, the output set value is not substantially changed.

  If “NO” in the step S107, for example, if the touch operation to be changed is not performed, the processor 30 determines whether or not the output of the auxiliary information is ended in a step S115. For example, it is determined whether all characters displayed after the word read out first are read out. If “NO” in the step S115, that is, if the reading voice is not output, the processor 30 returns to the step S103. On the other hand, if “YES” in the step S115, that is, if the output of the reading voice is finished, the processor 30 proceeds to the step S117.

  In step S117, the processor 30 initializes the third auxiliary information timer. That is, the third auxiliary information counter 360 is reset and time measurement is started. Subsequently, in step S119, the processor 30 determines whether or not the third auxiliary information timer has expired. That is, it is determined whether the third predetermined time (standby time) has elapsed since the output of the reading voice has been completed. If “NO” in the step S119, that is, if the third predetermined time has not elapsed after the output of the reading voice is finished, the processor 30 repeats the step S119.

  On the other hand, if “YES” in the step S119, that is, if the third predetermined time has elapsed after the output of the reading voice is finished, the processor 30 increments the variable n in a step S121. This variable n is a variable for counting the number of times the read-out voice has been output. When the variable n is “0”, when the variable n is incremented in step S121, the variable n becomes “1”. Subsequently, in step S123, the processor 30 determines whether or not the variable n is “3” or more. That is, it is determined whether or not the same reading voice is output three times. If “NO” in the step S123, that is, if the number of times of outputting the same reading voice is less than 3, the processor 30 returns to the step S101.

  If “YES” in the step S123, that is, if the same reading voice is output three times, the processor 30 proceeds to a step S131 (FIG. 18). Note that the value of the variable n is initialized to “0” when “YES” is determined in step S103 or step S107, that is, when another reading voice is output.

  Referring to FIG. 18, in step S131, the processor 30 displays ruby. That is, ruby is displayed instead of the reading voice. Specifically, the processor 30 reads from the display character buffer 332 a word of the same type (here, a word including at least one kanji character) displayed after the specified character (specific word). Next, the processor 30 reads out the ruby corresponding to the read word from the ruby dictionary data 342. Then, the processor 30 displays the read ruby in association with the display position of each word.

  Subsequently, in step 133, the processor 30 initializes the third auxiliary information timer. That is, the time after the ruby is displayed is measured. Subsequently, in step S135, the processor 30 determines whether or not the third auxiliary information timer has expired. That is, the time after the ruby is displayed is measured. If “NO” in the step S135, that is, if the third predetermined time has not elapsed after the ruby is displayed, the processor 30 repeats the step S135. On the other hand, if “YES” in the step S135, that is, if the third predetermined time elapses after the ruby is displayed, the processor 30 erases the ruby in a step S137. Subsequently, in step S139, the processor 30 determines whether or not it is the final scroll position. For example, it is determined whether all characters (documents) acquired from the network have been displayed on the display 14. If “NO” in the step S139, that is, if all characters are not displayed, the process returns to the step S51 (FIG. 15). On the other hand, if “YES” in the step S139, that is, if all characters are displayed, the processor 30 ends the auxiliary information output processing.

  If “YES” is determined in step S95, that is, if the manner mode is set, the processor 30 displays ruby in step S141. That is, since no sound can be emitted from the speaker 18, ruby is displayed as auxiliary information. The processor 30 that executes the process of step S141 functions as an output unit.

  Subsequently, in step S143, the processor 30 initializes the third auxiliary information timer. That is, the third auxiliary information counter 360 is reset, and measurement of time after the ruby is displayed is started.

  Subsequently, in step S145, the processor 30 determines whether or not scrolling is performed, as in step S103. If “YES” in the step S145, for example, if a scroll operation is performed, the processor 30 deletes the ruby in a step S147 and returns to the step S51 (FIG. 15). That is, the ruby displayed corresponding to the specific word is deleted. On the other hand, if “NO” in the step S145, for example, if the scroll operation is not performed, the processor 30 determines whether or not the change operation is performed in a step S149 similarly to the step S107.

  If “YES” in the step S149, that is, if a changing operation is performed, the processor 30 changes a word to which ruby is added in a step S151. For example, as shown in FIG. 7, when a touch operation is performed on the word “bitter juice”, the first word to which ruby is given is changed to “bitter juice”. The processor 30 that executes the process of step S151 functions as a changing unit. Then, the processor 30 calculates the amount of change in step S153, changes the output set value in step S155, and returns to step S141.

  If “NO” in the step S149, that is, if the changing operation is not performed, the processor 30 determines whether or not the third auxiliary information timer has expired in a step S157. That is, it is determined whether the third predetermined time has elapsed since the ruby was displayed. If “NO” in the step S157, that is, if the third predetermined time has not elapsed after the ruby is displayed, the process returns to the step S141. On the other hand, if “YES” in the step S157, that is, if the third predetermined time has elapsed after the ruby is displayed, the process proceeds to a step S137 (FIG. 18).

  Note that when the user performs an operation of deleting the display of characters, the processor 30 ends the auxiliary information output process regardless of the flow of the flowchart.

  In another embodiment, the process of step S87 (FIG. 16) may be omitted. In this case, the start of the specific line is the start position. In addition, steps S133 and S135 may be deleted, and instead, processing for deleting the ruby displayed when the scroll operation is performed may be added.

  FIG. 20 is a flowchart of manner mode switching processing. When the switching key for switching the manner mode is operated, the processor 30 determines whether the manner mode is enabled in step S171. For example, the processor 30 determines whether the switching key has been switched so that the manner mode is enabled. If “YES” in the step S171, that is, if the manner mode is enabled, the processor 30 turns on the manner mode flag 350 in a step S173 and ends the manner mode switching process. On the other hand, if “NO” in the step S171, that is, if the switching key is switched so as to cancel the manner mode, the processor 30 turns off the manner mode flag 350 in the step S175 and ends the manner mode switching processing. . However, when an operation to turn off the power is performed, the processor 30 ends the manner mode switching process regardless of the flow of the flowchart.

  The specific word may be a word including characters (kanji) having a large number of strokes, or may be a pre-registered word such as an obfuscated kanji.

  In this embodiment, characters are updated (scrolled) by a touch operation. However, in other embodiments, a scroll button (also referred to as a jog dial) or a scroll-dedicated hard key with a predetermined scroll amount is used. Etc. may be performed.

  For example, when scrolling is performed by a scroll button, step S1-7 is omitted in the determination process of another embodiment (see FIG. 13). In step S9, it is determined whether the scroll button has been operated. If "YES" is determined in the step S9, the processor 30 calculates an operation amount (rotation amount) for the scroll button in a step S11 and integrates the operation amounts calculated in the step S13. If “NO” is determined in step S9, that is, if the operation on the scroll button is finished, the processor 30 turns off the scroll flag 352 in step S21, and scrolls based on the total operation amount in step S23. The amount is calculated, and the entire operation amount is deleted in step S25.

  Further, when scrolling is performed using a dedicated hard key for scrolling, steps S1-S7, S11-15, S19, and 25 are omitted in the determination processing of the other embodiments. In step S9 of other embodiments, it is determined whether a dedicated hard key has been operated. If “NO” in this step S9, the processor 30 ends the determination processing of the other embodiments. On the other hand, if “YES” in the step S9, the processor 30 turns on the scroll flag 352 in a step S17. Subsequently, the processor 30 reads the scroll amount scrolled by the hard key in step S23, records it in the scroll amount buffer 334, turns off the scroll flag in step S21, and ends the determination process.

  In addition to the HP, the characters displayed on the display 14 may be a mail body, a document created by a text editor, or the like.

  Further, the first predetermined time and the second predetermined time may be set based on the number of displayed characters, the number of lines, and the font size. For example, when the number of characters, the number of lines, and the font size are changed so as to increase (increase), the first predetermined time and the second predetermined time are set short. On the other hand, when the number of characters, the number of lines, and the font size are changed to be small (small), the first predetermined time and the second predetermined time are set longer.

  In this embodiment, since the document (character) is Japanese, the ruby is displayed as “Hiragana”, but when the character is English, the ruby may be “phonetic symbol”. That is, even in a language other than Japanese, a character string indicating the reading corresponding to the language is displayed as ruby.

  In this embodiment, how to read a word is output by ruby and reading sound. However, in another embodiment, the meaning of the word may be output by ruby and reading sound.

  In addition, when the ruby dictionary does not include the ruby (fake pseudonym) of the specific word, it may be obtained from a server on the network.

  Moreover, when outputting the reading voice, the volume of the reading voice may be output so as to gradually increase.

  In another embodiment, scrolling may be performed by detecting the user's line-of-sight position using infrared rays or the like. For example, when detecting the user's line-of-sight position, when the detected line-of-sight position is included in the display area of the up scroll icon 70 and the down scroll icon 72, the user scrolls in the corresponding direction.

  Furthermore, when the line-of-sight position can be detected, auxiliary information may be output based on the line-of-sight position when the movement of the line-of-sight position is stopped.

  The program used in this embodiment may be stored in the HDD of the data distribution server and distributed to the mobile phone 10 via the network. Further, the storage medium may be sold or distributed in a state where a plurality of programs are stored in a storage medium such as an optical disk such as a CD, a DVD, or a BD (Blue-Ray Disk), a USB memory, and a memory card. When the program downloaded through the above-described server or storage medium is installed in a portable terminal having the same configuration as that of this embodiment, the same effect as that of this embodiment can be obtained.

  The specific numerical values given in this specification are merely examples, and can be appropriately changed according to a change in product specifications.

DESCRIPTION OF SYMBOLS 10 ... Mobile phone 14 ... Display 16 ... Touch panel 30 ... Processor 40 ... Input device 44 ... Flash memory 46 ... RAM
50… Vibrator

Claims (15)

A character display device that outputs auxiliary information related to characters displayed on a display screen,
A determination unit for determining whether auxiliary information needs to be output,
A character display device comprising: a specifying unit that specifies a character to output auxiliary information when it is determined that auxiliary information needs to be output; and an output unit that outputs auxiliary information related to the character specified by the specifying unit .   The character display device according to claim 1, wherein the determination unit determines whether auxiliary information needs to be output according to a length of time for which the display screen is updated.   The character display device according to claim 1, wherein the display screen is updated according to an update operation. The determination unit determines whether an update operation has been performed from when the character is displayed until the first predetermined time elapses;
4. The character according to claim 3, wherein the specifying unit specifies a character for which auxiliary information is to be output when it is determined that an update operation has not been performed until a first predetermined time has elapsed after the character was displayed. Display device. The determination unit determines whether an update operation has been performed until a second predetermined time has elapsed after the display of the character is updated,
The specifying unit specifies a character for which auxiliary information is to be output when it is determined that the update operation has not been performed until the second predetermined time has elapsed after the display of the character is updated. 4. The character display device according to 4. A calculation unit that calculates a speed at which characters are read based on the update operation; and a setting unit that sets the second predetermined time based on the speed at which characters are read calculated by the calculation unit, The character display device according to claim 5. The specifying unit includes a line specifying unit for specifying a specific line and a search unit for searching for a specific word based on the specified specific line,
The character display device according to claim 1, wherein a character to which auxiliary information is to be output is specified based on the specific word searched by the search unit. The specifying unit further includes a display determination unit that determines whether the specific word searched by the search unit is displayed before the specific line specified by the line specifying unit,
The character display device according to claim 7, wherein the search unit re-searches for another specific word when it is determined that the searched specific word is displayed before the specified specific line.   The character display device according to claim 7 or 8, wherein the specific word includes at least one Chinese character.   The character display device according to claim 7, wherein the specific word includes English words having a predetermined number of characters or more. Touch panel,
The character display device according to claim 1, further comprising: a detection unit that detects a touch operation on the touch panel; and a change unit that changes a character to which auxiliary information is output when the touch operation is performed.   The character display device according to claim 1, wherein the auxiliary information includes ruby.   The character display device according to claim 1, wherein the auxiliary information includes a reading voice of characters. A processor of a character display device that outputs auxiliary information related to characters displayed on the display screen;
A determination unit for determining whether auxiliary information needs to be output,
When it is determined that it is necessary to output the auxiliary information, the auxiliary information that functions as a specifying unit that specifies a character for which auxiliary information is to be output, and an output unit that outputs auxiliary information regarding the character specified by the specifying unit. Output program. An auxiliary information output method for a character display device that outputs auxiliary information related to characters displayed on a display screen,
Determine if auxiliary information needs to be output,
An auxiliary information output method for specifying a character to which auxiliary information is to be output and outputting auxiliary information related to the specified character when it is determined that auxiliary information needs to be output.

Images