JP2013012816A - Portable information terminal, display control method and display control program - Google Patents

Abstract

Provided is a portable information terminal capable of easily grasping the contents of a TV program while avoiding a decrease in the convenience of the application when using the application and avoiding overlooking a scene desired by the user in the TV program. .
A mobile phone that receives a digital television broadcast wave in which a caption and a television image accompanying a television image are multiplexed, extracts the television image from the digital television broadcast wave received by a display and a one-segment receiver. A TV extractor 32 for extracting subtitles, a subtitle extractor 33 for extracting subtitles, an application executing unit 35 for executing a predetermined application for displaying an image such as an e-mail, and executing an application when a TV image is displayed on the display 13. When a request is received from the input unit 14, a display control unit 34 is provided that stops the display of television images and displays a display image and subtitles displayed by the application on the display 13.
[Selection] Figure 2

Description

  The present invention relates to a portable information terminal capable of viewing TV video and audio in addition to execution of an application (hereinafter, also simply referred to as an application) that realizes functions such as transmission / reception of mail and WEB browsing. The present invention relates to display control of an image generated by the display on a display.

  In recent years, many portable information terminals such as mobile phones are standardly equipped with an application (browser) having a web browsing function using a browser, an application for creating and sending / receiving mail (email application), and television broadcasting such as 1Seg. It has a function to receive. When a mail is received while watching a television broadcast, the user launches a mail application, browses the received mail, creates a reply to the mail, and the like. As a screen display control at this time, when displaying an image displayed by the mail application such as a mail browsing screen and a TV image at the same time, the display area of the display is divided into two, and the image of the mail application is reduced to one side. It is often the case that the TV image is reduced and displayed on the other side, but since the display of the portable information terminal is small, the display of characters, figures, etc. is crushed and it is difficult to recognize the application, Decreasing problems can arise.

  In order to avoid this, when a TV program is switched to CM (Commercial Message), if the mail application is started by a user instruction and the application image is displayed on the entire surface of the display, it is not necessary to reduce characters, figures, etc. Can be displayed. In this case, the TV image is not displayed on the display, but if the user can listen to the TV sound, the user can determine that the CM has ended based on the content of the TV sound that has been listened to. If it is determined that the commercial has ended, if the user resumes viewing the television program, it is possible to avoid missing a scene that the user wants to see in the television program.

JP 2007-318369 A

  However, since 1Seg viewing is often performed in a state where a voice cannot be output, such as in a train, in this state, the end time of the CM cannot be determined, leading to missing a scene to be seen in a television program. Even when earphones are used in a state where no sound can be output, it is often difficult to hear the sound due to train running sounds, in-car announcements, etc. In this case as well, it is impossible to determine the end time of the CM, and it is not possible to watch on TV programs. It leads to missing the scene you want. In addition, it becomes necessary to always carry the earphone, which reduces the convenience for the user.

  In view of the above problems, the present invention can easily grasp the contents of a TV program while avoiding a decrease in the convenience of the application when using the application, and avoids overlooking the scene that the user wants to see in the TV program. An object is to provide a portable information terminal.

  In order to solve the above-described problems, the present invention provides a portable information terminal that receives a digital television broadcast wave in which a television image and subtitles accompanying the television image are multiplexed, the display, and the received digital television broadcast. Video extraction means for extracting TV video from waves, subtitle extraction means for extracting subtitles from the received digital TV broadcast wave, execution means for executing a predetermined application for displaying images other than TV video, and TV video In the case of displaying on the display, when the application is requested to be executed by the user, the display of the television video is stopped, and the display image and the subtitles by the application executed by the executing means are displayed on the display. Display control means for displaying.

  The portable information terminal according to the present invention has the above-described configuration, so that the user can operate the application widely using the display and can easily view the contents of the TV video by browsing the subtitles related to the TV video. I can grasp it.

1 is an external perspective view of a mobile phone 1 according to an embodiment of the present invention. It is a figure which shows the internal structure of the mobile telephone 1 which concerns on one Embodiment of this invention. It is a flowchart which shows the function execution process which concerns on one Embodiment of this invention. It is a flowchart of the function execution process which concerns on one modification of this invention. It is a flowchart which shows the display change process in the mobile telephone 1 which concerns on one modification of this invention. It is a flowchart which shows a process at the time of adding chase reproduction | regeneration to the function execution process which concerns on the modification of this invention. (A) is a figure which shows an example of the display image in the case of displaying a television broadcast with a caption, (b) and (c) are figures which show an example of the display image in the case of performing an application with a caption. . (A) is a figure which shows the display image in the case of performing an application without a caption, (b) is a figure which shows the display image in the case of performing an application with a caption. (A), (b) is a figure which shows an example of the external appearance and display image of a touchscreen type mobile telephone. It is a figure for demonstrating the change of service ID by a swipe operation (FIG. 10 (a) is before a change, FIG.10 (b) is after a change). It is a figure which shows an example of the screen display in the case of operating a browser application as an application.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
1. Configuration A cellular phone 1 as an example of a portable information terminal is specifically a computer system including a microprocessor, a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. A computer program is stored in the RAM. The cellular phone 1 achieves its functions by the microprocessor operating according to the computer program.

FIG. 1 is an external perspective view of the mobile phone 1.
FIG. 2 is a diagram showing an internal configuration of the mobile phone 1.
As shown in FIG. 1, the mobile phone 1 is configured to include a microphone 11, a receiver 12, a display 13, an input unit 14, an earphone connection unit 15, and a one-segment antenna 16. In this embodiment, an example in which a one-segment broadcasting wave is used as a digital television broadcasting wave will be described, but the present invention is not limited to this. It may be based on other digital television broadcasting specifications such as DVB-H (Digital Video Broadcasting-Handheld) and ATSC-M / H (Advanced Television Systems Committee-Mobile / Handheld).

  In addition, as shown in FIG. 2, the mobile phone 1 has a microphone 11, a receiver 12, a display 13, an input unit 14, an earphone connection unit 15, a one-seg antenna 16, a communication antenna 21, a wireless communication unit 22, as shown in FIG. Signal processing unit 23, one-segment receiving unit 31, television image extraction unit 32, caption extraction unit 33, display control unit 34, application execution unit 35, audio extraction unit 36, audio control unit 37, speaker 38, control unit 41, storage unit 42 and a video storage unit 43.

The microphone 11 collects the voice uttered by the user during a call and converts it into a call signal that is an electrical signal, and transmits the call signal to the signal processing unit 23.
The receiver 12 receives the voice signal generated by the signal processing unit 23, converts the received voice signal into voice, and amplifies the voice so that the user can receive the voice.
The display 13 is a display unit that displays characters, images, and the like, and is a liquid crystal display as an example.

The input unit 14 is an input device for a user to input a user instruction to the mobile phone 1. The input unit 14 includes a keypad, a touch panel, and the like as an example. The user inputs a user instruction by operating a keypad, a touch panel, or the like. The input user instruction is notified to the control unit 41.
The earphone connection unit 15 is an earphone jack to which an earphone, a headphone, or the like is connected. The earphone connection unit 15 detects whether the earphone is connected and notifies the control unit 41 of it.

The one seg antenna 16 is an antenna that receives a one seg broadcast wave.
The communication antenna 21 is an antenna that transmits and receives radio communication waves.
The wireless communication unit 22 performs wireless communication such as communication and data communication with a base station (not shown) constituting the mobile phone network via the communication antenna 21. The radio communication unit 22 demodulates the signal received from the base station to generate a baseband signal and transmits the baseband signal to the signal processing unit 23, and modulates the baseband signal received from the signal processing unit 23 to transmit to the base station To do.

  The signal processing unit 23 restores audio data and communication data from the baseband signal received from the wireless communication unit 22, converts the audio data into an audio signal and outputs the audio signal to the receiver 12, and controls the communication data about the control unit 41 is output. The signal processing unit 23 receives a call signal (voice signal) from the microphone 11 to generate voice data, receives communication data from the control unit 41, generates a baseband signal from these data, and performs wireless communication. To the unit 22.

  The one-segment receiver 31 includes a tuner, an OFDM (Orthogonal Frequency Division Multiplexing) demodulator, an error corrector, a demultiplexer, and the like. ID) one-segment broadcasting wave is received using the one-segment antenna 16. Then, an OFDM signal is extracted from the received one-segment broadcast wave, demodulated, and a digital signal is extracted. Then, an error correction process is performed on the extracted digital signal to generate a TS packet signal, which is separated into TS packets related to television video, captions, and audio. The TS packet related to the TV video is output to the TV video extracting unit 32, the TS packet related to the subtitle is extracted to the subtitle extracting unit 33, and the TS packet related to the audio is output to the audio extracting unit 36.

The TV image extraction unit 32 decodes the TS packet related to the TV image received from the one-segment reception unit 31, generates one-segment TV image data, and outputs it to the display control unit 34.
The caption extraction unit 33 decodes the TS packet related to the caption received from the one-segment reception unit 31 to generate caption data, and outputs the caption data to the display control unit 34.
The video storage unit 43 stores television video data for so-called chasing playback. The video accumulation unit 43 accumulates television video data (hereinafter referred to as “accumulated video data”) for a certain period (for example, 10 minutes) from the newest television video data generated by the television video extraction unit 32. deep. The start and end of accumulation are instructed by the control unit 41. As an example, an instruction to start accumulation is given when execution of an application with subtitles is started, and an instruction to end accumulation is given after execution of an application with subtitles is finished and chasing playback of accumulated video data is performed.

In addition, it is good also as accumulating about a television image | video with a television audio | voice. In this case, it is assumed that both the TV video and the TV audio are played back when chasing playback.
The application execution unit 35 executes an application program (hereinafter simply referred to as an application) stored in the storage unit 42 in accordance with an activation instruction from the control unit 41. It is assumed that the application program is accompanied by displaying an image on the display 13 such as a UI (User Interface) image, a still image, and a moving image at the time of execution. In this embodiment, the application is e-mail software as an example. However, the application is not limited to this, and any application that displays an image on the display 13 such as game software, memo pad software, or browser software may be used. It may be replaced. The application execution unit 35 may execute a plurality of application programs in parallel.

  The display control unit 34 generates a television image from the television image data output from the television image extraction unit 32. In addition, a caption image is generated from the caption data output from the caption extraction unit 33. Here, when generating the caption image, the display control unit 34 generates an image that displays the display color of the specific character string in a color different from the colors of the other character strings in order to alert the user particularly. It is good. For example, when a television video is a video of a soccer broadcast, a character string such as “GOAL” or “goal” may be displayed in yellow as a specific character string, and another character string may be displayed in blue. Thereby, the user can be made to recognize more strongly that there was a goal scene in the soccer game than when there was another scene. A specific character string using a color different from other character strings as a display color is stored in the storage unit 42 as a specific character string list, and the display control unit 34 generates a subtitle image. refer.

  Further, when generating the subtitle image, the display control unit 34 may change the color of the character string for each service ID related to the selected television image. Thereby, the user can know the current service ID by recognizing the color of the subtitles to be displayed. In this case, the correspondence between the service ID and the character color when the subtitle is displayed is determined in advance, and information indicating the correspondence is stored in the storage unit 42 or the like. In addition, the correspondence between the service ID and the character color when displaying the subtitle is not limited to a predetermined one, and the color designation by the user operation is accepted and the service ID and the color associated with the color designation are associated with each other. It is good.

In addition, for the sake of convenience, the stored video image is referred to as a stored TV image for the purpose of distinguishing the TV image from the stored video data stored in the video storage unit 43 from the TV image generated from the TV video data output from the TV video extracting unit 32. .) Is generated.
The display control unit 34 performs layout (arrangement, superposition, etc.) for displaying the generated television image, subtitle image, application image, and stored television image on the display 13. Then, a video signal for displaying the laid out image (display image) is generated and output to the display 13. Here, an example of the display image will be described with reference to the drawings.

7 and 8 are diagrams illustrating examples of display images.
A display image 71 in FIG. 7A is an image displayed when a television broadcast is displayed with captions. In the display image 71, a caption image 73 is disposed at the lower end portion, and a television image 72 including an area for displaying additional information regarding the television program such as a service ID and a program name is disposed in the remaining portion.

  A display image 81 in FIG. 7B is an image displayed when an application is executed with captions. In the display image 81, a caption image 73 representing the content of the television image is arranged at the lower end portion of the display 13, and the application image 82 is arranged in all the remaining portions. The subtitle image 73 displays a character string of about 1 to 2 lines. In this case, by securing an area for displaying the caption on the display 13, the area for displaying the display image by the application is not compressed on the display 13, and the user can use the application. It is possible to avoid a decrease in convenience. Note that the subtitle display position is not limited to the lower end of the display, and may be any place as long as it does not obstruct the application image such as the upper end.

  A display image 85 in FIG. 7C is an image displayed when an application is executed with captions. In the display image 85, a caption image 87 representing the content of the television image is superimposed on the lower end portion of the application image 86. The subtitle image 87 is a telop in which subtitle characters are described in a translucent image. For the user, there is an advantageous effect that the content of the application image 86 under the translucent image can be read, that is, the application image visible to the user is larger than the display image 71.

A display image 91 in FIG. 8A is an image displayed when the application is executed without subtitles. The display image 91 is displayed on the entire surface of the display 13.
A display image 95 in FIG. 8B is an image displayed when an application is executed with captions. The display image 95 includes an icon image indicating the received radio wave intensity of the antenna, a TV service ID (channel number), a program name, and a battery remaining amount at the lower end portion of the application image 96 in addition to the caption indicating the content of the TV image. A state information image 97 indicating various information (hereinafter referred to as state information) such as an image to be displayed is arranged.

In this case, there is an advantage that the contents of the television can be grasped by subtitles and the state information can be confirmed while watching the application image 96.
When an application is executed with captions, the display image 81, the display image 85, and the display image 91 can be selected according to a user instruction input by the user using the input unit 13.

The voice extraction unit 36 decodes the TS packet related to the voice received from the one-segment reception unit 31 to generate voice data, and outputs the voice data to the voice control unit 37.
The voice control unit 37 generates a voice signal from the voice data acquired from the voice extraction unit 36 and outputs the voice signal to the speaker 38. The voice control unit 37 also stores voice data in the storage unit 42 for predetermined voices such as ringtones and startup sounds, converts the voice data into voice signals, and outputs the voice signals to the speaker 38.

The speaker 38 converts the sound signal received from the sound control unit 37 into sound and amplifies the sound.
The control unit 41 performs overall control of the mobile phone 1. The operation of the control unit 41 will be described later.
The storage unit 42 stores application programs, various control information, and the like.

2. Operation The function (TV function, application (mail) function) execution process of the mobile phone 1 configured as described above will be described below.

FIG. 3 is a flowchart showing the function execution process.
The control unit 41 waits for the user to use the input unit 14 to make an execution request for execution of the TV function, execution of the application function with captions, or execution without captions (S11).
If there is an execution request (S11 = YES), it is determined whether the requested function is a television function or an application function (S12). In the case of the television function, it is assumed that the user also specifies a service ID together with the execution request.

If the requested function is a TV function (S12 = TV function), it is determined whether the application function is currently being executed and an application image related to the application is being displayed (S13).
When the application image is being displayed (S13 = YES), the control unit 41 instructs the display control unit 34 to stop displaying the application image (S14).
Then, the one-seg receiving unit 31 is instructed to receive the one-seg broadcast wave together with the notification of the service ID designated by the user (S15). The one-seg receiving unit 31 receives the one-seg broadcast (S15), performs OFDM demodulation, error correction, and demultiplexing, and extracts a TS packet related to the television image with the specified service ID. Then, the one-segment receiving unit 31 outputs a TS packet related to the television image to the television image extracting unit 32. The TV image extracting unit 32 generates TV image data from the TS packet received from the one-segment receiving unit 31, and outputs the TV image data to the display control unit 34 (S16).

  In addition, the control unit 41 determines whether or not captions are currently being extracted (S17). If captions are not being extracted (S17 = NO), the control unit 41 instructs the one-seg receiving unit 31 to extract captions. The one-seg receiving unit 31 extracts a TS packet related to the caption and outputs the TS packet to the caption extraction unit 33. The caption extraction unit 33 generates caption data from the TS packet received from the one-segment reception unit 31 and outputs it to the display control unit 34 (S18).

The display control unit 34 generates a display image from the television video data and the caption data, and outputs a signal indicating the display image to the display 13. The display 13 displays a display image (S19). At this time, the display image 71 of FIG.
Further, the one-segment receiving unit 31 extracts a TS packet related to the voice of the designated service ID. Then, the one-segment receiving unit 31 outputs the TS packet related to the audio to the audio extracting unit 36. The voice extraction unit 36 decodes the TS packet related to the voice received from the one-segment reception unit 31 to generate voice data, and outputs the voice data to the voice control unit 37. The voice control unit 37 generates a voice signal from the voice data acquired from the voice extraction unit 36 and outputs the voice signal to the speaker 38. (S20).

In the present embodiment, when the television function is executed, subtitles are also displayed. However, the present invention is not limited to this, and whether to display subtitles may be selected by a user operation.
In S12, when the execution-instructed function is an application function (S12 = application function), the control unit 41 determines whether or not the execution instruction is an instruction to execute the application with captions (S30).

  When the execution of the application with subtitles is instructed (S30 = YES), the control unit 41 determines whether or not the television function is currently being executed (S31). If the TV function is being executed, the TV image extraction unit 32 is instructed to stop the extraction and display of the TV image (S32), and the audio extraction unit 36 is instructed to stop the extraction and output of the TV sound ( S33). Furthermore, it is determined whether or not captions are extracted for caption display (S34). If captions are not being extracted (S34 = NO), a caption extraction instruction is issued to the one-segment receiving unit 31. The one-segment receiving unit 31 instructed to extract the caption extracts the TS packet related to the caption and outputs the TS packet to the caption extraction unit 33. The caption extraction unit 33 generates caption data from the TS packet received from the one-segment reception unit 31 and outputs it to the display control unit 34 (S35).

Next, the control unit 41 instructs the application execution unit 35 to execute the application program. The application execution unit 35 reads the application program instructed to be executed from the storage unit 42 and executes it (S36).
At this time, the application execution unit 35 generates an application image representing a UI image, a still image, a moving image, and the like to be displayed when the application program is executed, and outputs application image data representing the application image to the display control unit 34 ( S37).

  The display control unit 34 generates a display image in which the caption image and the application image are laid out from the received caption image data and the application image data, and outputs a video signal indicating the display image to the display 13. The display 13 displays a display image based on the received video signal. At this time, an image such as one of the display images 81, 85, and 95 already described is displayed on the display 13 as a display image.

If it is determined in S30 that the application function is not executed with captions (S30 = NO), when the TV function is being executed (S51 = YES), the control unit 41 executes the TV function execution. Is instructed to the one-segment receiver 31. The one-seg receiving unit 31 stops the one-seg reception and stops the execution of the television function (S52).
Then, the control unit 41 instructs the application execution unit 35 to execute the application program. The application execution unit 35 reads and executes the application program from the storage unit 42 (S53).

At this time, the application execution unit 35 outputs application image data related to an application image representing a UI image, a still image, a moving image, and the like to be displayed when the application program is executed to the display control unit 34.
The display control unit 34 generates a display image in which only the application image is laid out from the received application image data, and outputs a video signal indicating the display image to the display 13. The display 13 displays a display image based on the video signal (S54). At this time, as the display image, for example, an image like the display image 91 described above is displayed.
3. Modification (1) In the above-described embodiment, the application is executed with captions when there is an execution instruction with captions of the application (S30 = YES). However, the present invention is not limited to this. For example, it may be determined whether or not to execute the application with subtitles according to conditions such as whether an earphone is inserted or whether the manner mode is set.

  As a result, even when there is no instruction from the user to execute the app with subtitles, the user can execute the app with subtitles when it is assumed that the user wants to watch the subtitles of the TV video while executing the app. This can improve user convenience. The manner mode is a mode generally provided in a mobile phone, and is a mode in which the incoming call tone is turned off and an incoming call is notified by vibration by a vibrator.

FIG. 4 is a flowchart of the function execution process according to this modification.
The flow when the execution-instructed function in FIG. 4 is a television function (S11 to S20) is the same as that in FIG.
Hereinafter, a case where the function execution instruction is an application function (S12 = application function) will be described.

  In this case, the control unit 41 determines whether the earphone connection is detected by the earphone connection unit 15 (S61). If the earphone connection is not detected by the earphone connection unit 15 (S61 = NO), Further, it is determined whether or not the cellular phone 1 is in the manner mode (S62). When the manner mode is set (S62 = YES), the process of executing the application with captions is performed, and the process proceeds to S63.

On the other hand, when the connection to the earphone is detected (S61 = YES) or the manner mode is selected (S62 = NO), the process proceeds to S71 in order to execute the application without subtitles.
In the execution with subtitles of the application after S63, the control unit 41 determines whether or not the TV function is currently being executed (S63), and if it is being executed (S63 = YES), the extraction / display of the TV video is stopped. (S64) The TV sound extraction / output is stopped (S65). Then, it is determined whether or not caption extraction is in progress (S66). If caption extraction is not performed (S66 = NO), caption extraction processing is performed (S67). If caption extraction is in progress (S66 = YES), caption extraction is performed. continue.

Next, the control unit 41 instructs the application execution unit 35 to execute the application program. The application execution unit 35 reads and executes the application program from the storage unit 42 (S68).
At this time, the application execution unit 35 outputs application image data related to the application image to be displayed when the application program is executed to the display control unit 34.

The display control unit 34 generates a display image in which the caption image and the application image are laid out from the received caption image data and the application image data, and outputs a video signal indicating the display image to the display 13. The display 13 displays a display image (S69).
In the execution without subtitles of the application after S71, the control unit 41 determines whether or not the TV function is currently being executed (S71), and when it is being executed (S71 = YES), the extraction / display of the TV video is stopped. (S72). Then, it is determined whether or not subtitles are currently being extracted (S74). When subtitles are being extracted (S74 = YES), subtitle extraction processing is stopped (S75), and subtitles are not being extracted (S74 = NO). Subtitle extraction is not performed as it is.

  Next, the control unit 41 instructs the application execution unit 35 to execute the application program. The application execution unit 35 reads the application program from the storage unit 42 and executes it (S76). Then, the display control unit 34 generates a display image from the received application image data, and outputs a video signal indicating the display image to the display 13. The display 13 displays a display image (S77).

If it is determined in S71 that it has not been executed (S71 = NO), the extraction and output of the TV sound is started (S73), and the process proceeds to S76.
FIG. 5 is a flowchart showing a process for changing the display (display change process) when the user changes the connection state of the earphone or the manner mode in the mobile phone 1.

When the control unit 41 receives a notification from the earphone connection unit 15 that there is a change in the earphone connection state, or when the managed manner mode is changed (S91), the earphone connection is connected. It is determined whether it is in the state (S92) or the manner mode (S93).
If at least one of the earphone connection is in the connected state (S92 = YES) or not the manner mode (S93 = NO), the control unit 41 proceeds to S101 in order to display only the application display screen. If the earphone connection is not in the connected state (S92 = NO) and the manner mode is set (S93 = YES), the process proceeds to S94 in order to simultaneously display the application display screen and the caption.

  In S94, the control unit 41 determines whether or not the TV sound is being extracted / outputted (S94). If the TV sound is being extracted / outputted (S94 = YES), the TV sound is extracted / outputted. Cancel (S95). Then, it is determined whether subtitles are extracted for subtitle display (S96). When subtitles are not being extracted (S96 = NO), a subtitle extraction instruction is issued to the one-segment receiving unit 31. The one-segment receiving unit 31 instructed to extract the caption extracts the TS packet related to the caption and outputs the TS packet to the caption extraction unit 33. The caption extraction unit 33 generates caption data from the TS packet received from the one-segment reception unit 31 and outputs it to the display control unit 34 (S97). The display control unit 34 causes the display 13 to display a display image that simultaneously displays the application image and the caption (S98), and proceeds to S91.

  In S101, the control unit 41 determines whether or not the TV sound is being extracted / outputted (S101). If the TV sound is not being extracted / outputted (S101 = NO), the TV sound is extracted / output. Start (S102). Then, it is determined whether subtitles are extracted for subtitle display (S103). When subtitles are being extracted (S103 = YES), the subtitle extraction unit 33 is instructed to stop subtitle extraction. The subtitle extraction is stopped (S104).

The display control unit 34 generates a display image from only the application image and displays it on the display 13 (S105), and proceeds to S91.
(2) In addition to the function execution processing described with reference to FIG. 3, when the application is executed with captions, the video storage unit 43 may store a television video for a predetermined time as background processing. . The content of the TV video stored in the video storage unit 43 has been confirmed by the user by watching the caption while the application function is being executed.

  Then, when the application is changed from being executed with subtitles to being changed to a state in which the TV function is executed, the stored TV image is chased and reproduced prior to the execution of the TV function. When all the unviewed TV video data stored in the video storage unit 43 has been played back and disappeared, the background storage ends when chasing playback catches up with real-time viewing (viewing the TV video currently being broadcast in 1Seg). And continue real-time viewing.

FIG. 6 is obtained by adding a TV video storage process and a chasing playback process to FIG.
Below, it demonstrates centering around the changed part from FIG.
Specifically, when the function instructed to be executed by the user is an application function (S12 = application function) and the television function is executed before switching to the application function (S31 = YES), Background accumulation is started (S111). Here, background accumulation means that a one-seg broadcast wave is received by the one-seg receiving unit 31 without displaying a television image on the display 13 and the accumulated video data extracted from the one-seg broadcast wave is stored in the video accumulation unit 43. It is. In addition to TV video data accumulation, TV audio data may also be accumulated in the background. In this case, in step S33, the output of the television sound is stopped, but the extraction of the television sound is continued.

  Further, when the function instructed to be executed by the user is a TV function (S12 = TV function) and the application image is being displayed (S13 = YES), the control unit 41 executes the application function with captions. It is determined whether or not (S112). If it is execution with subtitles (S112 = YES), the execution of the application is stopped (S14), and chasing playback of the stored TV video (if TV audio is also stored in the background, audio may also be played back. ) (S113), the background accumulation ends (S114), and the process proceeds to S15.

If there is no execution with subtitles (S112 = NO), the execution of the application is stopped (S14), and the process proceeds to S15.
As described above, the user can view a TV image for a predetermined time before starting the execution of the TV function for the TV program whose contents have been confirmed by watching the caption during the execution of the application function. it can. In particular, when watching subtitles and recognizing that there is a scene you want to watch about TV video, if you stop the app function and instruct the execution of the TV function, watch the scene by chasing playback. Can do. Thereby, the convenience for a user can be improved.

(3) In the above-described embodiment, the example has been described in which the user gives an instruction to the mobile phone using an input device such as a keypad, but the present invention is not limited to this. For example, a touch panel type mobile phone or the like may be used.
FIG. 9A is a diagram illustrating an example of the appearance of a touch-sensitive mobile phone.
A display image 101 is displayed on the touch panel display. A display image 101 is an image displayed when an application is executed with subtitles. In the display image 101, a software keyboard 102 is displayed at the lower end portion of the application image 96. The user inputs characters and gives instructions to the mobile phone using the software keyboard 102. A state information image 97 is arranged under the software keyboard 102.

  Further, the display image 102 in FIG. 9B is different from the display image 101 in the arrangement of the images. A state information image 97 is arranged at the upper end of the display image 102, an application image 96 is arranged thereunder, and a software keyboard 102 is arranged at the lower end portion of the application image 96. When the user designates the arrangement position of the software keyboard 102, the software keyboard can be arranged at a desired position on the display where input is easy.

  Further, as shown in FIG. 10A, the user touches and slides the portion of the status information image 97 in which the TV service ID (“8ch” in the figure) is displayed (figure 10). The service ID can be changed by performing a so-called swipe operation. As a result of the swipe operation, the service ID is changed to “10ch” and the subtitle of “10ch” is displayed as in the state display image 112 in the display image 111 of FIG.

(4) In the above-described embodiment, the image displayed by the mail application is described as an example of the application image. FIG. 11 is an image showing an example using a browser application as an example of an application.
In the display image 121 of FIG. 11, an application image 122 by a browser application is arranged. A software keyboard 102 is arranged at the lower end of the application image 122. Near the center of the application image 122, an input window for a search target word and a button for instructing start of search are displayed. The user instructs to start inputting the search term by touching the input window. Then, a search term is input using the software keyboard 102. By touching a button for instructing start of search after inputting the search term, the search term is searched, and the search result is displayed.

  (5) FIG. 7B shows an example of a display image when a mail is created while displaying a subtitle with a service ID of 8ch. In this way, when a user creates an email while checking the contents of a TV program using subtitles, the email sent after completion of the email includes the viewing of the television program that the sender of the email has checked. It is also possible to include a link, an activation command, etc. that can be easily started by the recipient. The recipient of this e-mail receives the e-mail using his / her mobile phone and displays it on the screen for viewing, and displays an image indicating the link included in the displayed e-mail and an image indicating the start of execution of the start command on the keypad, Specify using an input device such as a touch panel. As a result, the mobile phone of the mail recipient starts receiving the television program whose content has been checked by the mail sender and displays it on the screen. With this configuration, it is possible to start viewing a television program whose contents have been checked by the mail sender in a simple procedure on the mobile phone of the mail receiver.

  (6) A cellular phone processor that performs processing for controlling the state transition shown in the embodiment, state determination processing at start-up, and the like, and a program code in a machine language or high-level language that is executed by various circuits connected to the processor It is also possible to record a control program consisting of the above in a recording medium, or to distribute and distribute it via various communication paths. Such a recording medium includes an IC card, a hard disk, an optical disk, a flexible disk, a ROM, a flash memory, and the like. The distributed and distributed control program is used by being stored in a memory or the like that can be read by the processor, and the processor executes the control program to realize each function as shown in each embodiment. Will come to be. In addition to directly executing the control program, the processor may be compiled and executed or executed by an interpreter.

  (7) Each functional component shown in the above embodiment may be realized as a circuit that executes the function, or may be realized by executing a program by one or a plurality of processors. Moreover, it is good also as what is comprised as a package of IC, LSI, and other integrated circuits. This package is incorporated into various devices for use, whereby the various devices realize the functions as shown in the embodiments.

(8) Although the above embodiment has been described with an example of a mobile phone, the present invention can also be realized as a portable information terminal having the same configuration and function.
(9) The above-described embodiments and modifications may be partially combined.

  The portable information terminal of the present invention is suitable for a portable information terminal provided with a digital television broadcast receiving function in addition to an execution function of an application such as mail and WEB.

DESCRIPTION OF SYMBOLS 1 Cellular phone 11 Microphone 12 Receiver 13 Display 14 Input part 15 Earphone connection part 16 One segment antenna 21 Communication antenna 31 One segment reception part 32 Television image extraction part 33 Subtitle extraction part 34 Display control part 35 Application execution part 36 Voice extraction part 37 Voice control Unit 38 speaker 41 control unit 42 storage unit 43 video storage unit

Claims (12)

A portable information terminal that receives a digital television broadcast wave in which a television image and subtitles accompanying the television image are multiplexed,
Display,
Video extraction means for extracting TV video from the received digital TV broadcast wave;
Subtitle extraction means for extracting subtitles from the received digital television broadcast wave;
Execution means for executing a predetermined application for displaying an image other than a television image;
When a television image is displayed on the display, when the application is requested to be executed by the user, the display of the television image is stopped, and the display image and the subtitles by the application executed by the execution unit are displayed. A portable information terminal comprising: display control means for displaying on the display. 2. The display control unit according to claim 1, wherein when the display image and the subtitles displayed by the application are displayed on the display, the subtitles are superimposed on the display image displayed by the application. Mobile information terminal. When the display image displayed by the application and the subtitle are displayed on the display, the display control unit divides a display area on the display, displays the display image based on the application on one side, and displays the subtitle on the other side. The portable information terminal according to claim 1, wherein: The portable information terminal further includes:
A detecting means for detecting whether or not the earphone is connected;
When the application is requested to execute the application, the display control unit stops the display of the television image, and when the detection unit detects the connection of the earphone, the display control unit suppresses the display of the caption. A display image associated with the execution of the application is displayed on the display, and when the detection unit does not detect the connection of the earphone, the display image associated with the execution of the application and the subtitle are displayed on the display. The portable information terminal according to claim 1. The portable information terminal has a manner mode,
When the application is requested to execute the application, the display control unit stops the display of the television image, and when the portable information terminal is not in the manner mode, the display control unit suppresses the display of the subtitle and executes the application. A display image associated with the application is displayed on the display, and when the portable information terminal is in the manner mode, a display image associated with execution of the application and the subtitle are displayed on the display. 1. A portable information terminal according to 1. The display control means holds a specific character string, and when the subtitle is displayed on the display and the subtitle includes the specific character string, the specific character string is changed to another The portable information terminal according to claim 1, wherein the portable information terminal is displayed in a color different from that of the character string. The display control means includes
It holds information indicating the correspondence between the predetermined service ID and character color,
The portable information terminal according to claim 1, wherein when the subtitle is displayed on a display, the subtitle is displayed in a character color corresponding to a service ID related to the selected television image. The portable information terminal further includes:
A storage means for storing television images for a predetermined time in order from the latest reception time,
When the display control means receives a request for restarting the display of the canceled TV image from a user, the display control means displays the stored TV image prior to restarting, and then restarts the display of the TV image. The portable information terminal according to claim 1. The portable information terminal according to claim 1, wherein the digital television broadcast wave is a one-segment broadcast wave. The mobile information terminal according to claim 1, wherein the mobile information terminal is a mobile phone. A display control method used for a portable information terminal that includes a display and receives a digital television broadcast wave in which a television image and subtitles accompanying the television image are multiplexed,
A video extraction step of extracting TV video from the received digital TV broadcast wave;
A subtitle extraction step of extracting subtitles from the received digital television broadcast wave;
An execution step of executing a predetermined application that is independent of the display of the TV image and performs image display;
When a TV image is displayed on a display, when the application is requested to be executed by a user, the display of the TV image is stopped, the application is executed, and the display image and the subtitles are displayed by the application. A display control method comprising: a display control step for displaying on a display. A display control program for use in a portable information terminal that includes a display and receives a digital television broadcast wave in which a television image and subtitles accompanying the television image are multiplexed,
A video extraction step of extracting TV video from the received digital TV broadcast wave;
A subtitle extraction step of extracting subtitles from the received digital television broadcast wave;
An execution step of executing a predetermined application that is independent of the display of the TV image and performs image display;
When a TV image is displayed on a display, when the application is requested to be executed by a user, the display of the TV image is stopped, the application is executed, and the display image and the subtitles are displayed by the application. A display control program for causing a computer to execute a display control step for displaying on a display.

Images