JP6680579B2 - Information support system for the show - Google Patents

Description

  The present invention relates to a system for providing information support in a show or the like.

  At a show held at a theme park or stage, the audience may not understand the dialogue of the performer. For example, the audience may be deaf and unable to hear the dialogue itself, or the dialogue may be heard but not understood because the dialogue is not in the audience's native language.

  In order to deal with such a problem, a system has been proposed in which subtitles are displayed on a display device installed in the seat of a spectator (Patent Document 1). In this system, the caption information transmitting device transmits the dialogue as character information to the display device of each seat for display.

  According to this system, a dialogue can be displayed in text information to a deaf audience, and a dialogue can be displayed in translated text information to a foreign audience.

JP, 2007-61412, A

  However, in the above-mentioned conventional technique, it is necessary to provide a subtitle information transmitting device and to provide each display device with a receiving device for receiving the subtitle character information. Further, it is necessary for the operator to operate the timing of transmitting the dialogue so that the display timing of the dialogue characters coincides with the progress of the show.

  Further, such a problem occurs not only when displaying the character information of the dialogue, but also when displaying the auxiliary character information associated with the progress of the show.

  It is an object of the present invention to solve the above problems and provide an information support system for a show that does not require a device for transmitting character information.

  Some independently applicable features of the invention are listed.

(1) (2) (3) The information support system according to the present invention is an identifier transmitting device that is installed in a predetermined area and has an identifier, a signal output device that outputs a signal to a speaker installed in the area, and a user. In the information support system including a mobile terminal device, the signal output device includes a start sound signal associated with the start of a show provided in the area and a sound signal according to the progress of the show. Is configured to output a signal including at least to the speaker,
The portable terminal device records the support information in association with the identifier of the identifier transmitting device, the assistance information including character text corresponding to the voice according to the progress of the show provided in the area where the identifier transmitting device is installed. Part and the strength of the signal received from the nearby identifier transmitting device, the user having the portable terminal device specifies in which area the identifier transmitting device installed is near, and the identifier transmitting device. Area specifying means for acquiring the identifier of the above, a start sound detecting means for detecting whether or not the ambient sound acquired by the microphone includes the start sound output from the speaker installed in the area, and the start sound detecting means. When the start sound is detected by the character string stored in the recording unit in association with the acquired identifier of the identifier transmission device. Assistance information including the door and a display control means for displaying on the display.

  Therefore, the support information can be displayed according to the progress of the show in each area.

(4) In the information support system according to the present invention, the start sound is a low-frequency sound having a predetermined frequency, and the start-sound detecting means includes the ambient sound acquired by the microphone, and the low-frequency sound having the predetermined frequency is equal to or higher than a predetermined level. The feature is that whether or not the start sound is included is determined depending on whether or not the start sound is included.

  Since the low frequency sound with no directivity is used as the starting sound, the sound reaches the area evenly.

(5) In the information support system according to the present invention, the low-frequency sound is a combination of low-frequency sounds of a plurality of frequencies, and the start sound detection means adds the plurality of predetermined sounds to the ambient sound acquired by the microphone. It is characterized in that whether or not the start sound is included is determined depending on whether or not all low-frequency sounds of frequencies are included above a predetermined level.

  Therefore, erroneous detection of the start sound can be prevented.

(6) The information support system according to the present invention, the support information, in association with the character text corresponding to the voice of the performer, includes information for identifying the speaker, the display control means, in the character text. Correspondingly, information for identifying a speaker is displayed, or a portrait icon or a photo icon of a character played by a performer identified based on the information is displayed.

  Therefore, it is possible to easily know which performer's character the dialogue is.

(7) In the information support system according to the present invention, the support information includes character text corresponding to the voice of the performer and character text for explaining the scene, and the display control means corresponds to the voice of the performer. The character text to be displayed is displayed as a speech bubble, and the character text for explaining the scene is displayed without being a speech bubble.

  Therefore, the explanation of the scene and the dialogue can be clearly distinguished.

(8) In the information support system according to the present invention, the display control means displays, together with the performer of the show imaged by the imaging unit, the text corresponding to the performer's voice in association with the performer. It has a feature.

  Therefore, the dialogue can be displayed over the image of the actual show.

(9) In the information support system according to the present invention, the area identification means, when acquiring the identifier from the identifier transmission device, copies the support information recorded in the recording unit in association with the identifier onto the volatile high-speed memory. The display control means performs display based on the support information copied on the volatile high-speed memory.

  Therefore, the display can be performed quickly when the show starts.

(10) (11) A mobile terminal device according to the present invention is a mobile terminal device for providing information support to a user who watches a show provided in a predetermined area, and the progress of the show provided in the area. A recording unit for recording support information including character text corresponding to the voice according to the above, and a start detecting whether the ambient sound acquired by the microphone includes the start sound output from the speaker installed in the area. The sound detection means and the display control means for displaying the support information including the character text on the display when the start sound is detected by the start sound detection means.

  Therefore, the support information can be displayed as the show progresses.

(12) (13) The mobile terminal device according to the present invention is a mobile terminal device for providing information support to a user who watches a show provided in a predetermined area, and is associated with the identifier of the identifier transmitting device. A recording unit for recording support information including character text corresponding to the voice according to the progress of the show provided in the area where the identifier transmitting device is installed, and a volatile high-speed functioning as a work area for processing. Based on the strength of the signal received from the memory and the identifier transmitting device in the vicinity, the user having the mobile terminal device specifies in which area the identifier transmitting device installed is near, and the identifier transmitting device. Area identification means for acquiring the identifier of the above, and copying the support information recorded in the recording unit in association with the identifier on the volatile high-speed memory; And a display control means for displaying the help information replicated to the memory on the display.

  Therefore, the display can be performed quickly when the show starts.

  In the present invention, the “show” refers to something that is presented to the audience with dialogue, such as a stage, a movie, or a musical.

  The “mobile terminal device” includes a smartphone, a mobile information terminal, a mobile phone, a tablet, and the like.

  In the embodiment, the "area specifying means" corresponds to step S2.

  In the embodiment, the "start sound detecting means" corresponds to steps S12 and S13.

  In the embodiment, the "display control means" corresponds to step S14.

  The “program” is a concept including not only a program directly executable by the CPU but also a source format program, a compressed program, an encrypted program, and the like.

It is a functional block diagram of the information support system by one embodiment of this invention. It is a system configuration diagram of an information support system. It is an arrangement example of the access point 2 and the speaker 6 in the area where the show is performed. It is an example of arrangement of access points when applied to a theme park. This is an example of the reproduction circuit 46 and the speaker 6. 3 is a hardware configuration of the mobile terminal device 10. It is a flowchart of a mobile terminal program. It is a flowchart of a mobile terminal program. It is an example of an SSID table. It is a display example of dialogue. It is a display example of dialogue. It is a display example of dialogue.

1. System Configuration FIG. 1 shows a functional block diagram of an information support system for a show according to an embodiment of the present invention. An identifier transmitting device 2, a signal output device 4, and a speaker 6 are provided in the area where the show is held. The identifier transmitting device 2 transmits its own ID. In this embodiment, the identifier transmitting device 2 having an ID different for each area is provided.

  The signal output device 4 gives a sound signal such as dialogue and music to the speaker 6 as the show progresses. Upon receipt of this sound signal, the speaker 6 outputs speech and music as a sound.

  In this embodiment, the dialogue of the performers of the show is not given by the performers but given to the audience by the sound from the speaker 6. Therefore, the signal output device 4 is preliminarily recorded with sound signals such as dialogue and music according to the progress of the show.

  The signal output device 4 gives the above-mentioned sound signal to the speaker 6 at the start of the show. In this embodiment, a start signal is inserted at the beginning of this sound signal.

  A user who is an audience carries the mobile terminal device 10. In the recording unit 22 of the mobile terminal device 10, support information in which text of a show or the like performed in each area is used as character information is recorded.

  The area specifying means 12 of the mobile terminal device 10 receives the ID from the identifier transmitting device 2 and specifies in which area it is.

  Along with the start of the show, the speaker 6 outputs a start sound based on the start signal. The start sound detecting means 16 of the mobile terminal device 10 determines whether the ambient sound acquired by the microphone 14 includes this start sound. The display control device 20 of the mobile terminal device 10 selects the support information 24 corresponding to the area specified by the area specifying means 12 from the support information 24 recorded in the recording unit 22. Further, when the start sound is detected, the selected support information 24 is read and displayed on the display 18.

  Therefore, support information such as dialogue is displayed as character text on the mobile terminal device 10 of the user in accordance with the progress of the show.

  FIG. 2 shows a system configuration when an information support system for a show is realized in a theme park. Areas A1 to An for performing shows are provided in the theme park. As shown in FIG. 3, a stage 51 and an audience seat (audience area) 49 are provided in each of the show areas A1 to An. Further, each of the areas A1 to An is provided with a wireless access point 2 which is an identifier transmitting device, an audio device 4 which is a signal output device, and a speaker 6 connected to the audio device 4. Areas A1 to A6 for performing shows are scattered in a theme park, for example, as shown in FIG.

  The wireless access point 2 is a device for relaying a smartphone owned by a user to the Internet. The wireless access point 2 has an identifier called SSID, receives an inquiry from a terminal device such as a smartphone, and returns the SSID. This SSID is different for each wireless access point. Also, the range of the radio waves from the wireless access point is narrow (about 100 m). Therefore, the terminal device can know which area A1 to A6 is near the access point 2 by receiving this SSID.

  In this embodiment, an identifier transmitting device that transmits an identifier (SSID) to the mobile terminal device 10 is used by using the above-described function of the access point 2 for connecting a terminal device such as a smartphone to the Internet.

  FIG. 5 shows the configuration of the acoustic device 4. In the recording section 42, show data such as music and dialogue used in a show in the area is given to the speaker 6. In the show, the performer does not speak the dialogue, the dialogue included in the show data is output from the speaker 6, and the performer responds to the dialogue. That is, the progress of the show will be performed based on the show data.

  FIG. 6 shows the hardware configuration of the mobile terminal device 10. In this embodiment, the tablet computer is the mobile terminal device 10. A memory 62, a touch screen display 64, a non-volatile memory 66, a wireless LAN circuit 68, a microphone 70, and a camera 72 are connected to the CPU 60.

  The memory 62 is composed of a high-speed but volatile semiconductor memory or the like, and functions as a work area of the CPU 60. The touch screen display 64 is for displaying and accepting an input by a user operation. The wireless LAN circuit 68 is a circuit for communicating with the access point 2.

  An operating system 74, a mobile terminal program 76, and support information 78 are recorded in the non-volatile memory 66. The mobile terminal program 76 cooperates with the operating system 74 to exert its function. These programs are downloaded from the server device via the wireless LAN circuit 68, for example.

Support information 78 is also recorded in the non-volatile memory 66. The support information 78 is data to be displayed on the touch screen display 64 in correspondence with the show data sent during the show in each of the areas A1 to A6. In this embodiment, the support information of all areas A1 to A6 is downloaded from a server device or the like and recorded in advance.

2. Support Information Providing Processing FIGS. 7 and 8 show flowcharts of the support information providing processing by the mobile terminal program 76. When the mobile terminal program 76 of the mobile terminal device 10 owned by the user is activated, the CPU 60 of the mobile terminal device 10 (hereinafter, sometimes abbreviated as the mobile terminal device 10) causes the SSID stored in the non-volatile memory 66 to be stored. Is read (step S1). FIG. 9 shows an example of the SSID list. The SSID is recorded in association with each of the access points 2 provided in the areas A1 to A6 of each show shown in FIG. Further, the file name of the support information file of the show executed at the access point and the show start time are also recorded.

  Next, the mobile terminal device 10 acquires the signal from the access point received by the wireless LAN circuit 68 and analyzes the SSID. The signals from the access points 2 in the areas 1 to A6 are attenuated according to the distance, so that only the signals from the access points in the vicinity of the mobile terminal device 10 are received.

  Further, it is determined whether the received SSID is a predetermined SSID registered in the above SSID list (step S2). This is because some access points are installed in the theme park regardless of the information provided for the show.

  If the received SSID is not the predetermined SSID, signal reception and SSID confirmation processing are repeated. Upon receiving the predetermined SSID recorded in the list, the mobile terminal device 10 determines whether the intensity of the radio wave exceeds a threshold value (step S3). As described above, the radio field intensity is attenuated according to the distance from the access point. Therefore, by checking whether or not the radio field intensity is equal to or higher than a predetermined value, it is confirmed whether or not the mobile terminal device 10 (that is, the user who has the mobile terminal device 10) has entered the show area (whether or not the mobile terminal device 10 has approached a predetermined distance). be able to. The radio field intensity can be acquired from the wireless LAN circuit 68.

  When the radio wave intensity does not exceed the predetermined value, the mobile terminal device 10 returns to step S2 and receives the radio wave and confirms the SSID. When the radio field intensity exceeds the predetermined value, the SSID list of FIG. 9 is referred to, the support information file name of the access point (area) corresponding to the received SSID is specified, and the non-volatile memory 66 is searched (step S5). ). Here, in the support information file, the lines and scene explanations of the performers are recorded so as to match the progress of the show.

  When the mobile terminal device 10 finds the support information file, it reads it from the non-volatile memory 66 and expands it in the memory 62, which is a work area (step S7). If the support information file is not found even after the lapse of a predetermined time due to the file being damaged (step S10), the server device is accessed through the access point and the support file is downloaded again. Then, it returns to step S1 and repeats processing.

  When the support information file is loaded in the memory 62, the mobile terminal device 10 acquires the start time of the closest show ahead of the current time from the SSID list (step S8). For example, when the SSID is “32149373” and the current time is 12:00, the start time 2 of 13:30 is acquired.

  The mobile terminal device 10 determines whether or not the current time is less than 5 minutes before the start time (step S9). Five minutes ago, the mobile terminal device 10 acquires ambient sound with the microphone 70. In this embodiment, the start sound includes the synthesized sound of the first low frequency sound (100 Hz in this embodiment) and the second low frequency sound (50 Hz in this embodiment) at the beginning of the show data 44. (See Figure 5).

  Therefore, the speaker 6 arranged in the area of the show outputs a sound obtained by combining the first low-frequency sound and the second low-frequency sound a predetermined time before the start of the show (three minutes before in the present embodiment). become. Since these low-frequency sounds have frequencies with no directivity (less), they reach the area almost uniformly regardless of the direction and arrangement of the speakers. Further, the apparatus of FIG. 5 is an apparatus originally necessary for the show, and since only some changes are made to the show data, the existing equipment for the show can be used as it is.

  The mobile terminal device 10 determines whether the acquired ambient sound contains the first low frequency component (100 Hz in this embodiment) at a level equal to or higher than a predetermined value (step S12). This judgment can be realized by analyzing the binarized data of the acquired ambient sound with a bandpass filter program.

  If the first low frequency component equal to or higher than the predetermined value is not included, the process returns to step S11 and the acquisition of the ambient sound is repeated. If the first low frequency component equal to or higher than the predetermined value is included, the mobile terminal device 10 includes the second low frequency component (50 Hz in this embodiment) in the acquired ambient sound at a level equal to or higher than the predetermined value. It is determined whether or not (step S13).

  If the second low frequency component equal to or higher than the predetermined value is not included, the process returns to step S11 and the acquisition of the ambient sound is repeated. When it is determined in step S13 that the second low frequency component equal to or more than the predetermined value is included, the speaker 6 in the area emits a start sound that is a synthesized sound of the first low frequency sound and the second low frequency sound. Therefore, it can be determined that it is a predetermined time before the start of the show (3 minutes before in this embodiment).

  The mobile terminal device 10 detects the start sound, reproduces the support information file expanded in the memory 62, and displays it on the touch screen display 64 (step S14).

  FIG. 10 shows a display example of the touch screen display 64. A balloon 100 shows a portrait 100 of a character dressed as a performer and the text of the performer's dialogue. Therefore, even a deaf user can know the dialogue. The character name is displayed below the portrait 100. In the example of FIG. 10, the portraits of the same character are displayed on the same side (left side or right side) so that they can be easily identified.

  The mobile terminal device 10 sequentially displays the support information on the touch screen display 64 according to the support information file. It should be noted that when the screen cannot be displayed at all, it is displayed by scrolling upward. Moreover, since the support information is generated so as to match the progress of the show, it is possible to obtain the dialogue of each performer accompanying the progress of the show.

  Further, as shown in FIG. 11, the points to be noted on the stage other than the dialogue, the explanation 108, and the like can be included in the support information. In this embodiment, the points of interest and the explanation 108 are displayed in a format other than a balloon.

  When the end of the support information file is displayed, the mobile terminal device 10 deletes the support file expanded in the memory 62 from the memory 62 (step S17). When the stop button 106 is pressed during the display of the support information file, the mobile terminal device 10 stops the display of the support information file (step S15).

As described above, the support information is displayed on the mobile terminal device 10 at the user's hand as the show progresses.

3. Other
(1) In the above embodiment, a low-frequency synthesized sound of two frequencies is used as the start sound. However, a low frequency of a single frequency may be used as the starting sound. Alternatively, low-frequency synthetic sounds of three or more frequencies may be used.

(2) In the above embodiment, the low frequency is used as the starting sound. However, sounds of other frequencies may be used. For example, ultrasonic waves can be used.

(3) In the above embodiment, an access point is used as the identifier transmitting device. However, a device that transmits an identifier such as a beacon may be used.

(4) In the above embodiment, when the start sound is not captured, the support information for the show is not displayed. However, in response to the time during the show (for example, 3 minutes after the start of the show), the show data 44 is set to have a different start sound (a frequency different from the original start sound. For example, 40 Hz and 110 Hz). May be included. When the mobile terminal device 10 receives the other start sound, the display starts on the touch screen display 64 from the support information corresponding to the time during the show.

  By doing so, even when the original start sound cannot be captured, it is possible to display the support information that matches the progress of the show.

(5) In the above embodiment, the theme park show was described. However, it can be applied to general shows in which the dialogue of the performers progresses on time, such as a movie in a movie theater.

(6) In the above embodiment, the portrait is displayed in FIGS. 10 and 11. However, you may make it display a photograph.

(7) In the above embodiment, the dialogue is displayed in the balloon from the portrait. However, as shown in FIG. 12, the performer imaged by the user with the camera 72 of the mobile terminal device 10 is displayed on the touch screen display 64 (see 110 in the figure), and the dialogue is displayed on the performer. You may In this case, the mobile terminal device 10 determines who the imaged performer is a character based on the combination of the performer's clothes colors (hat, presence of glasses, etc.), and then adds the dialogue to the character. It can be realized by displaying. In this case, the support information may include the text data of the dialogue, the display start time according to the time from the start of the show, the display end time, and information indicating the character.

(8) In the above embodiment, dialogue is displayed in Japanese for Japanese users. However, the dialogue may be displayed in an understandable language such as a native language for foreign users.

(9) In the above embodiment, the low frequency sound is used as the start signal. However, the light emitted from the lighting used for the show may be controlled to be on / off, and this may be used as the start signal. In this case, a sensor for receiving the illumination light may be provided in the mobile terminal device 10, and it may be determined whether or not it is the start signal depending on whether or not the illumination blinks in a pattern determined as the start signal in advance. Further, the start signal may be a combination of sound and light.

Claims (17)

An information support system including an identifier transmitting device installed in a predetermined area and having an identifier, a signal output device outputting a signal to a speaker installed in the area, and a mobile terminal device owned by a user. ,
The signal output device is configured to output a signal including at least a start sound signal associated with the start of a show provided in the area and an audio signal according to the progress of the show to the speaker,
The portable terminal device,
A recording unit that records, in association with the identifier of the identifier transmitting device, support information including character text corresponding to the voice according to the progress of the show provided in the area where the identifier transmitting device is installed,
Based on the strength of the signal received from the nearby identifier transmitting device, the user having the mobile terminal device specifies in which area the identifier transmitting device installed is near, and the identifier of the identifier transmitting device is specified. Area identification means to acquire,
Start sound detection means for detecting whether or not the ambient sound acquired by the microphone includes a start sound output from a speaker installed in the area,
When a start sound is detected by the start sound detection means, display control means for displaying on the display support information including character text recorded in the recording portion in association with the acquired identifier of the identifier transmission device,
Information support system equipped with. A mobile terminal device for providing information support to a user who watches a show provided in a predetermined area,
A recording unit that records, in association with the identifier of the identifier transmitting device , support information including character text corresponding to the voice according to the progress of the show provided in the area where the identifier transmitting device is installed,
Based on the strength of the signal received from the nearby identifier transmitting device, the user having the mobile terminal device specifies in which area the identifier transmitting device installed is near, and the identifier of the identifier transmitting device is specified. Area identification means to acquire,
Start sound detection means for detecting whether or not the ambient sound acquired by the microphone includes a start sound output from a speaker installed in the area,
When a start sound is detected by the start sound detection means, display control means for displaying on the display support information including character text recorded in the recording portion in association with the acquired identifier of the identifier transmission device,
A mobile terminal device equipped with. The device of claim 2, wherein
The start sound is a low frequency sound of a predetermined frequency,
The start sound detecting means determines whether or not the start sound is included, depending on whether or not the ambient sound acquired by the microphone contains a low frequency sound of the predetermined frequency or more at a predetermined level or more. Characterized device. The apparatus of claim 3,
The low frequency sound is a combination of low frequency sounds of a plurality of frequencies,
The start sound detecting means determines whether or not the start sound is included, depending on whether or not the ambient sound acquired by the microphone contains all of the low frequency sounds of the plurality of predetermined frequencies above a predetermined level. A device characterized by being. The device according to claim 3 or 4,
The support information includes information for identifying the speaker in association with the text corresponding to the voice of the performer,
The display control means displays information identifying a speaker in association with the character text, or displays a portrait icon or a photo icon of a character played by a performer identified based on the information. And the device. The device according to any one of claims 3 to 5,
The support information includes character text corresponding to the voice of the performer and character text for explaining the scene,
The display control means displays the character text corresponding to the voice of the performer as a balloon, and displays the character text for explaining the scene without making it a balloon. The device according to any one of claims 3 to 6,
The display control means displays, together with the performer of the show imaged by the imaging unit, character text corresponding to the performer's voice corresponding to the performer's voice. The device according to any one of claims 3 to 7,
When the area specifying unit acquires the identifier from the identifier transmitting device, the support information recorded in the recording unit in association with the identifier is duplicated on the volatile high speed memory,
The display control means performs display based on the support information copied on the volatile high-speed memory. A portable terminal program for realizing a portable terminal device for providing information support to a user who watches a show provided in a predetermined area, the computer comprising:
Based on the strength of the signal received from the nearby identifier transmitting device, the user having the mobile terminal device specifies in which area the identifier transmitting device installed is near, and the identifier of the identifier transmitting device is specified. Area identification means to acquire,
Start sound detection means for detecting whether or not the ambient sound acquired by the microphone includes a start sound output from a speaker installed in the area,
When the start sound is detected by the start sound detecting means, the start sound is recorded in the recording unit in association with the acquired identifier of the identifier transmitting device, and according to the progress of the show provided in the area where the identifier transmitting device is installed. A portable terminal program for causing a display to display support information including character text corresponding to a voice on a display. In the program of claim 9,
The start sound is a low frequency sound of a predetermined frequency,
The start sound detecting means determines whether or not the start sound is included, depending on whether or not the ambient sound acquired by the microphone contains a low frequency sound of the predetermined frequency or more at a predetermined level or more. Characteristic program. In the program of claim 10,
The low frequency sound is a combination of low frequency sounds of a plurality of frequencies,
The start sound detecting means determines whether or not the start sound is included, depending on whether or not the ambient sound acquired by the microphone contains all of the low frequency sounds of the plurality of predetermined frequencies above a predetermined level. A program characterized by: The program according to any one of claims 9 to 11,
The support information includes information for identifying the speaker in association with the text corresponding to the voice of the performer,
The display control means displays information identifying a speaker in association with the character text, or displays a portrait icon or a photo icon of a character played by a performer identified based on the information. And the program. The program according to any one of claims 9 to 12,
The support information includes character text corresponding to the voice of the performer and character text for explaining the scene,
The program, wherein the display control means displays the character text corresponding to the voice of the performer as a balloon, and displays the character text for explaining the scene without making the balloon. The program according to any one of claims 9 to 13,
The display control means displays a character text corresponding to the performer's voice in association with the performer of the show imaged by the image capturing unit. The program according to any one of claims 9 to 14,
When the area specifying unit acquires the identifier from the identifier transmitting device, the support information recorded in the recording unit in association with the identifier is duplicated on the volatile high speed memory,
The display control means performs a display based on the support information copied on the volatile high-speed memory. A mobile terminal device for providing information support to a user who watches a show provided in a predetermined area,
A recording unit that records support information including character text corresponding to the voice according to the progress of the show provided in the area,
Start sound detection means for detecting whether or not the ambient sound acquired by the microphone includes a start sound output from a speaker installed in the area,
When a start sound is detected by the start sound detection means, display control means for displaying support information including the character text on a display,
A mobile terminal device equipped with. A portable terminal program for realizing a portable terminal device for providing information support to a user who watches a show provided in a predetermined area, the computer comprising:
Start sound detection means for detecting whether or not the ambient sound acquired by the microphone includes a start sound output from a speaker installed in the area,
When the start sound is detected by the start sound detection means, display control means for displaying on the display assistance information including character text corresponding to the voice according to the progress of the show provided in the area,
A mobile terminal program with.

Images