JP2006102270A - Information processing method, and information processing terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a content of high entertainment property more suitable for a portable device. <P>SOLUTION: In an information processing terminal 10, a microphone 40 obtains external sound. A sound conversion table 72 manages sound data expressing the obtained sound and sound data to be matched with their generation sources correlated with each other. A figure object table 74 correlates and manages the generation sources and figures according to them. A sound recognition part 42 refers to the sound conversion table 72 and specifies the generation source of the obtained sound. A control part 60 refers to the figure object table 74 and specifies a figure according to the specified generation source. A display part 20 displays the specified figure. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information processing method and an information processing terminal. In particular, the present invention relates to an information processing method and an information processing terminal for executing a game and other programs.

  In recent years, portable information terminals capable of executing games have become widespread. In such an information terminal, it is difficult to realize the high performance of a stationary game machine, and there is a tendency to demand performance and entertainment unique to a portable game machine.

  If it is possible to provide content that is more attractive to be realized with such an information terminal than to be realized with a stationary game machine, it can be a killer content for such an information terminal. The present invention has been made in such a situation, and an object thereof is to provide a technology for realizing highly entertaining content more suitable for a portable device.

  In order to solve such a problem, in the present invention, a sound is input from the outside and a sound generation source is specified. A preset process is executed according to the identified generation source.

  Note that any combination of the above-described components, the expression of the present invention converted between a method, a device, a game machine, a system, a computer program, a recording medium on which the computer program is recorded, and the like are also aspects of the present invention. It is effective as

  According to the present invention, highly entertaining content can be realized.

First, before describing an embodiment in detail, an outline is given below.
A certain aspect inputs sound from the outside and specifies the generation source of the sound. A preset process is executed in accordance with the identified generation source. Here, “sound” mainly refers to a non-vocal sound, but is a concept including a voice uttered by a human or an animal. In such a case, a male person, a female person, a cat, or the like is a source. The above process displays a graphic corresponding to the identified source and a graphic symbolizing it. This “symbolic figure” includes a characterized object that is the source of sound. Moreover, when displaying a figure, you may display the identified figure in a different aspect according to the specific accuracy. For example, when the recognition rate exceeds a predetermined threshold, a specific object is displayed, and when it is lower than that, a more abstract object is displayed. Note that the above processing may cause the character to perform an action that represents or suggests the identified source.

  Another aspect presents the search object directly or indirectly to the user. In response to a user instruction, a sound is input from the outside, a source of the sound is specified, and it is determined whether or not the source matches the object. If they match as a result of the determination, the user is notified in a predetermined manner that the object has been found. Here, “indirectly” includes giving a hint to the user to recall the object.

  In another aspect, sounds are sequentially input from the outside, the sound sources are sequentially specified, and information indicating the sources is sequentially stored. A predetermined reproduction instruction is received from the user, and then a graphic corresponding to the generation source is specified with reference to the information, and the graphic is displayed on the screen in a predetermined display form. When displaying, the graphic may be displayed in a unified format under a predetermined concept. For example, when unified with one theme of fish, regardless of whether the input sound source is a car or a log, they are displayed as graphic objects imitating the fish as the theme. Further, a sample of sound to be input from the outside may be reproduced at the request of the user or at a predetermined time.

  In another aspect, an external sound is acquired by a microphone, and sound data to be matched with sound data representing the sound is associated with the generation source and managed in the first table. With reference to the first table, the sound generation unit identifies the source of the acquired sound. The generation source and the corresponding graphic are associated and managed by the second table, and the graphic from the generation source is specified by the control unit with reference to the second table. The figure is displayed on the screen. Here, the “second table” associates a graphic symbolizing the generation source. Further, the information indicating the generation source specified by the sound recognition unit or the sound acquired by the microphone may be sequentially stored in the storage unit. When a predetermined reproduction instruction is received from the user, if the information is stored in the storage unit, the figure is identified with reference to the information, and if the sound is stored, the sound source and the figure corresponding thereto Is identified.

  In another aspect, an external sound is acquired by a microphone, and sound data to be matched with sound data representing the sound is associated with the generation source and managed in the first table. With reference to the first table, the sound generation unit identifies the source of the acquired sound. The generation source and the corresponding figure are associated and managed in the second table. With reference to the second table, the game execution unit identifies the figure from the generation source. The figure is displayed on the screen. When the generation source is specified by the sound recognition unit, a predetermined character is caused to execute a predetermined action by the game execution unit. Here, the “predetermined character” is a main character that is operated by the user and performs a main action. The “predetermined action” corresponds to an action reminiscent of randomness such as applying magic. Processing that should be considered an error, such as the appearance of an irrelevant figure due to incorrect recognition of sound, can be replaced with a game effect that expresses randomness. In addition, an object desired by a character different from the character is directly or indirectly presented to the user.

(First embodiment)
The present embodiment is an example of a game that recognizes a sound and causes a sound source that is the sound generation source to appear as a graphic object in the game field. Conventionally, many games using a microphone are used as an alternative to a controller, such as instructing by voice, reading a dialogue, or talking to a character. This could be embarrassing to shout out for shy people. This embodiment provides a completely new type of game that does not require utterance, even though it is a game that uses a microphone.

  FIG. 1 is a functional block diagram showing the overall configuration of the information processing terminal 10. The information processing terminal 10 corresponds to a portable game machine, a mobile phone having a game function, a PDA (Personal Digital Assistants), or the like. The information processing terminal 10 includes a display unit 20, an input unit 30, a microphone 40, a sound recognition unit 42, a communication unit 50, a control unit 60, a storage unit 70, and an external storage unit 80.

  This configuration is realized in terms of hardware by a CPU, a memory, a drive such as a hard disk, a microphone, and other devices, and in terms of software by a program related to game execution and sound recognition. It is drawn as a functional block realized by cooperation. Therefore, those skilled in the art will understand that these functional blocks can be realized in various forms by a combination of hardware and software. These functional blocks are stored as software in a recording medium such as a flash memory, and are read into the storage unit 70 from the external storage unit 80 having a reading function corresponding to the recording medium when the game is executed, and then executed by the CPU. It may be realized by being processed.

  The display unit 20 is configured by a liquid crystal panel, for example, and outputs an image generated by the control unit 60. The input unit 30 includes direction keys and operation keys that accept operation instructions from the user. Moreover, in this embodiment, an external sound is extract | collected from the microphone 40 when a user operates a key. For example, it is possible to design such that a sound is acquired while the key is pressed, or a sound is acquired for several seconds when the key is pressed once.

  The microphone 40 acquires an external sound. The microphone 40 recognizes a single impact sound based on a single collision, and can also recognize non-voice sounds such as a wooden board, a metal can, a glass bottle, a drum hitting sound, applause, a hand bell, and a bell. The microphone 40 may be provided on the main body or may be externally attached.

  Note that a microphone array may be used as the microphone 40. When a microphone array is used, the sound source direction can also be estimated from the time difference when the sound reaches each microphone. For example, a virtual beamformer is calculated in parallel, and sounds from each direction are extracted. Then, when the sound in the loudest direction is taken out and the power continues above a certain value, the subsequent processing may be started. This microphone array can also be used to reduce background noise.

  Note that an AGC (Automatic Gain Control) circuit (not shown) may be provided to control the sound acquired by the microphone 40 within a predetermined range. Further, an analog / digital converter (not shown) may be provided to perform spectrum calculation or the like with a digital signal.

  The sound recognition unit 42 identifies the generation source (hereinafter referred to as a sound source) from the sound acquired by the microphone 40. Hereinafter, an example of a sound source identification method will be shown. First, in order to determine whether or not it is a single impact sound, the input sound is analyzed, and whether or not the temporal change in the power forms an exponential decay type profile that is characteristic of the single impact sound. Is determined. Next, the spectrum at the time of the peak of the power of the single impact sound and the attenuation is calculated, and 32 feature values obtained by dividing the spectrum into 16 frequency bands are obtained. Each single impact sound is subjected to pattern matching with a distribution of feature amounts created in advance from a large number of samples, and the type of the most matched sound source is output as an identification result.

  The control unit 60 controls the entire information processing terminal 10. The game execution unit 62 includes a program for realizing a game executed by the information processing terminal 10. The game execution unit 62 reads out various data from the storage unit 70 and progresses the game while storing data input by the user from the input unit 30 as necessary.

  The communication unit 50 has a function of transmitting and receiving packets to and from other information processing terminals such as a game machine using a wireless LAN or the like. For example, acquired graphic objects can be exchanged.

  The storage unit 70 includes a sound conversion table 72 and a graphic object table 74. The sound conversion table 72 stores sample data of many sound sources used for matching processing in the sound recognition unit 42. Details of the sound conversion table 72 will be described later. The graphic object table 74 stores graphic objects such as characters that symbolize the sound source or have a certain relationship after the sound source is specified by the sound recognition unit 42.

  The external storage unit 80 corresponds to a hard disk, a predetermined recording medium, and the like, and stores data such as game programs, sound samples and graphic objects, and is used for saving game data.

  FIG. 2 is a diagram illustrating an example of the sound conversion table 72. In the sound conversion table 72, many sampled sound data are registered. For example, in the sound data 1, a sound when a log is hit is registered. Each sound data may have a digital characteristic value of the sampled sound.

  In FIG. 2, an item of element information indicating a material level (hereinafter referred to as “element level”) such as an object level log or a tree abstracting a table or the like is also provided. In addition, information such as a specific dog cry or an animal cry that is a generalized concept of a cat cry may be set in this item. This item includes sound data having a characteristic amount common to the object group described above. Moreover, you may have several sound data with respect to one object, such as a fishing rod. For example, each sound data may be registered assuming various cases such as lightly hitting, hitting strongly, dropping, rubbing, and hitting with a spoon. As described above, it is possible to register a large number of sound data. In this case, the sound conversion table 72 is stored by storing all of the sound data in the external storage unit 80 and outputting a part thereof to the storage unit 70 as appropriate. May be generated. The sound recognizing unit 42 specifies the sound source described above with reference to the sound conversion table 72 generated in this way. Specifically, the sound data generated from the sound acquired from the outside and each sound data set in the sound conversion table 72 are matched, and the recognition rate indicating the degree of matching is obtained for each sound data. Go. At that time, matching may be performed with all set sound data, or a matching target may be narrowed down by an algorithm described later. Details of the process of specifying the sound source with reference to this recognition rate will be described later.

  FIG. 3 is a flowchart for explaining the overall operation of the game executed by the information processing terminal 10 in the present embodiment. The game is set in a gray world with no sound or color. For example, assume an island in such a situation. There are several inhabitants living on the island, but each has troubles, and its expression is crying. The hero who is the main character listens to troubles from those residents and solves them, thereby changing the residents who are sub-characters to smile.

  First, the game execution unit 62 directly or indirectly presents an object to be searched for by the user. Specifically, the main character operated by the user approaches the inhabitants and hears their troubles (S10). Here, the main character may talk to the inhabitants and ask for trouble in the conversation process, or the inhabitants may appeal to the main character from the beginning. The troubles are various, such as the throat is dry, the bonfire is extinguished and it feels cold, the flowers are not energetic and sad, or the earth and sand are in the way and cannot move forward. A user who operates the main character imagines an object for solving these problems and searches for a sound for acquiring the object.

  The object desired by the residents may be directly appealed to the hero, but a hint for reaching the object may be presented indirectly. In this case, it is possible to stir the user's imagination. It is also possible to have multiple answers for the object. For example, if a resident complaining of the cold is presented with a fire for a bonfire or a blanket for overcoming the cold, the problem of the resident will be solved.

  Next, a user searches for the sound of the target object for solving a resident's trouble, and collects the sound (S12). For example, when searching for water, the faucet of a water tap is opened, and a sound in a state where water is flowing is collected. Specifically, the information processing terminal 10 is carried and goes near the water supply, where the input unit 30 is operated to enable the microphone 40 and collect external sounds.

  Next, the sound recognition unit 42 analyzes the sound input from the microphone 40 and identifies the sound source with reference to the sound conversion table 72 (S14). Details of this processing will be described later.

  Next, the game execution unit 62 refers to the graphic object table 74, converts the sound source specified by the sound recognition unit 42 into a corresponding graphic object, and displays it on the screen (S16). For example, when the log is a sound source, a log character imitating an object such as a log previously registered in the graphic object table 74 or anthropomorphic log character is displayed on the display unit 20, and registered when the sound of water flowing is a sound source. Display characters such as water spirits. During this conversion time, the main character eats the sound acquired by the microphone, displays a scene that applies magic after mastication, and displays that the sound has been input and that it is processing it You may go. While gaining the matching time between the acquired sound and the sound conversion table 72, the user is made aware that the sound has been input, and the user has a sense of expectation as to what kind of object will appear. Can be increased. Furthermore, since it is difficult to set the sound recognition rate to 100%, an unintended graphic object may appear in rare cases. The action that symbolizes the uncertainty of applying magic can be compared to the situation where the sound cannot be converted to the corresponding graphic object with full accuracy from the perspective of the designer. Usually, the appearance of an unintended graphic object can be said to be an error, but it can be used as a game effect on the contrary that a magical phenomenon such as magic occurs rarely, and it is two birds with one stone.

  Next, the game executing unit 62 determines whether or not the sound source specified by the sound recognizing unit 42 matches the object, and determines whether or not the residents' trouble has been solved (S18). If they do not match (N in S18), the trouble of the inhabitant could not be solved, so the process proceeds to step S10, and the user further hears the trouble. More detailed hints may be issued in the second process than in the first process. Or you may transfer to step S12 and input a new sound immediately. Of course, when the game is interrupted (N in S24), the current play ends.

  If the identified sound source matches the object (Y in S18), the user is notified in a predetermined manner that the object has been found. In the example of FIG. 3, it is expressed by the following processing. First, the resident's facial expressions that have solved their worries become smiles (S20). Further, the range of about 5 m radius of the inhabitants is changed from gray to a normal color scheme (S22). As a result, the island will gradually become lively. The effect of coloring the gray island is accompanied by the effect of increasing the user's motivation.

  The notification to the user is not limited to such an effect, and characters such as “correct answer” and “success” may be displayed on the screen. Of course, the user may recognize the success with sound effects. The user repeats the above-described processing until the game is interrupted or cleared (N in S24), solves the residents' problems one after another, and energizes the island.

  When the game is interrupted (Y in S24), the current state of the island can be recorded on the internal hard disk or a removable and portable recording medium, and the current play can be terminated. .

  Next, details of the above-described sound source identification processing will be described. FIG. 4 is a flowchart illustrating an example of a sound source identification process performed by the sound recognition unit 42. The example shown below includes an element that displays a specified graphic object in a different manner depending on its specific accuracy. The sound recognition unit 42 acquires a sound from the microphone 40 and matches the sound data registered in the sound conversion table 72 (S112).

  As a result of the matching, the sound recognition unit 42 can detect sound data whose recognition rate indicating the degree of matching exceeds a predetermined recognition rate (hereinafter referred to as a first threshold), for example, a recognition rate of 85% ( The sound source of the acquired sound is specified as the sound source corresponding to the sound data (S116).

  As a result of calculating the recognition rate for each sound data in the sound conversion table 72, if sound data exceeding the first threshold value cannot be detected (N in S114), it is determined whether or not a plurality of sound source candidates can be detected. (S118). When a plurality of sound source candidates cannot be detected, that is, only one sound data can be detected (N in S118), even if the first threshold value is not reached, the sound source is specified as the sound data (S116).

  When a plurality of sound source candidates can be detected, for example, when the sound data generated from the acquired sound satisfies 50% of the sound data of the fishing rod and 30% of the sound data of the wooden bat (Y in S118), It is determined whether or not there are elements at the element level and the higher concept level that are common to all of the detected sound source candidates (S120). When the item exists (Y in S120), the sound source is specified as the element of the element level and the higher concept level (S122). For example, when a scoop and a wooden bat are detected as a plurality of sound source candidates, both of them include a tree as element information in the table of FIG. That is, the scoop contains iron as element information, but the wooden bat does not contain iron, so iron is not specified as a sound source. Of course, sound data that does not substantially match, such as satisfying only 5% of the sound data, does not correspond to a sound source candidate.

  If there are no common element level and higher concept level items (N in S120), specify the item with the highest recognition rate among multiple sound source candidates and specify the sound source for the element level and higher concept level items (S124). For example, when the acquired sound satisfies 50% of the sound data of the fishing rod and 20% of the sound data of the mobile phone, a tree that is an item of the element level of the fishing rod having a high recognition rate is specified as the sound source.

  In this way, a system with fewer conversion errors can be generated by displaying graphic objects of different levels according to specific accuracy. In other words, when the accuracy is low, by displaying the one closer to the elemental level, the network is expanded, so that conversion errors are reduced. Further, the size of the graphic object to be displayed may be changed according to the specific accuracy. For example, when the accuracy is high, the graphic object may be displayed large, and when the accuracy is low, it may be displayed small. The accuracy in matching can be expressed visually.

  FIG. 5 is a diagram showing an image screen A for schematically explaining one scene of a game using the information processing terminal 10 in the present embodiment. This image screen A shows a state where the main character M is listening to the trouble of the resident R. Here, Resident R is appealing to the protagonist M, "The throat is crazy."

  Next, FIG. 6 is a diagram showing an image screen B for schematically explaining one scene of the game using the information processing terminal 10 in the present embodiment. This image screen B is displayed after a user who has imagined that water is necessary from the appeal of the resident R acquires the sound of water flowing from the microphone 40. More specifically, after the sound of the water flowing is collected, for example, the main character M performs an action of applying magic for about 1 second, and shows the appearance of water W as a graphic object corresponding to the magic. It is.

  As described above, according to the first embodiment, game content using sound as an essential element can be realized by recognizing sound and making it appear as an object in the game field. Moreover, since all sounds existing in nature can be targeted, the content is particularly suitable for portable devices such as portable game machines and mobile phones that can be carried. This content is not limited to simply porting the content of a stationary game machine to a portable device, but is a portable device that has a wide play field, that is, many types of sounds that can be collected. It can be said that it makes use of its characteristics.

  Further, the user can have curiosity like a science experiment of “what will appear” during the time from when the sound is collected until the figure object appears. Furthermore, in accordance with hints from the game content side, it is possible to expect an effect of inviting the user to the outdoors for searching for sounds, and an effect of renewing a general image for a conventional game of staying indoors can be expected. In particular, it is expected that children will be able to play a lot of playful desires to convert various sounds existing in nature into graphic objects, so that children will be able to play outdoors.

(Second Embodiment)
This embodiment is not a game-led content that searches for a target sound by guidance from the game content side as in the first embodiment, but a material for collecting sounds from the natural world and forming a game on the user side Is to collect.

  The configuration of the second embodiment is the same as the functional block shown in FIG. This functional block may be an information processing system realized by cooperation of a plurality of devices. For example, a portable game machine including an input unit 30, a microphone 40, a sound recognition unit 42, a control unit 60, a storage unit 70, and an external storage unit 80, a display unit 20, an input unit 30, a game execution unit 62, and a storage unit 70, and a stationary game machine including an external storage unit 80 or a personal computer may be linked. In this case, it is possible to mainly collect outdoor sounds with a portable game machine, record it as log data, input the log data to a stationary game machine, and execute the game with the game machine.

  In addition, a mobile phone or a microphone kit including the input unit 30, the microphone 40, the control unit 60, the storage unit 70, and the external storage unit 80, the display unit 20, the input unit 30, the sound recognition unit 42, the game execution unit 62, the storage A stationary game machine including the unit 70 and the external storage unit 80 may be linked. In this case, it is possible to mainly collect outdoor sounds with a mobile phone or a microphone kit, input the collected sound data into a stationary game machine, and execute the game on the game machine. Of course, the functional blocks in FIG. 1 may be realized by a single device.

  FIG. 7 is a flowchart for explaining the overall operation of the game executed by the information processing terminal 10 or the information processing system in the present embodiment. In this embodiment, a user collects sound and uses it as a material to form the game. First, the user starts recording for use as a game material (S30). The microphone 40 acquires an external sound and stores it in the storage unit 70. The sound recognition unit 42 determines whether a predetermined trigger has occurred (S32). Here, the predetermined trigger corresponds to a case where a sound of a predetermined threshold level or higher is detected, a case where the single impact sound described above is detected, or the like. This also applies when the user issues a sound sampling instruction from the input unit 30.

  In step S32, while the predetermined trigger is not generated (N in S32), the recording is simply continued without activating the above-described sound source specifying process (S30). When a predetermined trigger occurs (Y in S32), the sound recognition unit 42 performs the sound source identification process described above (S34). Then, information including the identified sound source, for example, log data is stored in the storage unit 70 or the external storage unit 80 (S36). Here, the log data may be address data on the sound conversion table 72 of the specified sound source. The acquired date and time may also be included in the log data.

  The process described above is continued until it is desired to end the recording by the user's intention, or until the recording should be terminated due to the limitation of the capacity of the external storage unit 80 (N in S38).

  After the recording is finished (Y in S38), if the recorded device is different from the device that executes the game, the user inputs the log data to the device that executes the game (S40). Therefore, this process is not necessary when recording and playing games with a single device. Then, the user executes the game at a desired time (S42). The game execution unit 62 refers to the graphic object table 74 and converts the log data into a predetermined graphic object (S44). The graphic object is displayed on the screen in accordance with the progress of the game and the user's operation. The game execution start and the subsequent user operation are predetermined reproduction instructions. Here, “reproducing” includes displaying the object collected by sound as a graphic.

  The user repeats the above-described processing until the game is interrupted or cleared (N in S46), and when the game is interrupted (Y in S46), the current game situation is recorded on the internal hard disk or recording medium. This time, the play can be finished.

  Here, an example of a game applicable to the present embodiment will be described. In this game, an object collected by sound is displayed in a unified format under a predetermined concept. It consists of a number of mini-games such as a fishing game, a bird-shooting game, and a car racing game. In this case, graphic objects in a plurality of formats are registered in the graphic object table 74 for one sound source. For example, a plurality of log sound sources, such as a character imitating a fish, a character imitating a bird, and a character imitating a car, are registered in correspondence with the contents of the mini game.

  For example, when a fishing game is selected by the user, the game execution unit 62 refers to the graphic object table 74 and converts the log data generated from the sound collected by the user into a graphic object imitated by the corresponding fish. , Convert as the game progresses.

  FIG. 8 is a diagram showing an image screen for schematically explaining one scene of a game using the information processing terminal 10 or the information processing system in the present embodiment. FIG. 8 shows an image screen during the execution of the fishing game. The game execution unit 62 is a graphic object imitating a fish such as the whistle A1, the bullet train A2, the alarm clock A3, the mobile phone A4, and the log A5 shown in FIG. And is displayed on the display unit 20. The format of the graphic object is unified with the concept of fish so that it matches the content of the game. Cat C, the main character, is fishing for them.

  In this way, it is possible to enjoy the sound that is consciously or unconsciously collected by the user by converting it into a graphic object that matches the content of the game. Further, when the log data includes information on the collection date and time corresponding to each sound source, it is possible to control the timing and order of appearance of the graphic object. For example, the game execution unit 62 may cause graphic objects to appear in the order in which they are collected.

  Furthermore, a plurality of graphic objects whose formats are not standardized may be used as materials for various puzzle games without imitating the collected sounds in a uniform format as a graphic object according to the game contents. For example, a game in which the graphic objects are stacked within a time limit and compete for their height may be used.

  As described above, according to the second embodiment, as in the first embodiment, the game content using the sound as an essential element is realized by recognizing the sound and causing it to appear as an object in the game field. Can do. In addition, since all sounds existing in the natural world can be targeted, the content is particularly suitable for portable devices such as portable game machines and mobile phones.

  In addition, the user can enjoy the fun of collecting the material used for the game in the form of sound and the game using it. You can really enjoy the chef ’s choice of ingredients and cooking.

  The present invention has been described based on the embodiments. The embodiments are exemplifications, and it is understood by those skilled in the art that various modifications can be made to combinations of these components and processing processes, and such modifications are also within the scope of the present invention. . Hereinafter, such modifications will be described.

  In the first and second embodiments, various algorithms can be used to improve the matching speed by the sound recognition unit 42. For example, in the first embodiment, the sample data of the object for solving the residents' troubles and the sample data of the sound source having a high degree of association with the object are loaded from the external storage unit 80 to the storage unit 70. On the other hand, only the element level and higher concept level items are loaded from the external storage unit 80 to the storage unit 70 for the sample data of the sound source having a low degree of association with the object. Alternatively, the sample data of a sound source with a low degree of association is appropriately thinned and loaded. By constructing the sound conversion table 72 in this way, the number of times of matching between the object and the sample data having a low degree of association can be reduced, and the speed of matching processing as a whole can be increased.

  In the first and second embodiments, the collected sound data is pre-matched with the sound data representing the elemental level and the higher concept level in FIG. 2, and only the items that may be applicable are subject to the object level. You may perform a matching process with this item. This also reduces the number of times of matching with the sample data, and the overall matching process can be speeded up.

  Further, in the second embodiment, an example has been described in which a user collects sound and forms the game using the sound as a material. In this regard, a diary may be created using the collected sound as a material. If a graphic object converted from sound is used like a pictogram and a diary is created, the graphic object can be used as a starting point for tracing past memories. If a GPS (Global Positioning System) is installed in the information processing terminal 10, a diary including information obtained by tracing a route traveled on that day together with sound can be created. Therefore, it is also possible to record information as to where the sound was collected.

  In the second embodiment, a predetermined sound source is specified from the recorded data and recorded as log data. In this regard, when a large-capacity hard disk or the like is mounted on the external storage unit 80, the recording data itself may be recorded there. Then, when the game is executed, the above-described sound source specifying process and the conversion process to the graphic object may be performed. According to this, although the amount of data becomes large, it becomes possible to reproduce the collected sound. According to such an aspect, it is possible to realize content particularly suitable for a portable device other than the game format.

  In addition, in the first and second embodiments, in order to present a hint to the user what kind of graphic object appears by collecting what sound, at the request of the user or at a predetermined time, A mode for reproducing a sample of a sound to be input from the outside in association with a graphic object may be installed. When the user executes this mode, a plurality of graphic objects appear on the screen, and when the user selects one of them, a sample sound for causing the selected graphic object to appear is reproduced. Good. At this time, a sound sample that has not yet been collected by the user may be reproduced. Further, in the first embodiment, when the user cannot easily collect sound for solving the residents' trouble, the sound of the target object is reproduced as a hint, and the user is prompted to collect such sound. Good. According to this, user-friendly content can be realized.

  In the first and second embodiments, the sound source of the acquired sound is specified, and the graphic object corresponding to the sound source is displayed. In this regard, the character may be caused to take an action according to the sound source. For example, when a fishing rod is specified as a sound source, a character performs a gesture for fishing. In this case, an action such as a character gesture may be registered in the graphic object table 74 as a still image or a moving image corresponding to the sound source. Furthermore, if the information processing method of the present invention is applied to a doll such as a stuffed toy, the doll can be made to act according to the specified sound source.

  Furthermore, the present invention can also be applied to inputting icons and pictographs to a mobile phone or the like by collecting external sounds. According to this, a new input method for a portable device such as a cellular phone can be provided.

It is a functional block diagram which shows the whole structure of the information processing terminal in embodiment. It is a figure which shows an example of the sound conversion table in embodiment. It is a flowchart for demonstrating the whole operation | movement of the game which the information processing terminal in 1st this embodiment performs. It is a flowchart which shows an example of the sound source identification process by the sound recognition part in embodiment. It is a figure which shows the image screen A explaining the scene of the game using the information processing terminal in 1st Embodiment roughly. It is a figure which shows the image screen B explaining roughly one scene of the game using the information processing terminal in 1st Embodiment. It is a flowchart for demonstrating the whole operation | movement of the game which the information processing terminal in 2nd Embodiment or the information processing system performs. It is a figure which shows the image screen explaining roughly one scene of the game using the information processing terminal in the 2nd Embodiment, or an information processing system.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 Information processing terminal, 20 Display part, 30 Input part, 40 Microphone, 42 Sound recognition part, 50 Communication part, 60 Control part, 62 Game execution part, 70 Storage part, 72 Sound conversion table, 74 Graphic object table, 80 External Memory part.

Claims (17)

Inputting sound from outside,
Identifying the source of the input sound;
Performing a preset process according to the identified source;
An information processing method comprising:   The information processing method according to claim 1, wherein the step of executing displays a graphic corresponding to the identified generation source.   3. The information processing method according to claim 1, wherein the step of executing displays a graphic corresponding to the specified generation source in a different manner depending on the specific accuracy. Presenting the search object directly or indirectly to the user;
In response to a user instruction, inputting a sound from outside,
Identifying the source of the input sound;
Determining whether the identified source matches the object;
If the result of determination is a match, a step of notifying the user that the object has been found in a predetermined manner;
An information processing method comprising: Inputting sound sequentially from outside;
Sequentially identifying the source of the input sound;
Sequentially storing information indicating the source;
Receiving a predetermined reproduction instruction from the user;
After the reproduction instruction, referring to the information, specifying a figure corresponding to the generation source,
Displaying the identified figure on the screen in a predetermined display form;
An information processing method comprising:   6. The information processing method according to claim 5, wherein the displaying step displays the figure in a unified format under a predetermined concept.   7. The information processing method according to claim 1, further comprising a step of reproducing a sample of sound to be input from outside. A microphone that captures external sound,
A first table for managing sound data to be matched with sound data representing the acquired sound, and its generation source in association with each other;
Referring to the first table, a sound recognizing unit for identifying a source of the acquired sound;
A second table for managing the generation source in association with the graphic corresponding thereto;
A control unit for referring to the second table and identifying the figure from the generation source;
A display for displaying the identified figure on the screen;
An information processing terminal comprising:   9. The information processing terminal according to claim 8, wherein the second table associates a graphic symbolizing the generation source.   10. The information processing terminal according to claim 8, further comprising a storage unit that sequentially stores information indicating the generation source specified by the sound recognition unit.   The information processing terminal according to claim 10, wherein the control unit specifies the graphic with reference to the information when receiving a predetermined reproduction instruction from the user.   The information processing terminal according to claim 8, further comprising a storage unit that sequentially stores sounds acquired by the microphone.   13. The information processing terminal according to claim 12, wherein the sound recognition unit and the control unit specify a generation source of the sound and a figure corresponding thereto when receiving a predetermined reproduction instruction from the user. Information processing terminal. A microphone that captures external sound,
A first table for managing sound data to be matched with sound data representing the acquired sound, and its generation source in association with each other;
Referring to the first table, a sound recognizing unit for identifying a source of the acquired sound;
A second table for managing the generation source in association with the graphic corresponding thereto;
A game execution unit that refers to the second table and identifies the figure from the generation source;
A display for displaying the identified figure on the screen;
The game execution unit causes a predetermined character to execute a predetermined action when the sound recognition unit specifies the generation source.   15. The game machine according to claim 14, wherein the game execution unit directly or indirectly presents an object desired by a character different from the character to the user. Processing to input sound from outside,
Processing to identify the source of the input sound,
A process of executing a preset process according to the identified source;
A computer-readable program characterized by causing a computer to execute. Processing to input sound from outside,
Processing to identify the source of the input sound,
A process of executing a preset process according to the identified source;
A computer-readable recording medium on which a computer-readable program is recorded.

Images