JP2004164288A - Information processor, information processing support device, user information management device and information processing support system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make other equipment to efficiently execute requested information processing even when the requested information processing cannot be executed with a resource inside a main body. <P>SOLUTION: This portable information processor 1 has a telephone function, allows voice input, and has a CCD camera 6 or the like. The portable information processor 1 can access a server of a resource management company 13, the external equipment 12 or PCs 11a-11d inside a territory via a network 10. When the processing is requested from a user A, the portable information processor 1 decides whether the processing is possible inside itself, downloads the resource of the external equipment 12 and constructs an application when the processing is impossible, and accomplishes the processing by use of the hardware resource. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention is directed to an information processing apparatus, an information processing support apparatus, and a user information management that can perform a process in cooperation with another device even when an information processing request received from the outside cannot be achieved by own resource. The present invention relates to a device and an information processing support system.
[0002]
[Problems to be solved by the invention]
Conventionally, when one device cannot satisfy the processing function, it is being studied to perform processing in cooperation with an external device. For example, in order to solve a numerical calculation problem that cannot be processed by one PC, parallel processing may be performed using a plurality of PCs. In this case, since the plurality of PCs have substantially the same configuration (CPU, memory, processing speed) and the resources themselves are fixed, when performing another process, the resources of the plurality of PCs are adapted to another process. Need to be reconfigured.
[0003]
On the other hand, when the user who uses the device is a person, unlike a simple numerical calculation, the request and command of a general person are not limited to a specific field, so when a command is issued from a person to a PC, It will be difficult to process it using only the resources of the PC. This assumes, for example, HMI (Human-Machine Interface) based on voice recognition, image recognition (lip reading), character recognition, and the like.
[0004]
Therefore, in order to respond to such a request, a coordination function with an external device different from the conventional parallel processing is required (cooperation distributed processing). In this case, in order to eliminate the user's irritation regarding the processing delay caused by the cooperation of the external device, means for notifying the user of the predicted processing completion time during the processing is required.
[0005]
Further, in order to realize the above request, specifically, when the device recognizes a word spoken by the user, the device determines whether the word is a noun, a verb, an adjective, a particle, or the like. It is necessary to have a function of classifying and performing control in accordance with the purpose of the user. It is necessary to comprehend the intention of the user by classifying each part of speech and associating it with its inflected form. That is, the intention of the user is grasped by grasping the contents of the request, that is, performing text analysis from the result of the voice recognition.
[0006]
The present invention has been made in view of the above circumstances, and has as its object the purpose of receiving an information processing request from a person or another device even if the processing cannot be executed only by the information processing device itself. It is an object of the present invention to provide an information processing device, an information processing support device, a user information management device, and an information processing support system which can be executed by requesting a device.
[0007]
[Means for Solving the Problems]
According to the information processing apparatus of claim 1, when the request information from the outside is received by the receiving means, the determination means determines whether or not the requested information processing can be executed using its own resource, and the request information can be executed. In this case, the execution means executes the program as it is. If the execution is not possible, the search means searches whether or not the resources insufficient for the execution can be collected. Thus, a processing program can be constructed, and the requested information processing can be executed by the execution means.
[0008]
This makes it possible to build a processing program by collecting resources that are insufficient for requested information processing from the outside, even if the resources cannot be achieved only by the resources provided by the user. Thereby, a wide range of information processing can be achieved in cooperation with the outside, and a general-purpose use can be achieved by reducing the restriction on the range of the content of the requested information processing.
[0009]
According to the information processing apparatus of the second aspect, in the above invention, when the searching means determines that the insufficient resource is hardware, the processing requesting means searches the information processing support apparatus capable of using the hardware of the insufficient resource. Requesting information processing to be executed and receiving the result executed by the hardware by the receiving means, the hardware resources are insufficient in the self, and the processing program cannot be constructed. Even in such a case, this can be achieved by using hardware provided in an external information processing support device.
[0010]
According to the information processing apparatus of the third aspect, in each of the above inventions, the processing time estimating means cooperatively processes the requested information processing using the processing time using only its own resource and external resources. The processing time is estimated, and the processing method selecting means compares the two estimated processing times to select and execute a processing method suitable for processing the requested information processing. Even when processing can be performed using the provided resources, if processing can be performed in a short time by processing using external resources, such as when priority is given to processing time, external resources should be selected and processed. Will be able to
[0011]
As a result, it is possible to select and execute a reliable and quick process by giving priority to the processing time, without being limited to a mode of using an external resource only when the resource cannot be achieved by its own resource. It becomes possible to respond flexibly to the requested information processing.
[0012]
According to the information processing apparatus of the fourth aspect, in each of the above inventions, as the receiving means, the input means for receiving a request for information processing to be input by voice by a person, and the execution means for inputting the voice information input by the input means Since it is configured to include request interpreting means for interpreting as executable information, when a request is made for information processing by a person, the request can be made by directly inputting by voice, The usability can be improved.
[0013]
According to the information processing support apparatus according to claim 5, the information processing apparatus is accessed from the information processing apparatus via a network, and the information processing apparatus according to claim 1 has a resource deficiency by the program construction means of the information processing apparatus. Receiving the collection request, the resource providing unit provides the insufficient resource in response to the request, so that the execution of the requested information processing can be achieved in cooperation with the information processing apparatus.
[0014]
According to the information processing support apparatus of the sixth aspect, in the invention of the fifth aspect, when the resource providing means determines that the insufficient resource is hardware, Searches for another information processing support device that can use the hardware, and requests information processing to be performed by the hardware. If information processing can be executed in cooperation with the processing support device, it can be requested and executed. Therefore, in addition to the resources provided by itself, the processing can be performed by using the hardware resources of other information processing support devices. It can be realized.
[0015]
According to the information processing support apparatus according to claim 7, the information processing apparatus according to claim 2 or the processing request unit of the information processing support apparatus according to claim 5 receives a request to use the hardware of the insufficient resource. In this case, there are provided processing means for receiving and processing the information processing to be performed by the target hardware, and transmitting means for passing the processing result of the processing means to the receiving means of the information processing apparatus. It is also possible to provide the information processing apparatus with hardware that is a resource deficient in response to the use request, perform information processing, and transmit the result by the transmission unit. This makes it possible to support and achieve information processing that cannot be processed due to insufficient hardware resources by the information processing apparatus alone.
[0016]
According to the information processing support device of the eighth aspect, in the invention of the fifth to seventh aspects, when a resource provided by the device itself corresponds to an external resource selected by the processing method selection means of the information processing device, Since the requested information processing is executed in cooperation with a request, the requested information processing can be efficiently achieved when the processing capacity alone is poor or there are resources that cannot be processed. .
[0017]
According to the user information management apparatus of the ninth aspect, when audio information is transmitted through the network using the information processing apparatus of the fourth aspect, the user information management apparatus is connected to the network and the identification information generation unit performs the information processing. The identification information of the user is generated based on the voice information transmitted from the device, and the resource management means manages the identification information generated by the identification information generation means as a resource. When accessing the processing device by inputting voice information, the identification information of the user can be centrally managed, and even when the user changes the information processing device to another one. , The information input so far can be read and used. Furthermore, even when it is desired to use the information processing device or another information processing device, it can be shared by acquiring it as a resource.
[0018]
According to the information processing support system according to claim 10, an information processing apparatus to which a user can request an information processing, and at least one piece of information operated by receiving an information processing request from the information processing apparatus via a network. Means for determining whether or not an information processing request can be processed by internally held resources, and requesting an external device for a resource that is insufficiently processed by internally held resources. A resource acquisition unit that acquires the resource from outside via a network, and when the information processing support device receives a request for a resource shortage from the information processing device, if the resource shortage is software, the software resource Means for providing software resources to search for and send In the case of hardware, a search means for searching for a resource shortage of the hardware, and a peripheral device having the hardware searched by the search means for a task whose processing is delayed due to the shortage of the hardware resource. A task requesting means for requesting, and a transfer means for receiving a request result from the requested peripheral device and transmitting the request result to the information processing apparatus. Information processing that cannot be processed alone can be achieved in cooperation. In addition, there is no need to provide an excessive resource as a resource on the information processing apparatus side, which is advantageous in terms of cost.
[0019]
According to the information processing support system of the eleventh aspect, in the invention of the tenth aspect, when the request is made by inputting voice information to the information processing apparatus, the request is made based on the input voice information. Resource management means for generating identification information of a user who has performed the voice input and managing the identification information as a resource outside the information processing apparatus, so that the resource management means uses the identification information of the user managed as a resource. As a result, it is possible to perform a cooperative operation with enhanced security while effectively using information for voice recognition.
[0020]
According to the information processing support system of the twelfth aspect, in the invention of the eleventh aspect, the resource management means is configured to receive and manage an application built on the information processing apparatus side as a resource. The app generated by the device can be provided as a resource that can be used by other information processing devices, so that the application can be effectively used, and unnecessary processing can be reduced and quick processing can be performed. Will be able to
[0021]
According to the information processing support system of the thirteenth aspect, in the invention of the eleventh or twelfth aspect, the resource management means is configured to provide the user's recognition information in response to a request from the information processing support apparatus. In addition, the security can be enhanced by sharing the user identification information, and the requirements of the user can be quickly and reliably grasped.
[0022]
According to the information processing support system of the present invention, when an instruction is received from a user, a determination unit that determines whether the instruction can be processed only by the hardware of the main unit, and only the main unit is determined by the determination unit. AI agent generating means for generating an AI agent for temporarily moving to an external information processing support device and using the resources to complete necessary processing when it is determined that the instruction cannot be processed by , The AI agent completes necessary processing using resources held in the information processing support apparatus, and transfers the completion result to a location before movement. Since it is configured to disappear, under the concept of an AI agent, information processing can be efficiently achieved even when resources inside the information processing apparatus are insufficient. It becomes possible.
[0023]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an embodiment in which the present invention is applied to a system using a portable information processing device will be described with reference to the drawings.
[0024]
(Explanation of basic configuration)
FIG. 1 schematically shows the overall configuration of this system. A portable information processing device 1 as an information processing device is a user mainly used by a user A, and is called a so-called mobile device. The portable information processing device 1 has both a function as a mobile phone and a function as a packet communication device.
[0025]
The portable information processing device 1 includes a keyboard 2 for inputting operations, a display device 3, and a microphone 4, a speaker 5, a CCD camera 6, and a touch panel 7 (see FIG. 2). And an operation input or an image input. For communication with the outside, transmission and reception are performed through the antenna 8. The display device 3 is, for example, an LCD, an EL, an organic EL, or the like, and can be used as an image display of the CCD camera 6 or as a TV monitor.
[0026]
The portable information processing device 1 can access the network 10 via the relay station 9 by using the wireless telephone function. Examples of external devices (information processing support devices) that the user A can use as his / her own territory include a home PC (personal computer) 11a, a company PC 11b, a vehicle PC 11c, and other PCs 11d. These are represented by the Internet and the like. The portable information processing device 1 can be accessed through a network 10.
[0027]
An external device 12 as an information processing support device that can be commonly used by many users is connected to the network 10 and is accessible by the portable information processing device 1. Further, a terminal device (server) of a resource management company 13 as a user information management device that manages a personal recognition module described later for each of a large number of users is also connected to the network 10, and the portable information processing device 1 and external devices Accessible by 11, 12, etc.
[0028]
FIG. 2 shows an electrical configuration of the portable information processing device 1. The control circuit 14, which controls the entire control, mainly includes a CPU, a ROM, a RAM, and the like. In addition to the control of the telephone function and the communication function, the control circuit 14 has software and hardware to achieve various information processing functions. Is incorporated. The control circuit 14 is connected to a communication circuit 15, a GPS receiver 16, a memory 17, an IC card reader 18 for reading and writing information on an IC card, and the like, in addition to the components described above.
[0029]
The data transmitted to the outside by the communication circuit 15 can be received by the PCs 11a to 11d placed in a house, a company, a vehicle, or the like via the relay station 9 or the like, or can be received by an external device 12 described later. it can. In order to determine the destination of the transmission data, an Internet IP address set in the device or a user address uniquely set by the user is used.
[0030]
The control circuit 14 of the portable information processing device 1 analyzes the result obtained by the user's voice recognition, and analyzes the user's generated sound (characteristics of pronunciation, intonation, vowels, consonants, etc.) and the vocabulary used by the user. Features are determined and stored.
[0031]
As described above, the portable information processing device 1 is configured to be able to recognize the voice of the user A and store the characteristics of the user A. The user A accumulates the analysis and learning results of the portable information processing device 1 that is almost always used in a server managed by A, the PCs 11a to 11d, and the like. Alternatively, the analysis of the user A and the accumulation and management of the learning result may be stored and managed in the server of the resource management company 13.
[0032]
The external device 12 requests the portable information processing device 1 of the user A to use the data for recognizing the user A. When the necessary authentication is completed, the portable information processing device 1 outputs the voice recognition data required for the user authentication. Can be received. Similarly, when the data use request of the user A is sent from the external device 12 to the server of the resource management company 13, the server is configured to transmit necessary data to the external device 12 by communication.
[0033]
In this manner, the user A who performs input using the portable information processing device 1 can receive the speech recognition data from the portable information processing device 1 or the resource management company 13. And that language can be recognized with certainty.
[0034]
The data relating to voice recognition received by the external device 12 from the portable information processing device 1 or the resource management company 13 has an expiration date, and when the time set as the expiration date elapses, the data is automatically transmitted. Is to be deleted. Depending on the type of the external device 12, for example, a set time is set in days for a device that is used for a long time such as a home appliance, and is deleted in minutes for a device such as a vending machine. Is set to If data is used for security purposes, the data may be updated on a monthly or yearly basis.
[0035]
(Schematic operation explanation)
Next, an example of performing a preliminary operation check based on a recognition result will be described with reference to FIGS. First, FIG. 3 sequentially shows a schematic operation of the portable information processing device 1. FIGS. 4 and 5 show a flow in which these are detailed.
[0036]
In the operation flow of the portable information processing device 1 shown in FIG. 3, first, when an input is made by a user, the information is collected (step A1), and what the information means about the collected information is recognized. Processing is performed (step A2). Here, the information gathering of step A1 is a step of checking whether there is an input from outside, that is, the user A or another user, and the information recognition of the following step A2 is to change the information into another form when the input is made. Then, a process of changing the form to a form that is easy for the device to understand (in the voice recognition, an operation of changing the voice to text) is performed.
[0037]
Next, when the requested processing content can be recognized, the portable information processing device 1 determines whether or not execution is possible within the range of the information obtained on the recognition result (step A3). This is a process of analyzing text data and determining a user's intention from the text data (determining an operation to be performed by the device based on a command, a request, a question, and the like).
[0038]
Next, based on the recognition result, the operation of the request is checked in advance, and the part that cannot be recognized with the information necessary for execution is inquired to the user A to increase the recognized vocabulary (step A4). Here, the preliminary operation check means that if the user A cannot understand the words spoken, the user A confirms to the user A what purpose the user A has and what specific processing is expected. It is done to do.
[0039]
Here, the software and hardware conditions that meet the user A's intention are verified (the user's intention is checked and the operation is simulated. Here, the vocabulary increase, the setting value for the recognition condition improvement is adjusted, and the matching data is collected. ,accumulate).
[0040]
Subsequently, if it is determined that the internal resource cannot meet the request of the user A, the shortage resource is searched, and if the shortage resource is found, the user A is operated in cooperation with the outside (here, the shortage resource is used). To select whether to build an application in the portable information processing device 1 or to request a task to the outside), provide information and confirm, and the user A downloads the insufficient resources or performs a cooperative operation. Is received, the corresponding resource is collected or a process of requesting a task to the external device 12 (step A5) is performed. When the corresponding modules are collected in this manner, next, as operation determination processing (step A6), it is determined that the processing determined to be operable is actually performed, and the operation is performed (step A7). .
[0041]
Thereby, the operation contrary to the intention of the user A is not performed, the operation efficiency of the portable information processing device 1 is improved, and the characteristics of the user A are recorded to improve the recognition rate. In addition, it is possible to prevent an erroneous operation of the portable information processing device 1 due to a mistake or misunderstanding of the user A.
[0042]
(Detailed operation explanation)
Next, the operation of the portable information processing device 1 will be described in detail with reference to FIGS. First, the control circuit 14, which is the main part of this operation, performs a process as to whether or not the user A is going to perform input (conversation) with the device from the audio data input through the microphone 4 (step S1). Then, a process result such as detection of presence / absence of the voice of the user and reduction of background noise is constantly output, and a determination is made so that if there is an input (conversation) of the user A, the process can be surely shifted to a recognition process. (Step S2).
[0043]
The control circuit 14 determines whether or not there is a conversation based on the output result. If it is determined that there is no conversation, the process returns to step S1. (Step S3). Subsequently, the appropriately cut data is converted into digital data (step S4), and a conversion process is performed so that the data can be recognized (step S5).
[0044]
Next, the control circuit 14 performs a speech recognition process (speech matching) on the converted data (step S6), and converts this into text data (step S7). At this time, the sound volume, intonation data and the like are also analyzed.
[0045]
Thereafter, the control circuit 14 grammatically classifies the sentence structure of the obtained text data based on the word arrangement (step S8). Subsequently, words are extracted from the text data, and they are divided into parts of speech (nouns, verbs, particles, adjectives, etc.) (step S9). For the extracted words, IDs (data type tags) for classifying the parts of speech are respectively assigned. Attach and store (steps S10, S11).
[0046]
Here, the control circuit 14 checks the inconsistency of the part of speech attached to each word, or determines whether there is a word that could be recognized as a text but has no meaning (a word not in the recognition data dictionary). Is checked (step S12), and if there is no problem ("YES" is determined in step S12), the process proceeds to the next step S20.
[0047]
On the other hand, if the words have inconsistencies, the control circuit 14 proceeds to step S13, displays the inconsistent words on the display device, and prompts the user to input again. The control circuit 14 waits for the user to input again (steps S14 and S15), and the input data is subjected to a recognition process (step S16). If there is no re-input by the user, “YES” is determined in the step S15, and the screen moves to the start screen (return to the step S1).
[0048]
Here, the control circuit 14 analyzes the input data, determines whether or not the used word is in the data dictionary, and determines whether or not the word is inconsistent. If the input data cannot be understood (not in the recognition dictionary), the user is notified of the incomprehensible word by repetition or display. The user enters a word that was not understood thereby. The input result is analyzed to determine whether it can be understood. In this part, the control circuit 14 stores necessary data for recognizing the input word, and can increase the recognition rate by increasing the number of recognition candidates for the same user A input. Necessary data includes basic phoneme data, phoneme variation parameters, intonation, speed, changes in selected vocabulary, and the like.
[0049]
Next, the control circuit 14 checks again whether there is any inconsistency in the recognized data (step S17), and if there is any inconsistency, determines whether or not to register the data with the user (step S18), If "YES", a display is made to input a correct word and the user is requested (step S19). When a substitute word is input by the user, the control circuit 14 stores the sound data and the substitute word in association with each other. If the user does nothing while the set time has elapsed, the data is inconsistent and no further processing can be performed. Therefore, the user moves to the start screen ("NO" in step S18 and step S1). Back to).
[0050]
When there is no contradiction at the word level after obtaining the alternative input in step S19, the control circuit 14 next classifies the message type of the recognized text (step S20 in FIG. 5). Here, the message type is assumed to be, for example, each type of call, description, request, question, confirmation, response, and the like. At the time of this classification, the control circuit 14 searches for a verb from the classified text and analyzes and determines a message type from the context of the verb (step S21).
[0051]
Thereafter, the control circuit 14 determines whether or not the content of the message type can be handled (step S22). If it is determined that the content cannot be handled, the control circuit 14 reconfirms the message type with the user (step S23). In the reconfirmation process, a screen is displayed to prompt the user to input a message type. Then, when the user inputs re-confirmation, the control circuit 14 checks whether the result is the same message type as before and checks which message type is the result (step S24).
[0052]
If the control circuit 14 determines that the message type cannot be determined even if the message type is re-checked (determined as “NO” in step S24), the control circuit 14 displays a message indicating that the message cannot be handled, a reason why the message cannot be handled, and recommended items for input. (Step S25). In this case, it is preferable to provide guidance on an input method for clarifying the message type. For example,
"If you have a question, please use" ...? "
It is preferable to provide guidance by displaying such as or by transmitting voice.
[0053]
Next, if it is determined in step S22 that the message type can be handled in the text message type, the control circuit 14 analyzes the word included in the message type and checks whether there is a resource for processing the message. (Step S26).
[0054]
Next, when it is determined that the resources are insufficient (determination of “YES” in step S27), the control circuit 14 starts communication with the external device 12 and searches for the insufficient resources (step S28). As the external device 12, a search is made on the Internet 10 via PCs 11a to 11d at the office or home to which a user can contact, or a connection is made to a resource management company 13 that manages resources to inquire whether there is a resource.
[0055]
If the control circuit 14 finds a lacking resource by performing the search process (determined “YES” in step S29), the control circuit 14 reads out the attribute of the resource (step S30), and handles the resource lacking for the user. Is inquired (step S31).
[0056]
Here, the control circuit 14 downloads the resource to the user (step S33), or when the size of the insufficient resource is large, when the download time is too long, or when the internal processing capacity is expected to be insufficient, or the like. An inquiry is made to select whether to cooperate with an external device (step S34) or to cancel the process (step S35).
[0057]
When the user decides to execute (in step S32, one of steps S33 and S34 is selected), the control circuit 14 downloads the insufficient resources (step S33) or cooperates with the external device 12. The operation (step S34) is set up, the processing for constructing the application is executed (steps S36 to S39), and the operation according to the message of the user is performed (the function of this part can be said to be a real-time interactive application construction environment). .
[0058]
Note that the control circuit 14 classifies and stores the applications obtained through the above processing for each message type. In this case, if the storage area cannot be secured because the resource itself is large, the resource name and the location (address) information where the resource was obtained are stored. Thereby, when a similar user request is made in the same message type in the future, the application can be quickly constructed by reading out the stored resource information.
[0059]
(Description of the management system of the resource management company)
Next, a management system in the resource management company 13 using the above system will be described with reference to FIG. In FIG. 6, a resource management company 13 is mainly configured to manage user's voice recognition related data as resources.
[0060]
The above-described portable information processing device 1 has a telephone function, and a usage contract is made with a telephone company (not shown). At the same time as using the telephone, registration with the resource management company 13 for the extension of the voice recognition function is performed. Here, the voice recognition processing can be used as an auxiliary means for confirming the user himself / herself.
[0061]
First, when the user uses the telephone function using the portable information processing device 1, the speech recognition related data normally used by the user is improved, and the recognition rate is improved. The data related to the voice recognition is recorded periodically in the resource management company 13. As a result, even if the portable information processing device 1 owned by the user is broken, there is no danger of losing the voice recognition related data. Therefore, when the new portable information processing device 1 is used, the voice recognition related data is newly stored in the device. You do not need to create it.
[0062]
Next, when the user issues an instruction to the portable information processing device 1, the portable information processing device 1 checks the message type in accordance with the instruction as described above, and allocates resources corresponding to the message type from the resource management company 13 free of charge. get. The resource management company may adopt a system in which a fee is collected from the user according to the download of the resource.
[0063]
Further, by using the portable information processing device 1 as described above, the application constructed by the user can be managed by the resource management company 13 side. In this way, when another user wants to use the application of the managed resource, the user can share the application by distributing it for a fee or free of charge. At that time, if the usage fee can be paid to the user who built the application, the user who builds the application can also build an application that is actively provided, and the user who uses the application is already completed Choosing the right app from the apps you are using will allow you to use it as a quick and proven resource.
[0064]
The resource management company 13 proactively uses the voice recognition-related data of the user managed by the server with the external device 12 (service device for which a fee is charged), thereby collecting the use fee. Can be enjoyed. The use of the voice recognition related data for user recognition is provided by providing a procedure for notifying the resource management company 13 of the use somewhere in the procedure for requesting the purchase to the external device 12 so that the resource management company 13 can grasp the usage status. I do. For example, the resource management company 13 performs a billing process to the management company of the external device 12 at the timing when the voice recognition related data for user recognition is transferred to the external device 12.
[0065]
By constructing the system as described above, a device having a high user recognition rate can provide a recognition function superior to the conventional recognition function, so that the service is improved and the user is easily accepted. . In addition, since personal authentication can be performed strictly, security is also effective. In addition, since the voice management related data for user recognition is managed by the resource management company 13, there is no risk of losing its own data.
[0066]
FIG. 6 shows an example in which resources are collected in the portable information processing device 1 and an application is built in the portable information processing device 1. That is, in order to respond to the request of the user, a message type of the user is found, and it is verified whether or not the operation according to the message type can be performed. As a result, the operation cannot be performed only by the resources inside the portable information processing device 1. An example is shown in which an application is constructed by acquiring resources from the external device 12 or the like.
[0067]
When the portable information processing device 1 has hardware such as an arithmetic device and a memory that are sufficiently fast and has hardware resources capable of building a large application, the portable information processing device 1 can execute without any problem. When hardware resources are insufficient and a sufficient application cannot be built internally, it is necessary to build an application that processes a user's request in cooperation with an external hardware resource.
[0068]
The control circuit 14 of the portable information processing device 1 analyzes the content of the message type obtained from the language recognition result to simulate the construction of the application in what configuration can respond to the request of the user. If it can be handled by internal resources, build an application and execute the user's request.
[0069]
On the other hand, when the resources inside the mobile information processing device 1 cannot be used, or when the application can be constructed but the processing takes time, or when the application cannot be constructed because there is no hardware resource for constructing the application, the following: Take such a response. The control circuit 14 searches for an external resource. If the resource management company 13 having an external resource that can be handled, or the user can supplement the lacking resources (hardware) with the external devices 11a to 11d, the external device 12, or the like held in another place, the cooperative operation request and the Send the data including the request content.
[0070]
The devices 11a to 11d and 12 that manage the external resources that have received the request content reply from the portable information processing device 1 with a response indicating whether or not the request content can be responded, and when the response can be performed, how long the request content can be responded to. Send to circuit 14. Further, when the resource management company 13 whose usage is charged is used, the fee information and the like are also received.
[0071]
The portable information processing device 1 presents these to the user, and entrusts the user with the determination of whether to execute the request. In a user request, it is also possible for the user to make the same request many times, to judge the judgment conditions relating to the request, and to manage the cooperative operation without leaving the judgment to the user.
[0072]
(Explanation of data transfer from resource management company to external device)
7 and 8 schematically show how data is transferred from the resource management company 13 to the external device 12. FIG. As shown in FIG. 7, information is transmitted from the portable information processing device 1 of the user to the external device 12, and the external device 12 sends the recognition module, that is, the voice recognition related data for user recognition to the server of the resource management company 13 which is the host. Request transmission and receive the data. The external device 12 can recognize the language of the user of the portable information processing device 1 and process the user's request. Hereinafter, the flow of FIG. 8 will be described.
[0073]
In FIG. 8, the external device 12 makes use registration in advance with a server of the resource management company 12 (hereinafter, simply referred to as a resource management company) (step P1). The portable information processing device 1 also performs use registration with the resource management company 12 (step P2). The resource management company 13 accepts these use registrations (Step P3).
[0074]
Each time the user uses the portable information processing device 1, the voice recognition related data is stored and stored. The stored voice recognition related data is transmitted to the resource management company 12 at appropriate time intervals. (Step P4) The resource management company 12 periodically updates the data (Step P5).
[0075]
When the user A of the portable information processing device 1 wishes to use the external device 12, the portable information processing device 1 issues a use request to the external device 12 (step P6). In response to this, the external device 12 receives the external device use request, and reads the user ID included in the use request (Step P7). Next, the external device 12 makes a user confirmation request and a data use request to the resource management company 13 (Step P8).
[0076]
In response to this, the resource management company 12 performs a user confirmation process (step P9), and then sends necessary data to the external device 12 that has received the request (step P10). The external device 12 collects necessary data (resources) so as to process the request of the user (step P11), and sets up the application (step P12).
[0077]
When the process is completed, the external device 12 performs a display on the portable information processing device 1 or the external device 12 so as to prompt the user to input (Step P13). On the other hand, the user performs an input process using the portable information processing device 1 (Step P14). The external device 12 performs data recognition and response processing (Step P15).
[0078]
When the use is completed, the user performs a use completion input using the portable information processing device 1 (step P16). Upon receiving the use completion transmitted from the portable information processing device 1, the external device 12 performs processing to delete the data received from the resource management company 13 after a set time (step P17).
[0079]
(Explanation when mobile information processor builds application)
Next, with reference to FIG. 9, an example in which the portable information processing device 1 receives a request from a user, considers application construction, and builds the entire application using the external device 12 will be described. In this description, the processing performed by the control circuit 14 in the portable information processing device 1 will be described in a form in which an audio module, which is software, mainly operates.
[0080]
That is, the voice module of the portable information processing device 1 recognizes a language from a voice input by the user, and classifies the user's request into a message type based on the recognition result. Next, the resource manager analyzes the message type and its details, examines what resources are used to build the application, and creates an application specification design document. The application specification design document describes the types of resources required for building the application and their configurations (connection of application modules).
[0081]
Based on the application specification design document, the resource manager investigates resources inside the portable information processing device 1. In this case, an example is shown in which it is determined that it is difficult to process in the portable information processing device 1. For example, this case corresponds to a case where it takes too much time to build an application in the portable information processing device 1 because the amount of calculation is extremely large.
[0082]
The portable information processing device 1 sends the application specification design document and the resources of the portable information processing device 1 to the external device 12 to the external device 12. The external device 12 collects necessary resources from a resource management company 13 inside or outside the device and builds an application based on the application usage design document. The application built in the external device 12 gives a result in response to a user request. The issued result is sent to the portable information processing device 1 using the communication interface circuit, and presented to the user.
[0083]
FIG. 10 shows the relationship between the resource manager and the user when the application is constructed as described above. That is, the resource manager converts the language and gesture of the user into text, determines the message type and the message type correspondence information (required function modules and resources), and confirms the purpose of the user.
[0084]
When the resource manager knows the purpose of the user, the resource manager checks resources inside the own device, creates a temporary application, and determines whether or not the temporary application satisfies the user's purpose. If the user's purpose cannot be satisfied, resources are collected from outside, a temporary application is created again, and presented to the user. Place resources so that the app is fully functional where the user likes, and start running the app.
[0085]
Also, the configuration (resource list, resource arrangement, etc.) of the application that the user liked is recorded, and when the user later wants to operate the application again, the application can be quickly constructed.
[0086]
(Explanation of the case where the portable information processing device executes the process in cooperation with the external device)
In the above example, the portable information processing device 1 constructs an application on the external device 12 and returns only the result to the portable information processing device 1. Instead, as shown in FIG. The portable information processing device 1 builds a part of the application, the external device 12 builds the remaining applications, and operates in cooperation with each other. It may be possible to obtain a specific result.
[0087]
As an example of such a case, when an application that operates on JAVAVM and requires a large amount of resources is operated by the portable information processing device 1 having no resources, an application that cannot be operated by the portable information processing device 1 alone is connected to an external device. This is effective as a means for operating in cooperation with the mobile information processing apparatus 12 so as to make the user seem to operate only with the portable information processing device 1.
[0088]
Considering that a database of available resources on a network is provided and a user's request is processed by using them as appropriate so that any application can operate, the configuration shown in FIG. 11 is efficient.
[0089]
(Description of specific application examples)
Further, as another example, when a large number of images are created, such as when creating an animation of computer graphics, if one computer processes them, an enormous amount of computational power is required. Conventionally, image creation and moving image creation have been performed using a plurality of high-speed computers capable of mounting a plurality of CPUs.
[0090]
In such a case, by adopting the configuration of the present invention, a control application at the center of image creation builds application functions necessary for drawing on each of a plurality of low-load PCs on a network, and a CPU of the CPU. It becomes possible to allocate a drawing screen, the number of drawn images, and the like according to the ability. In addition, in order to convert the drawn result into a moving image, the control application searches for a PC or the like having a function to convert the drawn image, and issues an instruction to transmit data drawn by a plurality of PCs to the PC. Thus, a large-scale image (moving image) can be created without using expensive equipment as in the related art.
[0091]
However, this premise is that when the control application selects a PC with a small load, it receives a security function (mutual authentication), and when this authentication is confirmed, the selected PC receives an instruction. At this time, each of the external PCs to which the control application requests work has an available resource list, and the control application refers to the resource list and allocates work to the external PC. Further, the control application cannot access the resource area of the PC exceeding the resource list.
[0092]
(Explanation of the system established as a business model)
Next, a business model established using the above system will be described. The user of the PC to whom the control application requests the business is provided with services such as discounting the communication fee, points according to the usage time, and the ability to use the created image at low cost. In this way, by renting a PC to work, the purchase of the PC can be reduced.
[0093]
For example, the PC itself is mainly leased individually so that a user who wants to use the PC can jointly use the PC during idle time when the user is not using it. Here, the user who wants to use the free time is a heavy user who wants to run an application with a large load, and if a user who operates a normal application is a light user, he pays a time-based fee to both the light user and the heavy user. In this way, PC maintenance costs (electricity costs, communication costs) are paid by heavy users according to the usage time and amount. The light user can use the PC at a lower cost than before. In addition, there is an effect that a heavy user does not need a space for installing a PC.
[0094]
(Explanation of the example applied to the OS auxiliary application of the in-vehicle server)
Next, an example in which the above-described system is applied to an OS auxiliary application of an in-vehicle server will be described. That is, the auxiliary application of the in-vehicle server receives a request from outside (performs a plurality of processes at the same time). The auxiliary application (OSGi) determines whether the content of the request can be executed by an application module (an applet, a servlet, or its component software) mounted on the in-vehicle server.
[0095]
If the auxiliary application determines that it cannot be processed by the in-vehicle server main body, it checks what application module is insufficient. The auxiliary application accesses the network to check whether the missing module can be acquired. When the auxiliary application finds that the insufficient application module can be acquired via the network, the auxiliary application inquires of the user whether the application module can be acquired. Alternatively, the user sets in advance conditions for automatically acquiring an application module. If the condition is not satisfied, the user is inquired.
[0096]
The auxiliary application acquires the scarce resource via the network. When the auxiliary application acquires the resource shortage, the auxiliary application builds the application into an executable application and passes the process to the OS. The OS performs the requested processing. The operation of the application is felt and the completion is notified to the OS. When the OS confirms the completion of the processing, the result is passed to the auxiliary application. The auxiliary application deletes or saves unnecessary resources.
[0097]
Subsequently, in the case where the functions of the portable information processing device 1 in the above-described system are executed by PCs 11a to 11d (hereinafter, referred to as PC 11) as information processing apparatuses, software configured to execute the above-described system in the PC 11 is used. A case where a resource collection type AI module (hereinafter simply referred to as an AI module) is set and performed will be described.
[0098]
FIG. 12 is a chart showing the basic operation. When the AI module of the PC 11 located at the user's hand (home) receives a processing instruction (step R1) from the user (step R2), the AI module (software) is only the main body (hardware) where the AI module (resident) resides. It is determined whether the instruction can be processed (steps R3 and R4).
[0099]
If the instruction can be processed in the main body (determined as “YES” in step R4), the internal processing is executed and the result is output (steps R5 and R6). If it is determined that the command cannot be processed only by the main unit, the AI module generates an AI agent (soft module) that can be temporarily moved to another PC, and the other PC 12 (other information processing device or external information processing device). An AI agent (software module) is sent to the device (step R7).
[0100]
Upon receiving the AI agent (step R8), the other PC 12 starts the AI agent internally. The AI agent requests the use of the resources (hardware and software) in the PC 12 (step R9), and if OK (determines “YES” in step R10), completes the necessary processing using the resources. (Step R11), and transfers the completion result to a place (home) where the AI module is located (Step R12). Thereafter, the AI agent in the PC 12 self-destructs when the necessary processing is completed, or the AI agent stops, leaving an instruction to delete the AI agent to the OS (step R13).
[0101]
If the AI agent issues a request to use the internal resource and does not obtain an OK (determined “NO” in step R10), the request of the AI agent cannot be executed. This is notified to the PC 11 where the AI module, which is the source of the AI agent, resides (steps R14, R15).
[0102]
On the PC 11 side, when the AI module receives the processing result from the PC 12 to which the AI agent has been sent (step R16), the result is output to the user (step R6). If the request to use the internal resource is not OK from the AI agent sent to the PC 12, after receiving this notification (step R15), another PC 12 is searched and the above steps are repeatedly executed. Or take action if unavailable.
[0103]
In this manner, unlike remote processing using the network 10, there is no need to constantly flow data through the line for communication, so that congestion on the network line can be reduced. However, if this is easily executed, the privacy of the PC user may be touched. Therefore, each of the PCs 11 and 12 should have a function of limiting resources allocated to the AI agent from another PC. Is required.
[0104]
A network area opened to the AI agent is called a public area, and an area not opened to the public is called a protected area. The AI agent is basically set so that it can search and move public area information. Furthermore, if it is assumed that the AI agent issuer pays for the use of the network, the PCs 11 and 12 that have accepted the AI agent in accordance with the payment have a network configuration in which the use restrictions on the available area are relaxed. good. Further, it is preferable that each PC user obtains a price corresponding to the use from another PC user.
[0105]
Next, a specific case in which the above-described resource collection type AI module is applied will be described.
[0106]
(Specific case 1)
First, as a specific example 1, real image navigation will be described. This means that the driver can view the destination while driving, the road function (autonomous driving area), congestion, traffic congestion at the entrance of the parking lot, whether the parking lot is an automatic toll collection system, This is a navigation system that can obtain real image information such as presence / absence and the like and that can be displayed as a moving image to a driver.
[0107]
Here, the PC 11c mounted on the vehicle as the information processing device is configured to function as an in-vehicle server. The in-vehicle server 11c cooperates with the car navigation device to improve the navigation function. Then, various information described later is displayed using a display device of the car navigation device.
[0108]
The user (the driver of the vehicle or the use of a passenger) can know the name of the place (for example, a shopping center) on the vehicle where he / she wants to go on communication media or the like (or obtained information on another medium). And At that time, if the user views the location, the traffic congestion status (viewed from the sky), the parking lot availability, the traffic congestion status at the entrance of the parking lot, whether the parking lot is compatible with the automatic toll collection system, Consider a situation in which the user wants to know the presence / absence or the like and requests the vehicle-mounted server 11c to perform an investigation.
[0109]
The in-vehicle server 11c investigates its own resources (memory, DVD, CD, connected network, etc.). For example, there is no information on the place the client wants (current aerial photograph, introduction text), no images near the parking lot, no basic data for automatic driving (digital road information), etc. If it is determined that the request cannot be processed by the server 11c alone, at that time, the insufficient data and functions for responding to the user request are classified, a task to be processed is configured, and the task is processed. Create an AI module.
[0110]
The AI module referred to here is a program script composed of text, a programming language that can be understood by the partner PC, an instruction of a user's voice if the partner PC can recognize speech, or data obtained by converting the text thereof. There are various forms.
[0111]
Next, how the AI module operates will be described in detail. The in-vehicle server 11c sends various communication media information to the user and, if necessary, from the media in-vehicle device (or the additional function module of the in-vehicle server) that records the information, sends the keyword requested by the user to the research, A search is performed from the recorded digital data (the in-vehicle server 11c may be provided with the function of a media in-vehicle device).
[0112]
As the information, for example,
[Information 1]-"XX Shopping Center will provide members with a 30-minute time service from XX. Only those who have the keyword information to be sent will receive a 40% discount on the following products. "
Is obtained by the user.
[0113]
When the user wants the introduced product, the user can move to the OO shopping center from the current position by voice to the in-vehicle server 11c and inquire whether the desired product can be purchased.
[0114]
Here, it is assumed that the user simply inquires of the in-vehicle server 11c "Can the product with the above information be purchased?" The in-vehicle server 11c asks the user some questions in response to the user's request,
"Can this vehicle reach its destination by XX: 30 (within MM minutes)?"
Is determined. Thus, the vehicle-mounted server 11c executes a task of estimating the destination arrival time of the vehicle.
[0115]
The in-vehicle server 11c searches for a plurality of routes to the destination, and determines the possibility of purchasing a product desired by the user from the average traveling time when traveling at a legal speed. Here, when there is no possibility at all, the in-vehicle server 11c returns a response indicating that it is impossible to the user.
[0116]
On the other hand, when the in-vehicle server 11c determines that there is a possibility that the product can be purchased, accurate traffic information from the current location to the destination, traveling time when avoiding the traffic, traffic conditions near the destination (parking status). In consideration of the number of traffic jams near the parking lot), the moving speed near the parking lot, and the like, processing for estimating the possibility of purchase is performed. However, there is a case where the above information is local information and detailed information cannot be obtained from the position of the vehicle-mounted server 11c. At that time, the on-vehicle server 11c needs to access various information transmitting devices near the destination to collect necessary information.
[0117]
For example, assuming that the route 1 to the target shopping center passes through prefectural roads A, B, C, and D, it is necessary to collect real-time information during that time. If there are other routes, real-time information is similarly collected for those routes to determine the arrival time.
[0118]
As shown conceptually in FIG. 13, the in-vehicle server 11c classifies the user's request into each passing area of the prefectural road, divides the request into tasks 1, 2, 3, and the like of the classification unit, and performs the AI module 1 that performs the task. , 2, 3 etc., and investigate the transit time. Receiving the respective transit times, the travel time to the destination can be accurately estimated.
[0119]
FIG. 14 shows the settings of the AI agent generated by the AI module, including the AI module ID, target network ID, script text, search area, answer data (unit), answer deadline, AI module life, options, and the like. It is a thing.
[0120]
Next, an example of a specific configuration of the AI agent will be described with reference to FIG. As the AI module ID, for example, a value in the IPv6 format is set. This includes the IP of the in-vehicle server 11c that has created the AI module. Then, the answer data is automatically returned to the in-vehicle server 11c. This may include even the task ID. As a setting example, for example,
"12DE: 09a1: 333F: FFFF: 12DE: 09a1: 333F: FFFF"
It is.
[0121]
As the target network ID, for example, the IP of the server (network) in the setting area is set (if there are a plurality, the plurality is set). . The access level of the AI agent is divided into public, private 1, private 2, and administrator access rights. In addition, it is usually set to public.
[0122]
Script text, for example,
"Calculate the transit time of the passing vehicles on the prefectural road XX line AB point from the passing times of multiple passing vehicles."
Etc., which may be described by arranging commands and data in order.
[0123]
The search area is a server in the latitude range or the longitude range, or a server of the resource management company 13 having an information database of the related area. Answer data, for example,
"Vehicle transit time at prefectural road XX line AB point (unit minutes)"
Set as etc. The data format can be set as text, binary, XML, etc., but it is often desirable to set the data format in a highly versatile XML format.
[0124]
The answer deadline is set to a time of, for example, 30 seconds. The life of the AI agent is set to, for example, 35 seconds. As an option 1, a condition in which the server that accepts the AI agent requests the accepting server to notify the sender that the life of the AI agent has expired (erased). Set the extension conditions, etc. The response term extension condition sets whether to extend the time if the processing is not completed within the designated time, or to stop the processing when the time comes.
[0125]
Here, position coordinates are set in the server to be searched. When the server is mounted on the target vehicle, the vehicle may move out of the search area due to the movement of the vehicle. In this case, vehicles that are out of the designated search area can be excluded from the search target.
[0126]
The in-vehicle server 11c uses a keyword to obtain general information on which server has which information on which network in order to search for a network around the destination. On the basis of the result, the vehicle server 11c creates a plurality of AI modules.
[0127]
The AI module first determines the general inspection network area and the search key in which the returning AI agent is active, and sends the AI agent to a server in the inspection network area. Among the plurality of AI agents, the AI agent first sent from the in-vehicle server 11c determines a work range and work contents according to the accepted network resources, and notifies the in-vehicle server 11c. The range of the work and the contents of the work are appropriately determined by the server that has received the AI agent.
[0128]
As shown in FIG. 16, the information returned by the first AI agent to the AI module is as follows. The AI module ID is assigned a value in the IPv6 format as described above. The ID of the in-vehicle server is set as the target network ID of the transmission destination. The investigation range server IP is set to the IP (determined by the AI agent receiving server) of the server that has been authenticated to perform the investigation.
[0129]
The authentication number is an authentication number indicating the result of the acceptance by the AI agent, and is issued by the receiving server. From the value of the authentication number, it can be considered later when the AI agent and the receiving server start processing. The investigation classification range is a category (or keyword) investigated by the AI agent.
[0130]
The AI module sets the work contents of the next AI agent so as not to overlap with the first AI agent, and transmits the work contents to the target server (network). Thereafter, similar settings are made to the AI agent transmitted from the vehicle-mounted server.
[0131]
When the AI agent is accepted, the accepting server reads the script or command included in the AI agent and executes the purpose of the AI agent. At this time, the receiving server analyzes the request contents of the AI agent and can reply with the information of the public area, that is, if the target data is obtained (for example, the receiving server stores the database of the vehicle traffic time in the public area). If it does, it is included in the response data of the AI agent and returned to the in-vehicle server 11c.
[0132]
(Specific case # 2)
As another form of the AI agent, the AI agent may be opened on the receiving server as one application, sequentially execute scripts included in the AI agent, obtain a result, and return the result to the vehicle server.
[0133]
As a specific example of the script, for example,
"Calculate the transit time of vehicles passing through the prefectural road XX line AB point from the transit times of multiple vehicles."
That is.
[0134]
For this reason, a case where the AI agent is sent from the in-vehicle server 11c to the traffic management server 12, which is an information processing support device, will be described.
[0135]
(1) The in-vehicle server 11c transmits the AI agent to the traffic management server.
(2) The traffic management server 12 authenticates the AI agent.
(3) The traffic management server 12 transmits the AI agent authentication result to the on-vehicle server.
(4) The traffic management server 12 translates the operation unit (script) of the AI agent and configures software so that the purpose of the AI agent can be achieved. In addition, the database of the traffic management server 12 is searched to find target data (data of travel time at the points A and B at the time of XX).
[0136]
(5) When the traffic management server 12 finds the target data (the traveling time between the vehicles A and B or the traveling speed of a plurality of vehicles is found, the traffic management server 12 processes the data and gives the answer of the traveling time between the vehicles A and B.
(6) The traffic management server 12 forms the set data configuration and returns an answer to the on-vehicle server 11c. If the option-related data needs to be sent, they are also sent to the in-vehicle server 11c at the same time.
(7) The in-vehicle server 11c that has received the response returns a reception completion signal if the response is sufficient.
(8) On the other hand, if the answer is insufficient (for example, when the number of samples is small and the accuracy is low), the in-vehicle server 11c constructs a new script (average traveling speed on a day with similar traffic conditions) to manage traffic. Send to server 12.
(9) If the received data is the received AI agent, the traffic management server 12 sends the script to it and performs the data search again.
(10) If the result is obtained, the traffic management server 12 returns a reply to the vehicle-mounted server 11c again.
(11) When the life of the AI agent has expired, the traffic management server 12 deletes the AI agent.
[0137]
The AI agent returns a response when it arrives at the destination server and is accepted, and thereafter returns a response until a result is obtained or only when the time is over. For this reason, communication between servers does not need to be performed at any time as in normal network processing, so that network traffic can be suppressed.
[0138]
(Specific case 3)
As another example, an example is shown in which the in-vehicle server 11c traveling at the point AB is monitored in real time to obtain the actual vehicle speed.
(1) The in-vehicle server 11c of the own vehicle searches for the server 12 (information processing support device) of the vehicle traveling between the points AB.
(2) As a result of the search, if there is a vehicle traveling between the points A and B, the IP is checked, and the AI agent is sent to the server 12 of the vehicle.
(3) If the server 12 of the vehicle to which the AI agent is sent permits the access of the AI agent, the AI agent transmits information such as the vehicle speed, the running time, and the situation around the vehicle to a vehicle speed sensor (or a measurement result memory area). Gather sufficient information using a vehicle or an in-vehicle camera. Alternatively, the script attached to the AI agent is executed by the in-vehicle server 12 of another vehicle.
[0139]
(4) When necessary information is collected, the AI agent (or the server 12 of another vehicle) returns a result to the on-vehicle server 11c of the own vehicle.
(5) The in-vehicle server 11c collects similar information from a plurality of vehicles and obtains accurate travel time information.
(6) When accessing the server 12 of another vehicle, the usage fee is calculated according to the access time (if the access is set to pay).
[0140]
(Specific case # 4)
Next, an example of the operation of the AI agent when performing image editing on a car will be described. Here, an example is shown in which, when the own vehicle does not have a telephoto camera and the desired scene cannot be photographed, the scene is photographed using the telephoto camera of another vehicle and processed in the vehicle. At this time, there is shown an example in which there is no processing software in the vehicle and resources of the processing software are brought in from outside.
[0141]
(1) The in-vehicle server 11c is requested by the user to take a picture specifying a shooting position and to collectively create a single screen. This is the case, for example, when creating a drive recording album. However, it is assumed that the in-vehicle server 11c determines that the designated angle (for example, telephoto) is impossible with the camera of the own vehicle. It is also assumed that it is determined that a function for collecting photos is not held.
[0142]
(2) The in-vehicle server 11c accesses the server 12 of a nearby vehicle and sends an AI agent to check whether or not there is a vehicle that can take a picture at the designated angle.
(3) The angle desired by the user is specified in the script of the AI agent, and when the image of the camera of another vehicle satisfies the specified condition, the image is captured.
(4) The image resource captured by another vehicle is sent to the vehicle-mounted server 11c of the own vehicle by the AI agent.
[0143]
(5) In parallel, the in-vehicle server 11c searches the network to search for an image software module (resource) for collecting photos, and sends the AI agent to a resource server having related resources. The script of the AI module includes search conditions (photo image editing function, enlargement / reduction, composite, superposition, layer configuration, etc.).
[0144]
(6) The resource server 12 sends necessary resources to the vehicle server 11c. Here, if payment is required, payment processing is performed at this point.
(7) The in-vehicle server 11c edits the data received from the other vehicle using the image editing resource so as to suit the user's preference. The result is shown to the user in the middle of editing, and editing software (reception resources) is used until the result is satisfied by the user.
[0145]
(Specific case # 5)
Next, a specific example in the case of purchasing a mail order product will be described. For example, an example is shown in which a user goes to a destination where the product is sold in order to immediately purchase a product that the user has learned through digital broadcasting.
[0146]
In a vehicle, a user obtains (views and listens to) information on an article he or she wants to purchase from a digital broadcast. At this time, it is assumed that the user can hear the name of the product, but cannot know when and where it is sold.
[0147]
The user requests the in-vehicle server 11c to search a digital broadcast by using a part of the information that cannot be completely heard as a search keyword. The in-vehicle server 11c causes the in-vehicle media device 12 to call a broadcast program listened to by a past user, and to select a plurality of portions that match the search keyword from the broadcast programs.
[0148]
The in-vehicle server 11c selects some candidates selected by the in-vehicle media device 12 and provides them to the user. If there is a suitable one, the user indicates it to the in-vehicle server 11c, and the in-vehicle server 11c determines a necessary part of the broadcast program from which the user has obtained information.
[0149]
The in-vehicle server 11c inquires the user about the contents desired by the user. For example, if the user responds that he / she wants to go to the sales location in a short time in order to purchase the item immediately, the vehicle-mounted server 11c searches for the route information to the sales location based on the determined digital broadcast program. I do. In this case, for example, when a today's travel schedule is set, it is also possible to consider how the vehicle travels and moves in order to go between the schedules.
[0150]
If the name of the sales company that sells the product that the user wants to purchase is included in the digital broadcast data, the sales location can be searched using the data as a search key. This presupposes that the broadcast program is created such that the link data to the sales company is embedded in the sales place, or conversely, the link data of the sales information is embedded in the sales company data. Condition.
[0151]
In this case, the media in-vehicle device 12 switches various digital information sent to the vehicle according to the user's request, and records a history of when and what the user listened to. The digital information data recorded by the media on-board unit 12 includes link data (for example, a URL address) that can be linked with a plurality of related information. The in-vehicle media device 12 is configured to separately record a program set by the user.
[0152]
In order to confirm information obtained from the communication media, the user can play back the information he has heard, search for a keyword, and perform an information search. Here, since the communication media information is converted into a digital signal and sent to the vehicle, the vehicle is equipped with a communication medium recording unit. The user can reconfirm the information (speech) he has heard.
[0153]
The voice information is converted to text information when text information is required for information retrieval or the like. Alternatively, when text information is transmitted simultaneously with the voice in advance, information search may be used using the text information as a search key. In addition, if the digital broadcast signal includes information for connecting (linking) to necessary information such as a URL, the driver can use the information to immediately access a related information site. Become.
[0154]
When a user searches using a so-called browser when accessing each site, it is difficult to access many servers at once to obtain information. Therefore, the in-vehicle server sends the AI module to the server of many related links, and collects a lot of information at the same time.
[0155]
As described above, the AI agent includes a script in which user preferences, price ranges, and the like are entered. In this way, many web sites can be searched at once, and a large amount of information can be collected in a short time. By collecting the collected information in the in-vehicle server 11c, subsequent processing can be easily performed.
[0156]
(Specific case 6)
Next, an example of data collection and processing will be described. While the user is traveling, the data file of the office user PC 11b is searched, and if a necessary file is found, the found file is transferred and displayed on the traveling vehicle. If the required data is not found on the user PC 11b, the AI agent is sent to the office network, selects a file similar to the file desired by the driver from the network, reconstructs the data, and sends it to the vehicle (driver). Forward.
[0157]
If the information data desired by the driver is not on the network, the AI agent searches them from the accessible area of the office network, searches for the data desired by the driver, processes the search data if necessary, Send to driver.
[Brief description of the drawings]
FIG. 1 is a schematic configuration diagram of a system showing an embodiment of the present invention.
FIG. 2 is an electrical block diagram of the portable information processing device.
FIG. 3 is a schematic flowchart of a process performed by the portable information processing device;
FIG. 4 is a flowchart of a processing program of the portable information processing device (part 1).
FIG. 5 is a flowchart of a processing program of the portable information processing device (part 2).
FIG. 6 is a diagram illustrating the operation of the resource management system.
FIG. 7 is a conceptual diagram of data transfer from a resource management company to an external device.
FIG. 8 is a flowchart showing the operation of the portable information processing device, the resource management company, and the external device in a mutual relationship;
FIG. 9 is an operation explanatory view showing a cooperative operation with an external device (part 1)
FIG. 10 is a view for explaining the flow of application construction of a resource manager.
FIG. 11 is an operation explanatory view showing a cooperative operation with an external device (part 2);
FIG. 12 is a flowchart showing an operation between the AI module and another PC.
FIG. 13 is an explanatory diagram of a configuration of a task based on a user request.
FIG. 14 is an explanatory diagram of setting items of an AI module.
FIG. 15 is a diagram showing a configuration example of an AI agent.
FIG. 16 is an explanatory diagram of information returned by an AI agent to an AI module.
[Explanation of symbols]
1 is a portable information processing device (information processing device), 4 is a microphone, 5 is a speaker, 6 is a CCD camera, 10 is a network, 11a to 11d are PCs (external devices and information processing devices), and 12 is an external device (information processing device). Support device), 13 is a server of the resource management company, and 14 is a control circuit.

Claims (14)

Receiving means for receiving a request for information processing from outside;
Determining means for determining whether the request information received by the receiving means can be executed using its own resource,
A search unit that searches for a lacking resource when it is determined that the resource is not executable by the determination unit and determines whether the resource can be collected from outside;
A program construction means for constructing a processing program for collecting the insufficient resources and executing the requested information processing when it is determined that collection is possible by the search means;
An execution unit that executes the requested information processing using the own resource or the processing program constructed by the program construction unit. The information processing device according to claim 1,
When the search means determines that the insufficient resource is hardware, a processing request for searching for an information processing support device capable of using the hardware of the insufficient resource and requesting information processing to be performed by the hardware Means,
Receiving means for receiving the information processing result from the information processing support apparatus. The information processing device according to claim 1 or 2,
A processing time estimating means for estimating the processing time when processing the requested information processing using only its own resource and the processing time when processing in cooperation using external resources;
Processing information selecting means for comparing the two processing times estimated by the processing time estimating means and selecting and executing a processing method suitable for processing the requested information processing; Processing equipment. The information processing apparatus according to claim 1,
The receiving means,
Input means for receiving a request for information processing that is input by voice by a person,
An information processing apparatus, comprising: request interpreting means for interpreting voice information input by the input means as information executable by the executing means. The information processing apparatus is provided so as to be accessible from an information processing apparatus via a network. An information processing support device comprising a resource providing unit for providing. The information processing support device according to claim 5,
When the resource providing unit determines that the lacking resource is hardware, it searches for another information processing support device that can use the hardware of the lacking resource and requests information processing to be performed by the hardware. An information processing support device, comprising: a processing request unit that performs processing. Information to be performed by the target hardware when a request to use the hardware of the scarce resource is received by a processing request unit of the information processing device according to claim 2 or the information processing support device according to claim 5. An information processing support apparatus comprising: processing means for receiving and processing a process; and transmitting means for passing a processing result of the processing means to a receiving means of the information processing apparatus. The information processing support device according to any one of claims 5 to 7,
An information processing support apparatus, wherein, when a resource provided by the apparatus itself corresponds to an external resource selected by a processing method selection unit of the information processing apparatus, the requested information processing is executed in cooperation with the request. When transmitting voice information through a network using the information processing apparatus according to claim 4,
Connected to a network, identification information generating means for generating identification information of the user based on the audio information transmitted from the information processing device,
A resource management unit for managing the identification information generated by the identification information generation unit as a resource. An information processing apparatus that allows a user to request an information processing request, and at least one information processing support apparatus that operates upon receiving an information processing request from the information processing apparatus via a network;
The information processing device,
Means for determining whether the information processing request can be processed by internally held resources,
Resource acquisition means for acquiring from outside via a network to request an external device for a resource that is insufficiently processed by internally owned resources,
The information processing support device,
A software resource providing unit that searches for the software resource and sends it to the information processing apparatus when the resource shortage is received from the information processing apparatus when the resource shortage is software;
When the scarce resource is hardware, searching means for searching for the scarce resource of the hardware,
A task requesting unit for requesting a peripheral device having hardware searched by the searching unit for a task whose processing has been delayed due to the lack of the hardware resources;
An information processing support system comprising: a transfer unit that receives a request result from the requested peripheral device and sends the result to the information processing apparatus. The information processing support system according to claim 10,
When the request is made by inputting voice information to the information processing device, the identification information of the user who performed the voice input is generated based on the input voice information, and this is generated by the information processing device. An information processing support system provided with resource management means for externally managing resources. The information processing support system according to claim 11,
The information processing support system, wherein the resource management unit is configured to receive and manage an application built on the information processing apparatus side as a resource. The information processing support system according to claim 11, wherein
The information processing support system, wherein the resource management unit provides the user recognition information in response to a request from the information processing support device. Determining means for determining whether or not the command can be processed only by the hardware of the main body when receiving the command from the user;
When the determining means determines that the instruction cannot be processed only by the main body, the AI that temporarily moves to an external information processing support apparatus and generates an AI agent that completes necessary processing using the resource is used. Agent generating means,
The AI agent completes necessary processing using resources internally held in the information processing support apparatus, and transfers the completion result to a location before movement. An information processing support system characterized by being configured to disappear.

Images