CN103677546B - Electronic device and its information processing method - Google Patents

Abstract

The invention provides electronic equipment and an information processing method thereof, wherein the information processing method is applied to first electronic equipment, the first electronic equipment and second electronic equipment are provided with data paths, and the information processing method comprises the following steps: detecting an input operation of a user to obtain input operation information; detecting a relative spatial parameter between the first electronic device and the second electronic device; determining feedback information according to the relative space parameters and the input operation information; and sending the feedback information to the second electronic equipment, wherein the second electronic equipment feeds back to a user according to the feedback information.

Description

Electronic device and its information processing method

technical field

The present invention relates to the field of information processing, and more specifically, the present invention relates to an electronic device and an information processing method thereof.

Background technique

With the popularity of portable terminals such as smart phones and tablet computers, cooperation between the portable terminals and other electronic devices such as television sets has attracted more and more attention.

However, at present, most of the applications related to the collaboration between the portable terminal and other electronic devices only focus on using the display unit of the other electronic device to display the content on the portable terminal. That is to say, in the prior art, usually only the content displayed and/or played on the portable terminal is mapped to the other electronic equipment as it is, so that the user can watch and/or Listen to what is said. In such a technology, the synergistic effect between the portable terminal and the other electronic devices is not fully reflected, and for the user, the user experience is relatively simple.

Contents of the invention

In view of the foregoing, the present invention provides an electronic device and an information processing method thereof, which can utilize different electronic devices for cooperative operations, thereby enriching user experience.

According to an embodiment of the present invention, an information processing method is provided, which is applied to a first electronic device, and the first electronic device has a data path with a second electronic device. The information processing method includes: detecting an input operation of a user, Obtaining input operation information; detecting a relative space parameter between the first electronic device and the second electronic device; determining feedback information according to the relative space parameter and the input operation information; and storing the feedback information sending to the second electronic device, wherein the second electronic device provides feedback to the user according to the feedback information.

The determining the feedback information may include: determining feedback image information and/or feedback sound information according to the relative spatial parameters and the input operation information; and the second electronic device may correspondingly display the Feedback images of feedback image information and/or output feedback audio corresponding to the feedback sound information.

The determining the feedback information may include: determining feedback time information according to the relative space parameter and the input operation information; and the second electronic device performs the feedback at the feedback time indicated by the feedback time information. feedback.

The information processing method may further include: determining sending time information according to the relative space parameter and the input operation information; wherein, sending the feedback information to the second electronic device includes: Send the feedback information to the second electronic device at the indicated sending time.

The detecting the user's input operation may include: detecting the user's sliding touch operation on the first electronic device or the movement of the first electronic device.

The input operation information may include speed information and/or acceleration information about the sliding touch operation or the movement of the first electronic device; and, the determining the feedback information may include: according to the relative space parameter, and according to The speed information and/or acceleration information determine the feedback information.

The input operation information may include speed information and/or acceleration information about the sliding touch operation or the movement of the first electronic device; and, the determining sending time information may include: according to the relative spatial parameter, and Determine sending time information according to the speed information and/or acceleration information.

The relative spatial parameter may be at least one of a relative distance between the first electronic device and the second electronic device, or a relative positional relationship between the first electronic device and the second electronic device .

Determining the feedback sound information may also include: according to the relative spatial parameter and the input operation information, determining first indication information for outputting the first audio, and causing the second electronic device to output as the feedback audio The second indication information of the second audio of the second audio, the second audio corresponds to the first audio;

Moreover, the information processing method may further include: outputting the first audio based on the first instruction information; and sending the second instruction information to a second electronic device; wherein, the second electronic device according to For the second indication information, output the second audio corresponding to the second indication information.

According to another embodiment of the present invention, an information processing method is provided, which is applied to a second electronic device, and the second electronic device has a data path with the first electronic device, and the information processing method includes: receiving the first The input operation information sent by the electronic device, the input operation information is generated after the user operates the first electronic device; detecting the relative spatial parameters between the first electronic device and the second electronic device; according to the The relative space parameter and the input operation information are used to determine feedback information; and feedback is given to the user according to the feedback information.

The determining the feedback information may include: determining feedback image information and/or feedback sound information according to the relative spatial parameters and the input operation information; and, the feedback step includes: correspondingly displaying information corresponding to the feedback The feedback image of the image information and/or the output of the feedback audio correspond to the feedback sound information.

The determining the feedback information may include: determining feedback time information according to the relative spatial parameter and the input operation information; and the feedback step may include: performing the feedback at the feedback time indicated by the feedback time information. feedback.

According to another embodiment of the present invention, an electronic device is provided. The electronic device serves as the first electronic device and has a data path with the second electronic device. The electronic device includes: a first detection unit for detecting an input operation of a user, obtaining input operation information; a second detecting unit, detecting a relative space parameter between the first electronic device and the second electronic device; a determining unit, determining feedback information according to the relative space parameter; and a sending unit, Sending the feedback information to the second electronic device, wherein the second electronic device provides feedback to the user according to the feedback information.

The determination unit may be configured to determine feedback image information and/or feedback sound information according to the relative spatial parameters and the input operation information; and, the second electronic device may correspondingly display the feedback image information The feedback image and/or output feedback audio corresponding to the feedback sound information.

The determining unit may be configured to determine feedback time information according to the relative spatial parameter and the input operation information; and, the second electronic device may perform the feedback at a feedback time indicated by the feedback time information.

The electronic device may further include: a sending time determining unit, configured to determine sending time information according to the relative space parameter and the input operation information; wherein, the sending unit is configured to transmit at the sending time indicated by the sending time information , sending the feedback information to the second electronic device.

The determining unit may be configured to determine, according to the relative spatial parameter and the input operation information, first instruction information for outputting the first audio and information for causing the second electronic device to output as the feedback audio The second indication information of the second audio, the second audio corresponds to the first audio; the sending unit may be configured to send the second indication information to the second electronic device, wherein the second electronic device The device outputs the second audio corresponding to the second instruction information according to the second instruction information; and, the electronic device may further include: an audio output unit, based on the first instruction information, output the first audio.

According to another embodiment of the present invention, an electronic device is provided. The electronic device serves as a second electronic device and has a data path with the first electronic device. The electronic device includes: a receiving unit for receiving the data sent by the first electronic device. The user's input operation information; the detection unit detects the relative space parameter between the first electronic device and the second electronic device; the determination unit determines the feedback information according to the relative space parameter and the input operation; and a feedback unit, configured to give feedback to the user according to the feedback information.

The determining unit may be configured to determine feedback image information and/or feedback sound information according to the relative spatial parameters and the input operation information; and, the feedback unit may include: an output unit correspondingly displaying information corresponding to the Feedback images of feedback image information and/or output feedback audio corresponding to the feedback sound information.

The determining unit may be configured to determine feedback time information according to the relative spatial parameter and the input operation information; and the feedback unit may be configured to perform the feedback at a feedback time indicated by the feedback time information.

In the electronic device and the information processing method thereof in the embodiment of the present invention, according to parameter information such as distance or relative position between at least two electronic devices, corresponding feedback information is determined and fed back to the user. Through such cooperative operations among electronic devices, a more realistic experience can be brought to the user, thereby enriching and improving the user experience.

Description of drawings

FIG. 1 is a flowchart illustrating an information processing method according to an embodiment of the present invention;

2 is a flowchart illustrating an information processing method of another embodiment of the present invention;

3 is a block diagram illustrating a main configuration of an electronic device according to an embodiment of the present invention;

FIG. 4 is a block diagram illustrating a main configuration of an electronic device according to another embodiment of the present invention.

5A-5H are schematic diagrams illustrating the display of the first electronic device and the second electronic device to which the information processing method according to the embodiment of the present invention is applied.

detailed description

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

First, an information processing method according to an embodiment of the present invention will be described with reference to FIG. 1 .

The information processing method in the embodiment of the present invention is applied to an electronic device. The electronic device may be a portable terminal such as a tablet computer, a smartphone, or the like. There is a data path between the electronic device and other electronic devices. In other words, the electronic device may communicate with the other electronic device through a wired or wireless link. The specific form of the wired or wireless link is not limited. The other electronic devices may be electronic devices such as smart TVs, notebook computers, personal computers, and the like. In the following description, for convenience of description, when appropriate, the electronic device is referred to as a first electronic device, and the other electronic device is referred to as a second electronic device.

As shown in FIG. 1 , when the information processing method of the embodiment of the present invention starts, first, in step S101 , the information processing method detects a user's input operation to obtain input operation information.

Specifically, in an embodiment, the first electronic device may include, for example, a touch sensing unit. The user may perform a touch operation such as a sliding touch operation or a click touch operation on the first electronic device. Thus, the information processing method can detect the sliding touch operation or click touch operation performed by the user on the first electronic device through the touch sensing unit, so as to obtain input operation information, such as information related to the sliding touch operation or click touch operation. The information of the instruction corresponding to the operation. In addition, the information processing method may also obtain, as the input operation information, speed information and/or acceleration information such as a sliding speed on the sliding touch operation.

In another embodiment, in addition to the above-mentioned touch sensing unit, the first electronic device may further include, for example, a pressure sensing unit. Thus, the information processing method can detect pressure such as the above-mentioned sliding touch operation or click touch operation through the pressure sensing unit, so as to obtain pressure information about the strength of the operation.

In another embodiment, the first electronic device may include an acceleration sensing unit, for example. The user can move the first electronic device through an operation such as grasping the first electronic device and waving it. Therefore, the information processing method may detect the motion of the first electronic device through the acceleration sensor, so as to obtain indicated information corresponding to the motion as the input operation information. In addition, the information processing method may also obtain velocity information and/or acceleration information when the first electronic device is in motion as the input operation information.

Next, in step S102, the information processing method detects a relative spatial parameter between the first electronic device and the second electronic device.

Specifically, the relative spatial parameter is a parameter representing a spatial relationship between the first electronic device and the second electronic device. More specifically, the relative spatial parameter may be the relative distance between the first electronic device and the second electronic device, or the relative positional relationship between the first electronic device and the second electronic device at least one of the

For example, the first electronic device may include a ranging sensor. The ranging sensor may be an ultrasonic ranging sensor, a laser ranging sensor, an infrared ranging sensor, or other ranging sensors in various forms. The information processing method may detect the relative distance between the first electronic device and the second electronic device through the distance measuring sensor.

Additionally, the first electronic device and the second electronic device may include a global positioning system. The information processing method may obtain the location of the first electronic device and the second electronic device based on the detected geographic location of the first electronic device and the location of the second electronic device received from the second electronic device. The relative positional relationship between the two electronic devices. The relative positional relationship may be in the form of an angle between a reference point of the first electronic device (eg, the location where the GPS is installed) and a reference point of the second electronic device (eg, the location where the GPS is installed) Accurately represented, it can also be roughly represented with a range of positions such as left, center and right according to the angle.

Certainly, the above-mentioned method of determining the relative position relationship by using GPS is only an example. The information processing method may also determine the relative positional relationship between the first electronic device and the second electronic device in various other ways. For example, the information processing method can determine the reference point (specific signal sending unit) of the second electronic device that sends the specific signal by receiving the specific signal (such as an infrared signal) sent by the second electronic device. The relative positional relationship between the reference points (specific signal receiving unit) of the first electronic device for the specific signal is used as the relative positional relationship between the first electronic device and the second electronic device.

Thereafter, in step S103, the information processing method determines feedback information according to the relative spatial parameter and the input operation information, and sends the feedback information to the second electronic device in step S104. Thus, the second electronic device provides feedback to the user according to the feedback information.

Specifically, the feedback information may include at least one of feedback image information, feedback sound information, and feedback time information.

In an embodiment, the information processing method determines feedback image information according to the relative spatial parameter and the input operation information. More specifically, multiple parameter value ranges may be preset in the first electronic device, and the feedback image corresponding to the input operation information is determined according to which parameter value range the relative spatial parameter is in.

For example, as images corresponding to the input operation information, multiple images may be pre-stored in the second electronic device. The information processing method may determine a plurality of images corresponding to the input operation information according to the input operation information. Thereafter, the information processing method selects an image from the plurality of images according to the relative spatial parameter, and generates an image instructing the second electronic device to display its pre-stored image that is stored by the first electronic device. The indication information of the selected image is used as the feedback image information.

Alternatively, the plurality of images may not be pre-stored in the second electronic device. The information processing method, after selecting one image from a plurality of images corresponding to the input operation information, generates image information on the content of the selected image as the feedback image information.

In another embodiment, the information processing method determines feedback sound information according to the relative spatial parameter and the input operation information. It is similar to the above-mentioned processing of image information, and will not be described in detail here. Likewise, the feedback audio information may be instruction information instructing the second electronic device to output its pre-stored audio selected by the first electronic device, or information about the audio selected by the first electronic device. Audio information for the audio content.

In another embodiment, the information processing method determines feedback time information according to the relative spatial parameter and the input operation information. For example, a linear or nonlinear mapping relationship between the relative space parameter and the feedback time may be preset in the first electronic device, so as to determine the feedback corresponding to the input operation information according to the relative space parameter time. More specifically, multiple parameter value ranges may be preset in the first electronic device, and the feedback time is determined according to which parameter value range the relative spatial parameter is in.

The second electronic device performs the feedback at the feedback time indicated by the feedback time information. The feedback time information may be absolute time, such as time information expressed in hours, minutes, and seconds. Alternatively, the feedback time information may also be a relative time interval between when the first electronic device sends the feedback information and when the second electronic device performs feedback, that is, time interval information.

Therefore, a time delay is introduced in the process from the detection of the user's operation by the first electronic device to the feedback of the second electronic device, and the time delay is different from that between the first electronic device and the second electronic device. Relative spatial parameters between electronic devices are correlated, thereby making the user experience more realistic.

In the above embodiment, the time delay is generated by causing the second electronic device to delay feedback. Alternatively, the time delay may also be generated by causing the first electronic device to delay sending.

More specifically, the information processing method may also determine sending time information according to the relative space parameter and the input operation information. Thereafter, the information processing method sends the feedback information to the second electronic device at the sending time indicated by the sending time information.

The process of determining the sending time information in the information processing method is similar to the process of determining the feedback time information, which will not be repeated here. Similarly, the sending time information may be absolute time information, or may be a relative time interval between when the feedback information is generated and when the first electronic device sends the feedback information, that is, time interval information.

Thus, the information processing method makes the process of detecting the user's operation from the first electronic device to the second electronic device give feedback taking into account the interaction between the first electronic device and the second electronic device. Relative space parameters. Specifically, the information processing method may enable the second electronic device to display different images or output different audios based on the difference in relative spatial parameters between the first electronic device and the second electronic device, or to Image display/audio output is performed at different times, thereby making the user feel more realistic.

Furthermore, in the above embodiments, the different feedback of the second electronic device takes into account the relative spatial parameters. Alternatively, or in combination therewith, the different feedbacks of the second electronic device may also consider user input operations.

More specifically, as described above, the input operation information obtained in step S101 includes speed information and/or acceleration information about the sliding touch operation or the movement of the first electronic device.

Thus, the information processing method may also determine the feedback time information according to the velocity information and/or acceleration information in addition to the relative spatial parameters.

Specifically, for example, a linear or nonlinear mapping relationship between the speed information and/or acceleration information and the feedback time may be preset in the first electronic device, so that according to the speed information and/or acceleration information And determine the feedback time. More specifically, for example, multiple ranges of the speed and/or acceleration values may be preset in the first electronic device, and the feedback time is determined according to which range the speed information and/or acceleration information is in. Same as above, the feedback time may be absolute time information or relative time information.

Likewise, the information processing method may also determine the sending time information according to the velocity information and/or acceleration information in addition to the relative spatial parameters. The processing thereof is similar to the processing of determining the feedback time information, and will not be repeated here.

Furthermore, the above exemplifies the operation of determining feedback time information/sending time information based on speed information and/or acceleration information. The operation of determining feedback image information or feedback audio information according to speed information and/or acceleration information is similar to this and will not be described in detail here.

Through the above embodiments, in the process from the first electronic device detecting the user's operation to the second electronic device giving feedback, not only the interaction between the first electronic device and the second electronic device is considered The relative spatial parameter also takes into account the user's input operation, so compared with the above-mentioned embodiment in which the feedback information is determined based only on the relative spatial parameter, the information processing method in the embodiment of the present invention brings more realistic feeling to the user.

In addition, in the above embodiment, based on the difference in relative space parameters between the first electronic device and the second electronic device and/or the information of the user's input operation, the second electronic device makes different feedbacks.

Alternatively, or in combination with this, the information processing method may also enable the first electronic device to perform corresponding feedback.

Specifically, the information processing method may determine, according to the relative spatial parameter and the input operation information, first instruction information for outputting the first audio, and for making the second electronic device output as the feedback Second indication information of a second audio of the audio, the second audio corresponding to the first audio.

More specifically, the information processing method determines the corresponding first audio according to information such as the above-mentioned indication corresponding to the sliding touch operation or the click touch operation, and thereby generates a first indication for outputting the first audio information. On the other hand, the information processing method determines a corresponding second audio according to the first audio, and thereby generates second instruction information for causing the second electronic device to output the second audio.

More specifically, multiple audios may be pre-stored in the first electronic device. The information processing method may select one audio from the plurality of audios according to user operation information, and generate first instruction information for outputting the selected audio (the first audio).

Likewise, the second electronic device may pre-store multiple audios and notify the first electronic device of information about the multiple audios. The information processing method may select one audio from the plurality of audios according to user operation information, and generate second instruction information for causing the second electronic device to output the selected audio (second audio).

Alternatively, multiple audios may not be pre-stored in the second electronic device, but the information processing method sends the audio information of the second audio itself as the second indication information to the second electronic device .

Thereafter, the information processing method sends the second indication information to the second electronic device.

Thus, the information processing method enables the first electronic device to output the first audio based on the first indication information. On the other hand, the second electronic device outputs the second audio corresponding to the second indication information according to the second indication information.

That is to say, in response to the user's input operation, the first electronic device and the second electronic device respectively output the first audio and the second audio (ie, the aforementioned feedback audio). The first audio and the second audio may be the same. Specifically, the first audio and the second audio may be different parts of specific audio. Alternatively, the first audio and the second audio may also be different but corresponding.

Specifically, the first audio and the second audio may be different parts of the same audio. For example, it is assumed that before the user operation is detected, the output of the first electronic device is the first part of the specific audio. The information processing method may also determine, according to the input operation information, the first instruction information for outputting the second part of the first audio and the instruction information for causing the second electronic device to output the third part of the first audio. Second instruction message. Thus, the information processing method enables the first electronic device to output the second part of the first audio according to the first instruction information, and enables the second electronic device to output the second part of the first audio according to the second instruction information, A third portion of the first audio is output.

In addition, the information processing method may also make the first electronic device and the second electronic device respectively output a first image and a second image (that is, the above-mentioned feedback image ). The first image and the second image may be the same or be different parts of a particular video. Alternatively, the first image and the second image may also be different but corresponding.

Further, the information processing method may also determine, according to the input operation information, the first instruction information for outputting the first audio of the first sound effect, and the second instruction information for causing the second electronic device to output the second sound effect. The second indication information of the second audio. Thus, the information processing method enables the first electronic device to output the first audio of the first sound effect according to the first instruction information, and enables the second electronic device to output the first audio of the first sound effect according to the second instruction information, Outputting the second audio of the second sound effect.

In an embodiment, the first sound effect may be a sound effect in which the volume gradually decreases from the current volume to a first predetermined value (for example, zero), and the second sound effect is a sound effect in which the volume gradually increases from zero to a second predetermined value ( For example, user predetermined value or maximum value) or the sound effect of the current volume.

Certainly, those skilled in the art can understand that the first sound effect and the second sound effect are only examples. Those skilled in the art can completely design various other sound effects according to needs.

In addition, in the above-mentioned embodiments, the case is described that the first electronic device outputs the first audio, and the second electronic device outputs the second audio corresponding to the first audio. Further, the information processing method may also enable the first electronic device and the second electronic device to output a third audio different from the first audio and the second audio.

Specifically, the information processing method may determine, according to the input operation, the first indication information for outputting the first audio and the third audio in chronological order, and the information for causing the second electronic device to output the first audio in chronological order. The second indication information of the third audio and the second audio.

Therefore, according to the information processing method of the above-mentioned embodiment of the present invention, the first electronic device first outputs the first audio, and then outputs the third audio. On the other hand, the second electronic device first outputs the third audio, and then outputs the second audio. Optionally, the information processing method may synchronize the time when the first electronic device outputs the third audio with the time when the second electronic device outputs the third audio.

Thus, in the process from the first electronic device outputting the first audio to the second electronic device outputting the second audio, the first electronic device and the second electronic device jointly output the third audio The process is used as a transition, so that the process of switching the audio output device is smoother and more natural, and the user experience is improved.

Further, the information processing method can not only enable the first electronic device to output the third audio synchronously with the second electronic device, but also set the sound effect of the third audio. Specifically, the information processing method may determine the first indication information for outputting the first audio of the first sound effect and the third audio of the first sound effect, and the third audio for outputting the second sound effect according to the input operation. The audio and the second indication information of the second audio of the second sound effect.

Thus, the information processing method enables the first electronic device to sequentially output the first audio of the first sound effect and the third audio of the first sound effect in time order according to the first indication information. On the other hand, the information processing method enables the second electronic device to output the third audio of the second sound effect and the second audio of the second sound effect in time sequence according to the second indication information.

In another embodiment, the information processing method may determine the first instruction information for outputting the first audio and the third audio of the first sound effect, and the third audio for outputting the second sound effect according to the input operation. The audio and the second indication information of the second audio.

Thus, the information processing method enables the first electronic device to sequentially output the first audio and the third audio of the first sound effect in chronological order according to the first indication information. On the other hand, the information processing method enables the second electronic device to output the third audio and the second audio of the second sound effect in time sequence according to the second indication information.

In addition, the output time of the third audio may be determined according to the relative spatial parameter.

Specifically, the information processing method may detect the relative space parameter between the first electronic device and the second electronic device through the above processing, and determine the output time of the third audio according to the relative space parameter . For example, the longer the distance between the first electronic device and the second electronic device, the longer the output time of the third audio. Conversely, the shorter the distance between the first electronic device and the second electronic device, the shorter the output time of the third audio. The specific processing of determining the output time of the third audio in the information processing method is similar to the above-mentioned processing of determining the feedback time, and will not be described in detail here.

Furthermore, in another embodiment, the information processing method may determine the output time of the third audio according to the speed information and/or the acceleration information.

Specifically, for example, a linear or nonlinear mapping relationship between the speed information and/or acceleration information and the output time of the third audio can be preset in the first electronic device, so that according to the speed information and and/or acceleration information to determine the output time of the third audio. More specifically, for example, multiple ranges of the speed and/or acceleration values may be preset in the first electronic device, and the third audio frequency is determined according to which range the speed information and/or acceleration information is in. output time.

In the above embodiment, the output time of the third audio as the transition audio can be determined according to the relative space parameters between the first electronic device and the second electronic device, so that the user can feel more realistic and rich. the user experience.

In addition, when the first electronic device and/or the second electronic device each include a plurality of output units, not only the output time of the third audio can be determined according to the output time of the first electronic device and the second electronic device The output unit of the third audio may also be determined according to the relative space parameters between the first electronic device and the second electronic device.

Specifically, for example, it is assumed that the second electronic device includes multiple audio output units such as a left channel output unit and a right channel output unit. The information processing method may determine the audio output unit corresponding to the relative positional relationship between the first electronic device and the second electronic device according to the relative positional relationship determined as described above, and The indication information of the determined audio output unit is sent to the second electronic device, whereby the second electronic device outputs the third audio on the determined audio output unit.

In this embodiment, the output unit of the third audio as the transition audio may be determined according to the relative spatial parameters between the first electronic device and the second electronic device, so that the user feels more realistic, and further Enrich the user experience.

In addition, the information processing method in the above embodiment describes the situation where the first electronic device and the second electronic device perform coordinated audio output.

Alternatively, or in combination therewith, the information processing method may also enable the first electronic device and the second electronic device to perform collaborative video output.

Specifically, in an embodiment, in the case that the above-mentioned first audio is different from the second audio, the information processing method may enable the first electronic device to output a first image that matches the first audio, and make the The second electronic device outputs a second image matching the second audio.

More specifically, the information processing method may determine, according to the input operation, third instruction information for outputting the first image and second instruction information for causing the second electronic device to output the first image. The fourth indication information of the image. The operation of determining the third indication information and the fourth indication information in the information processing method is similar to the above-mentioned operation of determining the first indication information and the second indication information, and will not be described in detail here.

Thereafter, the information processing method enables the first electronic device to display the first image based on the third indication information. On the other hand, the information processing method sends the fourth indication information to the second electronic device. The second electronic device displays the second image corresponding to the fourth indication information according to the fourth indication information.

In the above embodiment, the first image is different from the second image, the first image matches the first audio, and the second image matches the second audio.

Thus, the first electronic device and the second electronic device can not only perform cooperative audio output, but also perform cooperative video output, so that the first electronic device and the second electronic device respectively display different but corresponding images, and output different but corresponding audio respectively, thereby enriching the user experience.

In another embodiment, when the first audio is the same as the second audio, the information processing method may enable the first electronic device and the second electronic device to output the same image. Further, in the case that the first audio and the second audio are temporally different parts of the same audio, the information processing method may enable the first electronic device and the second electronic device to output Different parts in time in the same video.

More specifically, the information processing method may determine third instruction information for outputting the first image (or the first part of a specific video) according to the input operation, and for causing the second electronic device to output the indicated information. The fourth indication information of the first image (or the second part in the specific video). Thereafter, the information processing method displays the first image based on the third indication information. On the other hand, the information processing method sends the fourth indication information to the second electronic device. The second electronic device displays the first image according to the fourth indication information.

Optionally, after the second electronic device displays the first image, the information processing method may cause the first electronic device to stop displaying the image.

In the above embodiments, the first image matches the first audio and the second audio. The first part in the specific video corresponds to the first part in the specific audio output by the first electronic device, and the second part in the specific video corresponds to the second part in the specific audio output by the second electronic device. partially correspond.

Thus, the first electronic device and the second electronic device can not only perform cooperative audio output, but also perform cooperative video output, so that the same video can be displayed on the first electronic device and the second electronic device and/or output the same audio. In an embodiment, the information processing method may switch from the video/audio output of the first electronic device to the video/audio output of the second electronic device, thereby enriching user experience.

Thus, the information processing method enables the first electronic device and the second electronic device to perform respective feedbacks in response to user operations, thereby making the user experience more realistic. For example, the information processing method in the embodiment of the present invention can switch from the audio output of the first electronic device to the audio output of the second electronic device, and the time of the switching process is the same as that between the first electronic device and the second electronic device. The relative spatial parameters between them and/or the user's input operation information are related, so as to bring a richer and more realistic experience to the user.

It should be pointed out that the above describes each embodiment separately. However, those skilled in the art can understand that the various embodiments described above can be combined in various appropriate ways.

In addition, it should be pointed out that the information processing method described above is applied to the first electronic device, such as the above-mentioned portable terminal. Alternatively, the information processing method of the embodiment of the present invention may also be applied to a second electronic device, such as the above-mentioned TV. Next, the operation in this case will be described with reference to FIG. 2 .

FIG. 2 is a flowchart illustrating an information processing method of another embodiment of the present invention.

As shown in FIG. 2, when the information processing method of the embodiment of the present invention starts, first, in step S201, the information processing method receives the input operation information sent by the first electronic device, and the input operation information is provided by the user Generated after operating the first electronic device. Specifically, the information processing method receives the input operation information through a data path between the first electronic device and the second electronic device.

Next, in step S202, the information processing method detects a relative spatial parameter between the first electronic device and the second electronic device, and in step S203 according to the relative spatial parameter and the input operation information, Confirm feedback.

The operations in step S202 and step S203 of the information processing method are similar to the operations in steps S102 and S103 in FIG. 1 , and will not be repeated here. The difference from FIG. 1 is that the operations of steps S102 and S103 in FIG. 1 are performed on the first electronic device, while the operations of steps S202 and S203 in FIG. 2 are performed on the second electronic device.

Thereafter, in step S204, the information processing method enables the second electronic device to give feedback to the user according to the feedback information.

Similar to the information processing method described with reference to FIG. 1 , the information processing method in the embodiment of the present invention may also determine feedback image information and/or feedback sound information according to the relative spatial parameter and the input operation information. Moreover, in step S204, the information processing method may correspondingly display a feedback image corresponding to the feedback image information and/or output a feedback audio corresponding to the feedback sound information.

Similar to the information processing method described with reference to FIG. 1 , the information processing method in the embodiment of the present invention may also determine feedback time information according to the relative spatial parameter and the input operation information. Moreover, in step S204, the information processing method may perform the feedback at the feedback time indicated by the feedback time information.

Other operations of the information processing method in the embodiment of the present invention are similar to the operations of the information processing method in the above embodiment, and will not be repeated here.

The information processing method according to the embodiment of the present invention has been described above with reference to FIG. 1 and FIG. 2 .

Through the information processing method of the embodiment of the present invention, the process of detecting the user's operation from the first electronic device to the second electronic device for feedback takes into account the relationship between the first electronic device and the second electronic device. The relative space parameters between. Specifically, the information processing method may enable the second electronic device to display different images or output different audios based on the difference in relative spatial parameters between the first electronic device and the second electronic device, or to Image display/audio output is performed at different times, thereby making the user experience more realistic and improving and enriching the user experience.

Next, an electronic device according to an embodiment of the present invention will be described with reference to FIG. 3 . The electronic device of the embodiment of the present invention is a portable terminal such as a tablet computer, a smart phone, and the like. The electronic device may be embodied in the form of an information processing device.

There is a data path between the electronic device and other electronic devices. In other words, the electronic device may communicate with the other electronic device through a wired or wireless link. The specific form of the wired or wireless link is not limited. The other electronic devices may be electronic devices such as smart TVs, notebook computers, personal computers, and the like. In the following description, for convenience of description, when appropriate, the electronic device is referred to as a first electronic device, and the other electronic device is referred to as a second electronic device.

As shown in FIG. 3 , an electronic device 300 in this embodiment of the present invention includes: a first detection unit 301 , a second detection unit 302 , a determination unit 303 and a sending unit 304 .

Specifically, the first detection unit 301 detects a user's input operation to obtain input operation information.

The second detection unit 302 detects a relative space parameter between the first electronic device and the second electronic device.

The determining unit 303 determines feedback information according to the relative spatial parameters.

The sending unit 304 sends the feedback information to the second electronic device. The second electronic device provides feedback to the user according to the feedback information.

In an embodiment, the determining unit 303 is configured to determine feedback image information and/or feedback sound information according to the relative spatial parameter and the input operation information. And, the second electronic device correspondingly displays a feedback image corresponding to the feedback image information and/or outputs a feedback audio corresponding to the feedback sound information.

In another embodiment, the determining unit 303 is configured to determine feedback time information according to the relative spatial parameter and the input operation information. And, the second electronic device performs the feedback at the feedback time indicated by the feedback time information.

In another embodiment, the electronic device 304 may further include: a sending time determining unit, configured to determine sending time information according to the relative space parameter and the input operation information. The sending unit 304 is configured to send the feedback information to the second electronic device at the sending time indicated by the sending time information.

In another embodiment, the determining unit 303 is configured to determine, according to the relative spatial parameter and the input operation information, the first indication information for outputting the first audio, and the second electronic device outputting second indication information as a second audio of the feedback audio, the second audio corresponding to the first audio. The sending unit 304 is configured to send the second indication information to a second electronic device, wherein the second electronic device outputs the second indication information corresponding to the second indication information according to the second indication information. Two audio. Moreover, the electronic device 303 further includes: an audio output unit, configured to output the first audio based on the first indication information.

Next, an electronic device according to an embodiment of the present invention will be described with reference to FIG. 4 . The electronic device in the embodiment of the present invention is such as a smart TV, a notebook computer, a personal computer, and the like. The electronic device may be embodied in the form of an information processing device. The electronic device, as the second electronic device, has a data path with the first electronic device such as a smart phone or a tablet computer.

As shown in FIG. 4 , an electronic device 400 in this embodiment of the present invention includes: a receiving unit 401 , a detecting unit 402 , a determining unit 403 and a feedback unit 404 .

The receiving unit 401 receives user input operation information sent by the first electronic device.

The detecting unit 402 detects a relative space parameter between the first electronic device and the second electronic device.

The determining unit 403 determines feedback information according to the relative spatial parameter and the input operation.

The feedback unit 404 provides feedback to the user according to the feedback information.

In an embodiment, the determining unit 403 is configured to determine feedback image information and/or feedback sound information according to the relative spatial parameter and the input operation information. Moreover, the feedback unit 404 includes: an output unit, correspondingly displaying a feedback image corresponding to the feedback image information and/or outputting a feedback audio corresponding to the feedback sound information.

In another embodiment, the determining unit 403 is configured to determine feedback time information according to the relative spatial parameter and the input operation information. Moreover, the feedback unit 404 is configured to perform the feedback at the feedback time indicated by the feedback time information.

5A-5H are schematic diagrams illustrating the display of the first electronic device and the second electronic device to which the information processing method according to the embodiment of the present invention is applied.

In FIGS. 5A-5H , the application of the archery game is taken as an example to illustrate the electronic device and the information processing method thereof according to the embodiments of the present invention.

As shown in FIG. 5A , an archery application is running on the first electronic device 501 in the embodiment of the present invention, and a first image (bow and arrow image) is displayed. Correspondingly, the archery application is also running on the second electronic device 502 in the embodiment of the present invention, and the second image (target image) corresponding to the first image is displayed.

At this time, the information processing method applied to the first electronic device detects a user's input operation, such as a sliding operation to the left rear of the screen, so as to obtain input operation information. The input operation information includes, for example, instruction information for instructing to perform an archery action. In addition, the input operation information may also include information such as speed/acceleration of the sliding operation.

Next, the information processing method detects a relative space parameter between the first electronic device 501 and the second electronic device 502 . In this case, the information processing method, for example, detects the distance between the first electronic device 501 and the second electronic device 502 .

Thereafter, the information processing method determines to display the image about the target being shot according to the indication information contained in the input operation information. Then, according to the distance, the information processing method selects an image from a plurality of images about the target being shot in advance stored in the second electronic device 502 and notified to the first electronic device 501, and sends the The indication information of the selected image is determined as the feedback information. Thereafter, the information processing method sends the feedback information to the second electronic device 502 . The second electronic device 502 displays a feedback image as shown in FIG. 5C according to the feedback information.

In addition, in order to make the user's experience more realistic, the feedback information may also include an image about the flight process before the arrow hits the target, such as the image shown in FIG. 5B .

In addition, in combination with the feedback image, when displaying the feedback image shown in FIG. 5C , the information processing method can also enable the second electronic device 502 to output audio about the sound of the arrow hitting the target.

In addition, combined with the image shown in FIG. 5B , the information processing method can also enable the second electronic device 502 to output audio about the sound of the arrow flying.

In addition, the information processing method may also determine the time when the first electronic device 501 sends feedback information or the time when the second electronic device 502 performs sound/image feedback according to the distance parameter, so that when the user responds to the The second electronic device 502 displays the image of the arrow hitting the target/outputs the sound of the arrow hitting the target after a time interval corresponding to the distance parameter elapses from the first electronic device 501 making the archery action. In other words, a time delay is introduced between the first electronic device 501 detecting the shooting indication and the second electronic device 502 responding. During this delay, the second electronic device 502 may keep the original display unchanged, as shown in the schematic diagram of FIG. 5H . Through the introduction of time delay, the user experience is more realistic.

In addition, when the input operation information includes information such as the speed/acceleration of the sliding operation, the length of the time delay may be further determined according to the speed/acceleration of the sliding operation.

Fig. 5D is when the distance between the first electronic device 501 and the second electronic device 502 is smaller than the distance shown in Fig. 5C, the second electronic device 502 displays an image of an arrow hitting the target according to the feedback information schematic diagram.

Comparing Fig. 5C and Fig. 5D, it can be seen that the arrow in Fig. 5D hits the target deeper, that is, the exposed part of the arrow body is less. That is to say, the second electronic device 502 displays different feedback images according to the relative space parameters (specifically, distance) between the first electronic device 501 and the second electronic device 502, so that the It feels more realistic to the user.

5A-5D show the situation that the first electronic device 501 is located on the left side of the second electronic device 502 . 5E-5G show the situation that the first electronic device 501 is located on the right side of the second electronic device 502 .

Comparing FIGS. 5A-5D with FIGS. 5E to 5G, it can be seen that the arrows in FIGS. 5A-5D shoot from the left side of the second electronic device 502, while the arrows in FIGS. Right shot. That is to say, the second electronic device 502 displays different feedback images according to the relative spatial parameters (specifically, the relative positional relationship) between the first electronic device 501 and the second electronic device 502, so that It makes the user feel more realistic.

It should be noted that, in FIG. 5A-FIG. 5H , the description is made by taking the application of the information processing method to the first electronic device 501 as an example. As mentioned above, the information processing method in this embodiment of the law can be similarly applied to the second electronic device 502 .

The electronic device and the information processing method thereof according to the embodiments of the present invention are described above by taking the archery application as an example. Of course, the electronic device and the information processing method thereof in the embodiments of the present invention can also be applied to other various scenarios, which will not be described in detail here.

Above, an electronic device and an information processing method thereof according to an embodiment of the present invention are described with reference to FIGS. 1 to 5 .

It should be noted that in this specification, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or device comprising a set of elements includes not only those elements , but also includes other elements not expressly listed, or also includes elements inherent in such process, method, article or equipment. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.

It should also be noted that in this specification, "first", "second" and similar descriptions are only for the purpose of distinguishing one unit from another and do not mean that they must be arranged as multiple physically separated units. unit. Rather, it may be provided as physically separate units or combined into one unit.

Finally, it should be noted that the above series of processing includes not only processing performed in time series in the order described here, but also processing performed in parallel or separately rather than in time series.

Through the above description of the implementation manners, those skilled in the art can clearly understand that the present invention can be implemented by means of software plus a necessary hardware platform, and of course can also be implemented entirely by hardware. Based on this understanding, all or part of the contribution made by the technical solution of the present invention to the background technology can be embodied in the form of software products, and the computer software products can be stored in storage media, such as ROM/RAM, magnetic disks, optical disks, etc. , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute the methods described in various embodiments or some parts of the embodiments of the present invention.

In the embodiments of the present invention, the units/modules may be implemented in software so as to be executed by various types of processors. An identified module of executable code may, by way of example, comprise one or more physical or logical blocks of computer instructions which may, for example, be structured as an object, procedure, or function. Notwithstanding, the executable code of the identified modules need not be physically located together, but may comprise different instructions stored in different bits which, when logically combined, constitute the unit/module and implement the unit / The specified purpose of the module.

When the unit/module can be implemented by software, considering the level of existing hardware technology, the unit/module that can be implemented by software can be realized by those skilled in the art by building the corresponding hardware circuit without considering the cost Corresponding functions, the hardware circuit includes conventional very large scale integration (VLSI) circuits or gate arrays and existing semiconductors such as logic chips and transistors or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices, and the like.

The present invention has been described in detail above, and specific examples have been used herein to illustrate the principles and implementation modes of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; meanwhile, for the technical field Those of ordinary skill in the art will have changes in the specific implementation and scope of application according to the idea of the present invention. In summary, the contents of this specification should not be construed as limiting the present invention.

Claims (16)

1. a kind of information processing method, is applied to the first electronic equipment, and described first electronic equipment and the second electronic equipment have number According to path, described information processing method includes：

The input operation of detection user, to obtain input operation information；

Detect the relative spatial parameters between described first electronic equipment and described second electronic equipment；

According to described relative spatial parameters and described input operation information, determine feedback information；And

Described feedback information is sent to described second electronic equipment, wherein, described second electronic equipment is according to described feedback letter Cease and fed back to user,

The described feedback information of described determination includes：According to described relative spatial parameters and described input operation information, determine feedback Temporal information；

And, feedback time indicated by described feedback time information for described second electronic equipment carries out described feedback.

2. information processing method as claimed in claim 1, wherein,

The described feedback information of described determination includes：According to described relative spatial parameters and described input operation information, determine feedback Image information and/or feedback sound information；

And, described second electronic equipment accordingly shows feedback image and/or output corresponding to described feedback image information Feedback audio frequency corresponding to described feedback sound information.

3. information processing method as claimed in claim 2, also includes：

According to described relative spatial parameters and described input operation information, determine transmission time information；

Wherein, described feedback information is sent and include to described second electronic equipment：

The transmission time indicated by described transmission time information, described feedback information is sent to described second electronic equipment.

4. the information processing method as described in claim 1 or 3, wherein,

The input operation of described detection user includes：

Detect the slip touch operation to described first electronic equipment for the user or the motion of described first electronic equipment.

5. information processing method as claimed in claim 4, wherein,

Described input operation information includes the speed of the movement velocity with regard to described slip touch operation or described first electronic equipment Degree information and/or acceleration information；

And, described determination feedback information includes：

According to described relative spatial parameters, and according to described velocity information and/or acceleration information, determine described feedback information.

6. information processing method as claimed in claim 4, wherein,

Described input operation information includes the speed letter of the motion with regard to described slip touch operation or described first electronic equipment Breath and/or acceleration information；

And, described determination transmission time information includes：

According to described relative spatial parameters, and according to described velocity information and/or acceleration information, determine transmission time information.

7. information processing method as claimed in claim 1, wherein, described relative spatial parameters be described first electronic equipment with Relative between relative distance between described second electronic equipment or described first electronic equipment and described second electronic equipment At least one of position relationship.

8. information processing method as claimed in claim 2, wherein it is determined that feedback sound information also includes：

According to described relative spatial parameters and described input operation information, determine the first instruction letter for exporting the first audio frequency Breath and the second configured information for making the second audio frequency as described feedback audio frequency for the described second electronic equipment output, institute State the second audio frequency and correspond to described first audio frequency；

And, described information processing method also includes：

Based on described first configured information, export described first audio frequency；And

Described second configured information is sent to the second electronic equipment；Wherein, described second electronic equipment is according to the described second finger Show information, output is corresponding to described second audio frequency of described second configured information.

9. a kind of information processing method, is applied to the second electronic equipment, and described second electronic equipment and the first electronic equipment have number According to path, described information processing method includes：

Receive the input operation information that described first electronic equipment sends, described input operation information is the described in user operation Produce after one electronic equipment；

Detect the relative spatial parameters between described first electronic equipment and described second electronic equipment；

According to described relative spatial parameters and described input operation information, determine feedback information；And

Fed back to user according to described feedback information,

The described feedback information of described determination includes：According to described relative spatial parameters and described input operation information, determine feedback Temporal information；

And, described feedback step includes：Feedback time indicated by described feedback time information carries out described feedback.

10. information processing method as claimed in claim 9, wherein,

The described feedback information of described determination includes：According to described relative spatial parameters and described input operation information, determine feedback Image information and/or feedback sound information；

And, described feedback step includes：Accordingly show the feedback image corresponding to described feedback image information and/or output Feedback audio frequency corresponding to described feedback sound information.

11. a kind of electronic equipments, described electronic equipment has data path as the first electronic equipment and the second electronic equipment, described Electronic equipment includes：

First detector unit, the input operation of detection user, to obtain input operation information；

Second detector unit, detects the relative spatial parameters between described first electronic equipment and described second electronic equipment；

Determining unit, according to described relative spatial parameters, determines feedback information；And

Transmitting element, described feedback information is sent to described second electronic equipment, wherein, described second electronic equipment is according to institute State feedback information to be fed back to user,

Described determining unit is configured to according to described relative spatial parameters and described input operation information, determines that feedback time is believed Breath；

And, feedback time indicated by described feedback time information for described second electronic equipment carries out described feedback.

12. electronic equipments as claimed in claim 11, wherein,

Described determining unit is configured to, according to described relative spatial parameters and described input operation information, determine feedback image information And/or feedback sound information；

And, described second electronic equipment accordingly shows feedback image and/or output corresponding to described feedback image information Feedback audio frequency corresponding to described feedback sound information.

13. electronic equipments as claimed in claim 12, also include：

Transmission time determining unit, according to described relative spatial parameters and described input operation information, determines transmission time information；

Wherein, described transmitting element is configured to the transmission time indicated by described transmission time information, by described feedback information Send to described second electronic equipment.

14. electronic equipments as claimed in claim 12, wherein, described determining unit is configured to according to described relative spatial parameters With described input operation information, determine the first configured information for exporting the first audio frequency and be used for making described second electronics Second configured information of the second audio frequency as described feedback audio frequency for the equipment output, described second audio frequency corresponds to described first sound Frequently；

Described transmitting element is configured to send described second configured information to the second electronic equipment, wherein, described second electronics , according to described second configured information, output is corresponding to described second audio frequency of described second configured information for equipment；

And, described electronic equipment also includes：

Audio output unit, based on described first configured information, exports described first audio frequency.

15. a kind of electronic equipments, described electronic equipment has data path as the second electronic equipment and the first electronic equipment, described Electronic equipment includes：

Receiving unit, receives the input operation information of the user that described first electronic equipment sends；

Detector unit, detects the relative spatial parameters between described first electronic equipment and described second electronic equipment；

Determining unit, according to described relative spatial parameters and described input operation, determines feedback information；And

Feedback unit, is fed back to user according to described feedback information,

Described determining unit is configured to according to described relative spatial parameters and described input operation information, determines that feedback time is believed Breath；

And, the feedback time that described feedback unit is configured to indicated by described feedback time information carries out described feedback.

16. electronic equipments as claimed in claim 15, wherein,

Described determining unit is configured to, according to described relative spatial parameters and described input operation information, determine feedback image information And/or feedback sound information；

And, described feedback unit includes：

Output unit, accordingly shows corresponding to the feedback image of described feedback image information and/or output corresponding to described anti- The feedback audio frequency of feedback acoustic information.