CN109031961B

CN109031961B - Method and device for controlling operation object

Info

Publication number: CN109031961B
Application number: CN201810717169.7A
Authority: CN
Inventors: 李文博
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd; Shanghai Xiaodu Technology Co Ltd
Priority date: 2018-06-29
Filing date: 2018-06-29
Publication date: 2021-04-06
Anticipated expiration: 2038-06-29
Also published as: CN109031961A

Abstract

The embodiment of the application discloses a method and a device for controlling an operation object. One embodiment of the method comprises: outputting information for connection in response to acquiring a request indicating that an operation object in a target application is controlled by an external device; establishing connection with the second electronic equipment in response to receiving a connection establishment request initiated by the second electronic equipment based on the connection information, wherein the connection establishment request comprises an equipment identifier of the second electronic equipment; establishing a corresponding relation between the equipment identifier of the second electronic equipment and the object identifier of the operation object in the target application; receiving instruction information sent by second electronic equipment; and controlling the operation object indicated by the object identification corresponding to the equipment identification of the second electronic equipment to execute the operation instruction. The embodiment provides a method for controlling an operation object based on external equipment, and the operation efficiency is improved.

Description

Method and device for controlling operation object

Technical Field

The embodiment of the application relates to the technical field of computers, in particular to a method and a device for controlling an operation object.

Background

Along with the development of an intelligent home system based on the internet of things technology, intelligent televisions, intelligent sound boxes with screens and other intelligent devices are increasingly popularized.

At present, the interaction with the intelligent device mainly adopts a single voice interaction mode, but along with the increase of the adaptive application of the intelligent device, the complexity of the interaction is higher and higher.

Disclosure of Invention

The embodiment of the application provides a method and a device for controlling an operation object.

In a first aspect, an embodiment of the present application provides a method for controlling an operation object, which is applied to a first electronic device, and the method includes: outputting information for connection in response to acquiring a request indicating that an operation object in a target application is controlled by an external device; establishing connection with the second electronic equipment in response to receiving a connection establishment request initiated by the second electronic equipment based on the connection information, wherein the connection establishment request comprises an equipment identifier of the second electronic equipment; establishing a corresponding relation between the equipment identifier of the second electronic equipment and the object identifier of the operation object in the target application; receiving instruction information sent by second electronic equipment, wherein the instruction information comprises an operation instruction for controlling an operation object and an equipment identifier of the second electronic equipment; and controlling the operation object indicated by the object identification corresponding to the equipment identification of the second electronic equipment to execute the operation instruction.

In some embodiments, outputting the information for connection includes: and outputting the two-dimensional code encoded according to the connection information.

In some embodiments, establishing a correspondence between the device identifier of the second electronic device and the object identifier of the operation object in the target application includes: displaying alternative operation objects in the target application; receiving operation object selection information sent by second electronic equipment, wherein the operation object selection information comprises an object identifier of an operation object and an equipment identifier of the second electronic equipment; and establishing the corresponding relation between the object identification and the equipment identification included in the received object selection information.

In some embodiments, establishing a correspondence between the device identifier of the second electronic device and the object identifier of the operation object in the target application includes: acquiring voiceprint characteristics of a user operating the second electronic device; determining an object identifier corresponding to the voiceprint features according to a pre-established correspondence between the voiceprint features and the object identifiers; and establishing a corresponding relation between the determined object identification and the equipment identification of the second electronic equipment.

In some embodiments, obtaining voiceprint characteristics of a user manipulating the second electronic device comprises: outputting prompt information for prompting a user who operates the second electronic equipment to make a sound; in response to receiving the voice input information, voiceprint features of the voice input information are extracted.

In a second aspect, an embodiment of the present application provides a method for controlling an operation object, which is applied to a second electronic device, and the method includes: acquiring information for connection from a first electronic device; sending a connection establishment request to the first electronic device based on the acquired information for connection, wherein the connection establishment request comprises a device identifier of the second electronic device; in response to successful connection establishment with the first electronic device, determining an object identifier of an operation object in the controlled target application; displaying an operation interface of the operation object indicated by the determined object identification; receiving interaction information input by a user on an operation interface, and generating instruction information of an operation object indicated by the determined object identification based on the interaction information, wherein the instruction information comprises an operation instruction for controlling the operation object and equipment identification of the second electronic equipment; and sending the instruction information to the first electronic equipment.

In some embodiments, obtaining information for connection from a first electronic device includes: responding to a scanning action of the first electronic equipment, and acquiring a two-dimensional code from the first electronic equipment; and acquiring information for connection according to the two-dimensional code.

In some embodiments, the operator interface includes a virtual handle interface.

In some embodiments, the interaction information comprises at least one of: touch operation information, motion state information and voice information.

In some embodiments, determining an object identification of an operation object in the controlled target application comprises: displaying prompt information for prompting a user to make a sound; and determining the object identifier of the operation object in the controlled target application according to the corresponding relation between the object identifier and the equipment identifier, which is established by the first electronic equipment based on the voiceprint characteristics of the received voice input information.

In a third aspect, an embodiment of the present application provides an apparatus for controlling an operation object, where the apparatus is provided in a first electronic device, and the apparatus includes: an output unit configured to output information for connection in response to acquisition of a request indicating that an operation object in a target application is controlled by an external device; a connection unit configured to establish a connection with the second electronic device in response to receiving a connection establishment request initiated by the second electronic device based on the connection-use information, the connection establishment request including a device identification of the second electronic device; the establishing unit is configured to establish a corresponding relation between the equipment identifier of the second electronic equipment and the object identifier of the operation object in the target application; the receiving unit is configured to receive instruction information sent by the second electronic equipment, wherein the instruction information comprises an operation instruction for controlling an operation object and an equipment identifier of the second electronic equipment; and the control unit is configured to control the operation object indicated by the object identification corresponding to the equipment identification of the second electronic equipment to execute the operation instruction.

In some embodiments, the output unit is further configured to: and outputting the two-dimensional code encoded according to the connection information.

In some embodiments, the establishing unit comprises: the display subunit is configured to display the alternative operation objects in the target application; the receiving subunit is configured to receive operation object selection information sent by the second electronic device, wherein the operation object selection information comprises an object identifier of an operation object and a device identifier of the second electronic device; and the establishing subunit is configured to establish a corresponding relation between the object identifier and the equipment identifier included in the received object selection information.

In some embodiments, the establishing unit comprises: an obtaining subunit configured to obtain voiceprint characteristics of a user manipulating the second electronic device; the determining subunit is configured to determine an object identifier corresponding to the voiceprint features according to a pre-established correspondence between the voiceprint features and the object identifiers; and the second establishing subunit is configured to establish a corresponding relation between the determined object identifier and the device identifier of the second electronic device.

In some embodiments, the obtaining subunit is further configured to: outputting prompt information for prompting a user who operates the second electronic equipment to make a sound; in response to receiving the voice input information, voiceprint features of the voice input information are extracted.

In a fourth aspect, an embodiment of the present application provides an apparatus for controlling an operation object, where the apparatus is disposed on a second electronic device, and the apparatus includes: an acquisition unit configured to acquire information for connection from a first electronic device; a first transmitting unit configured to transmit a connection establishment request to the first electronic device based on the acquired information for connection, the connection establishment request including a device identification of the second electronic device; a determining unit configured to determine an object identifier of an operation object in the controlled target application in response to successful establishment of a connection with the first electronic device; the display unit is configured to display an operation interface of the operation object indicated by the determined object identification; the generating unit is configured to receive interaction information input by a user on the operation interface and generate instruction information of an operation object indicated by the determined object identification based on the interaction information, wherein the instruction information comprises an operation instruction for controlling the operation object and the equipment identification of the second electronic equipment; a second transmitting unit configured to transmit the instruction information to the first electronic device.

In some embodiments, the obtaining unit is further configured to: responding to a scanning action of the first electronic equipment, and acquiring a two-dimensional code from the first electronic equipment; and acquiring information for connection according to the two-dimensional code.

In some embodiments, the determining unit is further configured to: displaying prompt information for prompting a user to make a sound; and determining the object identifier of the operation object in the controlled target application according to the corresponding relation between the object identifier and the equipment identifier, which is established by the first electronic equipment based on the voiceprint characteristics of the received voice input information.

In a fifth aspect, an embodiment of the present application provides an apparatus, including: one or more processors; a storage device, on which one or more programs are stored, which, when executed by the one or more processors, cause the one or more processors to implement the method as described above in the first aspect or the second aspect.

In a sixth aspect, embodiments of the present application provide a computer-readable medium, on which a computer program is stored, which when executed by a processor, implements the method as described above in the first or second aspect.

According to the method and the device for controlling the operation object, the connection information is output in response to the request for acquiring the instruction to control the operation object in the target application through the external device, then the connection with the second electronic device is established in response to the received connection establishment request initiated by the second electronic device based on the connection information, the corresponding relation between the device identifier of the second electronic device and the object identifier of the operation object in the target application is established, finally the instruction information sent by the second electronic device is received, and the operation object indicated by the object identifier corresponding to the device identifier of the second electronic device is controlled to execute the operation instruction.

Drawings

Other features, objects and advantages of the present application will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, made with reference to the accompanying drawings in which:

FIG. 1 is an exemplary system architecture diagram in which one embodiment of the present application may be applied;

FIG. 2 is a flow diagram of one embodiment of a method for controlling an operand according to the present application;

FIG. 3 is a schematic diagram of an application scenario of a method for controlling an operation object according to the present application;

FIG. 4 is a flow diagram of yet another embodiment of a method for controlling an operand according to the present application;

FIG. 5 is a schematic block diagram of one embodiment of an apparatus for controlling an operation object according to the present application;

fig. 6 is a schematic structural diagram of still another embodiment of an apparatus for controlling an operation object according to the present application;

FIG. 7 is a block diagram of a computer system suitable for use in implementing the electronic device of an embodiment of the present application.

Detailed Description

The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings.

It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.

Fig. 1 shows an exemplary system architecture 100 to which embodiments of the method for controlling operands or the apparatus for controlling operands of the present application may be applied.

As shown in fig. 1, the system architecture 100 may include second

electronic devices

101, 102, 103, a network 104, and a first electronic device 105. The network 104 is used to provide a medium for communication links between the second

electronic devices

101, 102, 103 and the first electronic device 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The user may use the second

electronic device

101, 102, 103 to interact with the first electronic device 105 over the network 104 to receive or send messages or the like. Various applications may be installed on the second

electronic device

101, 102, 103, such as a smart device-like application, a browser application, a search-like application, a game-like application, etc. The second

electronic devices

101, 102, 103 may be various electronic devices including, but not limited to, a smartphone, a tablet computer, and the like. The second

electronic devices

101, 102, 103 can acquire connection information from the first electronic device; sending a connection establishment request to the first electronic device based on the acquired information for connection, wherein the connection establishment request comprises a device identifier of the second electronic device; in response to successful connection establishment with the first electronic device, determining an object identifier of an operation object in the controlled target application; displaying an operation interface of the operation object indicated by the determined object identification; receiving interaction information input by a user on an operation interface, and generating instruction information of an operation object indicated by the determined object identification based on the interaction information, wherein the instruction information comprises an operation instruction for controlling the operation object and equipment identification of the second electronic equipment; and sending the instruction information to the first electronic equipment.

The first electronic device 105 may interact with the second

electronic devices

101, 102, 103 via the network 104 to receive or send messages or the like. Various applications may be installed on the first electronic device 105, such as a smart device-like application, a browser application, a search-like application, a game-like application, and so forth. The first electronic device 105 may be a variety of electronic devices including, but not limited to, a smart speaker, a smart television, and the like. The first electronic device 105 may output information for connection in response to acquiring a request indicating that an operation object in the target application is controlled by the external device; establishing connection with the second electronic equipment in response to receiving a connection establishment request initiated by the second electronic equipment based on the connection information, wherein the connection establishment request comprises an equipment identifier of the second electronic equipment; establishing a corresponding relation between the equipment identifier of the second electronic equipment and the object identifier of the operation object in the target application; receiving instruction information sent by second electronic equipment, wherein the instruction information comprises an operation instruction for controlling an operation object and an equipment identifier of the second electronic equipment; and controlling the operation object indicated by the object identification corresponding to the equipment identification of the second electronic equipment to execute the operation instruction.

It should be noted that the method for controlling the operation object provided in the embodiment of the present application may be executed by the first electronic device 105, and may also be executed by the second

electronic devices

101, 102, and 103, and accordingly, the apparatus for controlling the operation object may be disposed in the first electronic device 105, and may also be disposed in the second

electronic devices

101, 102, and 103.

It should be understood that the number of first electronic devices, second electronic devices, networks in fig. 1 is merely illustrative. There may be any number of first electronic devices, second electronic devices, networks, as desired for implementation.

With continued reference to FIG. 2, a flow 200 of one embodiment of a method for controlling an operand according to the present application is shown. The method for controlling the operation object comprises the following steps:

in step 201, in response to acquiring a request indicating that an operation object in a target application is controlled by an external device, connection information is output.

In this embodiment, a method execution subject for controlling an operation object (e.g., a first electronic device shown in fig. 1) may output information for connection in response to acquiring a request indicating that an operation object in a target application is controlled by an external device. The target application may include a game application, a social application, and the like installed on the first electronic device, and the operation object may be an object that can be operated in the target application, for example, a virtual character, a virtual article, and other virtual objects in the application. The request indicating that the operation object in the target application is controlled by the external device may be generated in response to detection of a preset operation, such as an operation in which the user opens the target application, a user clicking a button indicating that the operation object in the target application is controlled by the external device, or inputting a voice indicating that the operation object in the target application is controlled by the external device. The connection information may include information for establishing a connection with the first electronic device, for example, an address of the first electronic device, information of a local area network where the first electronic device is located, information of a communication protocol used, and the like.

In some optional implementations of this embodiment, the outputting the connection information includes: and outputting the two-dimensional code encoded according to the connection information. The execution body may output other barcode images encoded according to connection information, and the connection information may include voice information, character information, and the like.

Here, the two-dimensional code (2-dimensional bar code) records data symbol information by using a pattern of black and white alternating distributed on a plane (two-dimensional direction) according to a certain rule by using a certain specific geometric figure; the concept of "0" and "1" bit stream forming the internal logic basis of computer is used ingeniously in coding, several geometric forms correspondent to binary system are used to represent literal numerical information, and can be automatically read by means of image input equipment or photoelectric scanning equipment so as to implement automatic information processing. The two-dimensional Code in this optional embodiment may be encoded by the first electronic device according to the connection information, the two-dimensional barcode/two-dimensional Code may be a stacked/row two-dimensional barcode or a Matrix two-dimensional barcode, and the Code system of the two-dimensional Code may be any one of Data Matrix, Maxi Code, Aztec, QR Code, Vericode, PDF417, Ultracode, Code 49, and Code 16K. Those skilled in the art should understand that the encoding manner of the two-dimensional code in this alternative implementation is not limited to the above listed ones.

Step 202, in response to receiving a connection establishment request initiated by the second electronic device based on the connection information, establishing a connection with the second electronic device.

In this embodiment, the executing entity may establish a connection with the second electronic device through Wi-Fi (WIreless-Fidelity), zigbee (zigbee protocol), Z-Wave (a radio-frequency-based, low-cost, low-power consumption, high-reliability, network-suitable short-range WIreless communication technology), and other local area network communication protocols in response to receiving a connection establishment request initiated by the second electronic device based on the connection information output in step 201.

Step 203, establishing a corresponding relation between the device identifier of the second electronic device and the object identifier of the operation object in the target application.

In this embodiment, after the execution main body establishes connection with the second electronic device, a corresponding relationship between the device identifier of the second electronic device and the object identifier of the operation object in the target application is established. The execution main body may randomly allocate an operation object to the second electronic device, or allocate an operation object to the second electronic device based on a default setting, or further acquire other input information and allocate an operation object to the second electronic device based on the acquired input information, so as to establish a correspondence between the device identifier of the second electronic device and the object identifier of the operation object in the target application.

In some optional implementation manners of this embodiment, the establishing a correspondence between the device identifier of the second electronic device and the object identifier of the operation object in the target application includes: displaying alternative operation objects in the target application; receiving operation object selection information sent by second electronic equipment, wherein the operation object selection information comprises an object identifier of an operation object and an equipment identifier of the second electronic equipment; and establishing the corresponding relation between the object identification and the equipment identification included in the received object selection information.

In some optional implementation manners of this embodiment, the establishing a correspondence between the device identifier of the second electronic device and the object identifier of the operation object in the target application includes: acquiring voiceprint characteristics of a user operating the second electronic device; determining an object identifier corresponding to the voiceprint features according to a pre-established correspondence between the voiceprint features and the object identifiers; and establishing a corresponding relation between the determined object identification and the equipment identification of the second electronic equipment.

Here, voiceprint is a spectrum of sound waves carrying verbal information displayed with an electro-acoustic instrument. Modern scientific research shows that the voiceprint not only has specificity, but also has the characteristic of relative stability. The voiceprint feature can be a feature that identifies the voiceprint spectrum of the user. If there are multiple persons' voices in a piece of audio, multiple voiceprint features can be extracted.

As an example, generating voiceprint features based on speech may be accomplished by extracting characteristic features in the speech. When the voiceprint feature extraction is performed on the voice, the features of the wavelength, the frequency, the intensity, the rhythm and the like in the voice can be extracted, the feature values of the features of the wavelength, the frequency, the intensity, the rhythm and the like in the voice can be determined, and the feature values of the features of the wavelength, the frequency, the intensity, the rhythm and the like in the voice can be used as elements in the voiceprint feature. Generating voiceprint features based on speech may also be performed by extracting acoustic features in the speech, such as mel-frequency cepstral coefficients. Mel-frequency cepstral coefficients are used as elements in the voiceprint feature. The process of extracting mel-frequency cepstral coefficients from speech may include pre-emphasis, framing, windowing, fast fourier transform, mel-filtering, log transform and discrete cosine transform.

The user identity may be identified by extracting voiceprint features. For example, a child, an elderly person, an adult female, an adult male may be identified, and a corresponding operation object may be assigned based thereon; for another example, the identification information of the user corresponding to the voiceprint feature may be determined based on a voiceprint feature library established in advance, and then the operation object controlled by the user in history may be searched based on the identification information of the user, or the operation object controlled by the user may be searched based on the identification information of the user. In addition, the camera can be called to analyze the facial features of the user under the permission of the user, and the identity of the user can be further identified.

In some optional implementations of this embodiment, acquiring a voiceprint feature of a user manipulating the second electronic device includes: outputting prompt information for prompting a user who operates the second electronic equipment to make a sound; in response to receiving the voice input information, voiceprint features of the voice input information are extracted. The prompt message for prompting the user operating the second electronic device to make a sound may be a text, voice or image message, and the content may be "please say a sentence", "please recite the following numbers: 12345".

Step 204, receiving instruction information sent by the second electronic device, where the instruction information includes an operation instruction for controlling an operation object and a device identifier of the second electronic device.

In this embodiment, the execution main body may receive instruction information sent by the second electronic device, where the instruction information includes an operation instruction for controlling an operation object and a device identifier of the second electronic device. The operation instruction may be used to instruct the operation object to perform a preset action, such as forward, backward, jump, and the like. When there are at least two second electronic devices, the execution subject may determine an operation object to which the operation instruction is directed according to the device identifier.

And step 205, controlling the operation object indicated by the object identification corresponding to the equipment identification of the second electronic equipment to execute the operation instruction.

In this embodiment, the execution main body may control the operation object indicated by the object identifier corresponding to the device identifier of the second electronic device to execute the operation instruction received in step 204. In addition, the execution main body can also return a feedback signal to the second electronic device, so that the second electronic device vibrates, plays a preset animation and the like, and the setting can be specifically carried out according to actual needs.

With continued reference to fig. 3, fig. 3 is a schematic diagram of an application scenario of the method for controlling an operation object according to the present embodiment. In the application scenario of fig. 3, after the first electronic device 301 establishes a connection with the second

electronic devices

302 and 303, a corresponding relationship between the device identifier of the second electronic device 302 and the object identifier of the operation object 306 in the target application, and between the device identifier of the second electronic device 303 and the object identifier of the operation object 307 in the target application is established; after receiving the instruction information 304 sent by the second electronic device 302, controlling the operation object 306 to execute the operation instruction included in the instruction information 304; after receiving the instruction information 305 sent by the second electronic device 303, the control operation object 307 controls to execute the operation instruction included in the instruction information 305.

The method provided by the above embodiment of the application receives instruction information sent by the second electronic device by establishing a corresponding relationship between the device identifier of the second electronic device and the object identifier of the operation object in the target application, and controls the operation object indicated by the object identifier corresponding to the device identifier of the second electronic device to execute the operation instruction, thereby providing a method for controlling the operation object based on the external device, so that for a complex interaction scene (such as a game), the interface feedback of the first electronic device is not shielded, and the interaction is more efficient; on the other hand, compared with direct interaction on the first electronic equipment, the corresponding relation between the equipment identification of each second electronic equipment and the object identification of the operation object is established, so that interaction of multiple persons can be supported, and the mode of controlling the operation object is enriched.

With further reference to FIG. 4, a flow 400 of yet another embodiment of a method for controlling an operand is shown. The process 400 of the method for controlling an operation object comprises the following steps:

step 401, obtaining connection information from a first electronic device.

In the present embodiment, a method execution subject (e.g., the second electronic device shown in fig. 1) for controlling an operation object may first acquire information for connection from the first electronic device. Reference may be made to the definition of the information for connection in step 201. The execution main body can acquire the information for connection through the content displayed on the screen of the first electronic equipment, and also can acquire the information for connection through other models sent by the first electronic equipment.

In some optional implementations of this embodiment, the obtaining the connection information from the first electronic device includes: responding to a scanning action of the first electronic equipment, and acquiring a two-dimensional code from the first electronic equipment; and acquiring information for connection according to the two-dimensional code. When the second electronic device scans the first electronic device, the second electronic device responds to the scanning action. Thereafter, the second electronic device may start a scanning device such as a scanner or a camera to read the two-dimensional code image displayed by the first electronic device. And after the two-dimensional code is obtained, decoding the two-dimensional code image through a decoding algorithm, wherein the decoding algorithm corresponds to the encoding algorithm of the first electronic equipment. And the second electronic equipment can obtain the connection information corresponding to the two-dimensional code after decoding the two-dimensional code image.

Here, the connection information can be quickly acquired by reading the two-dimensional code, which is beneficial to quickly and rapidly establishing connection and reduces the operation time of a user.

Step 402, sending a connection establishment request to the first electronic device based on the acquired information for connection, wherein the connection establishment request includes a device identifier of the second electronic device.

In this embodiment, the execution body may send a connection establishment request to the first electronic device based on the information for connection acquired in step 401, where the connection establishment request includes a device identifier of the second electronic device. The connection establishment request may be sent based on Wi-Fi (WIreless-Fidelity), zigbee (zigbee protocol), Z-Wave (a radio frequency-based, low-cost, low-power, highly reliable, network-adapted short-range WIreless communication technology), and other local area network communication protocols.

And step 403, in response to the successful establishment of the connection with the first electronic device, determining the object identifier of the operation object in the controlled target application.

In this embodiment, the execution subject may determine the object identifier of the operation object in the controlled target application in response to successfully establishing a connection with the first electronic device. The object identification of the operation object in the controlled target application can be determined by the first electronic device and also can be determined by the second electronic device.

In some optional implementations of this embodiment, determining the object identifier of the operation object in the controlled target application includes: displaying prompt information for prompting a user to make a sound; and determining the object identifier of the operation object in the controlled target application according to the corresponding relation between the object identifier and the equipment identifier, which is established by the first electronic equipment based on the voiceprint characteristics of the received voice input information. The specific manner of establishing the corresponding relationship between the device identifier of the second electronic device and the object identifier of the operation object in the target application may refer to step 203.

And step 404, presenting an operation interface of the operation object indicated by the determined object identification.

In this embodiment, the execution subject may present an operation interface for the operation object indicated by the determined object identifier. The operation interface can be different according to different types of target applications and operation objects, and can be set according to actual needs. For example, the operation object is a character, the operation interface may include a virtual handle interface, the operation object is a vehicle, and the operation interface may include a virtual steering wheel interface.

And step 405, receiving interaction information input by a user on the operation interface, and generating instruction information of an operation object indicated by the determined object identification based on the interaction information.

In this embodiment, the execution subject may receive interaction information input by the operation interface presented in step 404 by the user, and generate instruction information for the operation object indicated by the determined object identifier based on the interaction information, where the instruction information includes an operation instruction for controlling the operation object and a device identifier of the second electronic device. The interactive information input by the user on the operation interface can comprise various information input by the user when the operation interface is opened. The operation instruction may be different according to the target application and the type of the operation object, and may be set according to actual needs, for example, the operation object is a person, the operation instruction may include forward movement, backward movement, turning, dancing, and the like, the operation object is a vehicle, and the operation instruction may include acceleration, braking, turning, and the like.

In some optional implementations of this embodiment, the interaction information includes at least one of: touch operation information, motion state information and voice information. The touch operation information may include a click, a slide, a press, and the like. The motion state information may be obtained based on a sensor mounted on the second electronic device, and the motion state information may include whether to shake, move, turn, and a direction, distance, speed, etc. of the movement. The voice information may include voice instructions uttered by the user.

Step 406, sending instruction information to the first electronic device.

In this embodiment, the execution subject may send the instruction information generated in step 405 to the first electronic device based on the successfully established connection. In addition, the execution main body can also receive a feedback signal returned by the first electronic device.

The method provided by the above embodiment of the present application acquires information for connection from a first electronic device; sending a connection establishment request to the first electronic device based on the acquired information for connection, wherein the connection establishment request comprises a device identifier of the second electronic device; in response to successful connection establishment with the first electronic device, determining an object identifier of an operation object in the controlled target application; displaying an operation interface of the operation object indicated by the determined object identification; receiving interaction information input by a user on an operation interface, and generating instruction information of an operation object indicated by the determined object identification based on the interaction information, wherein the instruction information comprises an operation instruction for controlling the operation object and equipment identification of the second electronic equipment; the method for controlling the operation object based on the external equipment is provided by sending the instruction information to the first electronic equipment, and the operation efficiency is improved.

With further reference to fig. 5, as an implementation of the methods shown in the above-mentioned figures, the present application provides an embodiment of an apparatus for controlling an operation object, which corresponds to the method embodiment shown in fig. 2, and which is particularly applicable to various electronic devices.

As shown in fig. 5, the apparatus 500 for controlling an operation object of the present embodiment includes: an output unit 501, a connection unit 502, a setup unit 503, a reception unit 504, and a control unit 505. Wherein the output unit is configured to output the information for connection in response to acquiring the request indicating that the operation object in the target application is controlled by the external device; a connection unit configured to establish a connection with the second electronic device in response to receiving a connection establishment request initiated by the second electronic device based on the connection-use information, the connection establishment request including a device identification of the second electronic device; the establishing unit is configured to establish a corresponding relation between the equipment identifier of the second electronic equipment and the object identifier of the operation object in the target application; the receiving unit is configured to receive instruction information sent by the second electronic equipment, wherein the instruction information comprises an operation instruction for controlling an operation object and an equipment identifier of the second electronic equipment; and the control unit is configured to control the operation object indicated by the object identification corresponding to the equipment identification of the second electronic equipment to execute the operation instruction.

In the present embodiment, specific processing of the output unit 501, the connection unit 502, the establishment unit 503, the reception unit 504, and the control unit 505 of the apparatus 500 for controlling an operation object may refer to step 201, step 202, step 203, step 204, and step 205 in the corresponding embodiment of fig. 2.

In some optional implementations of this embodiment, the output unit is further configured to: and outputting the two-dimensional code encoded according to the connection information.

In some optional implementations of this embodiment, the establishing unit includes: the display subunit is configured to display the alternative operation objects in the target application; the receiving subunit is configured to receive operation object selection information sent by the second electronic device, wherein the operation object selection information comprises an object identifier of an operation object and a device identifier of the second electronic device; and the establishing subunit is configured to establish a corresponding relation between the object identifier and the equipment identifier included in the received object selection information.

In some optional implementations of this embodiment, the establishing unit includes: an obtaining subunit configured to obtain voiceprint characteristics of a user manipulating the second electronic device; the determining subunit is configured to determine an object identifier corresponding to the voiceprint features according to a pre-established correspondence between the voiceprint features and the object identifiers; and the second establishing subunit is configured to establish a corresponding relation between the determined object identifier and the device identifier of the second electronic device.

In some optional implementations of this embodiment, the obtaining subunit is further configured to: outputting prompt information for prompting a user who operates the second electronic equipment to make a sound; in response to receiving the voice input information, voiceprint features of the voice input information are extracted.

The apparatus provided in the foregoing embodiment of the present application outputs connection information in response to acquiring a request indicating that an operation object in a target application is controlled by an external device; establishing connection with the second electronic equipment in response to receiving a connection establishment request initiated by the second electronic equipment based on the connection information, wherein the connection establishment request comprises an equipment identifier of the second electronic equipment; establishing a corresponding relation between the equipment identifier of the second electronic equipment and the object identifier of the operation object in the target application; receiving instruction information sent by second electronic equipment, wherein the instruction information comprises an operation instruction for controlling an operation object and an equipment identifier of the second electronic equipment; the method for controlling the operation object based on the external equipment is provided, and the operation efficiency is improved.

With further reference to fig. 6, as an implementation of the methods shown in the above-mentioned figures, the present application provides yet another embodiment of an apparatus for controlling an operation object, which corresponds to the method embodiment shown in fig. 4, and which is particularly applicable in various electronic devices.

As shown in fig. 6, the apparatus 600 for controlling an operation object of the present embodiment includes: an acquisition unit 601, a first transmission unit 602, a determination unit 603, a presentation unit 604, a generation unit 605, and a second transmission unit 606. Wherein the acquisition unit is configured to acquire information for connection from a first electronic device; a first transmitting unit configured to transmit a connection establishment request to the first electronic device based on the acquired information for connection, the connection establishment request including a device identification of the second electronic device; a determining unit configured to determine an object identifier of an operation object in the controlled target application in response to successful establishment of a connection with the first electronic device; the display unit is configured to display an operation interface of the operation object indicated by the determined object identification; the generating unit is configured to receive interaction information input by a user on the operation interface and generate instruction information of an operation object indicated by the determined object identification based on the interaction information, wherein the instruction information comprises an operation instruction for controlling the operation object and the equipment identification of the second electronic equipment; a second transmitting unit configured to transmit the instruction information to the first electronic device.

In the present embodiment, the apparatus 600 for controlling an operation object: the specific processing of the obtaining unit 601, the first sending unit 602, the determining unit 603, the presenting unit 604, the generating unit 605 and the second sending unit 606 may refer to step 401, step 402, step 403, step 404, step 405 and step 406 in the corresponding embodiment of fig. 4.

In some optional implementations of this embodiment, the obtaining unit is further configured to: responding to a scanning action of the first electronic equipment, and acquiring a two-dimensional code from the first electronic equipment; and acquiring information for connection according to the two-dimensional code.

In some optional implementations of the present embodiment, the operator interface includes a virtual handle interface.

In some optional implementations of this embodiment, the interaction information includes at least one of: touch operation information, motion state information and voice information.

In some optional implementations of this embodiment, the determining unit is further configured to: displaying prompt information for prompting a user to make a sound; and determining the object identifier of the operation object in the controlled target application according to the corresponding relation between the object identifier and the equipment identifier, which is established by the first electronic equipment based on the voiceprint characteristics of the received voice input information.

Referring now to FIG. 7, shown is a block diagram of a computer system 700 suitable for use in implementing the electronic device of an embodiment of the present application. The electronic device shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.

As shown in fig. 7, the computer system 700 includes a Central Processing Unit (CPU)701, which can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)702 or a program loaded from a storage section 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data necessary for the operation of the system 700 are also stored. The CPU 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.

The following components may be connected to the I/O interface 705: an input section 706 including such as a keyboard, a mouse, and the like; an output section 707 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 708 including a hard disk and the like; and a communication section 709 including a network interface card such as a LAN card, a modem, or the like. The communication section 709 performs communication processing via a network such as the internet. A drive 710 is also connected to the I/O interface 705 as needed. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 710 as necessary, so that a computer program read out therefrom is mounted into the storage section 708 as necessary.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 709, and/or installed from the removable medium 711. The computer program, when executed by a Central Processing Unit (CPU)701, performs the above-described functions defined in the method of the present application. It should be noted that the computer readable medium described herein can be a computer readable signal medium or a computer readable medium or any combination of the two. A computer readable medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer readable medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the C language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in the embodiments of the present application may be implemented by software or hardware. The described units may also be provided in a processor, and may be described as: a processor includes an output unit, a connection unit, an establishment unit, a reception unit, and a control unit. Here, the names of these units do not constitute a limitation of the unit itself in some cases, and for example, the output unit may also be described as "a unit configured to output information for connection".

As another aspect, the present application also provides a computer-readable medium, which may be contained in the apparatus described in the above embodiments; or may be present separately and not assembled into the device. The computer readable medium carries one or more programs which, when executed by the apparatus, cause the apparatus to: outputting information for connection in response to acquiring a request indicating that an operation object in a target application is controlled by an external device; establishing connection with the second electronic equipment in response to receiving a connection establishment request initiated by the second electronic equipment based on the connection information, wherein the connection establishment request comprises an equipment identifier of the second electronic equipment; establishing a corresponding relation between the equipment identifier of the second electronic equipment and the object identifier of the operation object in the target application; receiving instruction information sent by second electronic equipment, wherein the instruction information comprises an operation instruction for controlling an operation object and an equipment identifier of the second electronic equipment; and controlling the operation object indicated by the object identification corresponding to the equipment identification of the second electronic equipment to execute the operation instruction.

The above description is only a preferred embodiment of the application and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention herein disclosed is not limited to the particular combination of features described above, but also encompasses other arrangements formed by any combination of the above features or their equivalents without departing from the spirit of the invention. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.

Claims

1. A method for controlling an operation object is applied to a first electronic device and comprises the following steps:

outputting information for connection in response to acquiring a request indicating that an operation object in a target application is controlled by an external device;

in response to receiving a connection establishment request initiated by a second electronic device based on the connection information, establishing a connection with the second electronic device, wherein the connection establishment request comprises a device identifier of the second electronic device;

establishing a corresponding relation between the equipment identifier of the second electronic equipment and the object identifier of the operation object in the target application based on the voiceprint characteristics of the user of the second electronic equipment;

receiving instruction information sent by the second electronic device, wherein the instruction information comprises an operation instruction for controlling an operation object and a device identifier of the second electronic device;

controlling an operation object indicated by the object identification corresponding to the equipment identification of the second electronic equipment to execute the operation instruction;

wherein the outputting of the connection information includes:

outputting a two-dimensional code encoded according to the connection information;

the controlling the operation object indicated by the object identifier corresponding to the device identifier of the second electronic device to execute the operation instruction further includes returning a feedback signal to the second electronic device, where returning the feedback signal to the second electronic device includes returning the feedback signal to the second electronic device so that the second electronic device vibrates or plays a preset animation.

2. The method of claim 1, wherein the establishing a correspondence between the device identifier of the second electronic device and the object identifier of the operation object in the target application comprises:

displaying alternative operation objects in the target application;

receiving operation object selection information sent by the second electronic device, wherein the operation object selection information comprises an object identifier of an operation object and a device identifier of the second electronic device;

and establishing a corresponding relation between the object identification and the equipment identification in the operation object selection information.

3. The method according to claim 1 or 2, wherein the establishing of the correspondence between the device identifier of the second electronic device and the object identifier of the operation object in the target application comprises:

acquiring voiceprint characteristics of a user operating the second electronic device;

determining an object identifier corresponding to the voiceprint features according to a pre-established corresponding relation between the voiceprint features and the object identifier;

and establishing a corresponding relation between the determined object identification and the equipment identification of the second electronic equipment.

4. The method of claim 3, wherein the obtaining voiceprint characteristics of a user manipulating the second electronic device comprises:

outputting prompt information for prompting a user who operates the second electronic equipment to make a sound;

in response to receiving voice input information, voiceprint features of the voice input information are extracted.

5. A method for controlling an operation object is applied to a second electronic device and comprises the following steps:

acquiring information for connection from a first electronic device;

sending a connection establishment request to the first electronic device based on the acquired information for connection, wherein the connection establishment request comprises a device identifier of the second electronic device;

in response to successful connection establishment with the first electronic device, determining an object identifier of an operation object in the controlled target application based on voiceprint characteristics of a user;

displaying an operation interface of the operation object indicated by the determined object identification;

receiving interaction information input by a user on the operation interface, and generating instruction information of an operation object indicated by the determined object identification based on the interaction information, wherein the instruction information comprises an operation instruction for controlling the operation object and a device identification of the second electronic device;

sending the instruction information to the first electronic equipment;

wherein the acquiring information for connection from the first electronic device includes:

responding to a scanning action of first electronic equipment, and acquiring a two-dimensional code from the first electronic equipment;

acquiring information for connection according to the two-dimensional code;

the method further comprises the steps of receiving a feedback signal returned by the first electronic device, and vibrating or playing a preset animation in response to the received feedback signal returned by the first electronic device.

6. The method of claim 5, wherein the operator interface comprises a virtual handle interface.

7. The method of claim 5, wherein the interaction information comprises at least one of: touch operation information, motion state information and voice information.

8. The method of any of claims 5-7, wherein the determining an object identification of an operation object in the controlled target application comprises:

displaying prompt information for prompting a user to make a sound;

and determining the object identifier of the operation object in the controlled target application according to the corresponding relation between the object identifier and the equipment identifier, which is established by the first electronic equipment based on the voiceprint characteristics of the received voice input information.

9. An apparatus for controlling an operation object, provided in a first electronic device, includes:

an output unit configured to output information for connection in response to acquisition of a request indicating that an operation object in a target application is controlled by an external device;

a connection unit configured to establish a connection with a second electronic device in response to receiving a connection establishment request initiated by the second electronic device based on the connection information, the connection establishment request including a device identification of the second electronic device;

the establishing unit is configured to establish a corresponding relation between the device identification of the second electronic device and the object identification of the operation object in the target application based on the voiceprint characteristics of the user of the second electronic device;

a receiving unit configured to receive instruction information sent by the second electronic device, wherein the instruction information includes an operation instruction for controlling an operation object and a device identifier of the second electronic device;

a control unit configured to control an operation object indicated by an object identifier corresponding to the device identifier of the second electronic device to execute the operation instruction;

wherein the output unit is further configured to:

wherein the control unit is further configured to return a feedback signal to the second electronic device, and the returning of the feedback signal to the second electronic device includes returning the feedback signal to the second electronic device so that the second electronic device vibrates or plays the preset animation.

10. The apparatus of claim 9, wherein the establishing unit comprises:

the display subunit is configured to display the alternative operation objects in the target application;

the receiving subunit is configured to receive operation object selection information sent by the second electronic device, wherein the operation object selection information comprises an object identifier of an operation object and a device identifier of the second electronic device;

and the establishing subunit is configured to establish a corresponding relationship between the object identifier and the device identifier in the operation object selection information.

11. The apparatus according to claim 9 or 10, wherein the establishing unit comprises:

an obtaining subunit configured to obtain voiceprint characteristics of a user manipulating the second electronic device;

the determining subunit is configured to determine an object identifier corresponding to the voiceprint feature according to a pre-established correspondence between the voiceprint feature and the object identifier;

and the second establishing subunit is configured to establish a corresponding relationship between the determined object identifier and the device identifier of the second electronic device.

12. The apparatus of claim 11, wherein the acquisition subunit is further configured to:

13. An apparatus for controlling an operation object, provided to a second electronic device, includes:

an acquisition unit configured to acquire information for connection from a first electronic device;

a first transmitting unit configured to transmit a connection establishment request to the first electronic device based on the acquired information for connection, the connection establishment request including a device identification of a second electronic device;

a determining unit configured to determine an object identifier of an operation object in the controlled target application based on a voiceprint feature of a user in response to successfully establishing a connection with the first electronic device;

the display unit is configured to display an operation interface of the operation object indicated by the determined object identification;

the generating unit is configured to receive interaction information input by a user on the operation interface and generate instruction information of an operation object indicated by the determined object identification based on the interaction information, wherein the instruction information comprises an operation instruction for controlling the operation object and the equipment identification of the second electronic equipment;

a second transmitting unit configured to transmit the instruction information to the first electronic device;

wherein the obtaining unit is further configured to:

acquiring information for connection according to the two-dimensional code;

the second sending unit is further configured to receive a feedback signal returned by the first electronic device, and vibrate or play the preset animation in response to receiving the feedback signal returned by the first electronic device.

14. The apparatus of claim 13, wherein the operator interface comprises a virtual handle interface.

15. The apparatus of claim 13, wherein the interaction information comprises at least one of: touch operation information, motion state information and voice information.

16. The apparatus of any of claims 13-15, wherein the determining unit is further configured to:

displaying prompt information for prompting a user to make a sound;

17. An electronic device, comprising:

one or more processors;

a storage device having one or more programs stored thereon;

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1-4 or claims 5-8.

18. A computer-readable medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-4 or claims 5-8.