CN102023790A - Method and system for dynamically operating interactive object - Google Patents

Abstract

The invention relates to a method and a system for dynamically operating an interactive object, which are suitable for an electronic system with a user interface module and an interactive module.

Description

Method and system for dynamically operating interactive objects

technical field

The present invention relates to a method and a system for dynamically operating an interactive object, in particular to a method and a system for operating an interactive object of a user interface by using a detection unit.

Background technique

At present, existing operating system user interfaces such as Mac OS X, Linux, Windows, etc. are all two-dimensional screen displays. The main reason is that traditional user interfaces are designed to adapt to input devices such as mouse or keyboard.

However, the functions of today's application software are increasing day by day, and each file or object can be mapped to a different application software or function. Therefore, the user interface designed by the application software is also increasing with different functions and applications. Even, there are more and more layers of function menus in the user interface, causing the user to complete a certain operation only through multiple inputs during the operation.

For Microsoft's window operating system, assuming that the user wants to use the drawing application software, and its input device is a touch screen, the user needs to at least click the start object at the bottom left of the screen, and then slide the scroll wheel in the start function menu until the accessory application is seen. object, then click the object of the accessory application, and then click the drawing application software to open the drawing application software; in other words, the user needs to go through multiple touches to complete an operation, which is quite inconvenient for the user operate.

Contents of the invention

In view of the above-mentioned problems in the prior art, the present invention provides a method for dynamically operating interactive objects to solve the problem of inconvenient operation of traditional user interfaces.

According to the purpose of the present invention, a method for dynamically operating an interactive object is proposed. This method is suitable for an electronic system. The electronic system has a user interface module and an interactive module. Start the interactive object of the user interface currently presented by the user interface module according to the start signal, receive the detection information output by the detection unit of the electronic system, obtain the corresponding response command in the interaction module according to the detection information, and the electronic system operates the interaction of the user interface according to the response command object.

Wherein, the detection unit includes an image extraction part and an image calculation part, and the step of generating the detection information by the image extraction part and the image calculation part at least includes: receiving a plurality of image data output by the image extraction part; calculating the variation of at least one local feature according to each image data information; generate corresponding detection information according to the change information. In addition, the change information is the relative action between the user and the image extraction unit.

Wherein, the detection unit is an acceleration kinetic energy sensor, and the step of generating detection information includes at least receiving acceleration data of at least one axial direction output by the acceleration kinetic energy sensor, calculating a displacement information according to the acceleration data, and then generating a corresponding displacement information according to the displacement information. detection information.

Wherein, the step of operating the user interface by the electronic system according to the response command further includes changing the angle and shape of the user interface according to an autostereoscopic method, so as to change the user interface into a three-dimensional object.

Among them, after the electronic system activates the interactive module according to the start signal, or after the electronic system operates the interactive object of the user interface according to the response command, it may also include: receiving the operation signal output by the control unit of the electronic system, and according to the operation signal in the interactive module The corresponding operation command is obtained, and the electronic system operates the interactive object according to the operation command.

According to the purpose of the present invention, a dynamic operation interactive object system is proposed, the system includes: a user interface module, an interactive module, a display unit, a starting unit and a detection unit, wherein the user interface module has multiple user interfaces, and the interactive module has multiple user interfaces. Interactive objects and multiple response commands, the display unit displays at least one user interface and interactive objects, the starting unit provides a starting signal, the detection unit provides at least one detection information, and the interactive module is activated after receiving the starting signal, and outputs a corresponding response according to the detection information Respond to commands, and operate interactive objects of the user interface according to the responding commands.

As mentioned above, according to the method of dynamically operating interactive objects of the present invention, it can have the following advantages:

(1) By operating the interactive object through the relative displacement between the user and the electronic system, or the displacement of the electronic system itself, the number of operations of the mouse, keyboard or touch screen can be reduced.

(2) The interactive object uses the displacement of the electronic system itself to operate the interactive object, and then cooperates with the operation of the mouse, keyboard or touch screen to make the electronic system have a variety of operating modes.

Description of drawings

Fig. 1 is a schematic diagram of the system structure of the present invention;

Fig. 2 is the action flowchart of the present invention;

Fig. 3 is a schematic view of the use state of the first embodiment of the present invention;

Fig. 4 is a flow chart of generating detection information by an image extraction unit and an image calculation unit according to the first embodiment of the present invention;

Fig. 5 is a schematic view of the use state of the second embodiment of the present invention;

Fig. 6 is a schematic view of the use state of the third embodiment of the present invention;

Fig. 7 is a flow chart of the detection information generated by the acceleration kinetic energy sensor according to the third embodiment of the present invention;

Fig. 8 is a schematic diagram of another use state of the present invention in the third embodiment;

Fig. 9 is a schematic diagram of another usage state of the third embodiment of the present invention;

Fig. 10 is a schematic diagram of the mobile phone of Fig. 9 being rotated again;

Fig. 11 is a schematic diagram of another use state of the present invention in the third embodiment;

12 is a flow chart of the electronic system operating the user interface according to the response command in various embodiments of the present invention;

Fig. 13 is a schematic diagram of a three-dimensional object according to various embodiments of the present invention;

Fig. 14 is a flow chart of actions after the manipulation unit is operated in various embodiments of the present invention; and

Fig. 15 is a schematic view of the use state of the fourth embodiment of the present invention.

Description of main component symbols:

1 is an electronic system, 10 is a display unit, 12 is a user interface module, 120 is a user interface, 14 is an interactive module, 140 is an interactive object, 142 is a response command, 144 is an operation command, 16 is a starting unit, 160 is a starting signal , 18 is the detection unit, 180 is the detection information, 182 is the image extraction part, 1820 is the image data, 184 is the image calculation part, 1840 is the change information, 19 is the control unit, 190 is the operation signal, 2 is the picture, 20 is the function In the menu, 3 is a three-dimensional object, 4 is an icon, S10-S60 are steps, S301-S304 are steps, S301'-S303' are steps, S501-S503 are steps, and S70-S90 are steps.

Detailed ways

Referring to FIG. 1 and FIG. 2, FIG. 1 and FIG. 2 are respectively a schematic diagram of the system structure of the present invention, and an action flowchart of the method for dynamically operating an interactive object of the present invention. In the figure, this method is applicable to electronic system 1, and this electronic system 1 has at least display unit 10, a user interface module 12 and interaction module 14, start unit 16 and detection unit 18, and the output in user interface module 12 by display unit 10 A user interface 120 (such as a graphical user interface, Graphical User Interface, referred to as: GUI) and an interactive object (Human-Machine Interaction Interface), this method includes:

(S10) whether to continue to receive the starting signal 160 that starting unit 16 outputs, if yes, then carry out step (S20), otherwise carry out step (S60);

(S20) Start the interactive module 14 according to the start signal 160, so as to output the interactive object 140 corresponding to the current user interface 120;

(S30) receiving the detection information 180 output by the detection unit 18;

(S40) Obtain the corresponding response command 142 from the interaction module 14 according to the detection information 180;

(S50) The electronic system 1 operates the interactive object 140 of the user interface 120 according to the response command 142, and then proceeds according to the step (S10); and

(S60) Keep the current user interface 120.

As mentioned above, in the electronic system 1 of the present invention, before the interactive module 14 is closed, the detection unit 18 will continue to obtain the detection information 180 and the response command 142, so that the electronic system 1 can present the interactive object 140 on the user interface 120 and operate the user interface. The interactive objects 140 of 120, in particular, different detection information 180 generate different response commands 142, and then different interactive objects 140 are generated for the user interface 120, and corresponding operations are performed. In this way, the actions of repeatedly clicking the user interface 120 are reduced, and the purpose of simplifying the operation steps of the electronic system 1 is achieved.

Referring to FIG. 3 , FIG. 3 is a schematic view of the use state of the first embodiment of the present invention. In the figure, the electronic system 1 is a computer system, and the display unit 10 may be a cathode ray tube (CRT) display, a liquid crystal (LCD) display or a touch display. The detection unit 18 includes an image extraction part 182 and an image calculation part 184, wherein the image extraction part 182 can be a network camera (Web Cam), a smart camera or a device with an image extraction function, and the image extraction part 182 is arranged on the surface of the display unit 10 The direction to the user, or the image extraction part 182 may be provided in a direction in which the user faces the display unit 10 , and the image calculation part 182 is connected with the image extraction part 184 . With reference to Fig. 4, Fig. 4 is the flow chart that the image extraction part and the image calculation part of the present invention generate detection information in this embodiment, and it comprises:

(S301) The image extraction unit 182 extracts a plurality of image data 1820;

(S302) The image calculation unit 184 receives each image data 1820;

(S303) The image calculation unit 184 calculates at least one local feature of each image data 1820 to generate change information 1840; and

( S304 ) The image calculation unit 184 generates corresponding detection information 180 according to the change information 1840 .

The change information 1840 is the relative action between the user and the image extraction unit 182, including the user moving to the image extraction unit 182, the user moving away from the image extraction unit 182, the user moving to the left or right of the display unit, the user nodding/shaking/turning the head Or various gestures, etc., as well as the speed and angle changes of various relative actions made by the user, etc., and then generate detection information 180 such as user approach, distance, left/right movement, nodding/shaking/turning head, etc. In this way, no matter the user's action changes or the display unit 10 is moved, the corresponding detection information 180 can be generated.

Referring to FIG. 5 , FIG. 5 is a schematic view of the use state of the second embodiment of the present invention. In the figure, its structure is roughly the same as that of the first embodiment, and the difference between the two is that the detection unit 18 is an acceleration kinetic energy sensor (G-Sensor), and this acceleration kinetic energy sensor can be arranged on any part of the user's body (such as: head, hands or feet), or be set in the display unit 10. Alternatively, refer to FIG. 6 , which is a schematic view of the use state of the third embodiment of the present invention. In the figure, the electronic system 1 is a handheld device (such as a mobile phone, a navigator or a locator, etc.), and the detection unit 18 is also an acceleration kinetic energy sensor (G-Sensor), which is set in the handheld device. Referring to Fig. 7, Fig. 7 is a flow chart of the acceleration kinetic energy sensor in this embodiment of the present invention generating detection information, including:

(S301') The acceleration kinetic energy sensor senses at least one axial acceleration data;

(S302') Calculate the displacement information according to the acceleration data; and

(S303') Generate corresponding detection information 180 according to the displacement information.

Wherein, the displacement information is the displacement such as movement or rotation of the part of the user where the acceleration kinetic energy sensor is installed, or the displacement such as movement or rotation of the display unit 10, or the displacement such as movement or rotation of the electronic system 1, and the user, the display unit 10 or the displacement such as rotation. The electronic system 1 makes various displacement speed and angle changes, etc., and then generates detection information 180 such as user approach, distance, left/right movement, nodding/shaking/turning head or various gestures.

Referring to FIG. 8, FIG. 8 is a schematic diagram of another use state of the present invention in the third embodiment. In the figure, the electronic system 1 is a mobile phone. When the mobile phone turns to the left, it outputs detection information 180, so that in the picture 2 presented by the display unit 10 on the mobile phone, an interactive object 140 (that is, the The function menu 20) shown in 8 slides with the direction of rotation. In this embodiment, the picture browsing interface is taken as an example for illustration, but the application field of the present invention is not limited thereto.

Referring to FIG. 9, FIG. 9 is a schematic diagram of another use state of the present invention in the third embodiment, or when the mobile phone is turned downwards, the detection information 180 is output immediately, so that the display unit 10 of the mobile phone is above the picture 2, And make the interactive object 140 (that is, the information box 22 shown in FIG. 9 ) slide down with the direction of rotation, for example: the information box indicates the shooting position of the picture. Referring to diagram 1010, FIG. 10 is a schematic diagram of the mobile phone in FIG. 9 rotating again. In the figure, when the mobile phone continues to turn downwards, the detection information 180 is output immediately, and the content of the interactive object 140 (that is, the information box 22 shown in FIG. time.

Referring to Figure 1111, Figure 11 is another schematic diagram of the third embodiment of the present invention, when the current user interface of the display unit 10 of the mobile phone is a map navigation screen, and when the mobile phone tilts to the left, detection information 180 of left tilt will be generated, Make the interactive object 140 displayed on the map guide screen (such as the position of the mark P (parking lot) shown in the upper left of Figure 11); The interactive object 140 is displayed on the navigation screen (such as the position of the mark 7 (convenience store) shown in the upper right of FIG. The interactive object 140 (for example, the position of the mark O (gas station) shown in the lower left of Figure 11) is displayed on the top; The interactive object 140 is displayed (for example, the path (navigation route) of the oblique part shown in the lower right of FIG. 11 ). In addition, of course, the detection information 180 of tilting or rotating up, down, left, and right can also be used as the response command 142 for moving up, down, left, and right, so that the map navigation screen moves accordingly.

In summary, how the response command of the present invention operates the user interface depends entirely on the definition of the interactive module for detection information and response commands, which is different. Therefore, on the user interface corresponding to different application software, various Detection information 180 will have a unique response command 142 to operate the user interface.

Referring to FIG. 12 and FIG. 13 , it is a flowchart of the electronic system operating the user interface according to the response command in various embodiments of the present invention, a schematic diagram of the three-dimensional object of the present invention, and a schematic diagram of the three-dimensional object of various embodiments of the present invention. In the figure, including:

(S501) Change the angle and shape presented by the user interface 120 according to the autostereoscopic method (Autostereoscopic), so as to change the user interface 120 into a three-dimensional object 3;

(S502) presenting the user interface 120 on one of the visible surfaces of the three-dimensional object 3; and

(S503) On other visible surfaces of the three-dimensional object 3, form an interactive object 140 (such as: a function menu, an information box).

Referring again to FIG. 13 , each user interface 120 is changed to have a different shape of the three-dimensional object 3 , and is represented by different colors on different surfaces of the three-dimensional object 3 , so as to achieve the purpose of clearly distinguishing each user interface 120 .

Referring to Fig. 1 and Fig. 14, wherein Fig. 14 is a flow chart of actions after the manipulation unit is operated in each embodiment of the present invention, in the figure, when the electronic system 1 activates the interactive module 14 according to the start signal 160, or the electronic system 1 After operating the interactive object 140 of the user interface 120 according to the response command 142, it may also include:

(S70) receiving the operation signal 190 output by the control unit 19 of the electronic system 1;

(S80) Obtain the corresponding operation command 144 in the interaction module 14 according to the operation signal 190;

( S90 ) The electronic system 1 operates the interactive object 140 according to the operation command 144 .

Referring to FIG. 15 , FIG. 15 is a schematic view of the use state of the fourth embodiment of the present invention. In the figure, the electronic system 1 is a mobile phone, the detection unit 18 is an acceleration kinetic energy sensor (G-Sensor), and is set in the mobile phone, and the display unit 10 is a touch display. When one of the interactive objects 140 in the mobile phone user interface 120 (such as icon 4 shown in FIG. Select as the operation signal 190, then tilt the mobile phone to the left to generate a response command 142, and gradually present the next display range of the user interface 120, and the selected icon 4 is further dragged to the next display range , the mobile phone uses the icon 4 to be dragged as the operation signal 190, and then the mobile phone tilts left until the display range of the display unit 10 presents the next display range, and the finger leaves the touch-sensitive display, and the icon 4 is moved to The action for the next display range. Of course, deleting and duplicating icons or files can also be completed, and details will not be repeated here.

Furthermore, in various embodiments of the present invention, the starting unit 16 or the manipulation unit 19 may be an input signal portion of a mouse, a keyboard, or a touch-sensitive display, and the input signal portion of the mouse, keyboard, or touch-sensitive display is operated to generate Activation signal 160 or operation signal 190 .

Referring to Fig. 1 again, Fig. 1 is a dynamic operation interactive object system of the present invention, the system includes a display unit 10, a user interface module 12, an interaction module 14, a starting unit 16 and a detection unit 18, wherein the user interface module 12 has multiple A user interface 120, the interactive module 14 has a plurality of interactive objects 140 and a plurality of response commands 142, the display unit 10 displays at least one user interface 120 and interactive objects 140, the starting unit 16 provides a starting signal 160, and the detection unit 18 provides at least one detection information 180 , and the interaction module 14 receives the activation signal 160 to be activated, and outputs a corresponding response command 142 according to the detection information 180 , and operates the user interface 120 with the interactive object 140 according to the response command 142 .

Referring again to FIG. 3 , the detection unit 18 includes an image extraction unit 182 and an image calculation unit 184, wherein the image extraction unit 182 extracts a plurality of image data 1820, and the image calculation unit 184 receives each image data 1820, and calculates at least one of each image data 1820 Change information 1840 of a local feature, and generate corresponding detection information 180 according to the change information 1840 .

Referring again to FIG. 5 , the detection unit 18 may be an acceleration kinetic energy sensor, which senses acceleration data in at least one axial direction, calculates displacement information, and then generates detection information. Referring to FIG. 1 again, the system also includes a manipulation unit 19, the manipulation unit 19 provides an operation signal 190, and the interaction module 14 also has at least one operation command 144, and outputs a corresponding operation command 144 according to the operation signal 190 to operate the interactive object 140 .

According to the above, the electronic system operates the interactive object by operating the command and responding to the command, which will simplify the operation process of the user interface and bring great convenience to the user in operating the electronic system.

The above is an exemplary description only, not a restrictive description. Any equivalent modifications or changes made without departing from the spirit and scope of the present invention shall be included in the scope of the appended claims.

Claims (13)

1. the method for a dynamic operation interactive objects, this method is applicable to electronic system, and this electronic system possesses display unit, subscriber interface module and interactive module, it is characterized in that, and this method comprises:

Start the interactive objects corresponding in the interactive module according to enabling signal with user interface;

Receive the detection information that detecting unit went out of electronic system;

In interactive module, obtain the corresponding response order according to described detection information; And

Electronic system is operated user interface according to described response command with described interactive objects.

2. method according to claim 1 is characterized in that, detecting unit comprises image extraction unit and image calculation portion, and image extraction unit and image calculation portion produce the step of described detection information, comprising:

The image extraction unit is extracted a plurality of view data;

Image calculation portion receives described a plurality of view data;

At least one local feature calculates according to described a plurality of view data in image calculation portion, to produce transition information; And

Image calculation portion produces corresponding described detection information according to described transition information.

3. method according to claim 2 is characterized in that, described transition information be the user with the image extraction unit between relative action.

4. method according to claim 3, it is characterized in that, describedly comprise relative to action: the user to the image extraction unit move, the user away from the image extraction unit, to the display unit left side move, to the display unit right side move, the user nods/shakes the head/rotary head or gesture.

5. method according to claim 1 is characterized in that, detecting unit is an acceleration kinetic energy sensor, and acceleration kinetic energy sensor produces the step of described detection information, comprising:

At least one axial acceleration information of acceleration kinetic energy sensor sensing;

Calculate displacement information according to described acceleration information; And

Produce corresponding described detection information according to described displacement information.

6. method according to claim 5 is characterized in that, described displacement information is the displacement of moving or rotating of user's the part that acceleration kinetic energy sensor is installed, and the speed of described each displacement of user and angle variation.

7. method according to claim 5 is characterized in that, described displacement information is displacements such as moving of display unit or rotation, and the speed of described each displacement of display unit and angle variation.

8. method according to claim 5 is characterized in that, described displacement information is moving or rotating of electronic system, and the speed of described each each displacement of described electronic system and angle variation.

9. method according to claim 1 is characterized in that, electronic system comprises according to the step of described response command operation user interface:

Change angle and the shape that user interface presents according to the automatic stereo method, so that user interface is changed into solid object;

User interface is presented on one of them visible surface of solid object; And

On other visible surface of solid object, form described interactive objects.

10. the system of a dynamic operation interactive objects is characterized in that, comprising:

Subscriber interface module has a plurality of user interfaces;

Start unit provides enabling signal;

Detecting unit provides at least one detection information;

Interactive module has a plurality of interactive objects and a plurality of response command; And

Display unit, explicit user interface and interactive objects;

Wherein, interactive module receives described enabling signal and is activated, and exports the corresponding response order according to described detection information, and operates the interactive objects of user interface according to response command.

11. system according to claim 10 is characterized in that, detecting unit comprises:

The image extraction unit is extracted a plurality of view data; And

Image calculation portion receives each view data, and calculates the transition information of at least one local feature of described each view data, and produces corresponding described detection information according to described each transition information.

12. system according to claim 10, it is characterized in that detecting unit is an acceleration kinetic energy sensor, described at least one axial acceleration information of acceleration kinetic energy sensor sensing, and calculate displacement information, and then produce detection information according to described acceleration information.

13. system according to claim 10 is characterized in that, also comprises controlling the unit, the described unit output function signal of controlling, and interactive module also has a plurality of operational orders, and interactive module is according to the corresponding operational order of each operation signal output, with the operation interactive objects.

Images